LSP: Language Model

Language Model as a Language Server

Overview

Features

• Completion (context-aware continuation sudgestions).
• Diagnostics (spelling, grammar, code correctness, etc).
• Go to Definition (aka thesaurus for natural languages or symbol definition for programming languages).

Usage

At the moment there is only one implementation in Python which are aimed in debugging interfaces and model evaluation. So, in order to run dev implementation one can do the following in shell.

lsp-lm serve  # stdio:

With the command above one starts a language server to communicate over standard I/O streams.

In order to serve pretrained HuggingFace model (e.g. CodeBERT base for MLM) one can run the following. We assume that model config and model weights in the same directory.

python -m lsp serve -m hf -M .../huggingface.co/microsoft/codebert-base-mlm tcp://127.0.0.1:5272

IPC

In order to use standard inter-procedural communication channels, one can start a language server to listen Unix domain socket (UDS) as follows.

lsp-lm serve unix://path/to/unix/domain/socket

TCP

In case of modern multi-host environment, one can want to listen public TCP/IP interface for remote access to a language server. So, serving TCP/IP (both v4 and v6) could be achieved with the command below.

lsp-lm serve tcp://0.0.0.0:5272

In order to serve IPv4 or IPv6 interfaces one should use URI schemata tcp4:// and tcp6:// correspondently. Default port is 5272.

Also, SSL/TLS could be used in order to protect connection in public or unprotected networks with specifying certificate, private key, and (optional) password files.

lsp-lm serve \
    --tls-cert cert.pem --tls-key key.pem --tls-pass password.txt \
    tcp://0.0.0.0:5272

Certificate and private key could be bundled in the same container. In this instance one can omit --tls-key option. Password option is mandatory only if private key is encrypted.

Surely, self-signed certificates are allowed. As a mild reminder, both certificate and (encrypted) private key could be generated with OpenSSL as follows.

cat password.txt
# strong-password-in-plain-text
openssl req -new -x509 -days 365 -out cert.pem -keyout key.pem -passout file:password.txt
openssl rsa -in key.pem -passin file:password.txt -check -noout
# RSA key ok

Development with Docker

In order to develop on different platforms we uses custom docker image for non-priviledge user based on Nvidia CUDA image. Image is parametrized by user name and user ID in a host system. The latter is crucial thing in binding host volumes.

docker build -t lsp-lm --build-arg UID=$(id -u) .
docker run --rm -ti -e TERM=$TERM -v $(pwd):/workspace lsp-lm