Unable to choose a completion model with Azure OpenAI

[marketneutral]

Description

I am using Azure OpenAI models and the option to choose a completion model is grayed out.
How can I get Jupyter AI to allow me to do completions?

All other features of Jupyter AI work for me.

Reproduce

[krassowski]

1. What version of JupyterLab and jupyter-ai do you have installed?
2. If you click on the cog icon and go to settings and enable inline completions from jupyter-ai, can you choose it?

[marketneutral]

1. What version of JupyterLab and jupyter-ai do you have installed?

These are the related packages

jupyter_ai                2.28.5
jupyter_ai_magics         2.28.5
jupyter_client            8.6.3
jupyter_core              5.7.2
jupyter-dash              0.4.2
jupyter-events            0.11.0
jupyter-lsp               2.2.5
jupyter_server            2.15.0
jupyter_server_mathjax    0.2.6
jupyter_server_terminals  0.5.3
jupyter-telemetry         0.1.0
jupyterhub                4.0.2
jupyterlab                4.3.4
jupyterlab_git            0.50.2
jupyterlab_pygments       0.3.0
jupyterlab_server         2.27.3
jupyterlab_widgets        3.0.13

3. If you click on the cog icon and go to settings and enable inline completions from jupyter-ai, can you choose it?

I don't see any option to enable inline completions from jupyter-ai

I found this item though in the footer:

When I click that, I do indeed get the ability in the jupyternaut settings to choose a completion model.
I've set to gpt-4o-mini for my Azure endpoint. I am not getting any completions however. How could I debug this? Thanks so much.

[krassowski]

On your screenshot there is "JupyterAI" provider section. If you scroll down there will be another "[ ] Enabled" checkbox. Anyways, using the statusbar does the same thing.

I am not getting any completions however. How could I debug this? Thanks so much.

Can you invoke it manually using Alt \ shortcut? There should be animation showing when it starts streaming.

[marketneutral]

Can you invoke it manually using Alt \ shortcut? There should be animation showing when it starts streaming.

No, the Alt \ doesn't do anything. When I press Alt the mouse cursor changes to +, and pressing Alt and \ does not do anything for me. I don't think this matters but this jupyterlab was spun up from JupyterHub docker spawner. The other jupyter AI functionality (i.e., in the chat window) works fine.

[eazuman]

Hi @marketneutral , not related to this issue but could you share the versions of langchain, langchain-openai, and other related langchain packages you're using for the above case?

I'm currently troubleshooting an issue with chat not working with similar jupyter_ai and jupyterlab packages and I want to see if the langchain packages could be causing the problem.

[marketneutral]

These are all the packages

19:13 $ pip list
Package                   Version
------------------------- --------------
aiohttp                   3.9.0b0
aiosignal                 1.3.2
aiosqlite                 0.19.0
alembic                   1.14.0
altair                    5.5.0
annotated-types           0.7.0
ansi2html                 1.9.2
ansicolors                1.1.8
anyio                     4.7.0
arch                      6.3.0
archspec                  0.2.3
argon2-cffi               23.1.0
argon2-cffi-bindings      21.2.0
arrow                     1.3.0
arviz                     0.20.0
asttokens                 3.0.0
async_generator           1.10
async-lru                 2.0.4
async-timeout             4.0.3
attrs                     24.3.0
awswrangler               3.7.3
azure-ai-inference        1.0.0b8
azure-core                1.32.0
babel                     2.16.0
beautifulsoup4            4.12.3
bleach                    6.2.0
blinker                   1.9.0
bokeh                     3.6.2
boltons                   24.0.0
boto3                     1.35.99
botocore                  1.35.99
Bottleneck                1.4.2
Brotli                    1.1.0
cached-property           1.5.2
cachetools                5.5.0
certifi                   2024.12.14
certipy                   0.2.1
cffi                      1.17.1
charset-normalizer        3.4.0
clarabel                  0.7.1
click                     8.1.8
cloudpickle               3.1.0
colorama                  0.4.6
comm                      0.2.2
conda                     24.11.2
conda-libmamba-solver     24.11.1
conda-package-handling    2.4.0
conda_package_streaming   0.11.0
cons                      0.4.6
contourpy                 1.3.1
cryptography              44.0.0
cvxpy                     1.6.0
cycler                    0.12.1
Cython                    3.0.11
cytoolz                   1.0.1
dash                      2.18.2
dask                      2024.12.1
dask-expr                 1.1.21
dataclasses               0.8
dataclasses-json          0.6.7
datasets                  2.2.1
debugpy                   1.8.11
decorator                 5.1.1
deepmerge                 2.0
defusedxml                0.7.1
dill                      0.3.9
distributed               2024.12.1
distro                    1.9.0
entrypoints               0.4
et_xmlfile                2.0.0
etuples                   0.3.9
exceptiongroup            1.2.2
executing                 2.1.0
faiss                     1.9.0
fastjsonschema            2.21.1
filelock                  3.16.1
Flask                     3.1.0
fonttools                 4.55.3
fqdn                      1.5.1
frozendict                2.4.6
frozenlist                1.5.0
fsspec                    2024.12.0
gitdb                     4.0.11
GitPython                 3.1.43
gmpy2                     2.1.5
graphviz                  0.20.3
greenlet                  3.1.1
h11                       0.14.0
h2                        4.1.0
h5netcdf                  1.4.1
h5py                      3.12.1
hpack                     4.0.0
httpcore                  1.0.7
httpx                     0.28.1
huggingface_hub           0.27.1
hyperframe                6.0.1
idna                      3.10
imagecodecs               2024.9.22
imageio                   2.36.1
importlib_metadata        8.5.0
importlib_resources       6.4.5
ipykernel                 6.29.5
ipympl                    0.9.5
ipython                   8.31.0
ipython_genutils          0.2.0
ipywidgets                8.1.5
isodate                   0.7.2
isoduration               20.11.0
itsdangerous              2.2.0
jedi                      0.19.2
Jinja2                    3.1.5
jiter                     0.8.2
jmespath                  1.0.1
joblib                    1.4.2
json5                     0.10.0
jsonpatch                 1.33
jsonpath-ng               1.6.1
jsonpointer               3.0.0
jsonschema                4.23.0
jsonschema-specifications 2024.10.1
jupyter_ai                2.28.5
jupyter_ai_magics         2.28.5
jupyter_client            8.6.3
jupyter_core              5.7.2
jupyter-dash              0.4.2
jupyter-events            0.11.0
jupyter-lsp               2.2.5
jupyter_server            2.15.0
jupyter_server_mathjax    0.2.6
jupyter_server_terminals  0.5.3
jupyter-telemetry         0.1.0
jupyterhub                4.0.2
jupyterlab                4.3.4
jupyterlab_git            0.50.2
jupyterlab_pygments       0.3.0
jupyterlab_server         2.27.3
jupyterlab_widgets        3.0.13
kiwisolver                1.4.7
langchain                 0.2.17
langchain-community       0.2.19
langchain-core            0.2.43
langchain-openai          0.1.25
langchain-text-splitters  0.2.4
langsmith                 0.1.147
lazy_loader               0.4
libmambapy                2.0.5
llvmlite                  0.43.0
locket                    1.0.0
logical-unification       0.4.6
lz4                       4.3.3
Mako                      1.3.8
markdown-it-py            3.0.0
MarkupSafe                3.0.2
marshmallow               3.25.1
matplotlib                3.8.4
matplotlib-inline         0.1.7
mdurl                     0.1.2
menuinst                  2.2.0
miniKanren                1.0.3
mistune                   3.0.2
mkl-service               2.4.2
mpmath                    1.3.0
msgpack                   1.1.0
multidict                 6.1.0
multipledispatch          0.6.0
multiprocess              0.70.17
munkres                   1.1.4
mypy_extensions           1.0.0
narwhals                  1.19.0
nbclassic                 1.1.0
nbclient                  0.10.2
nbconvert                 7.16.4
nbdime                    4.0.2
nbformat                  5.10.4
nest_asyncio              1.6.0
networkx                  3.4.2
notebook                  7.3.2
notebook_shim             0.2.4
numba                     0.60.0
numexpr                   2.10.2
numpy                     1.26.4
oauthlib                  3.2.2
openai                    1.59.7
openpyxl                  3.1.5
orjson                    3.10.14
osqp                      0.6.7.post3
overrides                 7.7.0
packaging                 24.2
pamela                    1.2.0
pandas                    2.2.3
pandocfilters             1.5.0
papermill                 2.5.0
parso                     0.8.4
partd                     1.4.2
patsy                     1.0.1
pexpect                   4.9.0
pickleshare               0.7.5
pillow                    11.0.0
pip                       24.3.1
pkgutil_resolve_name      1.3.10
platformdirs              4.3.6
plotly                    5.18.0
pluggy                    1.5.0
ply                       3.11
prometheus_client         0.21.1
prompt_toolkit            3.0.48
propcache                 0.2.1
protobuf                  5.28.3
psutil                    6.1.0
ptyprocess                0.7.0
pure_eval                 0.2.3
py-cpuinfo                9.0.0
pyarrow                   18.1.0
pycosat                   0.6.6
pycparser                 2.22
pycurl                    7.45.4
pydantic                  2.10.4
pydantic_core             2.27.2
Pygments                  2.18.0
PyJWT                     2.10.1
pymc                      5.20.0
pyodbc                    5.0.1
pyparsing                 3.2.0
PySocks                   1.7.1
pytensor                  2.26.4
python-dateutil           2.9.0.post0
python-dotenv             1.0.1
python-json-logger        2.0.7
pytz                      2024.1
PyWavelets                1.8.0
PyYAML                    6.0.2
pyzmq                     26.2.0
qdldl                     0.1.7.post5
referencing               0.35.1
regex                     2024.11.6
requests                  2.32.3
requests-toolbelt         1.0.0
responses                 0.18.0
retrying                  1.3.3
rfc3339_validator         0.1.4
rfc3986-validator         0.1.1
rich                      13.9.4
risk-infrastructure       0.1.26729
rpds-py                   0.22.3
ruamel.yaml               0.18.6
ruamel.yaml.clib          0.2.8
s3transfer                0.10.4
safetensors               0.5.2
scikit-image              0.24.0
scikit-learn              1.3.2
scipy                     1.11.4
scs                       3.2.7.post2
seaborn                   0.13.2
Send2Trash                1.8.3
sentence-transformers     3.3.1
setuptools                75.6.0
six                       1.17.0
smmap                     5.0.0
sniffio                   1.3.1
sortedcontainers          2.4.0
soupsieve                 2.5
SQLAlchemy                2.0.36
stack_data                0.6.3
statsmodels               0.14.4
sympy                     1.13.3
tables                    3.10.1
tblib                     3.0.0
tenacity                  8.5.0
terminado                 0.18.1
threadpoolctl             3.5.0
tifffile                  2024.12.12
tiktoken                  0.8.0
tinycss2                  1.4.0
tokenizers                0.21.0
toml                      0.10.2
tomli                     2.2.1
toolz                     1.0.0
torch                     2.5.1
torchvision               0.20.1
tornado                   6.4.2
tqdm                      4.67.1
traitlets                 5.14.3
transformers              4.48.0
truststore                0.10.0
types-python-dateutil     2.9.0.20241206
typing_extensions         4.12.2
typing_inspect            0.9.0
typing_utils              0.1.0
tzdata                    2024.2
unicodedata2              15.1.0
uri-template              1.3.0
urllib3                   2.3.0
watermark                 2.5.0
wcwidth                   0.2.13
webcolors                 24.11.1
webencodings              0.5.1
websocket-client          1.8.0
Werkzeug                  3.1.3
wheel                     0.45.1
widgetsnbextension        4.0.13
xarray                    2025.1.1
xarray-einstats           0.8.0
xlrd                      2.0.1
xxhash                    3.5.0
xyzservices               2024.9.0
yarl                      1.18.3
zict                      3.0.0
zipp                      3.21.0
zstandard                 0.23.0