Local LLM

[ctrivino1]

Hi,

This app is very cool and you did a great job! I think one thing that could really help thislibrary stand out is if there was a way to use a local LLM to do the same thing. Understandably I know most libraries use api's because of the amount of space local LLM's have but in the sector I work in we are not allowed to make api calls. I have a hugginface model I am trying to incorporate with your code using the reticulate package. I'm not sure if your library has this capability but I would love to know.

Cheers!