Skip to content

Simple API intended for remote execution calls to start/stop koboldcpp and list available files

License

Notifications You must be signed in to change notification settings

kawaii-wolf/koboldcpp-loader-api

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Node.js API to reload KoboldCPP

Simple API intended for remote execution calls to start/stop koboldcpp and list available files

Requirements

  • node.js & npm
  • A script to start koboldcpp This should take two parameters.
    • A context size
    • A model name A script to stop koboldcpp

How to install & run

  • copy default.json.template to default.json and configure
    • Set a shared secret in default.json. This will be required for calls to load/unload
  • npm install
  • node --experimental-fetch app.js

How to use

About

Simple API intended for remote execution calls to start/stop koboldcpp and list available files

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published