Skip to content

Commit

Permalink
Why tf did I think Coolio was from Oakland?
Browse files Browse the repository at this point in the history
  • Loading branch information
uogbuji committed Jul 2, 2024
1 parent b2fba8f commit 32c2133
Show file tree
Hide file tree
Showing 3 changed files with 5 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
![toolio_github_header](https://github.com/OoriData/Toolio/assets/12983495/e6b35d7f-4b37-4f77-8dc5-1bafc8befb86)
♪ Come along and ride on a fantastic voyage 🎵, with AI in the passenger seat and a flatbed full of tools.
♪ Come along and ride on a fantastic voyage 🎵, with AI riding shotgun seat and a flatbed full of tools.

Toolio is an OpenAI-like HTTP server API implementation which supports structured LLM response generation (e.g. make it conform to a [JSON schema](https://json-schema.org/)). It's also really useful for more reliable tool calling. It's based on the MLX framework for Apple Silicon (e.g. M1/M2/M3/M4 Macs), so that's the only supported platform at present.

Expand Down Expand Up @@ -220,4 +220,4 @@ Apache 2

# Project name

Named after the legend himself. Best don't pretend you don't know Coolio, fool! Popular rapper from Oakland. *Slide slide, but that's the past, I got something brand new for that a@@.*🎼
Named after the legend himself. Best don't pretend you don't know Coolio, fool! Popular rapper (R.I.P.) from LA. You watched *Cookin' with Coolio*, now it's time to Tool up with Toolio! *Slide slide, but that's the past; I got something brand new for that aßß.*🎼
2 changes: 2 additions & 0 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,8 @@ classifiers = [
"Programming Language :: Python :: Implementation :: PyPy",
]
dependencies = [
"mlx",
"mlx_lm",
"llm-structured-output",
"ogbujipt",
"fastapi",
Expand Down
1 change: 1 addition & 0 deletions test/test_readme_examples.py
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@
# httpserver fixture from pytest_httpserver starts the dummy server
async def test_number_guess(number_guess_ht, httpserver):
# Set up dummy server response
# See also: https://pytest-httpserver.readthedocs.io/en/latest/api.html
httpserver.expect_request(CHAT_COMPLETIONS_URL, method='POST').respond_with_json(number_guess_ht.resp_json)

llm = struct_mlx_chat_api(base_url=httpserver.url_for('/v1'))
Expand Down

0 comments on commit 32c2133

Please sign in to comment.