Api Server Example

[e253]

I made an example rocket.rs api server https://github.com/aurelianai/aurelian_server if anyone is interested.

[pixelspark]

I might have a more elaborate project utilizing rustformers/llm for a server that could be open sourced. Let me know if there is interest. It exposes WebSocket/SSE interfaces as well as endpoints for embedding, configurable sets of prompts and more.

[e253]

Would love to see it and contribute!

[pixelspark]

Would love to see it and contribute!

It took a bit longer than expected, but here it is: https://github.com/pixelspark/poly 🎉 let me know what you think @e253

[pixelspark]

@philpax you might like it too

[philpax]

That's awesome! Sorry, I was very behind on my emails. I've added it to the README - shame I couldn't mention it at the talk.