Distributed /inference/learning/agent swarms? #75
hrstoyanov
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
@tjake
Another follow-up from your Devoxx 2024 talk ...
Distributed inference/learning is getting very hot as it will allow scalability across many cheap computers. Another one is the just-release OpenAI Swarm agent framework
... But with Java we already have* mature, distributed and scalable agent frameworks* - for example Apache Peko Can such a higher level agent framework be used to quickly and painlessly extend JLama inference across compute nodes? Even implement distributed training and swarm of agents?
Beta Was this translation helpful? Give feedback.
All reactions