ChatterUI with llama.rn #37
Vali-98
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have recently added llama.rn to my project with decent success:
https://github.com/Vali-98/ChatterUI
It is essentially an Android mobile AI chat app that was originally relied on remote APIs to run inference, but I figured that this library was somewhat mature enough to add it in.
Its pretty slow on Android, and its rather unwieldy for anything above 3B parameters. Has there been interest in implementing OpenCL for Android? Or is the plan still to wait for Vulkan?
Beta Was this translation helpful? Give feedback.
All reactions