Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: sync llama.rn #72

Merged
merged 6 commits into from
Nov 1, 2024
Merged

feat: sync llama.rn #72

merged 6 commits into from
Nov 1, 2024

Conversation

a-ghorbani
Copy link
Owner

@a-ghorbani a-ghorbani commented Oct 31, 2024

Description

This update syncs llama.rn (the pr is still open) : , which:

  • Syncs llama.cpp with the b3972 release.
  • Adds additional builds for the i8mm and sve libraries for Android.

Fixes: #73, #50, #25, #45 ((addresses multiple crash reports on Android)

Platform Affected

  • iOS
  • Android

Checklist

  • Necessary comments have been made.
  • [ x] I have tested this change on:
    • iOS Simulator/Device
    • Android Emulator/Device
  • Unit tests and integration tests pass locally.

@a-ghorbani a-ghorbani marked this pull request as ready for review November 1, 2024 14:22
@a-ghorbani a-ghorbani merged commit 155601b into main Nov 1, 2024
1 check passed
@a-ghorbani
Copy link
Owner Author

I tested it on Pixel 9 Pro, Galaxy S24, and OnePlus 6 with the following models:

On these devices, all models worked fine except for Q4_0_4_4 on the OnePlus 6.

@a-ghorbani a-ghorbani deleted the agh/sync-llama.cpp branch November 3, 2024 13:44
EXTREMOPHILARUM pushed a commit to EXTREMOPHILARUM/pocketpal-ai that referenced this pull request Nov 4, 2024
* feat: sync llama.cpp

* chore: use llama.rn under @pocketpalai scope

* feat: expose xct settings in ui

* feat: expose min_p in ui

* chore: bump version
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feat]: sync llama.rn
1 participant