GitHub #1
Open
GitHub #1
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Problem: - exp and sqrt are using double precision for operations which is not required. Solution: - Use expf and sqrtf intead. Notes: - Although it's using single precision doesn't seem to affect the result. Results: ~ 10% improvement - before: 940 tok/s - after: 1020 tok/s
… maximum seq_len. get rid of seed option for now, use temp=0.0 for deterministic behavior
Speed up rmsnorm by using sqrtf/expf
use clock() instead of gettimeofday() for cross-platform compatibility
MSVC Compatibility fix for timer
candidate memmap implementation
clang version 16.0.4
added JNI for android with compiler optimization
Add another Rust port in Readme
fix: Use correct compiler for Win64 GCC in Makefile
README.md - Update notable forks section
Add fp:fast for better performance on windows
Added julia port to notable forks section in README.md
add vodkaslime llama.zig to readme
use ssize_t/int64 and 64bit version of ftell on windows
Add build step for win64 msys2/mingw
Add Java port.
Add tinyshakespeare dataset
Add link to Emscripten port in README
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.