Chonkie And Friends Co.

All

3 repositories

chonkie-docs
Public
A tiny handbook unlocking mighty power - 🦛 Documentation for Chonkie ✨
ai retrieval embeddings artificial-intelligence chunking rag llms chonkie
MDX
•0•1•0•0•Updated Dec 25, 2024Dec 25, 2024
chonkie
Public
🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
ai text-processing chunking rag retrieval-augmented-generation
Python
•
MIT License
•78•1.9k•10•1•Updated Dec 24, 2024Dec 24, 2024
autotiktokenizer
Public
🧰 The AutoTokenizer that TikToken always needed -- Load any tokenizer with TikToken now! ✨
nlp machine-learning transformers tokenizers tiktoken
Python
•
MIT License
•2•16•1•1•Updated Dec 11, 2024Dec 11, 2024