Skip to content

Issues: Blaizzy/mlx-vlm

Batch Processing Feature
#40 opened Jun 11, 2024 by Blaizzy
Open 6
ChatUI improvements
#45 opened Jun 23, 2024 by Blaizzy
Open
Models to port to MLX-VLM
#39 opened Jun 11, 2024 by Blaizzy
Open 26
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

40 Open 48 Closed
40 Open 48 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add a inference test with utils
#155 opened Dec 22, 2024 by Blaizzy
Latest mlx seems to break mlx-vlm + Qwen2
#154 opened Dec 20, 2024 by jrp2014
5
Add support for speculative decoding
#152 opened Dec 15, 2024 by Blaizzy
Add KVcache Quantization
#151 opened Dec 15, 2024 by Blaizzy
Add mlx-lm as dep, refactor utils and tests
#150 opened Dec 15, 2024 by Blaizzy
Add support for prompt caching (image + video)
#149 opened Dec 15, 2024 by Blaizzy
Add support for model Evals
#148 opened Dec 15, 2024 by Blaizzy
Keeping track of the performance and compatibility of models
#147 opened Dec 14, 2024 by jrp2014
Improvements: Papers
#146 opened Dec 7, 2024 by Blaizzy
Question: Prompt tokens per second.
#145 opened Dec 6, 2024 by stellanhaglund
1
Language Model only generation
#144 opened Dec 6, 2024 by Blaizzy
1
Load existing lora adapter not trained using mlx-vlm
#140 opened Dec 4, 2024 by Benjoyo
1
Idefics3Processor requires the PyTorch library but it was not found in your environment
#137 opened Nov 28, 2024 by simonw
Large memory spikes when processing images bug Something isn't working
#136 opened Nov 28, 2024 by neilmehta24
@Blaizzy
AttributeError: 'Qwen2TokenizerFast' object has no attribute 'tokenizer'. Did you mean: '_tokenizer'?
#135 opened Nov 28, 2024 by jrp2014
7
Excessive Memory Allocation (56.98GB) on M2 Mac Mini (32GB) Using Qwen2-VL-2B-Instruct-4bit
#123 opened Nov 24, 2024 by WildKratts
error video inference
#122 opened Nov 23, 2024 by zwanderer0
libc++abi: terminating due to uncaught exception of type std::runtime_error: Attempting to allocate too much memory
#121 opened Nov 23, 2024 by jrp2014
6
Video2Text Inference is slow and high vram consumption
#116 opened Nov 21, 2024 by southkorea2013
6
Support chat scenarios without images
#115 opened Nov 18, 2024 by madroidmaq
Support Chat API
#111 opened Nov 13, 2024 by madroidmaq
4
Chat UI error when prompt is longer than one character
#108 opened Oct 28, 2024 by faev999
Some picture captioning results with various models, for reference
#107 opened Oct 26, 2024 by jrp2014
2
LLaVa-NeXT needs tweaking for v4.47
#106 opened Oct 25, 2024 by jrp2014
3
Is it possible to call these vision llm's in Swift ?
#104 opened Oct 24, 2024 by kunal732
ProTip! Find all open issues with in progress development work with linked:pr.