Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q4)
#1487 opened Sep 21, 2024 by Ying1123
Open 21
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

131 Open 657 Closed
131 Open 657 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature] Due to GIL issues, the overlap mode doesn't actually always bring benefits?
#2573 opened Dec 25, 2024 by CSEEduanyu
2 tasks done
[Feature] (Willing to PR) Proposal: Drop-in fast replacement of PreTrainedModel.generate collaboration enhancement New feature or request feature high priority RLHF Using SGLang for post training
#2569 opened Dec 24, 2024 by fzyzcjy
2 tasks done
6
[Feature] Running multi-node offline inference via SLURM feature help wanted Extra attention is needed
#2561 opened Dec 23, 2024 by aflah02
2 tasks done
@zhaochenyang20
15
lora speed enhancement New feature or request
#2559 opened Dec 23, 2024 by qingzhong1
@zhaochenyang20
1
[Feature] Improve the Zero-Overhead Batch Scheduler performance for the small model
#2558 opened Dec 23, 2024 by libratiger
2 tasks done
4
[Bug] Error occurs when loading the gemma model in bitsandbytes format. bug Something isn't working
#2556 opened Dec 23, 2024 by upskyy
5 tasks done
@zhaochenyang20
1
upgrade setuptools and wheel if you found "torch module not found" when installing bug Something isn't working
#2554 opened Dec 23, 2024 by MiladInk
@zhaochenyang20
1
[Bug] Link error in SGLang Sampling Docs documentation Improvements or additions to documentation
#2551 opened Dec 23, 2024 by zhaochenyang20
5 tasks done
@zhaochenyang20
[Bug] Outlines version error for Grammar Backend bug Something isn't working good first issue Good for newcomers
#2550 opened Dec 23, 2024 by zhaochenyang20
5 tasks done
@zhaochenyang20
5
[Feature] Set outlines and xgrammar as addtional dependency enhancement New feature or request grammar-backend
#2549 opened Dec 23, 2024 by zhaochenyang20
2 tasks done
@zhaochenyang20
3
[Feature] (Willing to PR) Avoid KV cache occupying GPU memory when not used collaboration feature high priority
#2542 opened Dec 22, 2024 by fzyzcjy
2 tasks done
@zhaochenyang20
16
[Bug] Eagle2 has an unstable sampling rate during multi concurrency。
#2537 opened Dec 21, 2024 by coolhok
5 tasks done
[Bug] Transformers doesn't recognize LLaVA variant architectures
#2532 opened Dec 20, 2024 by amosyou
5 tasks done
[Feature] Add Docs For Quantization good first issue Good for newcomers quant LLM Quantization
#2531 opened Dec 20, 2024 by binhtranmcs
@zhaochenyang20
4
[Bug] SGLang v0.4.0 with AMD MI300X
#2530 opened Dec 20, 2024 by BruceXcluding
5 tasks done
1
sglang for Qwen2.5-14b deploy Error
#2520 opened Dec 19, 2024 by wuxianyess
@ispobock @HandH1998
2
Is video inference supported?
#2519 opened Dec 19, 2024 by wuxianyess
[Feature] Support for Evicting Specific KV Cache to Save GPU Memory
#2510 opened Dec 18, 2024 by ChenlongDeng
2 tasks done
[Feature] do sample = False?
#2508 opened Dec 18, 2024 by boqiny
2 tasks done
[Feature] TORCHINDUCTOR_CACHE_DIR not work ?
#2507 opened Dec 18, 2024 by MichoChan
2 tasks done
1
[Feature] Integration SGLang into OpenRLHF collaboration high priority
#2506 opened Dec 17, 2024 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Add Tutorial for Constraint Decoding documentation Improvements or additions to documentation good first issue Good for newcomers
#2505 opened Dec 17, 2024 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Add Math in our CI enhancement New feature or request good first issue Good for newcomers
#2504 opened Dec 17, 2024 by zhaochenyang20
2 tasks
@zhaochenyang20
[Feature] Benchmarking Performance on General Devices collaboration enhancement New feature or request
#2488 opened Dec 16, 2024 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] request smoothquant (int8, W8A8) quantization on 40G A100
#2474 opened Dec 13, 2024 by Hao-YunDeng
2 tasks done
@ispobock @HandH1998
5
ProTip! Add no:assignee to see everything that’s not assigned.