Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Add gptqmodel to the CI #2342

Open
BenjaminBossan opened this issue Jan 23, 2025 · 4 comments
Open

CI: Add gptqmodel to the CI #2342

BenjaminBossan opened this issue Jan 23, 2025 · 4 comments
Labels

Comments

@BenjaminBossan
Copy link
Member

BenjaminBossan commented Jan 23, 2025

This issue is to track the TODO from this comment. Once optimum 1.24.0 and transformers 4.49.0 are released, we should enable gptqmodel in the CI (and remove auto-gptq).

Copy link

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

@BenjaminBossan
Copy link
Member Author

Not stale. New optimum and transformers releases are out, we should be good to proceed.

@Qubitium
Copy link
Contributor

@BenjaminBossan Affirmative. To be clear, should we clear out all autogptq specific base code or just remove autogptq ci tests and replace with gptqmodel tests only?

@BenjaminBossan
Copy link
Member Author

Let's go with the latter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants