-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Weights and Baises Integration #383
base: main
Are you sure you want to change the base?
Conversation
Thanks for your contribution! I'll review this PR as soon as possible! |
I think you can create a new class called And currently, the logging logic in task.py is not designed for other loggers (e.g. I used tensorboard's You can provide a draft code and I'll refactor base on it. |
@RangiLyu I'm using the baselogger's API to create a new WandbLogger. I'll make the task accept a list of loggers so users can implement and add their own loggers later on.
|
@RangiLyu hey, any updates on this? |
I'll create another PR based on this. Some refactoring and unit tests should be added. I'll do it this week. |
Hey, is there a blocker here or something that we can help with? |
This PR adds support for Weights and Biases Metric and evaluation logging.
How to use?
--use-wandb
flag withtools/train.py
--eval-samples <int>
Tables
Tables Inspect, filter, query, and compare your model prediction to better debug
In the current implementation, the wandb arguments are directly passed in the Base Logger. We can refactor it out into a more suitable place if needed. There are more points of integration such as model checkpointing on cloud, interactive inference logging which can be built on top of this