-
Notifications
You must be signed in to change notification settings - Fork 122
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[feat] support video evaluation for qwen2-vl and add mix-evals-video2text #275
Commits on Sep 16, 2024
-
feat: add new ouput_path saving logic and add evaluation tracker to m…
…anage samples saving process
Configuration menu - View commit details
-
Copy full SHA for 9e4a2e1 - Browse repository at this point
Copy the full SHA 9e4a2e1View commit details -
Configuration menu - View commit details
-
Copy full SHA for edf2c00 - Browse repository at this point
Copy the full SHA edf2c00View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7464a05 - Browse repository at this point
Copy the full SHA 7464a05View commit details -
Configuration menu - View commit details
-
Copy full SHA for 022f1bb - Browse repository at this point
Copy the full SHA 022f1bbView commit details -
🚫 Remove unused import for cleaner code
Eliminated the commented-out import statement for WandbLogger to tidy up the code and enhance readability. This helps maintain focus on active components and prevents confusion over unused code. A cleaner structure contributes to better maintainability in the long run. No functional changes were made, just a step towards a more streamlined codebase.
Configuration menu - View commit details
-
Copy full SHA for 920c211 - Browse repository at this point
Copy the full SHA 920c211View commit details
Commits on Sep 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 7452238 - Browse repository at this point
Copy the full SHA 7452238View commit details -
Configuration menu - View commit details
-
Copy full SHA for b198dd7 - Browse repository at this point
Copy the full SHA b198dd7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 21a906a - Browse repository at this point
Copy the full SHA 21a906aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7646dbc - Browse repository at this point
Copy the full SHA 7646dbcView commit details -
✨ Enhance video and image processing capabilities
- Integrated vision processing for videos and images, improving context handling within the model. - Added error logging for missing utility dependencies to inform users about installation requirements. - Updated YAML configuration to standardize prompt handling for various video tasks. - Bumped version number to indicate ongoing development status. These changes streamline how visuals are managed in the model, contributing to better assistant responses in tasks involving media.
Configuration menu - View commit details
-
Copy full SHA for 61aa007 - Browse repository at this point
Copy the full SHA 61aa007View commit details -
Configuration menu - View commit details
-
Copy full SHA for d96f60d - Browse repository at this point
Copy the full SHA d96f60dView commit details
Commits on Sep 23, 2024
-
🎉 Enhance W&B logging and video playback
- Added automatic naming for W&B runs if not specified, improving organization. - Updated video frame rate from 1.0 to 0.5 for better performance and resource management during visual content processing. - Streamlined W&B logging by removing redundant code, ensuring cleaner execution flow. These changes optimize logging efficiency and enhance the overall user experience.
Configuration menu - View commit details
-
Copy full SHA for 92b6044 - Browse repository at this point
Copy the full SHA 92b6044View commit details -
✨ Refine conversation logic and adjust token limits
- Updated chat template logic for better formatting in responses, ensuring consistent handling of user and assistant roles. - Reduced maximum new tokens in multiple evaluation files to ensure more concise outputs and improve efficiency. - Enhanced clarity in few-shot tasks by explicitly labeling question and answer roles in generated text. - Simplified logging of contextual and target information during evaluation, ensuring better tracking of results. These adjustments improve the overall output quality and streamline the evaluation processes.
Configuration menu - View commit details
-
Copy full SHA for 4506035 - Browse repository at this point
Copy the full SHA 4506035View commit details
Commits on Sep 24, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 638b2e0 - Browse repository at this point
Copy the full SHA 638b2e0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 34b35cd - Browse repository at this point
Copy the full SHA 34b35cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for f0f5e62 - Browse repository at this point
Copy the full SHA f0f5e62View commit details