Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] support video evaluation for qwen2-vl and add mix-evals-video2text #275

Merged
merged 16 commits into from
Sep 24, 2024

Commits on Sep 16, 2024

  1. feat: add new ouput_path saving logic and add evaluation tracker to m…

    …anage samples saving process
    Luodian committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    9e4a2e1 View commit details
    Browse the repository at this point in the history
  2. add: regression test

    Luodian committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    edf2c00 View commit details
    Browse the repository at this point in the history
  3. add: regression test

    Luodian committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7464a05 View commit details
    Browse the repository at this point in the history
  4. clean: unuseful code

    Luodian committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    022f1bb View commit details
    Browse the repository at this point in the history
  5. 🚫 Remove unused import for cleaner code

    Eliminated the commented-out import statement for WandbLogger to tidy up the code and enhance readability. This helps maintain focus on active components and prevents confusion over unused code. A cleaner structure contributes to better maintainability in the long run.
    
    No functional changes were made, just a step towards a more streamlined codebase.
    Luodian committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    920c211 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2024

  1. Configuration menu
    Copy the full SHA
    7452238 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'origin/main'

    Luodian committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    b198dd7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    21a906a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    7646dbc View commit details
    Browse the repository at this point in the history
  5. ✨ Enhance video and image processing capabilities

    - Integrated vision processing for videos and images, improving context handling within the model.
    - Added error logging for missing utility dependencies to inform users about installation requirements.
    - Updated YAML configuration to standardize prompt handling for various video tasks.
    - Bumped version number to indicate ongoing development status.
    
    These changes streamline how visuals are managed in the model, contributing to better assistant responses in tasks involving media.
    Luodian committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    61aa007 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d96f60d View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. 🎉 Enhance W&B logging and video playback

    - Added automatic naming for W&B runs if not specified, improving organization.
    - Updated video frame rate from 1.0 to 0.5 for better performance and resource management during visual content processing.
    - Streamlined W&B logging by removing redundant code, ensuring cleaner execution flow.
    
    These changes optimize logging efficiency and enhance the overall user experience.
    Luodian committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    92b6044 View commit details
    Browse the repository at this point in the history
  2. ✨ Refine conversation logic and adjust token limits

    - Updated chat template logic for better formatting in responses, ensuring consistent handling of user and assistant roles.
    - Reduced maximum new tokens in multiple evaluation files to ensure more concise outputs and improve efficiency.
    - Enhanced clarity in few-shot tasks by explicitly labeling question and answer roles in generated text.
    - Simplified logging of contextual and target information during evaluation, ensuring better tracking of results.
    
    These adjustments improve the overall output quality and streamline the evaluation processes.
    Luodian committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    4506035 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Configuration menu
    Copy the full SHA
    638b2e0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    34b35cd View commit details
    Browse the repository at this point in the history
  3. Update qwen2_vl.py

    Luodian authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    f0f5e62 View commit details
    Browse the repository at this point in the history