Skip to content

Actions: EvolvingLMMs-Lab/lmms-eval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
1,367 workflow runs
1,367 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Add eval for cot Lint #890: Commit 08678c1 pushed by kcz358
January 27, 2025 07:56 39s dev/qwen_cot
dev/qwen_cot
January 27, 2025 07:56 39s
Support VSI-Bench Evaluation Lint #889: Pull request #511 opened by vealocia
January 26, 2025 03:29 Action required vealocia:main
vealocia:main
January 26, 2025 03:29 Action required
fix output format of airbench and vocal sound Lint #888: Pull request #510 opened by pbcong
January 25, 2025 05:16 33s pbcong:main
pbcong:main
January 25, 2025 05:16 33s
add fleurs task Lint #887: Commit c70c132 pushed by Devininthelab
January 24, 2025 14:36 40s dev/fleurs
dev/fleurs
January 24, 2025 14:36 40s
Fix custom model wrapper to enable usage of instanced model (#508) Lint #886: Commit f6fe367 pushed by Luodian
January 23, 2025 12:12 52s main
main
January 23, 2025 12:12 52s
fix device_map (#505) Lint #885: Commit 9c4929f pushed by Luodian
January 23, 2025 11:22 39s main
main
January 23, 2025 11:22 39s
Fix custom model wrapper to enable usage of instanced model Lint #884: Pull request #508 opened by ErezSC42
January 21, 2025 08:22 43s ErezSC42:fix-custom-model-wrapper
ErezSC42:fix-custom-model-wrapper
January 21, 2025 08:22 43s
Init Fleurs Lint #883: Commit fddbda4 pushed by kcz358
January 21, 2025 06:48 40s dev/fleurs
dev/fleurs
January 21, 2025 06:48 40s
Fix device_map Lint #881: Pull request #505 opened by coding-famer
January 18, 2025 18:52 36s coding-famer:patch-1
coding-famer:patch-1
January 18, 2025 18:52 36s
Fix NoneType Error in flatten Function for Text-Only Tasks in LLAVA… Lint #880: Commit b1fbf55 pushed by pufanyi
January 17, 2025 11:39 34s main
main
January 17, 2025 11:39 34s
Fix NoneType Error in flatten Function for Text-Only Tasks in LLAVA Models Lint #879: Pull request #501 synchronize by bibisbar
January 17, 2025 09:07 35s bibisbar:main
bibisbar:main
January 17, 2025 09:07 35s
[FIX] Minor errors in gemini_api.py and internvl2.py. (#502) Lint #878: Commit 721ee92 pushed by pufanyi
January 17, 2025 02:21 34s main
main
January 17, 2025 02:21 34s
Fix NoneType Error in flatten Function for Text-Only Tasks in LLAVA Models Lint #877: Pull request #501 synchronize by bibisbar
January 16, 2025 14:49 36s bibisbar:main
bibisbar:main
January 16, 2025 14:49 36s
Refactor print statement in construct_interleaved_input function Lint #876: Commit b23577e pushed by pufanyi
January 16, 2025 08:46 38s pufanyi/gpt4v_interleave
pufanyi/gpt4v_interleave
January 16, 2025 08:46 38s
Refactor GPT4V model and MMMU template YAML Lint #875: Commit ffe7ba1 pushed by pufanyi
January 16, 2025 08:45 35s pufanyi/gpt4v_interleave
pufanyi/gpt4v_interleave
January 16, 2025 08:45 35s
Refactor Qwen2_VL class to update max_num_frames default value and ha… Lint #874: Commit 40ef743 pushed by pufanyi
January 16, 2025 08:42 37s pufanyi/temp_qwen
pufanyi/temp_qwen
January 16, 2025 08:42 37s
Refactor construct_prompt function in mmmu/utils.py Lint #873: Commit 34853d0 pushed by pufanyi
January 16, 2025 06:47 40s pufanyi/gpt4v_interleave
pufanyi/gpt4v_interleave
January 16, 2025 06:47 40s
[FIX] Minor errors in gemini_api.py and internvl2.py. Lint #872: Pull request #502 opened by skyil7
January 16, 2025 06:45 34s skyil7:main
skyil7:main
January 16, 2025 06:45 34s
Refactor code for importing and using external libraries Lint #871: Commit 461114c pushed by pufanyi
January 16, 2025 05:04 33s pufanyi/gpt4v_interleave
pufanyi/gpt4v_interleave
January 16, 2025 05:04 33s
Refactor mmmu_doc_to_visual function to handle validation_Psychology_… Lint #870: Commit aa10a0c pushed by pufanyi
January 16, 2025 04:49 37s pufanyi/temp_qwen
pufanyi/temp_qwen
January 16, 2025 04:49 37s
[Support] Support new model: Ross (#494) Lint #868: Commit 8821357 pushed by kcz358
January 15, 2025 13:23 36s main
main
January 15, 2025 13:23 36s
[Support] Support new model: Ross Lint #867: Pull request #494 synchronize by Haochen-Wang409
January 15, 2025 12:48 44s Haochen-Wang409:main
Haochen-Wang409:main
January 15, 2025 12:48 44s
fix llama_vision chat_template and decode (#498) Lint #866: Commit f8fc141 pushed by pufanyi
January 15, 2025 04:36 39s main
main
January 15, 2025 04:36 39s
[WIP] style(megabench): improve code formatting and import ordering (… Lint #865: Commit 50ed3ce pushed by pufanyi
January 15, 2025 04:31 33s main
main
January 15, 2025 04:31 33s
Refactor Qwen2_VL class to improve video processing and context handling Lint #864: Commit 4728e43 pushed by pufanyi
January 15, 2025 01:45 34s pufanyi/temp_qwen
pufanyi/temp_qwen
January 15, 2025 01:45 34s