Similar Benchmarks

[Prince-Lee-PathAI]

Thanks for the great contribution to this professional Videos community. Your work is the first and latest(?) to integrate perception-comprehension-adaptation for LMMs evaluation.

I am doing master-level research in this area. Will you consider extending this benchmark to a wider range? Or could you please provide some ideas about the similar professional benchmarks like yours in case I didn't miss anything.

Thanks for your help.

[KairuiHu]

Hi @Prince-Lee-PathAI ,

Thank you for your interest in our work. I am glad to hear that the perception-comprehension-adaptation integration resonates with your research.

Regarding your question about extending the benchmark: Yes, this is an interesting direction and I would definitely welcome further exploration in this area.

You asked about similar professional benchmarks. While I am not certain if any others follow the "3-track" structure, here are a few related works that focus on educational video reasoning: VideoMathQA (which focus on math subject), Video-MMLU (have captioning), and 2.5 Years in Class (mainly for training). These works are also insightful.

Best of luck with your research, and look forward to further discussion.

Best regards,

[Prince-Lee-PathAI]

Hi @Prince-Lee-PathAI ,

Thank you for your interest in our work. I am glad to hear that the perception-comprehension-adaptation integration resonates with your research.

Regarding your question about extending the benchmark: Yes, this is an interesting direction and I would definitely welcome further exploration in this area.

You asked about similar professional benchmarks. While I am not certain if any others follow the "3-track" structure, here are a few related works that focus on educational video reasoning: VideoMathQA (which focus on math subject), Video-MMLU (have captioning), and 2.5 Years in Class (mainly for training). These works are also insightful.

Best of luck with your research, and look forward to further discussion.

Best regards,

Thanks for your very inspiring reply. Look forward to your work!