Skip to main content
archive Search
Submit Donate Log in

Press Enter to search · Advanced search

Multimedia

  • Replacements

See recent articles

Showing new listings for Monday, 16 November 2026

Total of 1 entries
Showing up to 2000 entries per page: fewer | more | all

Replacement submissions (showing 1 of 1 entries)

[1] arXiv:2604.17422 (replaced) [pdf, html, other]
Title: Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding
Shaoguang Wang, Weiyu Guo, Ziyang Chen, Xuming Hu, Hui Xiong
Comments: 10 pages, 5 figures. The 34th ACM International Conference on Multimedia (MM '26)
Journal-ref: Proceedings of the 34th ACM International Conference on Multimedia (MM '26), pp. 10508-10517, 2026
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

Long video understanding remains a formidable challenge for Multimodal Large Language Models (MLLMs) due to the prohibitive cost of processing dense frame sequences. Prevailing keyframe-selection methods rely on either a single visual-centric metric (e.g., CLIP similarity) or a static fusion of heuristic scores. This "one-size-fits-all" paradigm frequently fails: visual-only metrics are ineffective for plot-driven narrative queries, while indiscriminately adding textual scores introduces severe "modal noise" for purely visual tasks. To break this bottleneck, we propose Q-Gate, a plug-and-play, training-free framework that treats keyframe selection as a dynamic modality routing problem. We decouple retrieval into three lightweight expert streams: Visual Grounding for local details, Global Matching for scene semantics, and Contextual Alignment for subtitle-driven narratives. Crucially, Q-Gate introduces a Query-Modulated Gating Mechanism that uses the in-context reasoning of an LLM to assess query intent and dynamically allocate weights across the experts, activating necessary modalities while "muting" irrelevant ones to maximize the signal-to-noise ratio. Extensive experiments on LongVideoBench and Video-MME across multiple MLLM backbones show that Q-Gate outperforms representative keyframe-selection baselines in most settings, with particularly strong gains on long and medium videos, providing a robust and interpretable solution for scalable video reasoning. Code is available at this https URL

Total of 1 entries
Showing up to 2000 entries per page: fewer | more | all
We gratefully acknowledge support from our major funders, member institutions, , and all contributors.
About · Help · Contact · Subscribe · Copyright · Privacy · Accessibility · Operational Status (opens in new tab)