Memory-Efficient Long-Video Understanding (Capstone)
On top of InfiniPot-V compression (6K KV budget), I store the kept KV cache in INT4 instead of FP16. With Qwen2-VL-7B: Video-MME 63.5 vs 62.8 and MLVU 66.1 vs 65.8 (FP16), at ~1/3.1 the KV bytes (164 B vs 512 B per token per head).