Memory-Efficient Long-Video Understanding (Capstone)
Streaming long-video understanding with Qwen2-VL-7B: on top of InfiniPot-V KV cache compression, I store the kept KV cache in INT4 instead of FP16, so the model needs fewer KV bytes at the same token budget.