OmniStream: Mastering Perception, Reconstruction and Action in Continuous Streams

Benchmark Model Rank Results
zero-shot-generalization-on-calvinOmniStream-7B#8Avg. sequence length: 3.885
video-question-answering-on-videommmuOmniStream-7B#14Accuracy: 40.0
zero-shot-video-question-answer-on-egoschema-fullsetOmniStream-7B#27Accuracy: 60.9
zero-shot-video-question-answer-on-video-mme-w-o-subsOmniStream-7B#46Accuracy (%): 60.7
image-classification-on-imagenetOmniStream (400M)#323Top 1 Accuracy: 84.7%