StreamEval/StreamEval
Dataset · https://huggingface.co/datasets/StreamEval/StreamEval
Evaluating Interactive Streaming Video Generation Models StreamEval evaluates interactive streaming video generation in sessions lasting 15 to 300 seconds. Our benchmark has four key features: First interactive streaming video generation benchmark: Tests how systems respond to new requests and preserve context as video is generated. Fully open: Benchmark data, evaluation code, protocols, and scoring rules are publicly available. Comprehensive coverage: Five tasks… See the full description on the dataset page: https://huggingface.co/datasets/StreamEval/StreamEval.
First seen by Oriel on .
AI summary
StreamEval is an open benchmark for evaluating interactive streaming video generation across 15–300-second sessions, with five tasks, ten metrics, public evaluation assets, and monthly leaderboard updates.
- The benchmark tests responses to new requests and context preservation while video is generated interactively.
- benchmark/v1/full contains 300 conditions, while the dataset includes 738 input-media files totaling approximately 3.1 GB.
- Tasks cover avatar interaction, world generation, and video editing using session timelines, expected outcomes, and verification windows.
- Users can download the dataset with huggingface_hub and validate it through the StreamEval command-line tools.
- Code is Apache License 2.0, benchmark data is CC BY 4.0, and third-party footage and model adapters retain separate licensing terms.
#video generation #interactive streaming #benchmarking #hugging face
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 14, latest observation ; +4 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 1,118, latest observation ; +374 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | StreamEval/StreamEval | https://huggingface.co/datasets/StreamEval/StreamEval Read discussion |