Oriel — AI & technology worth noticing, every day.

StreamEval/StreamEval

Dataset · https://huggingface.co/datasets/StreamEval/StreamEval

Evaluating Interactive Streaming Video Generation Models StreamEval evaluates interactive streaming video generation in sessions lasting 15 to 300 seconds. Our benchmark has four key features: First interactive streaming video generation benchmark: Tests how systems respond to new requests and preserve context as video is generated. Fully open: Benchmark data, evaluation code, protocols, and scoring rules are publicly available. Comprehensive coverage: Five tasks… See the full description on the dataset page: https://huggingface.co/datasets/StreamEval/StreamEval.

First seen by Oriel on .

AI summary

StreamEval is an open benchmark for evaluating interactive streaming video generation across 15–300-second sessions, with five tasks, ten metrics, public evaluation assets, and monthly leaderboard updates.

  • The benchmark tests responses to new requests and context preservation while video is generated interactively.
  • benchmark/v1/full contains 300 conditions, while the dataset includes 738 input-media files totaling approximately 3.1 GB.
  • Tasks cover avatar interaction, world generation, and video editing using session timelines, expected outcomes, and verification windows.
  • Users can download the dataset with huggingface_hub and validate it through the StreamEval command-line tools.
  • Code is Apache License 2.0, benchmark data is CC BY 4.0, and third-party footage and model adapters retain separate licensing terms.

#video generation #interactive streaming #benchmarking #hugging face

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Likes

Total likes reported by the source.

  • Hugging Face Datasets: 14, latest observation ; +4 over observed period since

Downloads (30d)

Rolling 30-day downloads. A change in this value is not new downloads during the observed period.

  • Hugging Face Datasets: 1,118, latest observation ; +374 over observed period since

Aliases

SourceExternal IDURL
Hugging Face DatasetsStreamEval/StreamEvalhttps://huggingface.co/datasets/StreamEval/StreamEval Read discussion