SWE-bench/SWE-bench_Verified
Dataset · https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified
Dataset Summary SWE-bench Verified is a subset of 500 samples from the SWE-bench test set, which have been human-validated for quality. SWE-bench is a dataset that tests systems’ ability to solve GitHub issues automatically. See this post for more details on the human-validation process. The dataset collects 500 test Issue-Pull Request pairs from popular Python repositories. Evaluation is performed by unit test verification using post-PR behavior as the reference solution. The original… See the full description on the dataset page: https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified.
First seen by Oriel on .
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 189, latest observation ; +2 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 129,325, latest observation ; -5,787 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | SWE-bench/SWE-bench_Verified | https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified |