UniParser/RxnMiner-Benchmark
Dataset · https://huggingface.co/datasets/UniParser/RxnMiner-Benchmark
ChemRxn-Bench A benchmark for extracting complete, structured chemical reactions from literature figures: reaction schemes, substrate-scope tables with R-group templates, condition-optimization tables, multistep routes and total syntheses. Each figure comes with a manually annotated and expert-reviewed reference answer listing every concrete reaction drawn or implied in the figure, with exact molecular identities (SMILES, stereochemistry included), conditions and yields. It… See the full description on the dataset page: https://huggingface.co/datasets/UniParser/RxnMiner-Benchmark.
First seen by Oriel on .
AI summary
RxnMiner-Benchmark provides expert-reviewed references for evaluating systems that extract structured chemical reactions from literature figures, with RxnMiner achieving 71.0 macro reaction F1 versus 21.0 for direct prompting.
- The benchmark contains 603 figures and 8,510 concrete reactions, spanning reaction schemes, substrate-scope tables, condition-optimization tables, and multistep routes.
- Each figure's image is the only model input; annotations capture molecular structures, stereochemistry, conditions, yields, and generic templates that are not scored.
- Evaluation uses exact reactant and product set matching after RDKit canonicalisation, with stereochemistry-aware and stereochemistry-ignoring scores; each multistep stage counts separately.
- Access requires maintainer review, and the CC BY-NC-SA 4.0 dataset is limited to non-commercial use with attribution and share-alike terms.
#chemical reaction extraction #multimodal ai #benchmark datasets #cheminformatics
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 12, latest observation ; +1 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 853, latest observation ; +841 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | UniParser/RxnMiner-Benchmark | https://huggingface.co/datasets/UniParser/RxnMiner-Benchmark Read discussion |