nvidia/Nemotron-RL-litmus-bench-v0.2
Dataset · https://huggingface.co/datasets/nvidia/Nemotron-RL-litmus-bench-v0.2
Dataset Description: Litmus-Bench v0.2 is an open dataset for training and evaluating chemical reasoning in language models. It includes 47,118 training questions and 2,056 test questions, each in short-answer format and was created from the ChEMBL, ExpansionRx, and Biogen datasets, with some questions utilizing RDKit descriptors. All questions require short answers The dataset is for RL training. This dataset is released as part of NVIDIA NeMo Gym, an open-source library within… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-RL-litmus-bench-v0.2.
First seen by Oriel on .
AI summary
The Hugging Face dataset nvidia/Nemotron-RL-litmus-bench-v0.2 contains prompts asking for molecular drug-likeness scores from SMILES strings, paired with answer-extraction patterns and source metadata.
- The visible examples request a quantitative estimate of drug-likeness (QED) as a single floating point number.
- Prompts vary the required answer format, including angle brackets, XML-style tags, double parentheses, and \boxed{}.
- Each visible record includes a regular expression for extracting the numeric answer, a UUID, and provenance referencing chembl dataset_version 36 and a compound row_id.
- The provided excerpt shows task inputs and metadata, but no reference scores, evaluation results, or dataset methodology.
#cheminformatics #smiles #datasets #model evaluation
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 16, latest observation ; +6 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 604, latest observation ; +97 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | nvidia/Nemotron-RL-litmus-bench-v0.2 | https://huggingface.co/datasets/nvidia/Nemotron-RL-litmus-bench-v0.2 Read discussion |