MaziyarPanahi/Jev-Policy-Verification-180K
Dataset · https://huggingface.co/datasets/MaziyarPanahi/Jev-Policy-Verification-180K
Policy Verification — Jev 180K 180,000 validated typed decisions for modern AI systems. Response scoring, preference, helpfulness, and principle-fulfilment decisions. General-purpose dataset: this release contains no clinical or medical data. Jev outputs are model predictions, not ground truth. Each row pairs an upstream reference label with a pinned jev-1.13.0 prediction, confidence, structured answer, and provenance. The flat Parquet layout works directly with Hugging Face… See the full description on the dataset page: https://huggingface.co/datasets/MaziyarPanahi/Jev-Policy-Verification-180K.
First seen by Oriel on .
AI summary
Jev 180K is a general-purpose dataset of typed model decisions for studying response scoring, preferences, helpfulness, principle fulfilment, and policy verification.
- The release contains 180,000 rows across 45,281 decision groups, split into 171,719 training, 5,690 validation, and 2,591 test rows.
- Rows derive from nvidia/HelpSteer3 and nvidia/HelpSteer2, pairing upstream labels with pinned jev-1.13.0 predictions, confidence, structured answers, and detailed provenance.
- Across 40,569 directly comparable rows, Jev and source labels agreed 74.60%; this is a behavioral audit rather than an accuracy claim.
- Audits found no cross-split decision groups or source rows, zero jev_error values, valid probability distributions, and matching normalized and raw answers.
- Absolute scores are soft supervision, preference labels can be noisy, confidence is uncalibrated, exact-request duplicates remain, and users must review source-specific licenses.
#hugging face datasets #reward models #preference modeling #ai evaluation
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 13, latest observation ; +4 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 210, latest observation ; +195 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | MaziyarPanahi/Jev-Policy-Verification-180K | https://huggingface.co/datasets/MaziyarPanahi/Jev-Policy-Verification-180K Read discussion |