Oriel — AI & technology worth noticing, every day.

CohereLabsCommunity/CulturalRiddles

Dataset · https://huggingface.co/datasets/CohereLabsCommunity/CulturalRiddles

Cultural Riddles Explore the results: dashboard · Play: try the riddles yourself · Code: github.com/Cohere-Labs-Community/CulturalRiddles A community-built benchmark of original cultural riddles from 62 communities across 51 languages and 45 countries, written by 167 native speakers. Each riddle describes something without naming it, so answering it takes cultural knowledge, not translation or web search. A native speaker recognises the answer at once; a model succeeds only if… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabsCommunity/CulturalRiddles.

First seen by Oriel on .

AI summary

CulturalRiddles is a community-built benchmark testing whether models can answer original, culturally specific riddles across 62 communities, 51 languages, and 45 countries.

  • Native speakers wrote 6,191 riddles; English translations are provided for human reference and are never shown to models.
  • The release includes 170,520 answers from 28 model configurations, 74,383 native-speaker annotation rows, and model metadata.
  • Answers are scored from 0 to 3 using rules, native speakers, or agreeing LLM judges; 3,034 answers have no score.
  • The dataset is for evaluation only and must not be used to train, fine-tune, distill models, or seed synthetic data.
  • The riddles are intended to test community-specific cultural knowledge rather than translation, memorization, or web lookup.

#cultural benchmarks #multilingual evaluation #llm evaluation

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Likes

Total likes reported by the source.

  • Hugging Face Datasets: 42, latest observation ; +31 over observed period since

Downloads (30d)

Rolling 30-day downloads. A change in this value is not new downloads during the observed period.

  • Hugging Face Datasets: 607, latest observation ; +594 over observed period since

Aliases

SourceExternal IDURL
Hugging Face DatasetsCohereLabsCommunity/CulturalRiddleshttps://huggingface.co/datasets/CohereLabsCommunity/CulturalRiddles Read discussion