google/multimodal-knowledge-agent
Dataset · https://huggingface.co/datasets/google/multimodal-knowledge-agent
Multimodal Knowledge Agent (MKA) — 10 Showcase Examples Multimodal Knowledge Agent (MKA) is a benchmark from Google DeepMind for evaluating autonomous AI agents on complex, multi-step, real-world visual knowledge work across professional domains. Unlike text-extractable benchmarks where attachments can be solved via plain-text extraction or OCR alone, every MKA task contains a multi-file workspace with load-bearing visual artifacts—such as architectural CAD blueprints… See the full description on the dataset page: https://huggingface.co/datasets/google/multimodal-knowledge-agent.
First seen by Oriel on .
AI summary
Multimodal Knowledge Agent (MKA) is a Google DeepMind benchmark evaluating autonomous agents on complex visual knowledge work requiring multimodal perception, cross-document synthesis, tool use, and deliverable generation.
- The dataset provides 10 showcase tasks spanning GIS, architecture, engineering, biochemistry, workforce planning, finance, history, public policy, and data science.
- Each task uses a multi-file workspace containing essential visual artifacts that cannot be solved through plain-text extraction or OCR alone.
- Expected outputs include .xlsx, .pptx, .docx, .json, and structured technical reports produced through code execution and file inspection.
- Each task includes metadata.json, fine-grained weighted grading criteria in rubrics.json, and source files under input/.
- The dataset is licensed under the Apache License 2.0.
#multimodal agents #ai benchmarks #visual reasoning #tool use
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Likes
Total likes reported by the source.
- Hugging Face Datasets: 48, latest observation ; +37 over observed period since
Downloads (30d)
Rolling 30-day downloads. A change in this value is not new downloads during the observed period.
- Hugging Face Datasets: 4,248, latest observation ; +4,247 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Datasets | google/multimodal-knowledge-agent | https://huggingface.co/datasets/google/multimodal-knowledge-agent Read discussion |