Oriel — AI & technology worth noticing, every day.

google/multimodal-knowledge-agent

Dataset · https://huggingface.co/datasets/google/multimodal-knowledge-agent

Multimodal Knowledge Agent (MKA) — 10 Showcase Examples Multimodal Knowledge Agent (MKA) is a benchmark from Google DeepMind for evaluating autonomous AI agents on complex, multi-step, real-world visual knowledge work across professional domains. Unlike text-extractable benchmarks where attachments can be solved via plain-text extraction or OCR alone, every MKA task contains a multi-file workspace with load-bearing visual artifacts—such as architectural CAD blueprints… See the full description on the dataset page: https://huggingface.co/datasets/google/multimodal-knowledge-agent.

First seen by Oriel on .

AI summary

Multimodal Knowledge Agent (MKA) is a Google DeepMind benchmark evaluating autonomous agents on complex visual knowledge work requiring multimodal perception, cross-document synthesis, tool use, and deliverable generation.

  • The dataset provides 10 showcase tasks spanning GIS, architecture, engineering, biochemistry, workforce planning, finance, history, public policy, and data science.
  • Each task uses a multi-file workspace containing essential visual artifacts that cannot be solved through plain-text extraction or OCR alone.
  • Expected outputs include .xlsx, .pptx, .docx, .json, and structured technical reports produced through code execution and file inspection.
  • Each task includes metadata.json, fine-grained weighted grading criteria in rubrics.json, and source files under input/.
  • The dataset is licensed under the Apache License 2.0.

#multimodal agents #ai benchmarks #visual reasoning #tool use

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Likes

Total likes reported by the source.

  • Hugging Face Datasets: 48, latest observation ; +37 over observed period since

Downloads (30d)

Rolling 30-day downloads. A change in this value is not new downloads during the observed period.

  • Hugging Face Datasets: 4,248, latest observation ; +4,247 over observed period since

Aliases

SourceExternal IDURL
Hugging Face Datasetsgoogle/multimodal-knowledge-agenthttps://huggingface.co/datasets/google/multimodal-knowledge-agent Read discussion