Oriel — AI & technology worth noticing, every day.

Rethinking Structured Generation: Can Graph-Based Reasoning Resolve Ambiguity?

Paper · https://arxiv.org/abs/2610.31681

arXiv:2610.31681v1 Announce Type: new Abstract: Structured generation is typically formulated as a deterministic mapping from input to a single structured output. This assumption is fundamentally misaligned with natural language, which often admits multiple structurally distinct yet semantically valid interpretations. As a result, existing methods rely on single-reference supervision that collapses ambiguity into one prediction, leading to unstable and inconsistent outputs under underspecified inputs. We reformulate structured generation as an \textit{ambiguity-aware inference problem}, where the objective is to reason over a set of plausible structured outputs rather than predict a single solution. We show that standard training inherently suppresses valid alternatives, and instead adopt a multi-valid learning framework that preserves ambiguity during optimization. To operationalize this formulation, we construct a candidate space of structured outputs, represent each candidate as a graph capturing entities and their relationships, and perform selection via graph-based reasoning over semantic alignment and relational consistency. This enables principled comparison across competing interpretations beyond token-level likelihoods. Experiments on structured generation benchmarks demonstrate consistent improvements in accuracy, stability, and robustness under varying levels of ambiguity. These results highlight the importance of modeling ambiguity explicitly and suggest a shift from single-output prediction to set-level reasoning in structured generation.

First seen by Oriel on .

AI summary

This paper reframes structured generation as ambiguity-aware inference over multiple plausible outputs, using graph-based reasoning to select interpretations with stronger semantic and relational consistency.

  • Single-reference supervision suppresses valid alternatives and produces unstable outputs for underspecified inputs.
  • The proposed multi-valid learning framework preserves ambiguity during optimization instead of forcing one target prediction.
  • Candidates are represented as graphs of entities and relationships, then compared through semantic alignment and relational consistency.
  • Experiments on structured generation benchmarks report improved accuracy, stability, and robustness across varying ambiguity levels.

#structured generation #graph reasoning #ambiguity modeling #machine learning

Generated by gpt-5.6-sol. Check the original for details.

Aliases

SourceExternal IDURL
arXiv AI Papersoai:arXiv.org:2610.31681v1https://arxiv.org/abs/2610.31681 Read discussion