GovKM
Silent Retrieval Failure and Contextual Reliability

The Tool Said Success. The Evidence Was Missing.

A ToolUniverse audit found 91 silent failures in scientific agent-tool interaction, showing why a successful API response must preserve completeness and query semantics if it is to function as trustworthy evidence.
Published:
September 28, 2026
|
5
min read
|
Records Governance
|
Series:
GovKM Research
Governance illustration representing a scientific tool call marked successful while fields, filtering behavior, or evidence are silently incomplete.
Expand image

A successful tool call can still return incomplete evidence.

Researchers auditing 15 scientific tools and wrappers in the ToolUniverse environment manually validated 91 silent failures: cases where an invocation appeared successful while information or functionality was missing and neither the user nor the agent was told. Most failures originated in API or wrapper layers and could propagate into downstream scientific outputs that appeared valid.

The continuity failure

The result preserved success status while losing completeness, filtering semantics, and missingness state.

The GovKM interpretation

Retrieval evidence needs contextual reliability metadata. A downstream model cannot reason correctly about evidence gaps if the gap itself does not travel with the returned object.

Continuity path: Source / scientific database → Evidence / API result → Context / completeness and filtering state → Decision → Record / scientific output.

Source

Shreya Gopalan, Devansh Singh, Sundaraparipurnan Narayanan, “Silent Failures in Agent-Tool Interaction: An Audit of ToolUniverse,” arXiv, September 21, 2026.

RELATED FRAMEWORK DOMAINS

Explore the Connected Framework

Continue through the framework domains connected to this article.

FRAMEWORK DOMAIN

Information Continuity

Keep information trustworthy, accessible, and connected regardless of the technology used to create or manage it.

FRAMEWORK DOMAIN

Records Governance

Govern records as authoritative evidence supporting accountability, compliance, and organizational continuity.

RELATED CORE PRINCIPLES

Principles Applied in This Article

Explore the core principles connected to this article.

CORE PRINCIPLE

Grounded Trust

Maintain authority, evidence, provenance, and governance so organizational knowledge remains reliable and explainable.

CORE PRINCIPLE

Contextual Understanding

Preserve the relationships and context that allow organizational knowledge to retain meaning across time and change.

CORE PRINCIPLE

Relationship Governance

Connect and govern information, authority, evidence, context, decisions, actions, records, and institutional memory as one continuity architecture.

RELATED TOPOLOGY ELEMENTS

Follow the Continuity Relationships

Explore the continuity topology elements connected to this article.

CONTINUITY TOPOLOGY

Source

The originating person, system, record, event, or environment from which information enters institutional use.

CONTINUITY TOPOLOGY

Evidence

The verifiable material that supports, qualifies, challenges, or constrains an institutional claim.

CONTINUITY TOPOLOGY

Authority

The institutional standing that determines whether information, interpretation, or action is recognized as valid or permitted.

CONTINUITY TOPOLOGY

Context

The circumstances, relationships, constraints, and meaning required to interpret information correctly for a specific institutional purpose.

CONTINUITY TOPOLOGY

Decision

The governed selection, judgment, or determination made from available evidence, authority, and context.

CONTINUITY TOPOLOGY

Action

The execution, intervention, communication, or operational change performed in response to a decision or authorized objective.

CONTINUITY TOPOLOGY

Record

The durable institutional evidence of information, decisions, actions, transactions, and their governing relationships.

CONTINUITY TOPOLOGY

Institutional Memory

The governed body of retained knowledge and relationships through which an institution can understand and reconstruct its prior experience.

CONTINUITY TOPOLOGY

Future Reuse

The responsible application of preserved institutional knowledge to future analysis, decisions, actions, and learning.

RELATED KNOWLEDGE

Continue Exploring

Explore related research, framework domains, and continuity concepts.
CONTINUE WITH THE FRAMEWORK

Explore the continuity relationships that support trustworthy organizational intelligence.

Continue through the GovKM Framework to examine the doctrine, knowledge, and implementation guidance behind Organizational Continuity.
Explore the Continuity FrameworkView All Articles