Skip to content

CLI is passing trancuated snippet from Tool result to LLM #1000

@alok992-tech

Description

@alok992-tech

CLI is sending the trauncated tool result to LLM instead of writing the file to disk and read the entire text. This results in a incorrect response from LLM since it does not have the entire Tool Result in the context

At 50KB threshold (inline path):
• The tool result was under 50KB, so the CLI passed it inline to the LLM as textResultForLlm
• But the CLI applies token-based truncation before sending to the LLM — you can see this in the telemetry: "truncateBasedOn":"tokenCount","truncateStyle":"middle"
• The LLM receives a truncated version and has no way to read the rest — the full text only existed in memory, never on disk

The real gap is that there's no hybrid: "inline a truncated preview AND save the full content to a file so the LLM can read more if needed." That would be the ideal behavior,

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions