test: cover greeting to deferred email tool continuation - #218
Conversation
|
Warning Review limit reached
This review includes 3 billable files and costs up to $0.75. Or wait 29 minutes for your next included review. View limit detailsLimit details: You’ve used all 2 included reviews currently available. Review configuration: ⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Advanced Run ID: 📒 Files selected for processing (3)
Comment |
Tiny Sweeper reviewThis pull request adds an end-to-end regression test for a greeting followed by a deferred email tool invocation, and adjusts an existing dialect test to use `last()` instead of an indexed access. The new test validates that a deferred email tool is invoked after a tool search when preceded by a greeting, but it is missing a search tool registration which may leave the first tool call unhandled. State: Changes requested Review snapshot
Completeness: Complete What changedModified `crates/tinyagents-harness/src/agent_loop/dialect/test.rs` to use `last()` instead of indexing for assertion. Added new test `a_greeting_does_not_replace_the_email_request_after_tool_search` in `crates/tinyagents-integration-tests/tests/e2e_tool_dialects.rs` that simulates a conversation with greeting and deferred email tool. FeaturesNone identified with supported citations. TestsNo supported feature-to-test mapping was produced. Test execution is not inferred. Findings
Before merge
How this fits togetherflowchart LR
n0["...latest_request_after_a_tool_search_result<br/>changed"]:::changed
n1["harness_with<br/>changed"]:::changed
n2["apply_to_request"]:::impacted
n3["new"]:::impacted
n4["CaptureMiddleware"]:::impacted
n0 -->|calls| n2
n0 -->|tests| n2
n1 -->|calls| n3
n1 -->|uses| n4
classDef changed fill:#0d4429,stroke:#238636,color:#e6edf3
classDef impacted fill:#161b22,stroke:#6e7681,color:#c9d1d9
classDef flagged fill:#5a1e02,stroke:#d93f0b,color:#ffffff
classDef blocking fill:#67060c,stroke:#f85149,color:#ffffff
Agent review detailscritique
security
tests
commits
description
e2e
Evidence and run details
|
There was a problem hiding this comment.
Requesting changes: 1 lane(s) blocking, worst finding is high.
Fix or reply to the findings below and push. The next review clears this automatically once they are gone — you should not need to dismiss anything by hand.
$0.0056 · 158,211 in / 11,359 out · 9,692 cached (6%) · ladder/vectors, gpt-5.6-luna, deepseek/deepseek-v4-flash · 370 embedded
critique: $0.0024 · 92,633 in / 3,723 out · 6,108 cached (7%) · gpt-5.6-luna
security: $0.0013 · 58,041 in / 1,287 out · 3,584 cached (6%) · gpt-5.6-luna
description: $0.0011 · 4,557 in / 3,578 out · 0 cached (0%) · deepseek/deepseek-v4-flash
Summary
Dependency
Depends on tinyhumansai/tinyinference#30. Keep this PR draft until that gitlink is available upstream.
Live validation
A scratch-profile OpenHuman run against managed DeepSeek V4 Flash still sometimes returned the earlier greeting even with the correct email request on the backend wire. The end-to-end test proves the local loop behavior, not provider reliability. A supported Qwen3.5 Flash run completed the same two-turn scenario and invoked
GMAIL_FETCH_EMAILS. The production model/routing choice is being handled separately.Verification
cargo test --manifest-path Cargo.toml -p tinyagents-integration-tests --test e2e_tool_dialects(23 passed)cargo test --manifest-path Cargo.toml -p tinyagents-harness agent_loop::dialect::test --lib(6 passed)cargo fmt --manifest-path Cargo.toml --all --check