Issues

• [Calibration] Define profile usability requirements

  area-evaluatorsdesignenhancementpythontriage
  Design

  strands-agents/evals#424 · Filter by author leonhuang29 opened on Oct 9, 2026
  

• [Calibration] Define tool-level evaluator aggregation

  area-evaluatorsdesignenhancementpythontriage
  Design

  strands-agents/evals#425 · Filter by author leonhuang29 opened on Oct 9, 2026
  

• [Calibration] Add hierarchical bootstrap uncertainty

  area-evaluatorsenhancementpythontriage
  Feature

  strands-agents/evals#420 · Filter by author leonhuang29 opened on Oct 9, 2026
  

• [Calibration] Add versioned calibration profiles

  area-evaluatorsenhancementpythontriage
  Feature

  strands-agents/evals#421 · Filter by author leonhuang29 opened on Oct 9, 2026
  

• [Calibration] Validate transferability and default policy

  area-evaluatorsdesignenhancementpythontriage
  Design

  strands-agents/evals#422 · Filter by author leonhuang29 opened on Oct 9, 2026
  

• [Calibration] Support historical report recomputation

  area-evaluatorsenhancementpythontriage
  Feature

  strands-agents/evals#423 · Filter by author leonhuang29 opened on Oct 9, 2026
  

• Add a HoneyHive trace provider

  area-tracingenhancementpythontriage
  Feature

  strands-agents/evals#418 · Filter by author sanjeed5 opened on Oct 9, 2026

• [FEATURE] Statistical evaluation calibration support

  area-evaluatorsenhancementpythontriage
  Feature

  strands-agents/evals#411 · Filter by author poshinchen opened on Oct 6, 2026
  

• [BUG] Red team: parallel runs with a shared MCPClient fail

  area-redteambugpythontriage
  Bug

  strands-agents/evals#409 · Filter by author nhungbi opened on Oct 5, 2026
  

• [FEATURE] Red-Teaming: Skill-based red-teaming

  area-redteamenhancementpythontriage
  Feature

  strands-agents/evals#408 · Filter by author nhungbi opened on Oct 2, 2026
  

• [BUG] CloudWatchSessionMapper replaces span start/end time with now() when the epoch timestamp is a numeric string

  area-tracingbug
  Bug

  strands-agents/evals#398 · Filter by author AmirF194 opened on Sep 14, 2026
  1

• [FEATURE] Progressive disclosure for large reference knowledge, not just traces (extend TraceIndex with a KnowledgeIndex)

  area-evaluatorsenhancement
  Feature

  strands-agents/evals#395 · Filter by author pdebjyot opened on Sep 9, 2026

• [BUG] EvaluationReport.to_file() writes RFC-8259-invalid JSON (literal NaN), has no explicit encoding, and can leave a truncated file

  area-corearea-devxbug
  Bug

  strands-agents/evals#384 · Filter by author strandly-the-agent opened on Aug 27, 2026
  1

• [BUG] Experiment.to_file() truncates the destination before serializing — a serialization error destroys the existing file

  area-corearea-devxbug
  Bug

  strands-agents/evals#382 · Filter by author strandly-the-agent opened on Aug 26, 2026

• [BUG] TrajectoryEvaluator silently drops user-supplied tools on serialization and exposes no public tools attribute

  area-devxarea-evaluatorsbug
  Bug

  strands-agents/evals#381 · Filter by author strandly-the-agent opened on Aug 26, 2026

• [BUG] parse_timestamp: millisecond epochs silently misparsed, plus two robustness gaps

  area-devxarea-tracingbug
  Bug

  strands-agents/evals#378 · Filter by author strandly-the-agent opened on Aug 25, 2026
  1

• Interop: Case[InputT, OutputT] <-> EvalPort testcase.json

  area-coredesign
  Design

  strands-agents/evals#376 · Filter by author adhabnr-ux opened on Aug 23, 2026

• [FEATURE] Add metadata() to remaining evaluators

  area-evaluatorsenhancement
  Feature

  strands-agents/evals#363 · Filter by author max-rattray-aws opened on Aug 10, 2026

• [FEATURE] Evaluator metadata taxonomy (tier, method, description)

  area-devxarea-evaluatorsenhancement
  Feature

  strands-agents/evals#350 · Filter by author max-rattray-aws opened on Aug 3, 2026
  1

• [FEATURE] Failure cohort analysis for evaluation results

  area-corearea-evaluatorsenhancement
  Feature

  strands-agents/evals#348 · Filter by author max-rattray-aws opened on Aug 3, 2026
  1

• [FEATURE] Risk classification utility for multi-run results (bug vs flaky vs pass)

  area-corearea-evaluatorsenhancement
  Feature

  strands-agents/evals#349 · Filter by author max-rattray-aws opened on Aug 3, 2026
  1

• [FEATURE] Tool efficiency evaluator (LLM-as-judge, trajectory-based)

  area-evaluatorsenhancement
  Feature

  strands-agents/evals#345 · Filter by author max-rattray-aws opened on Aug 3, 2026
  1

• [FEATURE] Could-Not-Evaluate verdict for evaluators that cannot score a case

  area-devxarea-evaluatorsenhancement
  Feature

  strands-agents/evals#346 · Filter by author max-rattray-aws opened on Aug 3, 2026
  2

• [FEATURE] Per-run keying in EvaluationDataStore for multi-run resume and config-drift detection

  area-corearea-devxenhancement
  Feature

  strands-agents/evals#347 · Filter by author max-rattray-aws opened on Aug 3, 2026
  1

• [FEATURE] Deterministic inclusive language evaluator

  area-evaluatorsenhancement
  Feature

  strands-agents/evals#344 · Filter by author max-rattray-aws opened on Aug 3, 2026
  1