Microsoft Foundry Portal에서 직접 해보는 Evaluation Engineering
-
Updated
Sep 1, 2026
#
evaluation-engineering
Here are 5 public repositories matching this topic...
Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild
-
Updated
May 27, 2026 - Python
Evaluation-first AI case study for evolving retry/backoff policies with local LLMs, strict QA gates, and holdout validation.
python reliability-engineering python3 sdet retry-policy qa-automation ai-testing local-llm llm-evaluation openevolve evaluation-engineering
-
Updated
Apr 28, 2026 - Python
Awesome list for eval engineering (evals engineering): tools that automate LLM evals and agent evals, turn traces into test cases, and calibrate LLM-as-a-judge.
awesome awesome-list ai-agents ai-evaluation ai-testing llm-eval evals llm-evaluation llm-as-judge llm-as-a-judge llm-testing llm-evals agent-evals agent-evaluation ai-evals evaluation-engineering evals-engineering eval-engineering
-
Updated
Sep 15, 2026
Provider-neutral AI evaluation toolkit for reusable test cases, regression datasets, provider adapters, deterministic and LLM judges, agent trajectory and security evaluation, statistical analysis, quality/cost/latency trade-offs, online experiments, evidence guardrails, and release gates.
regression-testing evaluation-datasets model-evaluation effect-size online-experiments bootstrap-confidence-intervals ai-evaluation ai-testing trajectory-evaluation llm-evaluation llm-as-a-judge ai-security-testing agent-evaluation statistical-evaluation evaluation-harness evaluation-engineering judge-calibration evaluation-rubrics quality-cost-analysis ai-quality-gates
-
Updated
Oct 2, 2026 - Python
Add this topic to your repo
To associate your repository with the evaluation-engineering topic, visit your repo's landing page and select "manage topics."