Unit tests for AI agents that browse the web.
-
Updated
Jul 1, 2026 - HTML
#
search-evaluation
Here are 13 public repositories matching this topic...
Web search API evaluation for AI agents: You.com, Tavily, Exa and Parallel benchmarked · MCP server on npm & MCP Registry · Claude Code plugin · Hugging Face dataset
benchmark mcp search-api ai-agents web-search exa rag you-com evals llm-evaluation promptfoo web-search-api tavily model-context-protocol mcp-server parallel-ai claude-code-plugin search-evaluation search-benchmark
-
Updated
Oct 27, 2026 - HTML
Production-quality AI search project exploring modern retrieval, reranking, RAG, fine-tuning, personalization and evaluation for travel search.
python machine-learning information-retrieval embeddings personalization semantic-search query-rewriting opensearch reranking fine-tuning ai-search rag fastapi vector-search colbert hybrid-search splade aws-bedrock llm-evaluation search-evaluation
-
Updated
Sep 1, 2026 - Python
Evaluate e-commerce search with IR metrics and LLM judge panels: significance tests, cost budgets, an HTML dashboard, and a CI quality gate.
python elasticsearch information-retrieval ecommerce search-relevance ndcg github-actions llm llm-as-a-judge search-evaluation
-
Updated
Nov 4, 2026 - Python
Hybrid search engine and IR evaluation benchmark (BM25 vs kNN vs RRF) on German IT vacancies using Elasticsearch, FastAPI, and Streamlit.
python nlp elasticsearch information-retrieval docker-compose embeddings semantic-search bm25 job-search pydantic fastapi vector-search german-nlp streamlit sentence-transformers hybrid-search reciprocal-rank-fusion search-evaluation
-
Updated
Nov 3, 2026 - Python
Search evaluation with Jev as the judge. turbopuffer does the retrieval and hosted reranking, and DuckDB keeps every run and computes the metrics in SQL.
python information-retrieval relevance bm25 ndcg reranking vector-search esci duckdb hybrid-search llm-as-a-judge turbopuffer search-evaluation jev
-
Updated
Oct 26, 2026 - Python
An AI-powered web search and evaluation tool using Pydantic AI to generate prompts, fetch websites, and assess search results.
-
Updated
Apr 15, 2025 - Python
Deterministic safe-Rust BM25, WAND, block-max WAND, and TREC experiment toolkit
rust search-engine information-retrieval compression inverted-index bm25 trec wand search-evaluation
-
Updated
Nov 1, 2026 - Rust
Deterministic offline evaluation harness and calibrated multi-metric scoring engine for search, ranking, and RAG quality gates (Python + TypeScript).
python testing benchmark information-retrieval typescript metrics evaluation calibration ranking reproducibility deterministic scoring-engine normalization ndcg quality-gates explainable-ai mrr rag-evaluation offline-evaluation search-evaluation
-
Updated
Nov 10, 2026 - Python
MCP server that lets AI assistants search the legislation of Uzbekistan
mcp embeddings full-text-search semantic-search model-server legal-tech hybrid-search search-evaluation
-
Updated
Nov 10, 2026 - Python
Fork of adsabs/search-comparisons: compares results across academic search engines (NASA ADS, Google Scholar, Semantic Scholar, Web of Science) with query-intent analysis.
-
Updated
Jul 4, 2025 - Python
Search evaluation under missing relevance judgments with exact 2^u uncertainty bounds and BM25 RSJ non-negative IDF.
-
Updated
Oct 20, 2026 - TypeScript
기술 문서 60건으로 Keyword Baseline과 TF-IDF 검색을 구현하고 Precision@3·MRR로 비교한 검색 프로젝트
-
Updated
Oct 1, 2026 - Python
Add this topic to your repo
To associate your repository with the search-evaluation topic, visit your repo's landing page and select "manage topics."