Skip to content

About

A privacy-first, serverless Cloudflare Worker tool for batch testing and comparing large language model (LLM) APIs. 这是一个主打隐私安全、完全基于 Serverless (Cloudflare Worker) 的轻量级大语言模型 (LLM) 性能测速套件。

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

LLM API Speed Test

English | 简体中文

A privacy-first, serverless Cloudflare Worker tool for batch testing and comparing large language model (LLM) APIs.

Features

  • Privacy First: All configurations and histories are stored entirely in your browser (localStorage). No APIs are ever captured by backend logs.
  • Batch Testing: Input multiple models continuously.
  • Accurate Benchmarking: Tests both Time To First Token (TTFT) and accurate Output Speed (tok/s) using an advanced heuristic.
  • Provider Ready: 10+ built-in presets (OpenAI, Anthropic, Gemini, DeepSeek, Alaya, Kimi, etc).
  • Exporting: Save your LLM API rankings directly as a CSV.

Deployment

Cloudflare Workers is the easiest platform to setup LLM-API-SpeedTest:

Deploy to Cloudflare Workers

Wrangler CLI

# clone this repository
git clone https://github.com/PoweredByPassion/LLM-API-SpeedTest.git
cd LLM-API-SpeedTest

# install Cloudflare Workers (cli) aka Wrangler
npm i

# run locally for development or testing
npm start

# deploy the worker
npm run deploy

Alternatively, directly string copy worker.js to the Cloudflare Dashboard in Edit Code mode.

API Models Auto-Fetch

Enter your base URL and API secret, click Fetch Models, and instantly have your entire model list dumped into your test suite.

About

A privacy-first, serverless Cloudflare Worker tool for batch testing and comparing large language model (LLM) APIs. 这是一个主打隐私安全、完全基于 Serverless (Cloudflare Worker) 的轻量级大语言模型 (LLM) 性能测速套件。

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages