Ready-made tasks and shared services for AI jobs.
@metreeca/llms provides ready-made @metreeca/flow tasks for putting language models to work in a pipeline: prompting a model, extracting structured records from free text, and embedding content for semantic retrieval. The tasks run under the @metreeca/gear job executor, which supplies the shared services they draw on, including the clients of the model providers they reach.
- Ready-Made Tasks: prompting, extraction and embedding, chaining alongside any other task
- Shared Services: model clients, credentials and response caches, built on demand and released after the run
- Custom Bindings: a stubbed, throttled or recorded model swapped in for a run, leaving the job untouched
- Minimal Footprint: one package per model provider, each pulling in only the SDK that provider needs
Important
Pipelines are server-side workloads targeting Node.js 22 or later, relying on facilities such
as the filesystem, the process environment and fetch. The packages are not intended for the browser.
npm install @metreeca/gear # job executor and shared services
npm install @metreeca/llms # AI tasks and shared services
npm install @metreeca/llms-<provider> # model connectors, one package per providerWarning
TypeScript consumers must use "moduleResolution": "nodenext"/"node16"/"bundler" in tsconfig.json.
The legacy "node" resolver is not supported.
Install the core package, then add a connector package for each model provider the pipeline reaches. Each connector package pulls in only the SDK its own provider needs. The @metreeca/gear job executor ships separately: install it directly to set up and run the jobs putting tasks and connectors to work.
| Package | Description |
|---|---|
| @metreeca/llms | AI tasks and shared services |
| @metreeca/llms-google | Google model connectors |
| @metreeca/llms-openai | OpenAI model connectors |
Note
Each package documents its own API in its README and API reference; for complete coverage, see the API reference.
- open an issue to report a problem or to suggest a new feature
- start a discussion to ask a how-to question or to share an idea
This project is licensed under the Apache 2.0 License – see LICENSE file for details.