Skip to content

examples/itq_pipeline.cpp: anisotropic-data onboarding example - #8

Merged
JonathanKash merged 1 commit into
mainfrom
itq-example
Sep 2, 2026
Merged

examples/itq_pipeline.cpp: anisotropic-data onboarding example#8
JonathanKash merged 1 commit into
mainfrom
itq-example

Conversation

@JonathanKash

Copy link
Copy Markdown
Owner

Second self-checking example: the full ITQ workflow (train → persist → rotated index → recall comparison vs raw codes against float32 truth → exact re-rank with unrotated floats). Gates its own claims; runs in ~13 s; wired into make, CMake, and CI.

🤖 Generated with Claude Code

https://claude.ai/code/session_017ULiWeodALX2ZQiLKvTw25

A second self-checking example covering the ITQ workflow end to end:
synthesize decaying-spectrum data, train a rotation (2k subsample, 10
iterations - seconds, not minutes, by design: examples run on
contributor machines and CI), persist/reload it with validation, build
raw and rotated indexes over the same floats, and measure both against
exact float32 ground truth. The example gates its own claims: rotated
codes must beat raw codes (measured here: 0.340 -> 0.420 recall@10),
and exact re-ranking over the rotated index must work with the
ORIGINAL, unrotated floats - the cosine-preservation property that
makes rotation-only ITQ practical.

Wired into examples/Makefile, CMake (EDGEVECTOR_BUILD_EXAMPLES), and
the CI quickstart job via both build paths.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_017ULiWeodALX2ZQiLKvTw25
@JonathanKash
JonathanKash merged commit 31eda2a into main Sep 2, 2026
7 checks passed
@JonathanKash
JonathanKash deleted the itq-example branch September 2, 2026 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant