Why vector search benchmarks are meaningless without recall
Benchmarking Vector Indexes

Percona introduces vector-bench, an open benchmark that measures vector indexes fairly. It explains the two main index types, HNSW and IVF, and why recall and throughput must be reported together. The post details the harness, including build methods, concurrency, and filtered search, and warns against common pitfalls like TOAST in PostgreSQL.
Which is why “our database does 3,678 vector queries a second” tells you nothing.