PofoliaShared via Pofolia

Proceedings of the VLDB Endowment· 2025Q1

VSAG: An Optimized Search Framework for Graph-Based Approximate Nearest Neighbor Search

Xiaoyao Zhong, Haotian Li, Jiabao Jin, Mingyu Yang et al.

Short summary

VSAG, an open-source framework, significantly enhances graph-based approximate nearest neighbor search (ANNS) performance by optimizing memory access, automating parameter tuning, and accelerating distance computation, achieving up to 4x speedup over HNSWlib with equivalent accuracy.

AI-generated from the title and abstract; the full text is not read.

Key points

  • VSAG framework optimizes graph-based ANNS by improving memory access, automating parameter tuning, and accelerating distance computation.
  • It reduces L3 cache misses through pre-fetching and cache-friendly vector organization.
  • Automated parameter tuning selects optimal parameters without costly index rebuilding.
  • Efficient distance computation uses modern hardware, scalar quantization, and low-precision representations.
  • Experimental results show up to 4x speedup over HNSWlib with equivalent accuracy on real-world datasets.

AI-generated from the title and abstract; the full text is not read.

Abstract

Approximate nearest neighbor search (ANNS) is a fundamental problem in vector databases and AI infrastructures. Recent graph-based ANNS algorithms have achieved high search accuracy with practical efficiency. Despite the advancements, these algorithms still face performance bottlenecks in production, due to the random memory access patterns of graph-based search and the high computational overheads of vector distance. In addition, the performance of a graph-based ANNS algorithm is highly sensitive to parameters, while selecting the optimal parameters is cost-prohibitive, e.g., manual tuning requires repeatedly re-building the index. This paper introduces VSAG , an open-source framework that aims to enhance the in production performance of graph-based ANNS algorithms. VSAG has been deployed at scale in the services of Ant Group, and it incorporates three key optimizations: ( i) efficient memory access : it reduces L3 cache misses with pre-fetching and cache-friendly vector organization; ( ii) automated parameter tuning : it automatically selects performance-optimal parameters without requiring index rebuilding; ( iii) efficient distance computation : it leverages modern hardware, scalar quantization, and smartly switches to low-precision representation to dramatically reduce the distance computation costs. We evaluate VSAG on real-world datasets. The experimental results show that VSAG achieves the state-of-the-art performance and provides up to 4× speedup over HNSWlib (an industry-standard library) while ensuring the same accuracy.

The authors' abstract, as published at the source. Proceedings of the VLDB Endowment, 2025 · DOI ↗

TakeawaysPremium
Ask the paperFree account

Continue with a free account

Ask the paper: 3 free questions a day about this paper; save it, get its citation, new summaries every day for your field. Takeaways are Premium.

Continue free on the web

Sign in with Google or Apple; no card needed. You come back to this paper.

On your phone:

Field: Computer Vision and Pattern Recognition

Computer Vision and Pattern RecognitionComputer Science