jvector
JVector is a pure Java, zero dependency, embedded vector search engine, used by DataStax Astra DB and (soon) Apache Cassandra.
What is JVector?
Algorithmic-fast. JVector uses state of the art graph algorithms inspired by DiskANN and related research that offer high recall and low latency.
Implementation-fast. JVector uses the Panama SIMD API to accelerate index build and queries.
Memory efficient. JVector compresses vectors using product quantization so they can stay in memory during searches. (As part of our PQ implementation, our SIMD-accelerated kmeans class is 5x faster than the one in Apache Commons Math.)
Disk-aware. JVector’s disk layout is designed to do the minimum necessary iops at query time.
Concurrent. Index builds scale linearly to at least 32 threads. Double the threads, half the build time.
Incremental. Query your index as you build it. No delay between adding a vector and being able to find it in search results.
Easy to embed. API designed for easy embedding, by people using it in production.
Creator: Jonathan Ellis
Stars ⭐️: 304
Forked By: 24
https://github.com/jbellis/jvector
#jvector
➖➖➖➖➖➖➖➖➖➖➖➖➖➖
Join @datascience_bds for more cool repositories.
*This channel belongs to @bigdataspecialist group
Post #350
1.34K