upstream-archive/qdrant
1
0
Fork 0
mirror of https://github.com/qdrant/qdrant.git synced 2026-08-07 02:20:55 -05:00
Code Issues Packages Projects Releases Wiki Activity
5,465 Commits 346 Branches 118 Tags
94de0e2d2dcf997bf26bec34dad407d8de9a9abb
Commit Graph

5465 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Roman Titov
430b7925e2 Fix DateTimeWrapper parsing (#6952) 2025-07-29 12:41:32 +02:00
Roman Titov
22e15b9f40 Update collection-level payload index schema after recovering partial snapshot (#6886) 2025-07-29 12:25:24 +02:00
Tim Visée
0acb487f98 Update roadmap (#6947) 2025-07-28 13:27:03 +02:00
xzfc
9bd506d4f7 Introduce StableHash (#6940) 
* Introduce StableHash

* Use SipHasher24 explicitly
 2025-07-26 21:25:56 +00:00
Luis Cossío
03bbceaabb fix flaky welford calculation test (#6927) 
* use most significant digits for comparison

* use absolute or relative tolerance
 2025-07-25 08:47:45 -04:00
Craig Rueda
398637a535 Allow health check endpoints to bypass authentication (#6931) 2025-07-24 08:38:43 +02:00
Andrey Vasnetsov
2c8c0a91fd wait-for instead of validate (#6899) 2025-07-24 08:37:23 +02:00
Andrey Vasnetsov
2f44084d7e Fix PointId Hash (#6932) 
* fmt

* clippy
 2025-07-24 08:31:29 +02:00
Andrey Vasnetsov
6fdf445570 UUID index bug (#6916) 
* reproduce bug as unit test

* reproduce in even faster unit test

* fix alignment in mmap_hashmap

* clippy

* review fixes
 2025-07-22 20:26:35 +02:00
xzfc
a959e8a671 MADV_POPULATE_READ on sequential mmaps (#6923) 2025-07-22 14:05:07 +02:00
dependabot[bot]
ac852aacbb build(deps): bump delegate from 0.13.3 to 0.13.4 (#6914) 2025-07-22 09:14:31 +00:00
dependabot[bot]
d8cd02a375 build(deps): bump cc from 1.2.29 to 1.2.30 (#6920) 2025-07-22 08:57:46 +00:00
dependabot[bot]
4bc2b39c09 build(deps): bump sysinfo from 0.36.0 to 0.36.1 (#6919) 
---
updated-dependencies:
- dependency-name: sysinfo
  dependency-version: 0.36.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-22 08:49:19 +02:00
dependabot[bot]
bd750eaf88 build(deps): bump roaring from 0.11.0 to 0.11.1 (#6921) 2025-07-22 06:46:43 +00:00
dependabot[bot]
dea51aa3ca build(deps): bump serde_json from 1.0.140 to 1.0.141 (#6915) 2025-07-22 06:45:23 +00:00
dependabot[bot]
c045904b40 build(deps): bump rand from 0.9.1 to 0.9.2 (#6917) 
---
updated-dependencies:
- dependency-name: rand
  dependency-version: 0.9.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-22 08:45:21 +02:00
dependabot[bot]
7c3ac6f714 build(deps): bump object_store from 0.12.2 to 0.12.3 (#6918) 
---
updated-dependencies:
- dependency-name: object_store
  dependency-version: 0.12.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-22 08:22:04 +02:00
dependabot[bot]
3049705edc build(deps): bump strum from 0.27.1 to 0.27.2 (#6913) 
---
updated-dependencies:
- dependency-name: strum
  dependency-version: 0.27.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-22 08:20:40 +02:00
Andrey Vasnetsov
d0f333f9dc check for empty collection data (#6910) 2025-07-21 11:22:59 +02:00
Tim Visée
b81e81c1f8 Fix checkfs in MUSL builds (#6903) 2025-07-20 16:15:50 +02:00
Jojii
073d75eabf Minor inference code improvements (#6890) 2025-07-18 08:46:14 +02:00
Luis Cossío
c02490a1a6 [MMR] make lazy matrix non-symmetric (#6900) 
* make lazy matrix non-symmetric

* remove SymmetricMatrix

---------

Co-authored-by: generall <andrey@vasnetsov.com>
 2025-07-18 00:40:14 +02:00
Luis Cossío
92c3bc810b also handle special case (#6898) 2025-07-17 14:42:14 -04:00
Luis Cossío
5c51c19434 MMR with postprocessed score (#6897) 
* handle score_threshold only during search

* use original score for mmr output
 2025-07-17 19:49:44 +02:00
Tim Visée
6f4069e711 Preprocess query vectors, sort sparse vectors (#6895) 
* Add test to assert behavior of unsorted sparse query

* Preprocess sparse vectors

* Fix typo
 2025-07-17 16:11:44 +02:00
Tim Visée
a5869beb99 Deprecations for Qdrant 1.15.0 (#6892) 
* Deprecate init_from

* Mark memmap_threshold as deprecated

* Mark locks API as deprecated

* Mark RBAC collection access payload filter as deprecated

* Allow deprecations in tests and benchmarks
 2025-07-17 16:10:45 +02:00
Andrey Vasnetsov
1818a6e951 upd logs (#6894) 
* upd logs

* upd
 2025-07-17 14:32:18 +02:00
Jojii
16688a6a1b Replace Box with Either (#6887) 2025-07-17 11:04:43 +02:00
Luis Cossío
4f3d64ac59 [mmr] compute similarities lazily (#6877) 
* compute similarities lazily

* Update lib/collection/src/collection/mmr/lazy_matrix.rs

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

---------

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
 2025-07-17 10:41:24 +02:00
Tim Visée
5ddda7e409 Don't delete payload index RocksDB if we still use RocksDB storage type (#6888) 2025-07-17 10:14:18 +02:00
Andrey Vasnetsov
168674973a lowercase stemmer language for consistency (#6889) 2025-07-17 09:53:34 +02:00
Arnaud Gourlay
1362563c2c Bump thread-priority 2.1.0 (#6885) 2025-07-16 17:14:06 +02:00
Tim Visée
cd1a31448d Fix broken is_empty filter on new points (#6882) 
* Add test to catch bug

Bug: <https://github.com/qdrant/qdrant/issues/6880>

* Fix loading null index from wrong path

* Simplify test

* Also bump total point count when removing a point

* Add debug assertion, ensure we don't create null index in selector

* Update bug link

* Remove unused import

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

---------

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
 2025-07-16 14:25:09 +02:00
Kumar Shivendu
e14a003404 Fix bug that causes all replicas to die if node is restarted during resharding (#6800) 
* Fix bug that causes all replicas to die if node is restarted during resharding

* fix recursive async problem

* Avoid write lock unless required

* avoid using &mut when & is sufficient

* Remove is_in_progress since check_abort_resharding exists (#6806)

* On resharding abort, only abort transfers related to current operation

* Fix resharding dead replicas improvements (#6881)

* Apply suggestions to fix resharding dead replicas

* fmt

---------

Co-authored-by: timvisee <tim@visee.me>
 2025-07-16 17:51:30 +05:30
Tim Visée
edb460a5a6 After payload index migration, delete RocksDB files (#6873) 
* After payload index migration, delete RocksDB files

* Add comment on why it is safe to not clean up RocksDB files in some cases

* Update lib/segment/src/index/struct_payload_index.rs

Co-authored-by: Roman Titov <ffuugoo@users.noreply.github.com>

* Reformat

---------

Co-authored-by: Roman Titov <ffuugoo@users.noreply.github.com>
 2025-07-15 16:33:53 +02:00
Tim Visée
8b38f3a831 Adjust feature flag descriptions (#6875) 2025-07-15 15:31:37 +02:00
Tim Visée
70477eb5a9 Enable migration from RocksDB to mutable ID tracker by default (#6872) 
* Enable migration from RocksDB to mutable ID tracker by default

We planned to enable this by default in the Qdrant 1.15.0 release.

* Synchronize enable at version TODOs for other flags with planning

* Update OpenAPI spec
 2025-07-15 13:34:28 +02:00
Arnaud Gourlay
f95190c82e Do not track HW measurement when matching over a text index (#6833) 2025-07-15 11:30:48 +02:00
Arnaud Gourlay
a7ee4ceb51 Fix hardware counter vector_io for segment vector retrieval (#6863) 2025-07-15 11:30:22 +02:00
Tim Visée
70d231011b Fix payload index migration config and edge case handling (#6864) 
* Minor comment and log tweaks

* Persist payload index config when changed based on dirty flag

* Persist new index type when indices are rebuilt, they might have changed

* Still load RocksDB if some index still depends on it

* Fix typo
 2025-07-15 09:45:29 +02:00
dependabot[bot]
1c8e87d238 build(deps): bump ringbuffer from 0.15.0 to 0.16.0 (#6871) 2025-07-15 07:25:36 +00:00
dependabot[bot]
9d4b0929ad build(deps): bump sysinfo from 0.35.2 to 0.36.0 (#6869) 
---
updated-dependencies:
- dependency-name: sysinfo
  dependency-version: 0.36.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-15 09:08:12 +02:00
dependabot[bot]
975c6a6f89 build(deps): bump config from 0.15.11 to 0.15.13 (#6870) 
---
updated-dependencies:
- dependency-name: config
  dependency-version: 0.15.13
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-15 08:50:32 +02:00
dependabot[bot]
af20c52909 build(deps): bump memmap2 from 0.9.5 to 0.9.7 (#6867) 
Bumps [memmap2](https://github.com/RazrFalcon/memmap2-rs) from 0.9.5 to 0.9.7.
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/RazrFalcon/memmap2-rs/commits)

---
updated-dependencies:
- dependency-name: memmap2
  dependency-version: 0.9.7
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-15 08:48:45 +02:00
dependabot[bot]
2c229c482e build(deps): bump clap from 4.5.40 to 4.5.41 (#6866) 
---
updated-dependencies:
- dependency-name: clap
  dependency-version: 4.5.41
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-15 08:45:12 +02:00
dependabot[bot]
347eed5518 build(deps): bump rustls from 0.23.28 to 0.23.29 (#6865) 
Bumps [rustls](https://github.com/rustls/rustls) from 0.23.28 to 0.23.29.
- [Release notes](https://github.com/rustls/rustls/releases)
- [Changelog](https://github.com/rustls/rustls/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rustls/rustls/compare/v/0.23.28...v/0.23.29)

---
updated-dependencies:
- dependency-name: rustls
  dependency-version: 0.23.29
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-15 08:44:45 +02:00
Ivan Pleshkov
6521b0df7d bq scalar query benches (#6831) 
* bq scalar query benches

* review remarks
 2025-07-14 19:28:07 +02:00
Tim Visée
09bdbaf58d In mmap payload indices, replace boxing with Either (#6861) 2025-07-14 15:48:34 +02:00
Roman Titov
c6e38d16a7 Avoid blocking async runtime when loading local shard (#6862) 2025-07-14 15:03:16 +02:00
Tim Visée
cd045b2e7d Naive migration of payload indices from RocksDB to Gridstore (#6810) 
* Add function to detect if storage is using RocksDB

* Add feature flag to toggle payload index migration

* Add naive payload index migration, rebuild from scratch if RocksDB

* Adjust payload index rebuild logs

* When rebuilding payload indices, clean up existing storages

* Update OpenAPI spec

* Use weak references to Gridstore in mutable payload index flushers

* Rework payload index clear/wipe functions, make them consistent

* Naively migrate RocksDB before loading indices

* Fix mmap payload index load, staged like others (#6837)

* Add staged loading of mmap numeric payload index

* Add staged loading of mmap map payload index

* Add staged loading of mmap geo payload index

* Add staged loading of mmap full text payload index

* Add staged loading of mmap bool and null payload index

* Minor tweaks

* Don't fail clearing file cache if file does not exist

---------

Co-authored-by: jojii <jojii@gmx.net>
 2025-07-14 13:26:18 +02:00