Commit Graph

5465 Commits

Author SHA1 Message Date
Tim Visée
d523d9fb99 Bump dev version to 1.16.3-dev (#7682) 2025-12-03 13:51:14 +01:00
Tim Visée
3d4cf54278 Fix vector count in metrics showing minus zero (#7678)
Co-authored-by: <jojii <jojii@gmx.net>
2025-12-03 10:26:02 +01:00
Tim Visée
be07490604 Fix shard clean up on snapshot restore without manifest (#7673)
* On local replica recovery, also gracefully stop shard without manifest

* Reformat
2025-12-03 08:52:15 +01:00
Tim Visée
2ca2113ee1 Bump wal to 0.1.4 (#7674) 2025-12-02 18:10:17 +01:00
Tim Visée
a6a8fc50d9 build(deps): bump werkzeug from 3.1.3 to 3.1.4 in /tests (#7671)
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/3.1.3...3.1.4)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-version: 3.1.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-02 16:33:24 +01:00
Jojii
b4569d3555 Avoid panics on empty metric families (#7479) 2025-12-02 15:03:19 +01:00
Luis Cossío
d79cd9b99b activate fs-err features for nicer error messages (#7665)
* activate fs-err features for nicer error messages

* use in entire workspace
2025-12-02 10:40:36 -03:00
Tim Visée
747da0e793 Automatically opt-out of multi-mmap support by testing support (#7618) 2025-12-02 10:32:25 +01:00
Arnaud Gourlay
86ced6d89a Fix payload indexes drop/flush sequence (#7626)
* Fix release mmap handles before removing files

* weak references to handle after drop

* protect from concurrent drop/flush

* simplify locking

* Revert "simplify locking"

This reverts commit 7ebd324be4.
2025-12-02 10:27:48 +01:00
Jojii
8da4c22cae Make indexed-only-excluded-points metric default to 0 (#7649)
* Make indexed_only_excluded in metrics default to 0

* Fix tests
2025-12-02 09:36:41 +01:00
Luis Cossío
366ab07ba2 fix typo Uint8 -> Int8 (#7666) 2025-12-02 09:54:34 +03:00
dependabot[bot]
f560bc2c7c build(deps): bump actions/checkout from 5 to 6 (#7654)
Bumps [actions/checkout](https://github.com/actions/checkout) from 5 to 6.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v5...v6)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 21:49:42 -03:00
dependabot[bot]
7b82d5a91d build(deps): bump tracing-subscriber from 0.3.20 to 0.3.22 (#7658)
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.20 to 0.3.22.
- [Release notes](https://github.com/tokio-rs/tracing/releases)
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.3.20...tracing-subscriber-0.3.22)

---
updated-dependencies:
- dependency-name: tracing-subscriber
  dependency-version: 0.3.22
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 21:48:47 -03:00
dependabot[bot]
2f2830dc82 build(deps): bump fs-err from 3.1.3 to 3.2.0 (#7662)
Bumps [fs-err](https://github.com/andrewhickman/fs-err) from 3.1.3 to 3.2.0.
- [Changelog](https://github.com/andrewhickman/fs-err/blob/main/CHANGELOG.md)
- [Commits](https://github.com/andrewhickman/fs-err/compare/3.1.3...3.2.0)

---
updated-dependencies:
- dependency-name: fs-err
  dependency-version: 3.2.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:40:05 -03:00
dependabot[bot]
6a4646e895 build(deps): bump tikv-jemallocator from 0.6.0 to 0.6.1 (#7661)
Bumps [tikv-jemallocator](https://github.com/tikv/jemallocator) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/tikv/jemallocator/releases)
- [Changelog](https://github.com/tikv/jemallocator/blob/main/CHANGELOG.md)
- [Commits](https://github.com/tikv/jemallocator/compare/0.6.0...0.6.1)

---
updated-dependencies:
- dependency-name: tikv-jemallocator
  dependency-version: 0.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:32:31 -03:00
dependabot[bot]
b2cce0fb90 build(deps): bump io-uring from 0.7.10 to 0.7.11 (#7656)
Bumps [io-uring](https://github.com/tokio-rs/io-uring) from 0.7.10 to 0.7.11.
- [Commits](https://github.com/tokio-rs/io-uring/commits/v0.7.11)

---
updated-dependencies:
- dependency-name: io-uring
  dependency-version: 0.7.11
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:31:46 -03:00
dependabot[bot]
179d641ce1 build(deps): bump tokio from 1.47.1 to 1.48.0 (#7657)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.47.1 to 1.48.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.47.1...tokio-1.48.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-version: 1.48.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:29:58 -03:00
dependabot[bot]
cb373eb1e8 build(deps): bump zerocopy from 0.8.27 to 0.8.31 (#7663)
Bumps [zerocopy](https://github.com/google/zerocopy) from 0.8.27 to 0.8.31.
- [Release notes](https://github.com/google/zerocopy/releases)
- [Changelog](https://github.com/google/zerocopy/blob/main/CHANGELOG.md)
- [Commits](https://github.com/google/zerocopy/compare/v0.8.27...v0.8.31)

---
updated-dependencies:
- dependency-name: zerocopy
  dependency-version: 0.8.31
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:28:11 -03:00
dependabot[bot]
35817f11bc build(deps): bump lz4_flex from 0.11.5 to 0.12.0 (#7660)
Bumps [lz4_flex](https://github.com/pseitz/lz4_flex) from 0.11.5 to 0.12.0.
- [Release notes](https://github.com/pseitz/lz4_flex/releases)
- [Changelog](https://github.com/PSeitz/lz4_flex/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pseitz/lz4_flex/compare/0.11.5...0.12.0)

---
updated-dependencies:
- dependency-name: lz4_flex
  dependency-version: 0.12.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:25:26 -03:00
dependabot[bot]
a478b0bf6f build(deps): bump syn from 2.0.106 to 2.0.111 (#7659)
Bumps [syn](https://github.com/dtolnay/syn) from 2.0.106 to 2.0.111.
- [Release notes](https://github.com/dtolnay/syn/releases)
- [Commits](https://github.com/dtolnay/syn/compare/2.0.106...2.0.111)

---
updated-dependencies:
- dependency-name: syn
  dependency-version: 2.0.111
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-01 19:23:46 -03:00
Andrey Vasnetsov
824c5ad956 Explicit gracefull stop for LocalShard (#7640)
* sync function to ask to stop workers

fmt

update blocking_ask_workers_to_stop

* graceful shard stop on ShardReplicaSet changes

* make stop consuming

* implement graceful stop for replica set

* graceful shard stop in start_resharding_unchecked

* stop_gracefully fn on shard_holder

* collection graceful stop on delete

* explain when it is ok to shutdown

* fix tests and ensure blocking callsa are not called from async runtime

* fmt

* Annotate cancel safety for do_recover_from_snapshot function

* Minor comment nit

* make drop not wait on stop thread

* graceful stop in more tests

* graceful stop in more tests

* avoid background thread is shard was stopped gracefully

* annotate cancel safety

* fmt

* More cancel safety annotations

* Add two spawns to ensure cancel safety

---------

Co-authored-by: timvisee <tim@visee.me>
2025-12-01 18:46:09 +01:00
Arnaud Gourlay
2e6c9ae0a2 Fix shard crate testing feature (#7651) 2025-12-01 18:39:30 +01:00
Tim Visée
4010e7219f Add runtime flag to disable opening multiple mmaps on the same file (#7614)
* Fix delete_page not dropping sequential mmap

* In Gridstore Page, support using a single mmap

* In Gridstore Page, only open multiple mmaps if supported at runtime

* Support opening single mmap in UniversalMmapChunk

* Rename environment var, log warning when QDRANT_NO_MULTI_MMAP is set

* Support opening single mmap in MmapDenseVectors

* Remove unused result response

* Import LazyLock
2025-12-01 18:34:05 +01:00
Ivan Pleshkov
8df3dda006 Scalar quantization encoding parameter (#7602)
* scalar quantization encoding parameter

fix ci

remove method

review remarks

fix ci

* uint8 - int8
2025-12-01 12:03:36 +01:00
tellet-q
4fe1a1b068 Long running e2e test on many collections (#7576)
* Add test for many collections

* Reduce number of collections
2025-12-01 11:57:40 +01:00
Arnaud Gourlay
225caa8e5e Test storage compat. v1.6.1 (#7648) 2025-12-01 11:21:50 +01:00
Arnaud Gourlay
eba78a6728 Fix Gridstore has pointer lookup to account for nature of pending operation (#7638) 2025-12-01 10:55:44 +01:00
AMIR
4f13b994e3 Add list shard keys API (#7615) 2025-11-28 21:50:09 -03:00
Arnaud Gourlay
f45b49000b Bump Poetry 2.2.1 (#7633) 2025-11-28 15:48:50 +01:00
Arnaud Gourlay
adc3bb8540 Fix Openapi schema for DELETE issues (#7634) 2025-11-28 14:50:34 +01:00
Arnaud Gourlay
bf564a40cf Improve timeout logic for Telemetry (#7607)
* Improve timeout logic for Telemetry

* assert!

* fix misuses of StoppinGuard

* decrease timeout for each shard
2025-11-27 16:43:56 +01:00
Roman Titov
3daaba2f0e Make snapshot_manifest methods async (#7629)
* Make `snapshot_manifest` methods `async`, so that they don't block async runtime

* Spawn `restore_shard_snapshot` task on `update` runtime instead of "current"
2025-11-27 20:32:24 +05:30
Arnaud Gourlay
9b5cca03ae Standardize delete payload index terminology (#7630) 2025-11-27 16:01:00 +01:00
Luis Cossío
6ca3e46638 Fix wiping of Gridstore (#7627)
* fix wiping of gridstore

* clippy

* address @timvisee's review
2025-11-27 11:38:19 -03:00
Luis Cossío
0c61bffb70 homogenize bench for aarch64 too (#7628) 2025-11-27 11:34:38 -03:00
tellet-q
7b11a3782e Add a ClusterOperation to execute a sleep on the node (#7616)
* Add TestSlowDown ClusterOperation to execute a sleep on the node
2025-11-27 15:31:24 +01:00
Arnaud Gourlay
3babcfb1df Fix BufferedDynamicFlags flushing with concurrent drop/deletion (#7621)
* Fix BufferedDynamicFlags flushing with concurrent drop/deletion

* make sure to drop before fs remove
2025-11-27 14:18:56 +01:00
Ivan Boldyrev
2a7fc718fa Fix search in empty HNSW segments (#7620)
* Add top==0 tests

* Fix HNSW scan top==0 error
2025-11-27 18:56:10 +07:00
Ivan Pleshkov
a2be9e7fff refactor sq score_bytes (#7613) 2025-11-27 10:49:33 +01:00
Luis Cossío
e0aabd6084 Weak flusher references to Gridstore components (#7624) 2025-11-26 17:01:54 -03:00
Tim Visée
6467931915 Add a user agent to HTTP clients (#7623)
* Add user agent to add HTTP clients

* Move user agent constant to defaults.rs
2025-11-26 18:59:21 +01:00
Roman Titov
5ba7ac8ee8 Qdrant Edge Python bindings improvements (#7561)
* Use anonymous lifetime in `FromPyObject` implementations

* Use `PyResult` in `IntoPyObject` implementations

* Cleanup imports and derives

* Cleanup `filter` conversions

* Add `PointVectors` getters

* Move `config` module into sub-directory

* Split `config` into sub-modules

* Simplify enum bindings

* Add zero-cost conversions for `PyVectorDataConfig` and `PySparseVectorDataConfig`

* Add getters to config structures

* fixup! Add getters to config structures

More zero-cost conversions for `PyVector*DataConfig`

* Implement `PyHnswIndexConfig`

* Implement `PyQuantizationConfig`

* fixup! Simplify enum bindings

* fixup! Implement `PyHnswIndexConfig`

* fixup! Implement `PyHnswIndexConfig`

* fixup! Implement `PyHnswIndexConfig`

* Implement `PySparseVectorDataConfig`

* fixup! Implement `PySparseVectorDataConfig`

* fixup! Implement `PySparseVectorDataConfig`
2025-11-26 18:47:17 +01:00
Tim Visée
a5f534b3c1 Change minimum version for batch WAL transfer into constant (#7619) 2025-11-26 16:59:05 +01:00
tellet-q
3d42527be1 Build dev with new feature flag (#7612)
* Build dev images with new feature flag

* Disable feature for master and tags
2025-11-26 14:11:04 +01:00
Arnaud Gourlay
155465f154 Document storage compatibility test for v1.15.0 (#7601)
* Enable storage compatibility test for v1.15.0

* proper explanation
2025-11-26 12:11:19 +01:00
tellet-q
be6ff8ce31 Increase timeout for e2e tests (#7611) 2025-11-26 09:22:31 +01:00
Tim Visée
57ad76db98 Disable RocksDB features in local development builds (#7552)
* Disable rocksdb compile time feature by default

* Also disable RocksDB feature in segment crate

* Enable RocksDB feature in all CI builds

* Remove extra job for testing non-RocksDB build, it's the default now

* Keep RocksDB structures in generated OpenAPI schema

* Fix obsolete --workspace flag breaking builds with explicit features

* Also build including RocksDB in e2e tests on CI
2025-11-25 17:29:50 +01:00
Tim Visée
d0a870ce2e Fix cosign error on release image (#7606) 2025-11-25 16:57:58 +01:00
Tim Visée
b7394ce85e Bump rocksdb dependency to 0.24.0 (#7605) 2025-11-25 16:44:44 +01:00
Tim Visée
e630cf59fa Bump dev version to 1.16.2-dev (#7604) 2025-11-25 15:01:34 +01:00