Commit Graph

5465 Commits

Author SHA1 Message Date
krapcys1-maker
2aa6ae139b fix(startup): avoid double panic in telemetry error reporting (#8242)
Co-authored-by: local-user <local-user@local>
2026-02-27 15:19:34 +01:00
tellet-q
35c6ee92a8 Use pyroscope lib-1.0.1 (#8247) 2026-02-27 13:19:23 +01:00
krapcys1-maker
3ddf6234e1 test(segment): stabilize building cancellation timing assertions (#8243)
Co-authored-by: local-user <local-user@local>
2026-02-27 13:08:35 +01:00
Andrey Vasnetsov
7084b5dd91 read write gridstore (#8244)
* [WIP] read and write separattion

* Introduce GridstoreView which contains ephermal representation of data and implements search functions

* fmt

* hide test-only method + add missing file

* fmt

* [AI] do not Copy config

* review nits

* thx coderabbit

---------

Co-authored-by: Luis Cossío <luis.cossio@outlook.com>
2026-02-26 21:57:40 +01:00
Luis Cossío
21890d2738 use Cow<'_, [T]> as return type in dense vector storages (#8221)
* use `Cow<'_, [T]>` as return type in vector storages

* extract complex type

* clippy

* improve maybe_uninit_fill_from

* don't commit to graphlinks yet
2026-02-26 13:30:21 -03:00
Sapphire
ada810896a Optimize ImmutablePointToValues: inline single-value points to reduce RAM usage and increase performance (#8235)
* optimize: performance improve

* Optimize ImmutablePointToValues to store single values inline

- Replace PointMeta with PointValueEntry enum to distinguish single vs
  multi-value points
- Store single values directly in point_entries, reducing container
  overhead
- Only multi-value and empty points use the shared values_container
- Update all methods and tests to use new representation
- Add tests for edge cases and single-value optimizations

* Explicit branch for zero sized value

* Update comment

* Remove zero count branch as it appears to make it slightly slower

---------

Co-authored-by: 1995chen <chenl2448365088@gmail.com>
Co-authored-by: timvisee <tim@visee.me>
2026-02-26 16:44:45 +01:00
Arnaud Gourlay
3da9e949d7 Decrease Quickcheck test count for WAL on Windows (#8229) 2026-02-26 10:10:43 +01:00
Andrey Vasnetsov
03c0fa2cf7 Universal IO: gridstore pages (#8223)
* [manunal] Gridstore page use universal IO

* fmt

* Apply review feedback for universal IO gridstore pages (#8230)

* Apply review feedback from PR #8223

- Use `super::Result` import in mmap.rs instead of fully-qualified `crate::universal_io::Result`
- Restructure ValuePointer destructuring in get_value and delete_value to
  first match Some(pointer), then destructure separately

* Replace Either<E, GridstoreError> with E: From<GridstoreError> in Gridstore::iter

Use a trait bound instead of Either to combine callback and gridstore
errors, allowing `?` to work directly on GridstoreError. This simplifies
callers by removing Either matching and io::Error conversion workarounds.

---------

Co-authored-by: qdrant-claw <qdrant-claw@users.noreply.github.com>

---------

Co-authored-by: qdrant-claw <qdrant-claw@users.noreply.github.com>
2026-02-25 19:46:00 +01:00
tellet-q
ee02202af7 Upgrade pyroscope to 0.5.9 (jemalloc signal-safety fix) (#8225) 2026-02-25 18:09:06 +01:00
krapcys1-maker
fc608eb31d fix(rest): expose HTTP transport timeout controls for persistent clients (#8220)
* fix(rest): expose HTTP transport timeout controls for persistent clients

* chore(rest): address transport timeout nitpick comments

* chore(config): remove HTTP transport timeout keys from default config

---------

Co-authored-by: local-user <local-user@local>
2026-02-25 17:14:58 +01:00
Arnaud Gourlay
b91b3017da Remove unused dependencies (#8226) 2026-02-25 15:42:11 +01:00
krapcys1-maker
a93fa46532 [snapshot] Avoid leaving replicas in recovery state when shard data is absent (#8179)
* snapshot

* snapshot recovery: remove stale state read in revert guard
2026-02-25 15:38:41 +01:00
krapcys1-maker
2ae58b9b8f fix(collection): close snapshot checksum file before reading (#8219)
Co-authored-by: local-user <local-user@local>
2026-02-25 14:15:13 +01:00
dependabot[bot]
18a7587d4b build(deps): bump rand_distr from 0.5.1 to 0.6.0 (#8148)
* build(deps): bump rand_distr from 0.5.1 to 0.6.0

Bumps [rand_distr](https://github.com/rust-random/rand_distr) from 0.5.1 to 0.6.0.
- [Release notes](https://github.com/rust-random/rand_distr/releases)
- [Changelog](https://github.com/rust-random/rand_distr/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-random/rand_distr/compare/0.5.1...0.6.0)

---
updated-dependencies:
- dependency-name: rand_distr
  dependency-version: 0.6.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Migrate main code base to rand 0.10

* Migrate tests

* Migrate benches

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: timvisee <tim@visee.me>
2026-02-25 14:15:04 +01:00
tellet-q
dfd489b90a Upgrade reqwest to 0.13 and install ring as default rustls CryptoProvider (#8213)
* Upgrade reqwest to 0.13 and install ring as default rustls CryptoProvider

* Do not compile aws-lc-rs

* Update tests

* Revert changes
2026-02-25 12:34:59 +01:00
krapcys1-maker
200675741d fix(segment): guard min_should estimator edge cases (#8217)
Co-authored-by: local-user <local-user@local>
2026-02-25 11:07:34 +01:00
krapcys1-maker
6ee43a2b0f fix(collection): stabilize hw metrics cancellation test (#8218)
Co-authored-by: local-user <local-user@local>
2026-02-25 10:26:31 +01:00
Luis Cossío
4c3b4b8bc7 Fix unused self lint in macos (#8215)
* expect unused self

* Update lib/wal/src/mmap_view_sync.rs

Co-authored-by: Tim Visée <tim+github@visee.me>

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
2026-02-24 18:59:01 -03:00
Luis Cossío
e28543a604 use UniversalRead in ImmutableDenseVectors (#8210)
* use UniversalRead in ImmutableDenseVectors

...renamed from MmapDenseVectors

* remove madvise arg

* async_raw_scorer
2026-02-24 13:55:16 -03:00
xzfc
28d9c5be12 Single edge crate (#8173)
* Fixups of amalgamator

Fix issues that break `qdrant-edge` build process:
- `use … as segment;` - this causes `ast-grep` rules to replace wrong
  paths. So, rename to avoid collisions.
- `#[macro_use]` and `extern crate` required be in the top-level
  `lib.rs`.
- `format!("…", crate::something::…)` - `ast-grep` can't fix paths
  inside macros. Fixed by moving `crate::something::…` out of the macro.

* Add lib/edge/publish workspace and amalgamation script

* Move `lib/edge/examples` into `lib/edge/publish/` workspace

And fix them to use the generated `qdrant-edge` crate.

* Add github workflow

* Cleanup `qdrant-edge` public API

Removes empty modules. Checked by `cargo doc`.
2026-02-24 16:43:59 +00:00
Ivan Pleshkov
6382d1a7d2 remove rocksdb from gpu tests (#8211) 2026-02-24 16:17:26 +01:00
tellet-q
8d50f0a845 Add test for snapshot backpressure freeze (#8197)
* Add test for snapshot backpressure freeze
2026-02-24 15:04:59 +01:00
dependabot[bot]
c24462ec4b build(deps): bump strum from 0.27.2 to 0.28.0 (#8202)
Bumps [strum](https://github.com/Peternator7/strum) from 0.27.2 to 0.28.0.
- [Release notes](https://github.com/Peternator7/strum/releases)
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Peternator7/strum/compare/v0.27.2...v0.28.0)

---
updated-dependencies:
- dependency-name: strum
  dependency-version: 0.28.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 12:14:19 +01:00
Andrey Vasnetsov
949376f240 universal io mmap (#8196)
* [manunal] WIP: universal mmap interface

* [AI + manual]  implement proper error handelling, with `thiserror` instead of `pub type
  UniversalIoError = std::io::Error;` and implement all `todo!()` in MmapUniversal

* [AI]  implement UniversalWrite for MmapUniversal

* review fix: error wording

* review nits

---------

Co-authored-by: Luis Cossío <luis.cossio@outlook.com>
2026-02-24 11:54:57 +01:00
Andrey Vasnetsov
f07897ffd6 do not replicate shard by default if custom initial state is used (#8193) 2026-02-24 11:49:50 +01:00
Ivan Boldyrev
9bf8369a6a Use IdTrackerEnum type instead of dyn IdTracker (#8168)
* Use `IdTrackerEnum` type instead of `dyn IdTracker`

It would allow to be more flexible on the IdTracker trait, making it
dyn-incompatible eventually.

Coauthored with Claude Code.

* Review fixes
2026-02-24 10:53:23 +01:00
dependabot[bot]
a77e81d852 build(deps): bump env_logger from 0.11.8 to 0.11.9 (#8203)
Bumps [env_logger](https://github.com/rust-cli/env_logger) from 0.11.8 to 0.11.9.
- [Release notes](https://github.com/rust-cli/env_logger/releases)
- [Changelog](https://github.com/rust-cli/env_logger/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rust-cli/env_logger/compare/v0.11.8...v0.11.9)

---
updated-dependencies:
- dependency-name: env_logger
  dependency-version: 0.11.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 10:52:17 +01:00
dependabot[bot]
bc9fb90164 build(deps): bump actix-web from 4.12.1 to 4.13.0 (#8201)
Bumps [actix-web](https://github.com/actix/actix-web) from 4.12.1 to 4.13.0.
- [Release notes](https://github.com/actix/actix-web/releases)
- [Changelog](https://github.com/actix/actix-web/blob/main/CHANGES.md)
- [Commits](https://github.com/actix/actix-web/compare/web-v4.12.1...web-v4.13.0)

---
updated-dependencies:
- dependency-name: actix-web
  dependency-version: 4.13.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 10:29:57 +01:00
dependabot[bot]
5a09a7293a build(deps): bump anyhow from 1.0.101 to 1.0.102 (#8206)
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.101 to 1.0.102.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.101...1.0.102)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-version: 1.0.102
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 09:36:01 +01:00
dependabot[bot]
9e5a5f8f8a build(deps): bump serial_test from 3.3.1 to 3.4.0 (#8204)
Bumps [serial_test](https://github.com/palfrey/serial_test) from 3.3.1 to 3.4.0.
- [Release notes](https://github.com/palfrey/serial_test/releases)
- [Commits](https://github.com/palfrey/serial_test/compare/v3.3.1...v3.4.0)

---
updated-dependencies:
- dependency-name: serial_test
  dependency-version: 3.4.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 09:31:36 +01:00
dependabot[bot]
987550c9d6 build(deps): bump syn from 2.0.116 to 2.0.117 (#8205)
Bumps [syn](https://github.com/dtolnay/syn) from 2.0.116 to 2.0.117.
- [Release notes](https://github.com/dtolnay/syn/releases)
- [Commits](https://github.com/dtolnay/syn/compare/2.0.116...2.0.117)

---
updated-dependencies:
- dependency-name: syn
  dependency-version: 2.0.117
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 08:48:58 +01:00
dependabot[bot]
60ecae3097 build(deps): bump memmap2 from 0.9.9 to 0.9.10 (#8207)
Bumps [memmap2](https://github.com/RazrFalcon/memmap2-rs) from 0.9.9 to 0.9.10.
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/RazrFalcon/memmap2-rs/compare/v0.9.9...v0.9.10)

---
updated-dependencies:
- dependency-name: memmap2
  dependency-version: 0.9.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 08:46:54 +01:00
dependabot[bot]
f848bf627a build(deps): bump pyo3 from 0.28.1 to 0.28.2 (#8208)
Bumps [pyo3](https://github.com/pyo3/pyo3) from 0.28.1 to 0.28.2.
- [Release notes](https://github.com/pyo3/pyo3/releases)
- [Changelog](https://github.com/PyO3/pyo3/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyo3/pyo3/compare/v0.28.1...v0.28.2)

---
updated-dependencies:
- dependency-name: pyo3
  dependency-version: 0.28.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-24 08:37:07 +01:00
Luis Cossío
e897da900b add unzip to shell.nix (#8200)
* add `unzip` to deps

* sort
2026-02-23 16:57:03 +00:00
Andrey Vasnetsov
e1b8c05786 [AI] do not extend file before write (#8195) 2026-02-23 16:50:14 +01:00
xzfc
488765007f Use qdrant-rust-stemmers from crates.io (#8199) 2026-02-23 15:22:59 +00:00
Ivan Pleshkov
9f1a6be223 Gridstore non-blocking flush (#8188)
* gridstore unblocked flush

* review remarks
2026-02-23 12:18:14 +01:00
krapcys1-maker
011b890e1e gpu: use c_char pointers for Vulkan names (#8177) 2026-02-23 12:05:56 +01:00
xzfc
e3021a9429 Move github.com/qdrant/wal into lib/wal (#8185)
* Copy github.com/qdrant/wal into lib/wal

Commit: c07fb56ebc8120ebe4e3c602d31ce98f356f4676 2026-02-18

* Clean cruft

* Integrate lib/wal into workspace

* Cargo fmt

* Fix clippy warnings

* Adhere to our conventions

* Fix codespell warnings
2026-02-20 18:02:20 +00:00
Roman Titov
9cad4a4381 Universal I/O (#8183)
* WIP: `UniversalRead`/`UniversalWrite` traits

* fixup! WIP: `UniversalRead`/`UniversalWrite` traits

Relax `Sized` requirement on `UniversalRead`
2026-02-20 18:15:01 +01:00
Roman Titov
05b6b8b9ff Expose field index operations in qdrant-edge-py (#8187) 2026-02-20 17:56:09 +01:00
Arnaud Gourlay
a6c35be384 Fix Docker build for local compatibility tests (#8191) 2026-02-20 16:06:02 +01:00
Arnaud Gourlay
ab1917d634 Storage compatibility v1.17.0 (#8189) 2026-02-20 13:30:24 +01:00
Roman Titov
dca4ccc6d9 Use FsType::ExFat on non-Linux, so that Rust won't complain (#8186) 2026-02-20 11:43:29 +01:00
Daniel Boros
a52a6d91d5 refactor/opt (#8065)
* refactor: opt system

* feat: move tracker seperately

* feat: migrate opt logic to shards

* feat: add OptStrategy trait

* fix: missing drop

* fix: linter error

* fix: clippy errors

* fix: linter error

* fix: missing fns

* fix: linter

* fix: missing import

* fix: missing import

* fix: schema_gen imports

* chore: remove comment

* feat: add missing comments

* feat: restore optimize_segment_propagate_changes fn

* chore: move fs4 to workspace deps

* fix: compiler error

* chore: add import fixes

* feat: move optimzers to shard

* fix: clippy errors

* chore: restore tests and adjust them

* fix: linter issues

* fix: linter issue

* fix: remove CollectionResult where call is infallible

* fix: comment
2026-02-19 23:16:08 +01:00
Tim Visée
7eb57b50e5 Include RocksDB support in Linux binaries we release on GitHub (#8181) 2026-02-19 17:40:39 +01:00
Tim Visée
c73cf450e8 Bump dev version to 1.17.1-dev (#8161) 2026-02-19 13:36:14 +01:00
Arnaud Gourlay
6ea4e74f3d Optimize HNSW plain-search filtered allocation (#8175)
* Optimize HNSW plain-search filtered allocation

* keep comment
2026-02-19 10:58:37 +01:00
Andrey Vasnetsov
ab6cb8e467 missing timeout for payload index ops (#8176) 2026-02-19 10:39:50 +01:00
Tim Visée
8e3880bc2c WAL: advise mmap to cleanup closed segments (#8164) 2026-02-18 17:20:06 +01:00