upstream-archive/qdrant
1
0
Fork 0
mirror of https://github.com/qdrant/qdrant.git synced 2026-10-03 11:27:37 -05:00
Code Issues Packages Projects Releases Wiki Activity
4,590 Commits 453 Branches 119 Tags
f2d45b558dcb0968b16212bba76792aac2f31010
Commit Graph
1593 Commits
Author SHA1 Message Date
JojiiLuis CossíoLuis CossíoAndrey Vasnetsov
 		26a496b40e BM25 in the Core (#6891) 
* Uncouple tokenizer and TextIndexParams

* Refactor token processing in `TokenizerConfig` (#6912)

* Refactor token processing in TokenizerConfig

* fix max length checking

* [Bm25] Execution implementation (#6939)

* Add Bm25

* Execute BM25 if config available

* cargo format

* Add mocked tests for inference and bm25

* Properly apply InferenceType

* Fix tests

* Review remarks

* Review remarks

* Add overwritten model name fix again

* use enum instead of multiple constants

* ensure handling all fields of InferenceInput in infer_local

---------

Co-authored-by: Luis Cossío <luis.cossio@outlook.com>

* review fixes

* fmt

* spell-check

* deduplicate code

---------

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>
Co-authored-by: Luis Cossío <luis.cossio@outlook.com>
Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
 2025-08-11 13:16:15 +02:00
xzfc b79757d072 Introduce StableHash (#6940) 
* Introduce StableHash

* Use SipHasher24 explicitly
 2025-08-11 13:15:14 +02:00
Andrey Vasnetsov af7ab5b192 bump version to v1.15.1 (#6934) 2025-07-24 09:34:36 +02:00
dependabot[bot] 8b721f4d69 build(deps): bump delegate from 0.13.3 to 0.13.4 (#6914) 2025-07-24 08:46:13 +02:00
dependabot[bot] 5b6fb47cad build(deps): bump cc from 1.2.29 to 1.2.30 (#6920) 2025-07-24 08:46:08 +02:00
dependabot[bot] 9896976479 build(deps): bump sysinfo from 0.36.0 to 0.36.1 (#6919) 
---
updated-dependencies:
- dependency-name: sysinfo
  dependency-version: 0.36.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-24 08:46:03 +02:00
dependabot[bot] 2e69ab0c13 build(deps): bump roaring from 0.11.0 to 0.11.1 (#6921) 2025-07-24 08:45:46 +02:00
dependabot[bot] 336b050c19 build(deps): bump serde_json from 1.0.140 to 1.0.141 (#6915) 2025-07-24 08:45:40 +02:00
dependabot[bot] 536484aeb1 build(deps): bump rand from 0.9.1 to 0.9.2 (#6917) 
---
updated-dependencies:
- dependency-name: rand
  dependency-version: 0.9.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-24 08:45:35 +02:00
dependabot[bot] 17efe03f64 build(deps): bump object_store from 0.12.2 to 0.12.3 (#6918) 
---
updated-dependencies:
- dependency-name: object_store
  dependency-version: 0.12.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-24 08:45:31 +02:00
dependabot[bot] 0f3491f109 build(deps): bump strum from 0.27.1 to 0.27.2 (#6913) 
---
updated-dependencies:
- dependency-name: strum
  dependency-version: 0.27.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-24 08:45:26 +02:00
Tim Visée 137b6c1e4a Bump version to 1.15.0 (#6896) 
* Bump version to 1.15.0

* Update missed cherry picks

* Update redoc to 1.15.0
 2025-07-18 11:06:11 +02:00
Arnaud Gourlay 0dd3d8fccb Bump thread-priority 2.1.0 (#6885) 2025-07-17 14:02:06 +02:00
dependabot[bot] ec4adee327 build(deps): bump ringbuffer from 0.15.0 to 0.16.0 (#6871) 2025-07-17 14:00:03 +02:00
dependabot[bot] 36f97c766c build(deps): bump sysinfo from 0.35.2 to 0.36.0 (#6869) 
---
updated-dependencies:
- dependency-name: sysinfo
  dependency-version: 0.36.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:59:52 +02:00
dependabot[bot] 2646af2f43 build(deps): bump config from 0.15.11 to 0.15.13 (#6870) 
---
updated-dependencies:
- dependency-name: config
  dependency-version: 0.15.13
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:59:47 +02:00
dependabot[bot] 38ba8ba9e0 build(deps): bump memmap2 from 0.9.5 to 0.9.7 (#6867) 
Bumps [memmap2](https://github.com/RazrFalcon/memmap2-rs) from 0.9.5 to 0.9.7.
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/RazrFalcon/memmap2-rs/commits)

---
updated-dependencies:
- dependency-name: memmap2
  dependency-version: 0.9.7
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:59:43 +02:00
dependabot[bot] ec5a5605ef build(deps): bump clap from 4.5.40 to 4.5.41 (#6866) 
---
updated-dependencies:
- dependency-name: clap
  dependency-version: 4.5.41
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:59:38 +02:00
dependabot[bot] 2fe8095e07 build(deps): bump rustls from 0.23.28 to 0.23.29 (#6865) 
Bumps [rustls](https://github.com/rustls/rustls) from 0.23.28 to 0.23.29.
- [Release notes](https://github.com/rustls/rustls/releases)
- [Changelog](https://github.com/rustls/rustls/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rustls/rustls/compare/v/0.23.28...v/0.23.29)

---
updated-dependencies:
- dependency-name: rustls
  dependency-version: 0.23.29
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:59:33 +02:00
Arnaud Gourlay 98867d7735 Bump http 1.3.1 (#6849) 2025-07-17 13:55:49 +02:00
Arnaud Gourlay 80f406239f Bump strum 0.27.1 (#6850) 2025-07-17 13:55:44 +02:00
dependabot[bot] 1cdefd11a6 build(deps): bump cc from 1.2.27 to 1.2.29 (#6823) 
Bumps [cc](https://github.com/rust-lang/cc-rs) from 1.2.27 to 1.2.29.
- [Release notes](https://github.com/rust-lang/cc-rs/releases)
- [Changelog](https://github.com/rust-lang/cc-rs/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/cc-rs/compare/cc-v1.2.27...cc-v1.2.29)

---
updated-dependencies:
- dependency-name: cc
  dependency-version: 1.2.29
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:49:08 +02:00
dependabot[bot] 3789c48901 build(deps): bump reqwest from 0.12.20 to 0.12.22 (#6821) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.12.20 to 0.12.22.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.12.20...v0.12.22)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-version: 0.12.22
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:48:52 +02:00
Roman Titov b8ed6b8807 Upgrade indicatif to 0.18.0 (#6808) 2025-07-17 13:47:25 +02:00
dependabot[bot]andArnaud Gourlay a0384a5445 build(deps): bump charabia from 0.9.3 to 0.9.6 (#6780) 
* build(deps): bump charabia from 0.9.3 to 0.9.6

Bumps [charabia](https://github.com/meilisearch/charabia) from 0.9.3 to 0.9.6.
- [Release notes](https://github.com/meilisearch/charabia/releases)
- [Commits](https://github.com/meilisearch/charabia/compare/v0.9.3...v0.9.6)

---
updated-dependencies:
- dependency-name: charabia
  dependency-version: 0.9.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* cargo update jieba-rs

* fix chinese tokenizer tests

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Arnaud Gourlay <arnaud.gourlay@gmail.com>
 2025-07-17 13:46:02 +02:00
Ivan Pleshkov bd273ab68f Merge pull request #6728 
* # This is a combination of 7 commits.

* SameAsStorage default value

* fix coderabbit warnings

* neon for u8 bq

* sse for u8 bq

* fix windows build

* rename function

* add comments

* fmt

* fix arm build

* review remarks
 2025-07-17 13:45:51 +02:00
Arnaud Gourlay abb57baf96 bump tower-http-0.6.6 (0.6.5 yanked) (#6799) 2025-07-17 13:42:21 +02:00
Roman Titov bda74ceae2 Create custom shards in Initializing state instead of Active (#6778) 2025-07-17 13:39:59 +02:00
Jojiiandgenerall 8fa3dd4478 Implement stemming (#6770) 
* Implement stemming

* minor fix

* Add openapi specs

* Fix import

* Fix Test, rename API type

* update openapi

* fix rest models

* Review remarks

* Minor code cleanup

* make grpc naming aligned with Rest + use master branch for dependencies

* grpc docs

* use tagged version

---------

Co-authored-by: generall <andrey@vasnetsov.com>
 2025-07-17 13:38:36 +02:00
dependabot[bot] d50e6e10a1 build(deps): bump indexmap from 2.9.0 to 2.10.0 (#6781) 
Bumps [indexmap](https://github.com/indexmap-rs/indexmap) from 2.9.0 to 2.10.0.
- [Changelog](https://github.com/indexmap-rs/indexmap/blob/main/RELEASES.md)
- [Commits](https://github.com/indexmap-rs/indexmap/compare/2.9.0...2.10.0)

---
updated-dependencies:
- dependency-name: indexmap
  dependency-version: 2.10.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:36:17 +02:00
dependabot[bot] da7ba2a8da build(deps): bump indicatif from 0.17.11 to 0.17.12 (#6782) 
Bumps [indicatif](https://github.com/console-rs/indicatif) from 0.17.11 to 0.17.12.
- [Release notes](https://github.com/console-rs/indicatif/releases)
- [Commits](https://github.com/console-rs/indicatif/compare/0.17.11...0.17.12)

---
updated-dependencies:
- dependency-name: indicatif
  dependency-version: 0.17.12
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:36:12 +02:00
JojiiandAndrey Vasnetsov a44801b14d Implement new multilingual tokenizer (#6762) 
* Implement new multilingual tokenizer

* Remove unnecessary clones

* Codespell

* filter stopwords before stemmer

* Fix Chinese stopwords (#6765)

* Fix Chinese stopwords

* remove todo

---------

Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
 2025-07-17 13:34:44 +02:00
JojiiLuis Cossíogenerall
 		edc299b0cb Add new multilingual tokenizer (#6678) 
* Add new tokenizer for multilingual

* Make codespell happy

* improve handling of when to apply stemming

* Fix stemming implementation

* Fix Japanese language detection. Add tests for MultilingualV2

* Update lib/segment/src/index/field_index/full_text_index/tokenizers/japanese.rs

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>

* Update lib/segment/src/index/field_index/full_text_index/tokenizers/japanese.rs

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>

* Update lib/segment/src/index/field_index/full_text_index/tokenizers/multilingual.rs

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>

* Make init() private

* move model into segment, filter non-alphanumeric tokens

* fmt

* exclude punctuation from tokenizer result

* fm

---------

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>
Co-authored-by: generall <andrey@vasnetsov.com>
 2025-07-17 13:25:31 +02:00
Luis Cossíoandtimvisee ad936a463c [phrase matching] expose phrase condition (#6670) 
* add `"match": { "phrase": ... }` condition

* gen grpc and openapi

* [phrase matching] expose `phrase_matching` flag in rest and grpc (#6620)

* expose setting in rest and grpc

* phrase matching openapi test

* regen openapi

* [phrase matching] Text index fixes (#6730)

* allow rocksdb-based immutable text index

* fix repeated-token phrases

* fmt

* Update OpenAPI spec

---------

Co-authored-by: timvisee <tim@visee.me>

* add repeated word case in openapi test

* [phrase match | strict mode] Allow phrase condition when enabled in index (#6749)

* allow phrase filter when index is present

* prettier error message

* clippppppy

---------

Co-authored-by: timvisee <tim@visee.me>
 2025-07-17 13:25:12 +02:00
dependabot[bot] ea9b3a2cfb build(deps): bump io-uring from 0.7.7 to 0.7.8 (#6741) 
Bumps [io-uring](https://github.com/tokio-rs/io-uring) from 0.7.7 to 0.7.8.
- [Commits](https://github.com/tokio-rs/io-uring/commits)

---
updated-dependencies:
- dependency-name: io-uring
  dependency-version: 0.7.8
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:20:46 +02:00
Tim Visée 09142835f5 Bump Cargo.lock (#6751) 2025-07-17 13:20:40 +02:00
dependabot[bot] 1a2eca7d5a build(deps): bump env_logger from 0.11.6 to 0.11.8 (#6748) 2025-07-17 13:20:33 +02:00
dependabot[bot] 6c48a694fb build(deps): bump roaring from 0.10.12 to 0.11.0 (#6744) 2025-07-17 13:20:28 +02:00
dependabot[bot] 62edd2dee5 build(deps): bump prettyplease from 0.2.34 to 0.2.35 (#6745) 2025-07-17 13:20:18 +02:00
dependabot[bot] cce9009c50 build(deps): bump lz4_flex from 0.11.4 to 0.11.5 (#6746) 2025-07-17 13:20:13 +02:00
dependabot[bot] 5452cf614a build(deps): bump zerocopy from 0.8.25 to 0.8.26 (#6747) 2025-07-17 13:20:08 +02:00
dependabot[bot] 96b2750622 build(deps): bump libc from 0.2.173 to 0.2.174 (#6742) 
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.173 to 0.2.174.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Changelog](https://github.com/rust-lang/libc/blob/0.2.174/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.173...0.2.174)

---
updated-dependencies:
- dependency-name: libc
  dependency-version: 0.2.174
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:20:02 +02:00
xzfc 847bc2faf6 Fix CI cargo --locked build (#6732) 2025-07-17 13:17:20 +02:00
xzfc 85f74b459f Add hnsw_incremental_build benchmark (#6615) 2025-07-17 13:17:15 +02:00
Arnaud Gourlay c7c1f397ac Fix CI cargo --locked build (#6712) 2025-07-17 13:14:26 +02:00
dependabot[bot] 6d541814d1 build(deps): bump sysinfo from 0.33.1 to 0.35.2 (#6698) 
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.33.1 to 0.35.2.
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GuillaumeGomez/sysinfo/compare/v0.33.1...v0.35.2)

---
updated-dependencies:
- dependency-name: sysinfo
  dependency-version: 0.35.2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-07-17 13:14:15 +02:00
dependabot[bot] 9bd8252028 build(deps): bump libc from 0.2.172 to 0.2.173 (#6706) 2025-07-17 13:14:10 +02:00
dependabot[bot] 31708ddd87 build(deps): bump syn from 2.0.101 to 2.0.103 (#6703) 2025-07-17 13:14:05 +02:00
dependabot[bot] ac0ae20ebb build(deps): bump rustls from 0.23.27 to 0.23.28 (#6705) 2025-07-17 13:13:59 +02:00
dependabot[bot] f1361c449e build(deps): bump lz4_flex from 0.11.3 to 0.11.4 (#6702) 2025-07-17 13:13:45 +02:00