Commit Graph

4607 Commits

Author SHA1 Message Date
dependabot[bot]
42c500eae7 build(deps): bump cc from 1.2.32 to 1.2.33 (#7091)
Bumps [cc](https://github.com/rust-lang/cc-rs) from 1.2.32 to 1.2.33.
- [Release notes](https://github.com/rust-lang/cc-rs/releases)
- [Changelog](https://github.com/rust-lang/cc-rs/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/cc-rs/compare/cc-v1.2.32...cc-v1.2.33)

---
updated-dependencies:
- dependency-name: cc
  dependency-version: 1.2.33
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-19 08:46:20 +02:00
xzfc
8ea1ef6e39 Add AI review rules (#7080) 2025-08-18 16:13:54 +00:00
Ivan Pleshkov
3f75fae516 EncodedStorage upsert vector (#7048)
* EncodedStorage upsert vector
2025-08-18 17:39:23 +02:00
xzfc
acfdf02da8 Optional scorer methods via TBool (#6989)
* Add common::typelevel module

* Use common::typelevel for score_bytes

* Revert "Split FilteredScorer into FilteredScorer and FilteredQuantizedScorer"

This reverts commit ff3a93ee95.

* FilteredQuantizedScorer

* Extract `struct Filters` from `FilteredScorer` and `FilteredQuantizedScorer`

* Revert "QuantizedVectors::query_scorer_bytes"

This reverts commit 9dee824afd.

* Partial revert "Add QueryScorerBytes::score_bytes"

This reverts commit d80af4f698, but keeps
the QueryScorerBytes trait while removing implementations.

* Partial revert "Add EncodedVectorsBytes::score_point_vs_bytes"

This partially reverts commit c741e42f9a.
- trait `EncodedVectorsBytes` and its implementations: reverted/removed
- calls to `EncodedVectorsBytes::score_point_vs_bytes`: replaced with
  calls to `EncodedVectors::score_bytes`

* Remove unused method FilteredScorer::new_from_raw
2025-08-18 14:40:12 +00:00
Roman Titov
4bcb21b4b7 Cleanup collection::operations and shard::operations modules (#7064) 2025-08-18 16:26:06 +02:00
Jai
57ae0dd044 Fix criterion batch_query_bench (#6825) (#7077) 2025-08-18 15:16:30 +02:00
Ivan Pleshkov
8961eeaf0a Remove quantization save functions (#7043)
* remove quantization save

* revert convert_binary_encoding fn

* review remarks

* review remark

* review remarks
2025-08-18 13:55:07 +02:00
Roman Titov
13b05d18a3 Extract CollectionUpdateOperations into separate shard crate (#7054) 2025-08-18 11:48:02 +02:00
Andrey Vasnetsov
4eea3512fc do not skip empty histogram values + remove too small buckets (#7073)
* do not skip empty histogram values + remove too small buckets

* fix tests and remove some more values from the histogram

* remove redundant test
2025-08-18 11:19:41 +02:00
Roman Titov
2c9c39b4c1 Move SegmentHolder::scroll_read_lock to LocalShard::scroll_read_lock (#7053) 2025-08-18 09:56:34 +02:00
Ivan Pleshkov
995db9462f Bq encoding conversions as a separate function (#7070)
* bq encoding conversions as a separate function

* rename

* rename
2025-08-15 16:49:40 +02:00
Andrey Vasnetsov
c188f5b7c4 Update if (#7006)
* implement condition parameter for upsert operation

* fmt

* update api schema

* implement conditional update for update-vectors op

* rename to update_filter for consistency

* add tests

* explicilty ignore strict mode for conditional updates

* rabbit review fix

* Also assert vector element before, confirm we don't normalize

* Simplify filter creation using new helper

* Rename merge_with_ids to with_point_ids

---------

Co-authored-by: timvisee <tim@visee.me>
Co-authored-by: Tim Visée <tim+github@visee.me>
2025-08-15 15:47:43 +02:00
Luis Cossío
9973e41b0a add consistency param for count api in openapi (#6905)
* add consistency param to openapi spec for count api

* reorder query params: collection_name -> consistency -> timeout
2025-08-14 10:38:53 -04:00
Sid-Ahmed
fed67b7942 fix(core): optimize OCI Layers (#7005)
* fix(core): optimize OCI Layers

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>

* fix(core): optimize OCI Layers

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>

* fix(core): optimize OCI Layers

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>

---------

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>
Co-authored-by: Sid Ahmed DJELLALI <s.djellali@cyberdian.fr>
2025-08-14 16:16:18 +02:00
Ivan Pleshkov
0d1b0ead53 Use PointOffsetType in quantization (#7058)
* Use PointOffsetType in quantization

* review remarks

* review remarks
2025-08-14 16:16:08 +02:00
Tim Visée
60cf81fa64 Bump dev version to v1.15.4-dev (#7062) 2025-08-14 15:57:43 +02:00
Tim Visée
6bc846cfec Fix clippy warnings when compiling without RocksDB feature flag (#7059) 2025-08-14 14:25:57 +02:00
Andrey Vasnetsov
4a3008e77a Fix bm25 params (#7056)
* make bm25 parameters compatible with default fastembed params

* bm25 params in openapi schema

* fmt

* improve bm25 config deserialization

* more explicit docstring for disabling english
2025-08-14 14:23:29 +02:00
Luis Cossío
bd448eb580 make Gridstore::iter iterate by owned values (#7045) 2025-08-14 10:54:39 +02:00
Tim Visée
0deb1a40de In payload indices, make storage non optional (#7041)
* Make numeric index storage non optional

* Make map index storage non optional

* Make full text index storage non optional

* Remove unnecessary option

* Make geo index storage non optional

* Make bool index storage non optional

* Remove unnecessary result

* Make null index storage non optional
2025-08-14 09:52:46 +02:00
Tim Visée
e15fb6c90d Remove load function in payload indices (#7040)
* Remove load functions from numeric index

* Remove load functions from map index

* Remove unnecessary result and option

* Remove load functions from full text index

* Remove load functions from geo index

* Remove unnecessary result and option

* Remove load functions from bool index

* Remove load functions from null index

* Don't invoke load when loading payload indices, remove load from trait
2025-08-14 09:18:11 +02:00
Tim Visée
3e09dbb83a Open and load bool payload indices in single stage (#7039)
* Open and load simple bool index in single stage

* Open and load mutable bool index in single stage

* Open and load mutable null index in single stage

* Refactor index selector, don't return early
2025-08-13 17:37:54 +02:00
Tim Visée
c3b5fd0e87 Open and load geo payload indices in single stage (#7038)
* Open and load mutable geo index in single stage

* Open and load immutable geo index in single stage

* Open and load mmap geo index in single stage
2025-08-13 16:59:53 +02:00
Jojii
290f9e2675 Always load InferenceService (#7050)
* Always load InferenceService

* Add BM25 openapi test

* Add warning to development.yaml config (#7051)
2025-08-13 16:59:42 +02:00
xzfc
23dd2bbbfb shell.nix: switch to rustup (#7049)
* shell.nix: npins upgrade

* shell.nix: bump to rust 1.89

* shell.nix: use rustup instead of fenix
2025-08-13 12:09:12 +00:00
Ivan Pleshkov
7eb562e891 Quantization flusher (#7046)
* quantization flusher

* review remarks
2025-08-13 12:57:16 +02:00
Jojii
152bc5ef10 Improve h-sum in dot_avx calculation (#7002)
* Reduce amount of h-sum calculations in dot_avx

* Improve HSUM calculation and apply 4way-hsum to other places
2025-08-13 12:21:27 +02:00
Guglielmo
c22a58264a fix criterion sparse_index_build #6826 (#7044)
sparse_index_build: change config type from ImmutableRam to MutableRam (#6826)
2025-08-13 12:09:36 +02:00
Kacper Łukawski
c5452933a2 Improve description of full_scan_threshold (#7033)
* Improve description of full_scan_threshold in configuration

* Update OpenAPI spec

* edit in grpc

* coderabbit nit

---------

Co-authored-by: timvisee <tim@visee.me>
Co-authored-by: Luis Cossío <luis.cossio@outlook.com>
2025-08-13 12:02:40 +02:00
Tim Visée
190f6f1ae6 Open and load full text payload indices in single stage (#7004)
* Open and load mutable full text index in single stage

* Open and load immutable full text index in single stage

* Open and load mmap full text index in single stage
2025-08-13 10:53:34 +02:00
Tim Visée
33d8d1135c Open and load map payload indices in single stage (#7003)
* Open and load mutable map index in single stage

* Open and load immutable map index in single stage

* Open and load mmap map index in single stage
2025-08-13 10:32:05 +02:00
Tim Visée
e0fc16db82 Open and load numeric payload indices in single stage (#6999)
* In struct payload index open, use option to specify loaded, set rebuild

* Open and load mutable numeric index in single stage

* Open and load immutable numeric index in single stage

* Open and load mmap numeric index in single stage

* new_null_index always returns null index

Missing refactor for MutableNullIndex. Since we have the
`create_if_missing` flag, we no longer have `open_if_exists` function,
ergo, signature for `new_null_index` should not include an `Option`.

---------

Co-authored-by: Luis Cossío <luis.cossio@outlook.com>
2025-08-13 10:08:59 +02:00
dependabot[bot]
1b06abf063 build(deps): bump rustls from 0.23.29 to 0.23.31 (#7042)
Bumps [rustls](https://github.com/rustls/rustls) from 0.23.29 to 0.23.31.
- [Release notes](https://github.com/rustls/rustls/releases)
- [Changelog](https://github.com/rustls/rustls/blob/main/CHANGELOG.md)
- [Commits](https://github.com/rustls/rustls/compare/v/0.23.29...v/0.23.31)

---
updated-dependencies:
- dependency-name: rustls
  dependency-version: 0.23.31
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 16:26:14 +02:00
Ivan Pleshkov
1616806b8f BQ features without vector stats (#7009)
* bq all features without vector stats

* fix tests

* review suggestions

---------

Co-authored-by: generall <andrey@vasnetsov.com>
2025-08-12 14:58:43 +02:00
Tim Visée
8c1a01724f Bump dev version to v1.15.3-dev (#7014) 2025-08-12 13:45:34 +02:00
Arnaud Gourlay
b4b2624e2c Update actix-web-validator 0.7.0 (#7017) 2025-08-12 13:45:20 +02:00
dependabot[bot]
4ed846a7d4 build(deps): bump pprof from 0.14.0 to 0.14.1 (#7037)
Bumps [pprof](https://github.com/tikv/pprof-rs) from 0.14.0 to 0.14.1.
- [Changelog](https://github.com/tikv/pprof-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tikv/pprof-rs/commits)

---
updated-dependencies:
- dependency-name: pprof
  dependency-version: 0.14.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 13:44:40 +02:00
dependabot[bot]
18e7d18551 build(deps): bump proc-macro2 from 1.0.95 to 1.0.96 (#7036)
Bumps [proc-macro2](https://github.com/dtolnay/proc-macro2) from 1.0.95 to 1.0.96.
- [Release notes](https://github.com/dtolnay/proc-macro2/releases)
- [Commits](https://github.com/dtolnay/proc-macro2/compare/1.0.95...1.0.96)

---
updated-dependencies:
- dependency-name: proc-macro2
  dependency-version: 1.0.96
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 13:44:13 +02:00
dependabot[bot]
3e9f1604ef build(deps): bump ecow from 0.2.5 to 0.2.6 (#7035)
Bumps [ecow](https://github.com/typst/ecow) from 0.2.5 to 0.2.6.
- [Release notes](https://github.com/typst/ecow/releases)
- [Commits](https://github.com/typst/ecow/compare/v0.2.5...v0.2.6)

---
updated-dependencies:
- dependency-name: ecow
  dependency-version: 0.2.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 13:44:02 +02:00
Ivan Pleshkov
d31cd696bb wrap quantization chunked vectors (#7011) 2025-08-12 13:30:54 +02:00
Ivan Pleshkov
a3e457d387 Wrap quantization Vec<u8> in a separate structure (#7013)
* separate struct for vec u8 quantization storage

* cgf testing for test storage
2025-08-12 13:20:48 +02:00
dependabot[bot]
583217dac1 build(deps): bump prettyplease from 0.2.35 to 0.2.36 (#7034)
Bumps [prettyplease](https://github.com/dtolnay/prettyplease) from 0.2.35 to 0.2.36.
- [Release notes](https://github.com/dtolnay/prettyplease/releases)
- [Commits](https://github.com/dtolnay/prettyplease/compare/0.2.35...0.2.36)

---
updated-dependencies:
- dependency-name: prettyplease
  dependency-version: 0.2.36
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 12:12:56 +02:00
dependabot[bot]
8ec5d041f1 build(deps): bump uuid from 1.17.0 to 1.18.0 (#7021)
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.17.0 to 1.18.0.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/v1.17.0...v1.18.0)

---
updated-dependencies:
- dependency-name: uuid
  dependency-version: 1.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 11:25:36 +02:00
dependabot[bot]
593e107ef0 build(deps): bump tokio-util from 0.7.15 to 0.7.16 (#7023)
Bumps [tokio-util](https://github.com/tokio-rs/tokio) from 0.7.15 to 0.7.16.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-util-0.7.15...tokio-util-0.7.16)

---
updated-dependencies:
- dependency-name: tokio-util
  dependency-version: 0.7.16
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 11:08:18 +02:00
dependabot[bot]
90f39208c9 build(deps): bump actions/download-artifact from 4 to 5 (#7018)
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 4 to 5.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 11:02:15 +02:00
dependabot[bot]
8ffae5b2cb build(deps): bump actions/checkout from 4 to 5 (#7026)
Bumps [actions/checkout](https://github.com/actions/checkout) from 4 to 5.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 11:00:41 +02:00
dependabot[bot]
580e0eadd6 build(deps): bump bytemuck from 1.23.1 to 1.23.2 (#7020) 2025-08-12 06:46:50 +00:00
dependabot[bot]
f2f42b8593 build(deps): bump clap from 4.5.41 to 4.5.43 (#7028)
Bumps [clap](https://github.com/clap-rs/clap) from 4.5.41 to 4.5.43.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/clap_complete-v4.5.41...clap_complete-v4.5.43)

---
updated-dependencies:
- dependency-name: clap
  dependency-version: 4.5.43
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 08:17:01 +02:00
dependabot[bot]
39849018b7 build(deps): bump io-uring from 0.7.8 to 0.7.9 (#7027)
Bumps [io-uring](https://github.com/tokio-rs/io-uring) from 0.7.8 to 0.7.9.
- [Commits](https://github.com/tokio-rs/io-uring/commits)

---
updated-dependencies:
- dependency-name: io-uring
  dependency-version: 0.7.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 08:07:07 +02:00
dependabot[bot]
b264f62961 build(deps): bump sysinfo from 0.36.1 to 0.37.0 (#7029)
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.36.1 to 0.37.0.
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GuillaumeGomez/sysinfo/compare/v0.36.1...v0.37.0)

---
updated-dependencies:
- dependency-name: sysinfo
  dependency-version: 0.37.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 08:06:08 +02:00