Commit Graph
1633 Commits
Author SHA1 Message Date
David Sertic 44838980b7 update cluster descriptions 2023-07-18 21:01:58 +02:00
David Sertic d3889e24a6 update main endpoint descriptions 2023-07-18 20:51:01 +02:00
David Sertic 6d3eef9f00 update points descriptions 2023-07-18 20:39:52 +02:00
David Sertic 343b8134fd update service descriptions 2023-07-18 20:34:19 +02:00
David Sertic adfddf3a14 update snapshots descriptions 2023-07-18 20:31:53 +02:00
David Sertic 0ce9cc0df5 update collections descriptions 2023-07-18 20:19:12 +02:00
4827a362e8 Update collection: HNSW config (#2083)
* Add field to REST collection update to change HNSW config

* Add field to gRPC collection update to change HNSW config

* Update OpenAPI specification

* Update gRPC docs

* Improve optimizer filtering for excluded segment IDs

* Add config mismatch optimizer detecting basic HNSW mismatches

* Trigger optimizers when changing collection HNSW config

* Make config mismatch optimizer aware of vector specific HNSW configs

* Extract triggering optimizers after collection update into function

* Add config mismatch optimizer test for changing HNSW config

* Simplify config mismatch optimizer test

* Add config mismatch optimizer test for vector specific HNSW change

* Reformat

* Update collection HNSW params in integration test

* Validate HNSW config in collection update gRPC endpoint

* Improve description of update collection request

* Do not require to rebuild HNSW when on_disk flag changes

Ref: https://github.com/qdrant/qdrant/pull/2083#discussion_r1231002072

* Do rebuild segment with on_disk change

* Trigger optimizers in parallel

* Recreate optimizers only once on collection update

* Reformat

* Fix incorrect usage of self

* Fix deadlock in collection state config update

* Also rebuild index on full scan threshold change

* decompose worst_segment condition check

* review refactor

* Update lib/storage/src/content_manager/collection_meta_ops.rs

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>

* Update lib/api/src/grpc/proto/collections.proto

Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>

* upd grpc docs

* upd grpc docs

* update openapi

---------

Co-authored-by: generall <andrey@vasnetsov.com>
Co-authored-by: Luis Cossío <luis.cossio@qdrant.com>
2023-07-18 14:32:13 +02:00
dependabot[bot] c8837dd753 Bump lukemathwalker/cargo-chef (#2274)
Bumps lukemathwalker/cargo-chef from latest-rust-1.70.0 to latest-rust-1.71.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 08:53:34 +02:00
dependabot[bot] 3154a33ff7 Bump uuid from 1.4.0 to 1.4.1 (#2281)
Bumps [uuid](https://github.com/uuid-rs/uuid) from 1.4.0 to 1.4.1.
- [Release notes](https://github.com/uuid-rs/uuid/releases)
- [Commits](https://github.com/uuid-rs/uuid/compare/1.4.0...1.4.1)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 08:53:14 +02:00
dependabot[bot] d500ffb4f8 Bump clap from 4.3.12 to 4.3.15 (#2284)
Bumps [clap](https://github.com/clap-rs/clap) from 4.3.12 to 4.3.15.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.12...v4.3.15)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:28:52 -04:00
dependabot[bot] ed76952b5d Bump anyhow from 1.0.71 to 1.0.72 (#2276)
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.71 to 1.0.72.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.71...1.0.72)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:26:52 -04:00
dependabot[bot] 617456e76e Bump hashring from 0.3.0 to 0.3.1 (#2280)
Bumps [hashring](https://github.com/jeromefroe/hashring-rs) from 0.3.0 to 0.3.1.
- [Changelog](https://github.com/jeromefroe/hashring-rs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jeromefroe/hashring-rs/compare/0.3.0...0.3.1)

---
updated-dependencies:
- dependency-name: hashring
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:26:10 -04:00
dependabot[bot] 5220110aac Bump serde from 1.0.168 to 1.0.171 (#2282)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.168 to 1.0.171.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.168...v1.0.171)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:25:33 -04:00
dependabot[bot] fe3fa3e121 Bump sysinfo from 0.29.4 to 0.29.5 (#2279)
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.29.4 to 0.29.5.
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GuillaumeGomez/sysinfo/commits)

---
updated-dependencies:
- dependency-name: sysinfo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:24:18 -04:00
dependabot[bot] 46e0e50747 Bump semver from 1.0.17 to 1.0.18 (#2278)
Bumps [semver](https://github.com/dtolnay/semver) from 1.0.17 to 1.0.18.
- [Release notes](https://github.com/dtolnay/semver/releases)
- [Commits](https://github.com/dtolnay/semver/compare/1.0.17...1.0.18)

---
updated-dependencies:
- dependency-name: semver
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:23:52 -04:00
dependabot[bot] cf14f5e8cd Bump serde_json from 1.0.102 to 1.0.103 (#2277)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.102 to 1.0.103.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.102...v1.0.103)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 00:23:28 -04:00
Arnaud Gourlay 855cb32270 Try to fix flaky test_task_stop (#2271)
* Try to fix flaky test

* less strict
2023-07-18 01:25:48 +02:00
Andrey Vasnetsov ed3750afe0 fix python scripts ci (#2283)
* fix python scripts ci

* fix sh script
2023-07-18 00:08:05 +02:00
Andrey Vasnetsov dda8330e15 detect file extension better (#2272)
* detect file extension better

* fix clippy

* refactor + test
2023-07-17 17:10:52 +02:00
Zein Wen 79475ea972 Add geo_polygon filter to proto interface, complete conversion fn, and add an integration test (#2188) 2023-07-17 12:36:50 +02:00
dependabot[bot] 983a2b6edb Bump clap from 4.3.11 to 4.3.12 (#2264)
Bumps [clap](https://github.com/clap-rs/clap) from 4.3.11 to 4.3.12.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v4.3.11...v4.3.12)

---
updated-dependencies:
- dependency-name: clap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 10:59:56 +02:00
dependabot[bot] 054ccc10a7 Bump tar from 0.4.38 to 0.4.39 (#2259)
Bumps [tar](https://github.com/alexcrichton/tar-rs) from 0.4.38 to 0.4.39.
- [Commits](https://github.com/alexcrichton/tar-rs/compare/0.4.38...0.4.39)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 10:59:34 +02:00
dependabot[bot] c44b05b39b Bump geo from 0.25.1 to 0.26.0 (#2263)
Bumps [geo](https://github.com/georust/geo) from 0.25.1 to 0.26.0.
- [Changelog](https://github.com/georust/geo/blob/main/CHANGES.md)
- [Commits](https://github.com/georust/geo/commits)

---
updated-dependencies:
- dependency-name: geo
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-17 10:14:09 +02:00
Andrey Vasnetsov f4943a8267 try to fix flacky macos test (#2261)
* try to fix flacky macos test

* try more threads

* fix conditions for stopable task

* fix test
2023-07-14 14:24:19 +02:00
Tim Visée 69df274d22 Improve flaky stopable task test (#2257)
* Use duration constant

* Loosen requirements for stoppable task

* Add test for 64 concurrent stoppable tasks

* Reformat

* Improve stopping many stoppable tasks a bit

* Change stoppable task test requirements
2023-07-13 21:55:27 +02:00
二手掉包工程师 a0f5f895f7 Align the fmt command with .rusty-hook.toml (#2241)
* Align the fmt command with `.rusty-hook.toml`

Signed-off-by: hi-rustin <rustin.liu@gmail.com>

* Address #[warn(clippy::useless_conversion)]

Signed-off-by: hi-rustin <rustin.liu@gmail.com>

* Address #[warn(clippy::drain_collect)]

Signed-off-by: hi-rustin <rustin.liu@gmail.com>

---------

Signed-off-by: hi-rustin <rustin.liu@gmail.com>
2023-07-13 10:52:01 +02:00
dependabot[bot] 60bb4ec693 Bump serde_json from 1.0.100 to 1.0.102 (#2255)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.100 to 1.0.102.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.100...v1.0.102)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-13 08:05:16 +02:00
Arnaud Gourlay 511b7af6a6 Add missing assertion to shard transfer test (#2254) 2023-07-12 17:44:37 +02:00
Yaroslav Halchenko 6624c95afd codespell: workflow, config, typos fixed (#2248)
* Add github action to codespell master on push and PRs

* Add rudimentary codespell config

* some skips

* fix some ambigous typos

* [DATALAD RUNCMD] run codespell throughout

=== Do not change lines below ===
{
 "chain": [],
 "cmd": "codespell -w",
 "exit": 0,
 "extra_inputs": [],
 "inputs": [],
 "outputs": [],
 "pwd": "."
}
^^^ Do not change lines above ^^^

* Add dev branch as target for the workflow
2023-07-12 16:30:42 +02:00
Tim Visée a0a3620942 Fix stack overflow in segment spinlock (#2250) 2023-07-12 15:36:29 +02:00
Andrey Vasnetsov 38d35361aa use search runtime to do reads in shard transfer (#2252) 2023-07-12 15:36:18 +02:00
Tim Visée c09ebaa658 Fix LlamaIndex integration link in README (#2251) 2023-07-12 10:54:25 +02:00
Andrey Vasnetsov d7209fd1e8 limit transfers scheduling on sync-local-state (#2249) 2023-07-12 10:51:50 +02:00
Taras Tsugrii 3e252492c2 [bench] Reserve vector storage to avoid reallocs. (#2245)
This is particularly useful for microbenchmarks since
1) this cost shouldn't affect benchmark results
2) memory allocations are the largest source of measurement noise
2023-07-11 09:18:38 +02:00
dependabot[bot] 9d7981b295 Bump serde from 1.0.167 to 1.0.168 (#2243)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.167 to 1.0.168.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.167...v1.0.168)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-11 09:18:09 +02:00
Arnaud Gourlay 8fd32e8d28 SegmentSearcher search-in-segment is not async (#2211)
* SegmentSearcher search_in_segment is not async

* keep it iterator style
2023-07-10 15:00:04 +02:00
Andrey Vasnetsov b0aae6d35a upd wal deps (#2237) 2023-07-10 14:36:35 +02:00
Tim Visée c06e60a59d Fix expired TLS certificates in CI tests (#2239)
* Mark certificate generate script as executable

* Update TLS test certificates

* Extend TLS test certificate expiry to 10 years
2023-07-10 14:16:55 +02:00
Arnaud Gourlay 600e16055a Non blocking Scroll and parallel segments runs (#2221)
* Non blocking Scroll and parallel segments runs

* set max number of working threads used by spawn_blocking
2023-07-10 13:41:17 +02:00
Tim Visée 65876f7e8b Also run CI tests on macOS (#2227)
* Also test on macOS

* Remove trailing spaces from GitHub Workflow configurations
2023-07-10 11:36:06 +02:00
Tim Visée 36ef2d718a Fix macOS binary release job (#2228)
* Attempt to fix macOS binary release job

* Trigger release binary jobs on release publish, not on create
2023-07-10 11:35:03 +02:00
Arnaud Gourlay d984d751d7 Fix set payload index to handle type change (#2235) 2023-07-10 11:24:14 +02:00
dependabot[bot] 054ac71337 Bump serde from 1.0.166 to 1.0.167 (#2234)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.166 to 1.0.167.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.166...v1.0.167)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-07 21:05:37 +02:00
dependabot[bot] 49a55486c0 Bump thiserror from 1.0.41 to 1.0.43 (#2233)
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.41 to 1.0.43.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.41...1.0.43)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-07 21:04:54 +02:00
a0ed771409 Fix optimizers stop lock (#2222)
Co-authored-by: Tim Visée <tim+github@visee.me>
Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
2023-07-07 16:06:26 +02:00
Arnaud Gourlay 17b7731a89 Add message to unimplemented! (#2230)
* Add message to unimplemented!

* yield str id as well

* modern syntax
2023-07-07 12:09:50 +02:00
Luis Cossío a77d6775b2 remove unused Serialize derives in build.rs (#2225) 2023-07-07 10:49:41 +02:00
Arnaud Gourlay 4811156798 log HTTP server port at startup (#2224) 2023-07-06 22:20:24 +02:00
Luis Cossío e5510e3d30 remove unused "no_bracket_syntax" error code (#2223) 2023-07-06 15:59:14 -04:00
dependabot[bot] 1f31b31ac1 Bump async-trait from 0.1.70 to 0.1.71 (#2217)
Bumps [async-trait](https://github.com/dtolnay/async-trait) from 0.1.70 to 0.1.71.
- [Release notes](https://github.com/dtolnay/async-trait/releases)
- [Commits](https://github.com/dtolnay/async-trait/compare/0.1.70...0.1.71)

---
updated-dependencies:
- dependency-name: async-trait
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-06 08:39:29 +02:00