Ivan Pleshkov
2aff9fc8a3
vector index as enum
2023-03-08 21:02:59 +00:00
Ivan Pleshkov
41d5ecd63b
separate payload and vector index bases
2023-03-08 20:00:08 +00:00
Tim Visée
3caab75386
Make gcc-multilib optional in Docker build ( #1531 )
2023-03-07 17:03:20 +01:00
Andrey Vasnetsov
167fb518da
Fix recover snapshot peer ( #1534 )
...
* allow to recover distributed snapshot on local intance + allow recover non-existing collections
* async snapshot recovery
* fix tests
* be polite earlier
2023-03-07 17:03:01 +01:00
Andrey Vasnetsov
4f74c74998
Fix connections flood bug ( #1522 )
...
* fixed excessive requests during search
* fmt
2023-03-04 21:49:43 +01:00
Ivan Pleshkov and Andrey Vasnetsov
5174388ab4
integrate quantized data to storages ( #1311 )
...
* integrate quantized data to storages
* revert gitignore
* are you happy clippy
* quantize in optimizer
* provide flag
* fix segfault
* skip quantization flag, update scores
* use quantization flag
* are you happy fmt
* use quantization flag
* quantized search test
* are you happy fmt
* refactor test, refactor scorer choosing
* are you happy fmt
* run quantization on segment builder
* decrease testing parameters
* simplify segment
* update version
* remove use_quantization flag
* provide quantization config
* quantization version up
* euclid dist
* add euclid test
* saveload
* fix initialization bugs
* quantization lib version up
* fix arm build
* refactor scorer selecting
* quant lib version up
* are you happy fmt
* are you happy fmt
* are you happy clippy
* add save/load test for simple storage
* add comments
* quantiles
* quantization mmap
* remove f32
* mmap test
* fix mmap slice
* fix mmap test
* use chunks for quantization storage
* fix build
* are you happy fmt
* update quantization library
* update quantization lib
* update quantization lib
* integrate api changes
* are you happy fmt
* change quantization api
* additional checks in tests
* update quantization version
* fix unit tests
* add quantization to storage config
* use quantization for all cardinality search cases
* Integrate quantization suggestions 2 (#1520 )
* review api
* wip: refactor quantization integrations
* wip: refactor quantization integrations
* wip: fmt
* include quantization into snapshot
* fmt
---------
Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com >
2023-03-03 17:46:17 +01:00
dependabot[bot]
2f21b05c4c
Bump tokio from 1.25.0 to 1.26.0 ( #1517 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.25.0 to 1.26.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.25.0...tokio-1.26.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-03 08:18:04 +01:00
Arnaud Gourlay
d13e38dcff
Wait for all shards to be active in when testing collection recovery ( #1508 )
2023-03-01 14:29:30 +01:00
Ivan Pleshkov
83efed1fcf
fix windows warning unused parallel_graph_build ( #1513 )
2023-03-01 11:10:22 +01:00
dependabot[bot]
b5ded897a2
Bump atomicwrites from 0.3.1 to 0.4.0 ( #1511 )
...
Bumps [atomicwrites](https://github.com/untitaker/rust-atomicwrites ) from 0.3.1 to 0.4.0.
- [Release notes](https://github.com/untitaker/rust-atomicwrites/releases )
- [Commits](https://github.com/untitaker/rust-atomicwrites/compare/0.3.1...0.4.0 )
---
updated-dependencies:
- dependency-name: atomicwrites
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-01 08:35:21 +01:00
dependabot[bot]
dae1507f7a
Bump clap from 4.1.6 to 4.1.8 ( #1510 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.1.6 to 4.1.8.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.1.6...v4.1.8 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-01 07:17:32 +01:00
dependabot[bot]
830c0bf8d5
Bump prost-types from 0.11.6 to 0.11.8 ( #1509 )
...
Bumps [prost-types](https://github.com/tokio-rs/prost ) from 0.11.6 to 0.11.8.
- [Release notes](https://github.com/tokio-rs/prost/releases )
- [Commits](https://github.com/tokio-rs/prost/compare/v0.11.6...v0.11.8 )
---
updated-dependencies:
- dependency-name: prost-types
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-01 07:17:03 +01:00
dependabot[bot]
dcc53f0278
Bump actix-web from 4.3.0 to 4.3.1 ( #1503 )
...
Bumps [actix-web](https://github.com/actix/actix-web ) from 4.3.0 to 4.3.1.
- [Release notes](https://github.com/actix/actix-web/releases )
- [Changelog](https://github.com/actix/actix-web/blob/master/CHANGES.md )
- [Commits](https://github.com/actix/actix-web/compare/web-v4.3.0...web-v4.3.1 )
---
updated-dependencies:
- dependency-name: actix-web
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-28 11:05:40 +01:00
Andrey Vasnetsov
791f6c33c1
allow to use optimizer_config rest api, to avoid confusion with param name in collection_info api ( #1507 )
2023-02-28 10:20:32 +01:00
dependabot[bot]
d6e6d75ff1
Bump schemars from 0.8.11 to 0.8.12 ( #1505 )
...
Bumps [schemars](https://github.com/GREsau/schemars ) from 0.8.11 to 0.8.12.
- [Release notes](https://github.com/GREsau/schemars/releases )
- [Changelog](https://github.com/GREsau/schemars/blob/master/CHANGELOG.md )
- [Commits](https://github.com/GREsau/schemars/compare/v0.8.11...v0.8.12 )
---
updated-dependencies:
- dependency-name: schemars
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-28 09:51:03 +01:00
dependabot[bot]
b419a5929b
Bump tempfile from 3.3.0 to 3.4.0 ( #1506 )
...
Bumps [tempfile](https://github.com/Stebalien/tempfile ) from 3.3.0 to 3.4.0.
- [Release notes](https://github.com/Stebalien/tempfile/releases )
- [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS )
- [Commits](https://github.com/Stebalien/tempfile/commits )
---
updated-dependencies:
- dependency-name: tempfile
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-28 09:50:24 +01:00
dependabot[bot]
5acc496462
Bump prost from 0.11.7 to 0.11.8 ( #1504 )
...
Bumps [prost](https://github.com/tokio-rs/prost ) from 0.11.7 to 0.11.8.
- [Release notes](https://github.com/tokio-rs/prost/releases )
- [Commits](https://github.com/tokio-rs/prost/commits/v0.11.8 )
---
updated-dependencies:
- dependency-name: prost
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-28 09:49:26 +01:00
Arnaud Gourlay
ea485a9029
Fix condition check for values_count ( #1502 )
2023-02-28 09:47:28 +01:00
Andrey Vasnetsov
65953b85d4
allow null in snapshot priority ( #1493 )
2023-02-24 00:44:05 +01:00
dependabot[bot]
6840df3de1
Bump prost from 0.11.6 to 0.11.7 ( #1495 )
...
Bumps [prost](https://github.com/tokio-rs/prost ) from 0.11.6 to 0.11.7.
- [Release notes](https://github.com/tokio-rs/prost/releases )
- [Commits](https://github.com/tokio-rs/prost/commits )
---
updated-dependencies:
- dependency-name: prost
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-23 21:18:10 +01:00
Arnaud Gourlay and Andrey Vasnetsov
2770a24766
Nested payload filters ( #1487 )
...
* Nested payload filters
* close ToDo + add parsing of multuiple array values
* fmt
* improve testing nested arrays
* fix NumericIndex to accumulate points_to_values mapping
* revert numberic index + strict array field access
---------
Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com >
2023-02-23 15:57:12 +01:00
Roman Titov
77f2acd11e
Fix collection recovery during Raft snapshot application ( #1475 )
...
- Fix remote shards state recovery during Raft snapshot application
- Fix local shards data recovery during Raft snapshot application
- Refactor `test_collection_recovery` test
2023-02-23 23:13:22 +10:00
Andrey Vasnetsov
5849adca91
add listener shard state ( #1482 )
...
* add listener shard state
* add to config
* add test
2023-02-23 14:11:59 +01:00
dependabot[bot]
a2ff17dc7f
Bump memmap2 from 0.5.9 to 0.5.10 ( #1491 )
...
Bumps [memmap2](https://github.com/RazrFalcon/memmap2-rs ) from 0.5.9 to 0.5.10.
- [Release notes](https://github.com/RazrFalcon/memmap2-rs/releases )
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/RazrFalcon/memmap2-rs/compare/v0.5.9...v0.5.10 )
---
updated-dependencies:
- dependency-name: memmap2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-23 10:56:20 +01:00
dependabot[bot]
1653292e81
Bump pprof from 0.11.0 to 0.11.1 ( #1490 )
...
Bumps [pprof](https://github.com/tikv/pprof-rs ) from 0.11.0 to 0.11.1.
- [Release notes](https://github.com/tikv/pprof-rs/releases )
- [Changelog](https://github.com/tikv/pprof-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tikv/pprof-rs/compare/v0.11.0...v0.11.1 )
---
updated-dependencies:
- dependency-name: pprof
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-22 22:02:32 +01:00
Andrey Vasnetsov
45b441a896
manage number of working htreads a bit better ( #1485 )
2023-02-21 15:32:29 +01:00
dependabot[bot]
98d34ea340
Bump http from 0.2.8 to 0.2.9 ( #1480 )
...
Bumps [http](https://github.com/hyperium/http ) from 0.2.8 to 0.2.9.
- [Release notes](https://github.com/hyperium/http/releases )
- [Changelog](https://github.com/hyperium/http/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hyperium/http/compare/v0.2.8...v0.2.9 )
---
updated-dependencies:
- dependency-name: http
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-20 09:48:31 +01:00
dependabot[bot]
349bdfe40f
Bump memmap2 from 0.5.8 to 0.5.9 ( #1479 )
...
Bumps [memmap2](https://github.com/RazrFalcon/memmap2-rs ) from 0.5.8 to 0.5.9.
- [Release notes](https://github.com/RazrFalcon/memmap2-rs/releases )
- [Changelog](https://github.com/RazrFalcon/memmap2-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/RazrFalcon/memmap2-rs/compare/v0.5.8...v0.5.9 )
---
updated-dependencies:
- dependency-name: memmap2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-20 09:48:15 +01:00
Arnaud Gourlay
3803af502d
Access payload key through nested Array ( #1465 )
...
* Access payload key through nested Array
* support removal through array index
* propagate type changes
* fmt
* avoid allocating Vec of one element
2023-02-17 17:41:28 +01:00
dependabot[bot]
614564a09c
Bump clap from 4.1.4 to 4.1.6 ( #1474 )
...
Bumps [clap](https://github.com/clap-rs/clap ) from 4.1.4 to 4.1.6.
- [Release notes](https://github.com/clap-rs/clap/releases )
- [Changelog](https://github.com/clap-rs/clap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/clap-rs/clap/compare/v4.1.4...v4.1.6 )
---
updated-dependencies:
- dependency-name: clap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-16 10:01:57 +01:00
Luis Cossío and Andrey Vasnetsov
c15fec2a2a
feat: add "any" to "match" statements ( #1466 )
...
* feat: add "any" to "match" statements
Adds support for using "any" to match on a list of different possible values
* enable proper counting in cardinality estimation
* fmt
* upd OpenAPI
---------
Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com >
2023-02-15 11:11:20 +01:00
Roman Titov
cf04b1a92b
Add /cluster/recover API endpoint ( #1451 )
...
- Add required internal `raft::raw_node::RawNode::report_snapshot` calls
- Add methods to propagate `raft::raw_node::RawNode::request_snapshot` call to the consensus thread
- Add `/cluster/recover` API endpooint
- Add `test_collection_recovery.py` integration test (disabled on CI; documents current, incorrect behavior)
2023-02-15 04:19:11 +10:00
dependabot[bot]
479675a6cd
Bump lukemathwalker/cargo-chef ( #1469 )
...
Bumps lukemathwalker/cargo-chef from latest-rust-1.67.0 to latest-rust-1.67.1.
---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-13 22:22:08 +01:00
dependabot[bot]
97aaeb100f
Bump rocksdb from 0.20.0 to 0.20.1 ( #1464 )
...
Bumps [rocksdb](https://github.com/rust-rocksdb/rust-rocksdb ) from 0.20.0 to 0.20.1.
- [Release notes](https://github.com/rust-rocksdb/rust-rocksdb/releases )
- [Changelog](https://github.com/rust-rocksdb/rust-rocksdb/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-rocksdb/rust-rocksdb/compare/v0.20.0...v0.20.1 )
---
updated-dependencies:
- dependency-name: rocksdb
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-10 20:30:27 +01:00
dependabot[bot] and Ivan Pleshkov
1204682000
Bump rocksdb from 0.19.0 to 0.20.0 ( #1461 )
...
* Bump rocksdb from 0.19.0 to 0.20.0
Bumps [rocksdb](https://github.com/rust-rocksdb/rust-rocksdb ) from 0.19.0 to 0.20.0.
- [Release notes](https://github.com/rust-rocksdb/rust-rocksdb/releases )
- [Changelog](https://github.com/rust-rocksdb/rust-rocksdb/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rust-rocksdb/rust-rocksdb/compare/v0.19.0...v0.20.0 )
---
updated-dependencies:
- dependency-name: rocksdb
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
* fix api changes
---------
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ivan Pleshkov <pleshkov.ivan@gmail.com >
2023-02-10 10:22:34 +01:00
Andrey Vasnetsov
153d484489
fix file hamdlers release order ( #1462 )
2023-02-10 08:44:16 +01:00
dependabot[bot]
4d5d2693fa
Bump serde_json from 1.0.92 to 1.0.93 ( #1460 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.92 to 1.0.93.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.92...v1.0.93 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-10 08:40:37 +01:00
Andrey Vasnetsov
ac251358b9
Fix flacky windows test ( #1448 )
...
* use async sleep
* fmt
* disablee test_parallel_graph_build on CI on windows untill there is a way to reproduce
2023-02-09 20:48:00 +01:00
Roman Titov
1be2f67a2e
Reimplement ExtendedPointId deserialization ( #1453 )
...
Reimplement `ExtendedPointId` deserialization, to produce better error message when deserialization fails
2023-02-10 02:36:36 +10:00
Arnaud Gourlay
3aa148cdf7
Add UUID to storage compatibility tests ( #1447 )
2023-02-08 20:10:06 +01:00
Andrey Vasnetsov
26551c64ef
rollback custom deserialization for point id
2023-02-08 14:13:57 +01:00
Andrey Vasnetsov
f2fcf8e3e1
repo-token for protoc
2023-02-07 18:40:31 +01:00
Arnaud Gourlay
8ab4b1f0d4
disable test_task_stop on Windows ( #1443 )
2023-02-07 17:16:03 +01:00
Andrey Vasnetsov
c485b96d95
RFC for 2023 roadmap ( #1309 )
...
* RFC for 2023 roadmap
* upd bage
* upd titles
2023-02-07 08:54:09 +01:00
Andrey Vasnetsov
9d6c9e49b1
remove /collections/aliases ( #1440 )
2023-02-07 08:43:39 +01:00
dependabot[bot]
de57845323
Bump serde_json from 1.0.91 to 1.0.92 ( #1439 )
...
Bumps [serde_json](https://github.com/serde-rs/json ) from 1.0.91 to 1.0.92.
- [Release notes](https://github.com/serde-rs/json/releases )
- [Commits](https://github.com/serde-rs/json/compare/v1.0.91...v1.0.92 )
---
updated-dependencies:
- dependency-name: serde_json
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-06 20:32:50 +01:00
dependabot[bot]
f0f01a7e0f
Bump proptest from 1.0.0 to 1.1.0 ( #1438 )
...
Bumps [proptest](https://github.com/proptest-rs/proptest ) from 1.0.0 to 1.1.0.
- [Release notes](https://github.com/proptest-rs/proptest/releases )
- [Changelog](https://github.com/proptest-rs/proptest/blob/master/CHANGELOG.md )
- [Commits](https://github.com/proptest-rs/proptest/compare/1.0.0...v1.1.0 )
---
updated-dependencies:
- dependency-name: proptest
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-06 19:44:38 +01:00
dependabot[bot]
6704ea5ad7
Bump anyhow from 1.0.68 to 1.0.69 ( #1437 )
...
Bumps [anyhow](https://github.com/dtolnay/anyhow ) from 1.0.68 to 1.0.69.
- [Release notes](https://github.com/dtolnay/anyhow/releases )
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.68...1.0.69 )
---
updated-dependencies:
- dependency-name: anyhow
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-06 19:43:14 +01:00
Andrey Vasnetsov
2254284455
add extra timeout for windows ( #1436 )
...
* add extra timeout for windows
* fix
2023-02-06 19:17:42 +01:00
Andrey Vasnetsov
f9f03d5ccd
fix test_task_stop for windows
2023-02-06 15:07:35 +01:00