* Allow specifying initial state while creating shard key
* Dont wait for Active state if initial_state is set
* Generate gRPC docs and OpenAPI spec
* Apply suggestions
* Skip from scheamrs not serde
* Add integration test
* minor suggestions
* [strict-mode] Add max number of payload index count
* improve docs and validation for StrictModeConfig
* fix from coderabbit
* test blocking access to payload indexes
* polish test
* Deprecate init_from
* Mark memmap_threshold as deprecated
* Mark locks API as deprecated
* Mark RBAC collection access payload filter as deprecated
* Allow deprecations in tests and benchmarks
* Fix bug that causes all replicas to die if node is restarted during resharding
* fix recursive async problem
* Avoid write lock unless required
* avoid using &mut when & is sufficient
* Remove is_in_progress since check_abort_resharding exists (#6806)
* On resharding abort, only abort transfers related to current operation
* Fix resharding dead replicas improvements (#6881)
* Apply suggestions to fix resharding dead replicas
* fmt
---------
Co-authored-by: timvisee <tim@visee.me>
* add mmr as a ScoringQuery
* add mmr to CollectionQueryRequest
* handle mmr after collecting from shards
* use unwrap_or_else
* include mmr as a vector query
* ordering for MMR is None
* fix score threshold
* fmt + todo comment
* remove unused function
---------
Co-authored-by: generall <andrey@vasnetsov.com>
* Introduce new config to set default peer ID
* Add unit test to check persistence of default peer ID
* add missing update to main.rs
* fix clippy
* Log if using default peer ID
* Use non default peer id
* Move default_peer_id config to cluster config
* update main.rs
* minor var name refactor
* Add validation for default peer ID range
* Fix validation and ensure we dont generate Peer ID 0 randomly
* fmt
* Don't batch query if there's more segments than CPUs, limit threads
* Don't batch query if there's more segments than search threads
* Link to pull request
* Add note that we only consider local segments and global search threads
* Improve telemetry logic and test
* Parametrize telemetry test
* Consistency hash peeer ID across telemetry
* clean test
* Use Option in segments telemetry
* updat openapi spec
* Avoid test failure on change in order of params
* move problems.rs to collection crate
* change type on datetime_key expression
* extract from expression
* check for unindexed fields in formula
* clippy
* dedup code
* Only implement verification for `CollectionQuery` types (#6319)
* verify CollectionQuery's Prefetch
* remove implementation for REST query
* remove implementation for REST query groups
* add basic openapi test
* Add in rest and grpc
* add to QueryEnum
* implement Query trait
* connect to scorer creation
* upd tests
* additional changes
* fmt
* gen openapi and grpc docs
* coderabbit fix
* add changes in async scorer
* test sum_scores in more places, refactor to remove repetition
* Scroll lock: make sure no segments are modified between scroll and retrieve
* Take write lock in block_in_place to prevent blocking tokio runtime
* Use blocking write
* Recover collection snapshot on general runtime
* Make function const
---------
Co-authored-by: timvisee <tim@visee.me>
* Simplify `ShardKeyMapping` impl
* Automatically switch to new mappings format, if `Number` shard key is used
* Apply TODOs
* Add comment describing the issue, leave instructions for migration
* Cleanup
Remove unnecessary assignment
* Cleanup
Remove misleading comment
---------
Co-authored-by: timvisee <tim@visee.me>
* Propagate shard key mapping wrapper deeper
* Also bump reverse shard mapping when applying shard keys from snapshot
* Also apply new shard key mappings to existing replicas
* Apply shard key to replica set through apply_state directly
* Set both new shard key mappings through utility function
* Set shard key mappings directly during directory creation
* Rename get_key to key
* Update comment
* Use safe shard key wrapper type in consensus snapshot state
* Add shard ID iterator
* Produce net wrapped shard key mapping type directly
* Add useful comments
* Fix typo
