6 Commits

Author SHA1 Message Date
Sid-Ahmed
fed67b7942 fix(core): optimize OCI Layers (#7005)
* fix(core): optimize OCI Layers

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>

* fix(core): optimize OCI Layers

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>

* fix(core): optimize OCI Layers

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>

---------

Signed-off-by: Sid Ahmed Djellali <s.djellali@cyberdian.fr>
Co-authored-by: Sid Ahmed DJELLALI <s.djellali@cyberdian.fr>
2025-08-14 16:16:18 +02:00
tellet-q
f87e505439 Refactor bash tests: low-ram (#6911)
* Refactor low-ran bash test

* Address review
2025-08-05 13:05:39 +02:00
Arnaud Gourlay
289f73b12f Add sparse vectors to data compatibility tests (#3210)
* Add sparse vectors to data compatibility tests

* make tests more exhaustive and more automatic

* generate single or multi value payload fiels

* added binary quant case and increase dataset to 1000 points

* format python file

* add snapshot to lfs

---------

Co-authored-by: Luis Cossío <luis.cossio@outlook.com>
2023-12-14 12:59:26 +00:00
Roman Titov
16b7fb7688 Improve handling out-of-RAM errors during Qdrant startup (#1777)
* WIP: Start working on out-of-RAM errors handling [skip ci]

* Implement basic handling of out-of-RAM errors during Qdrant startup

* Try to fix CI fail by allowing both V1 and V2 cgroups

* Try to fix CI fail by improving cgroups handling

* Fix cgroups path detection/handling (+ some minor stylistic changes)

* fixup! Fix cgroups path detection/handling (+ some minor stylistic changes)

* Add test

* Enable low RAM test

* fixup! Add test

* free memory checks

* rm unused function

* Oom fallback script (#1809)

* add recover mode in qdrant + script for handelling OOM

* fix clippy

* reformat entrypoint.sh

* fix test

* add logging to test

* fix test

* fix test

---------

Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
2023-05-02 20:54:13 +02:00
Roman Titov
ced0abb4c7 Fix segment snapshotting (#1321) (#1334)
* WIP: Fix `Segment::take_snapshot`

TODO:
- This commit, probably, breaks snapshotting of segments with memmapped vector storage
- `ProxySegment::take_snapshot` seems to potentially similar bug

* WIP: Fix `Segment::take_snapshot`

- Fix snapshotting of `StructPayloadIndex`
- Fix snapshotting of segments with memmapped vector storage
- Temporarily break `ProxySegment::take_snapshot`

* Fix `ProxySegment::take_snapshot`

* Remove `copy_segment_directory` test

* nitpicking

* clippy fixes

* use OperationError::service_error

* Cleanup `TinyMap` trait bounds and derive `Debug`

* Fix `test_snapshot` test

- Derive `Debug` for `NamedVectors`

* Move utility functions from `segment.rs` to `utils` module

* Contextualize `segment::utils::fs::move_all` a bit more carefully

* Fix a typo

* add backward compatibility with old snapshot formats

* fmt

* add snapshot for compatibility test

* git lfs is a piece of shit

* Nitpicking

Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
2023-01-13 11:44:42 +01:00
Arnaud Gourlay
2ced2b43f8 validate storage compatibility - (#286) (#289) 2022-02-08 20:22:24 +01:00