Commit Graph
14 Commits
Author SHA1 Message Date
Arnaud GourlayandClaude Opus 5 00a0e0d768 test: cover TurboQuant, turbo4 datatype and keyword prefix in compat data (#10165)
* test: cover TurboQuant, turbo4 datatype and keyword prefix in compat data

Extend the storage compatibility fixture with vector and payload index
features that landed since the generator was last updated:

* TurboQuant quantization, one collection per persisted blob layout
  (bits1_5 and the default bits4)
* the turbo4 storage datatype, on both dense and multivector storage
* the keyword index `prefix` option, plus a matching prefix scroll in the
  query battery

Sparse vector configs reject the turbo4 datatype, so create_collection omits
the sparse datatype for that collection rather than forwarding it. This is a
no-op for every other collection.

Archives are generated once per release and keep the collection set of their
own generation, so expected collections are now resolved per version and the
new ones are only required from v1.19.0 onward. The prefix scroll stays
ungated: archives without the prefix index answer it by scanning.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

* test: fail instead of skip when a compatibility archive is missing

A 404 from the compatibility bucket means the archive was never published,
which no amount of retrying fixes. Skipping it reported the version as
covered while nothing ran, so a pull request adding a version could stay
green with its new coverage never executing.

Fail on 404 and keep skipping connection resets and timeouts, so a bucket
outage still does not turn unrelated pull requests red.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-11 11:21:57 +02:00
Arnaud Gourlay 83ae2577b8 Storage compatibility v1.18.1 (#9216) 2026-05-28 11:53:09 +02:00
Arnaud Gourlay 1c9cca02a3 Add v1.18.0 to storare compat. tests (#9028) 2026-05-13 11:29:00 +02:00
Arnaud Gourlay 5498f743ae Add v1.17.1 to storare compat. tests (#8763) 2026-04-22 10:32:33 +02:00
qdrant-cloud-botandCursor Agent 6e7f9973fb Add query verification to storage compatibility tests (#8758)
The compatibility tests previously only checked that collections loaded
with "ok" status. This adds actual queries against every collection to
catch errors/panics in on-disk code paths during version upgrades.

For each collection, we now run:
- Dense vector search (image, dim 256)
- Sparse vector search (text)
- Multivector search (multi-image, dim 128)
- Scroll with filters for all payload index types: keyword, float,
  integer, boolean, geo bounding box, full-text, uuid, datetime

Made-with: Cursor

Co-authored-by: Cursor Agent <agent@cursor.com>
2026-04-21 13:55:12 -04:00
xzfc 0b0df145b3 Drop RocksDB (#8529)
* Skip broken tests

* Add rocksdb dropper

This is a temporary tool. It will be removed later in this PR.

* [automated] Drop rocksdb

This commit is made by running tools/rocksdb/drop.sh

* Touch-up after ast-grep

The previous automated commit removed items, but not their comments.
Also, some blocks are left with only one item.
Also, ast-grep can't handle macros like `vec![]`.

This commit completes the job.

* Remove RocksDB dropper

* Remove mentions of rocksdb feature in CI

* Fix clippy warnings

These `FIXME` comments added previously in this PR by ast-grep by
"peeling" cfg_attr like this:

    -#[cfg_attr(not(feature = "rocksdb"), expect(...))]
    +#[expect(...)] // FIXME(rocksdb): ...

This commit removes these allow/expect attributes and fixes clippy
lints.

* Remove leftover rocksdb-related code

Removed:
- Cargo.toml: rocksdb cargo feature flag and dependencies.
- code: rocksdb-related items that was not under feature flag.
- flags.rs: rocksdb-related qdrant feature flags.

Disabled:
- Some benchmarks because these do not compile now.

* Print warning if rocksdb leftovers found in snapshots

* Remove Clone from tokenizer

* Regenerate openapi.json
2026-03-31 18:08:39 +00:00
Arnaud Gourlay ab1917d634 Storage compatibility v1.17.0 (#8189) 2026-02-20 13:30:24 +01:00
tellet-q 82ca36ed37 Download archives once (#7711) 2025-12-10 10:04:19 +01:00
Arnaud Gourlay 225caa8e5e Test storage compat. v1.6.1 (#7648) 2025-12-01 11:21:50 +01:00
Arnaud Gourlay 155465f154 Document storage compatibility test for v1.15.0 (#7601)
* Enable storage compatibility test for v1.15.0

* proper explanation
2025-11-26 12:11:19 +01:00
Arnaud Gourlayandtellet-q 0f2e415a72 Storage compat. tests all supported versions (#7566)
* Storage compat. tests all supported versions

* v1.15.0 creates problems

* less parallelism to not blow the disk

* Add xdist group (#7568)

* Add session fixture and xdist group

* Increase number of workers back to 4

* Revert caching

* Remove folders with docker_client

* Fix --dist=loadgroup

* Disable v1.15.0

---------

Co-authored-by: tellet-q <166374656+tellet-q@users.noreply.github.com>
2025-11-24 12:45:26 +01:00
Arnaud Gourlay af86a3b02b Bump storage compat. data v1.16.0 (#7560)
* Bump storage compat. data v1.16.0

* forgot about v1.15.5
2025-11-19 10:53:39 +01:00
Tim Visée cafe4aa482 Remove trailing whitespaces (#7435) 2025-10-21 14:05:57 +02:00
tellet-q c3ca182423 Refactor bash tests: storage-compatibility (#7299)
* Add e2e test for compatibility
2025-10-08 08:33:55 +02:00