mirror of
https://github.com/qdrant/qdrant.git
synced 2026-07-23 11:11:00 -05:00
607f016bbf
* Add empty placeholder vector storage types for named vector CRUD Introduce EmptyDenseVectorStorage and EmptySparseVectorStorage as placeholder storages for newly created named vectors on immutable segments. These report all vectors as deleted, consume no disk space, and are reconstructed from segment config on load via the new VectorStorageType::Empty and SparseVectorStorageType::Empty variants. Key design decisions: - is_on_disk is derived from original user config, not hardcoded - MultiVectorConfig is preserved for multi-vector support - Config mismatch optimizer skips Empty storage to avoid false rebuilds - Quantization delegates normally (handles 0 vectors gracefully) - get_vector includes debug_assert to catch unexpected access Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * [AI] segment-level operations for creating and deleting anmed vectors * [AI] implement named vector creation and deleting in proxy segment * [AI] Step 3: Proxy Segment Handling for Named Vector Operations * [AI] implement for Edge * [AI] implement consensus operations for named vector operations * [AI] refactor VectorNameConfig, remove VectorNameConfigInternal * [AI] handle vector schema inconsistency in raft snapshot recovery * [AI] rest + grpc API * [AI] clippy * [AI] generate openAPI schema * fmt * ci fixes * [AI] fix jwt access test * [AI] nop operation for awaiting of consensus-commited update ops * [AI] move vector name operations into points service * [AI] implement internal api for vector name operations * [AI] change collection-level config along with segment level operation * [AI] vector schema reconceliation instead of error * fmt * missing compile-time option * [AI] integration test * [AI] fix missing JWT tests * [AI] remove NOP * [AI] openapi test * [AI] fix initialization of mutable segment * [AI] more simple integration tests * fmt * [AI] make cluster test a bit harder * [AI] make test less flacky * [AI] rabbit comments * [AI] check params compatibility before writing vector config * [AI] make sure to register vector storages in structure payload index * [AI] vector name validation * lower vector length validation to 200 chars to account for prefix in filename * [AI] proxy segment: prevent stale data leak through optimization * fmt * [AI] filter out removed vectors from proxy response * [AI] handle vector name in proxy * fmt * adjust proxy info based on dropped vectors * [AI] proxy segment: update filters to correct has_vector condition * fmt * clippy * Fix consensus snapshot applicaiton for vector schema --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
50 lines
1.8 KiB
Bash
Executable File
50 lines
1.8 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
# Some OpenAPI files in this repository are generated and based upon other
|
|
# sources. When these sources change, the generated files must be generated
|
|
# (and committed) again. It is the task of the contributing user to do this
|
|
# properly.
|
|
#
|
|
# This tests makes sure the generated OpenAPI files are consistent with its
|
|
# sources. If this fails, you probably have to generate the OpenAPI files again.
|
|
#
|
|
# Read more here: https://github.com/qdrant/qdrant/blob/master/docs/DEVELOPMENT.md#rest
|
|
|
|
set -ex
|
|
|
|
# Ensure current path is project root
|
|
cd "$(dirname "$0")/../"
|
|
|
|
# Keep current version of file to check
|
|
cp ./docs/redoc/master/{,.diff.}openapi.json
|
|
|
|
# Regenerate OpenAPI files
|
|
tools/generate_openapi_models.sh
|
|
|
|
# Ensure generated files are the same as files in this repository
|
|
if diff -Zwa ./docs/redoc/master/{,.diff.}openapi.json
|
|
then
|
|
set +x
|
|
echo "No diffs found."
|
|
else
|
|
set +x
|
|
echo "ERROR: Generated OpenAPI files are not consistent with files in this repository, see diff above."
|
|
echo "ERROR: See: https://github.com/qdrant/qdrant/blob/master/docs/DEVELOPMENT.md#rest"
|
|
exit 1
|
|
fi
|
|
|
|
# Cleanup
|
|
rm -f ./docs/redoc/master/.diff.openapi.json
|
|
|
|
NUMBER_OF_APIS=$(cat ./docs/redoc/master/openapi.json | jq '[.paths[] | length] | add')
|
|
|
|
EXPECTED_NUMBER_OF_APIS=75
|
|
|
|
if [ "$NUMBER_OF_APIS" -ne "$EXPECTED_NUMBER_OF_APIS" ]; then
|
|
echo "ERROR: It looks like the total number of APIs has changed."
|
|
echo "ERROR: Expected: $EXPECTED_NUMBER_OF_APIS, got: $NUMBER_OF_APIS"
|
|
echo "ERROR: Verify that all new APIs are correctly whitelisted (or not) for the metrics endpoint"
|
|
echo "ERROR: See: 'REST_ENDPOINT_WHITELIST' and 'GRPC_ENDPOINT_WHITELIST'"
|
|
echo "ERROR: once consistency is restored, please update EXPECTED_NUMBER_OF_APIS in this script"
|
|
exit 1
|
|
fi
|