Commit Graph

470 Commits

Author SHA1 Message Date
George
bf14069f65 new: add python3.13 to ci (#849) 2024-11-15 10:17:49 +01:00
George
2d4fc2104c fix: fix type hint (#850) 2024-11-15 10:17:34 +01:00
George
35705c538b fix: fix model json schema compat, fix fields inspected for inference (#847)
* fix: fix model json schema compat, fix fields inspected for inference

* fix: fix type hint
2024-11-12 19:09:51 +01:00
George
8d6bee2434 new: make model name mandatory in inference structures (#846) 2024-11-12 19:09:44 +01:00
George
e15b21e5fb Alter image structure (#845)
* new: assign image.image Any type in grpc

* new: update image structure, rename embed utils Path to FieldPath
2024-11-11 18:03:26 +01:00
George
6d29cc6c1c new: extend signatures with images and inference objects (#842)
* new: extend signatures with images and inference objects

* fix: remove draft code
2024-11-11 17:52:55 +01:00
Hossam Hagag
f9fbc90dcf deprecate: Added deprecations for methods superseded by query_points (#843)
* deprecate: Added deprecations for methods superseded by query_points

* deprecate: Undeprecate search_matrix_offsets and search_matrix_pairs
2024-11-08 13:10:51 +01:00
Hossam Hagag
ff51482402 fix: Clean up resources when qdrant not responding while uploading to elevate deadlock (#840) 2024-11-07 12:39:36 +01:00
George
636f3e86fb Inference grpc (#838)
* new: update proto

* fix: rollback too recent changes to proto

* new: add and fix conversions

* fix: fix type hints

* fix: fix comment

* fix: convert options

* fix: fix vector output conversion

* tests: add custom conversion case for new vector fields
2024-11-06 14:32:10 +01:00
George
d2771afdfb Local inference image support (#836)
* new: add backbone for image support

* new: convert b64 to pil, embed images, add test

* tests: add test file

* refactor: replace 3 different inference object vars with a common one

* fix: fix type hints

* fix: fix type hints

* tests: add tests

* fix: remove redundant imports

* new: propagate image options

* Custom inference object (#837)

* new: add inference object support

* new: add inference object support

* fix: remove redundant import

* refactor: return newline

* fix: fix propagate options test
2024-11-04 08:37:53 +01:00
George
5e0a40e954 Propagate options (#835)
* new: propagate model params in document options

* new: update fastembed version

* fix: fix option propagation, add tests

* fix: update poetry lock

* fix: don't change the set model on embed raw types

* tests: extend propagate options test

* fix: erase cls model storage after each test
2024-10-31 09:56:58 +01:00
George
d75f064695 tests: unlock test (#825) 2024-10-29 18:54:12 +01:00
George
948127144a fix: update inspection cache (#826) 2024-10-29 18:28:34 +01:00
George
7de6aed644 bump version to 1.12.2-dev (#824) 2024-10-29 18:06:02 +01:00
Kartik Gupta
06041473f0 Tag remap (#801)
* remap tag with api.qdrant.tech

* re re-gen

* fix: Updated accessors

* regen with py 3.10.15

---------

Co-authored-by: Anush008 <anushshetty90@gmail.com>
2024-10-29 15:48:52 +01:00
George
c152e3c7bf Agnostic local inference (#799)
* new: update previous qdrant version

* new: rollback rest client as types moved to the core

* new: add model_fields_set pydantic compat

* new: add Document to models

* new: add local inference inspectors

* new: add inference functionality to qdrant client

* fix: fix type hints

* fix: fix type hints

* fix: fix type hints

* new: remove _cloud_inference arg from methods

* refactor

* tests: update tests, add path check

* fix: fix type hint

* fix: fix type hint

* fix: resolve plain query

* fix: remove redundant checks

* fix: fix resolve query doc

* tests: add test case for several docs in prefetch

* fix: fix tests

* new: forbid cloud inference with local mode

* fix: fix is_query assignment, fix embed dict

* tests: fix sparse vector values comparison

* fix: regen async

* fix: embed batch

* tests: extend local inference tests

* tests: add update operations and update vectors tests

* tests: remove redundant tests, add plain query points test

* fix: fix type hint

* fix: add missing import

* fix: yet another type hint fix

* tests: add query points groups and query batch points tests

* fix: do not try to embed a vector, comment missed disabled test stmt

* new: add late interaction embeddings without add and query methods

* fix: fix LITE import

* fix: fix problem with retrieving not available path, enable tests

* fix: fix exception message

* refactor: update type hint

* fix: update type hints

* chore: add docstrings to embed methods

* refactor: simplify inspector init

* fix: fix type hint

* new: reuse parser, fix type import

* refactor: rename parser, add docstrings

* fix: fix type hint

* fix: fix type hint

* fix: fix type hint

* refactor: smol refactor, docstrings

* fix: fix inspect embed

* deprecation warning for grpc.PointStruct

* new: populate inspections cache (#823)

* new: populate inspections cache

* fix: fix type hints

* fix: regen async

* fix: fix type hint

* fix: fix typo in filename

* fix: fix points check

* fix: fix type hint
2024-10-29 15:48:23 +01:00
George
b2add2dd72 fix: fix resolve prefetch input (#816)
* fix: fix resolve prefetch input

* fix: regen async
2024-10-25 18:19:03 +02:00
George
74f270d683 fix: fix dbsf on empty responses, add tests (#817)
* fix: fix dbsf on empty responses, add tests

* fix: fix type hints
2024-10-25 18:21:17 +03:00
George
1eb9b78f5d new: update dev version (#820)
* new: update dev version

* fix: update qdrant version for backward compatibility in ci
2024-10-25 17:06:02 +02:00
George
649cbcfdb8 fix: fix poetry installation in netlify (#819) 2024-10-25 15:07:32 +02:00
Hossam Hagag
b1bd522e41 fix: Raise if named vector not found in local mode while upsert (#813)
* fix: Raise if named vector not found in local mode

* fix: Raise if named vector not found in local mode while upsert

* chore: Added test case
2024-10-18 11:24:12 +04:00
George
8abfd0e6cd fix: fix docstrings to make sphinx happy (#814)
* fix: fix docstrings to make sphinx happy

* debug: downgrade poetry version

* fix: update virtualenv

* debug: remove debug line
2024-10-18 10:55:50 +04:00
George
589772635b fix: fix prefetch conversion, fix local mode query batch points offset, add tests (#812) 2024-10-15 11:25:06 +02:00
George
f2494cacdc fix: fix default vector distance matrix (#810) 2024-10-11 20:43:54 +02:00
Andrey Vasnetsov
2cd8214deb make api names consistent with grpc + fix a BUG (#805) 2024-10-07 23:35:55 +02:00
George
4bcdedddcc new: add mmap geo index (#804) 2024-10-07 17:53:40 +02:00
George
52ccd4181b fix: add local files only to set sparse model (#802) 2024-10-07 10:53:36 +02:00
George
c6adbc7853 fix: fix async grpc info (#800) 2024-10-07 08:41:27 +02:00
Hossam Hagag
d0bda1b3bb chore: Change embed to query_embed in fastembed mixin for sparse models (#797) 2024-10-05 23:29:24 +02:00
Luis Cossío
a6e2324884 chore: Update clients (#758)
* update rest client

* update grpc client with grpcio 1.65.4

* update grpc client with grpcio==1.49.1

* generate grpc client with grpcio==1.48.2

* generate grpc client with grpcio==1.66.1 and mypy-protobuf extension

* add mypy-protobuf to pyproject

* relax version for grpcio, but keep grpcio-tools at 1.48.2

* improve generation script

* fix bash script comment

Co-authored-by: George <george.panchuk@qdrant.tech>

* use old grpcio to generate client

* rollbakc mypy-protobuf

* regenerate with distance matrix

* new: update clients (#774)

* new: update clients

* rollback grpcio version

* feature: Facets (#759)

* facet in local_collection.py

* replace usages of calculate_payload_mask

* - qdrant remote
- qdrant base
- qdrant client
- conversions

* congruence tests + local mode fixes

* generate async client

* add type stubs and misc fixes

* fix mypy in Python 3.8

* generate async client

* review remarks

* gen async client

* update for bool facets

* Feature: Distance Matrix API (#769)

* add remote impls

* add client impl

* regen async client

* start local

* regen async

* local mode

* start congruence

* Fix local mode

* regen async of course

* test filtering

* fix min samples count

* simplify comparaison loop

* simplify samples loop

* add rest/gRPC conversion tests

* fix conversions + tests

---------

Co-authored-by: George <george.panchuk@qdrant.tech>
Co-authored-by: generall <andrey@vasnetsov.com>
Co-authored-by: Arnaud Gourlay <arnaud.gourlay@gmail.com>
2024-10-05 23:03:13 +02:00
George
2c638903ae bump to 1.11.4-dev (#792) 2024-09-24 23:00:37 +02:00
George
5b22703d4a fix: make resharding operations optional (#791) 2024-09-24 21:52:10 +02:00
Ruben
52d96974fd Remove-np-ninf (#782)
* change np.NINF to -np.inf

* Update qdrant_client/local/local_collection.py

---------

Co-authored-by: George <panchuk.george@outlook.com>
2024-09-24 21:07:25 +02:00
George
eec1d5aa92 fix: add sharding method to collection params conversion (#790) 2024-09-24 19:07:51 +02:00
Martin Vana
8ad5574633 Removed invalid await from grpc async call (#785)
* Removed invalid await from grpc async call

* fix: fix generation of grpc async create shard key, add tests

---------

Co-authored-by: George Panchuk <george.panchuk@qdrant.tech>
2024-09-24 18:43:34 +02:00
George
36995d41e5 fix: fix update_vectors in local mode, fix record comparison in tests (#787) 2024-09-24 16:15:33 +02:00
George
55fecb2417 bump dev version to 1.11.3-dev (#777) 2024-09-17 23:14:58 +02:00
paul2302
19b80b6bae Fix nested prefetches in qdrant_local.py (#772)
* Fix nested prefetches in qdrant_local.py

Local qdrant client with nested prefetches raised the exception: none type has no attribute query. This little change fixes it

* chore: Added the check for prefetch to async

* fix: Fix nested prefetch in async local mode by generating the async client

* chore: Added a test case for query using nested prefetch in congruence tests

* remove redundant version check

---------

Co-authored-by: hh-space-invader <h.hagag.ali@gmail.com>
Co-authored-by: George <panchuk.george@outlook.com>
2024-09-13 20:31:51 +02:00
George
75597a9061 fix: fix get vectors (#775)
* fix: fix nested prefetch

* refactoring: simplify condition

* fix: fix condition in get vectors
2024-09-13 17:50:48 +02:00
George
2bd4f7ab94 Fix grpc payload index params (#773)
* fix: update grpc parametrized payload index

* fix: optional lookup and range for integer payload index

* tests: add tests

* fix: remove updates which are too early for the time

* chore: add newline
2024-09-13 17:38:32 +02:00
Hossam Hagag
c107fb3f9f Tsk 757 add support for tuple in payload (#763)
* Add support for tuple in payload for grpc

* chore: delete health_check_pb2_grpc.py

* chore: Modify payload test case to test tuple datatype

* chore: Removed test case for tuple
We cannot test tuple as the return value is listvalue, so i only kept the list

* chore: Remove excess prints in info endpoint

* chore: Added tuple in random payload generator

* feat: convert the tuple payload of local mode to list for congruence
2024-09-13 17:19:55 +02:00
George
f568a21a97 bump dev version to 1.11.2-dev (#751) 2024-08-29 09:19:11 +04:00
George
9a92e16bdb fix: fix typo in splade model name (#754) 2024-08-26 10:46:52 +02:00
George
d4c7545c2d new: update fastembed to 0.3.6 (#753) 2024-08-23 22:19:10 +02:00
Hossam Hagag
97e317e1f1 improved semver comparison (#736)
* refactor: Improved semver comparision in tests

refs: #723

* refactor: Improved semver comparision in tests

* refactor: Refactored semver comparision in recommend
2024-08-23 19:35:34 +02:00
George
72f776977a fix: fix conversion in create_payload_index, add tests (#750)
* fix: fix conversion in create_payload_index, add tests

* fix: fix backward compatibility tests
2024-08-22 15:52:27 +02:00
George
54440c0ea4 fix: fix modifier.none conversion (#748) 2024-08-20 22:47:47 +02:00
Hossam Hagag
75b572c1f8 deprecate: mark async gRPC properties as deprecated in QdrantRemote (#740)
* deprecate: mark async gRPC properties as deprecated in QdrantRemote

- Added deprecation warnings to async gRPC properties: async_grpc_collections, async_grpc_points, async_grpc_snapshots, and async_grpc_root

refs: #592

* deprecate: Added deprication for async_grpc in QdrantClient and QdrantRemote
2024-08-18 23:14:57 +02:00
Hossam Hagag
94eac242d4 deprecate: mark rest property as deprecated in QdrantClient (#742)
* deprecate: mark rest property as deprecated in QdrantClient

- Added deprecation warnings for rest property
- refs: #597

* chore: Regenerated async qdrant client

- Regenerated async qdrant client to add the deprecation warning to async client for rest
2024-08-18 23:10:35 +02:00
Hossam Hagag
5d93e5e57a fix: handle type_params for Python 3.12+ (#739)
* fix: handle type_params for Python 3.12+
Refs: #725

* refactor: use kwargs in visit_FunctionDef while handling type_params for Python 3.12+

- Refactored visit_FunctionDef to utilize **kwargs for argument handling.

* refactor: pass positional arguments for AsyncFunctionDef with conditional type_params handling

- Refactored visit_FunctionDef to pass parameters as positional arguments to AsyncFunctionDef.
2024-08-15 15:27:38 +02:00