Hossam Hagag eaecf7d471 Multi gpu support (#358) ...

* feat: Added multi gpu support for text embedding

* feat: Add support for multi-gpu for special text models

* fix: Fix lazy_load to load the model to child processes when parallel is not none

* feat: Added lazy_load and multi-gpu to colbert

* feat: Add lazy_load and multi gpu to image models

* feat: Support lazy_load and multi-gpu to sparse models (except BM25)

* fix: Fixed BM25 not working

* refactor: Remove redundant GPUParallelProcessor

* refactor: Refactor _embed_*_parallel

* feat: Add cuda argument
refactor: Refactor how worker assign device

* fix: Fix if providers and cuda are None

* fix: Fix providers and cuda are none

* WIP: Multi gpu support review (#361)

* WIP: review

* wip: review

* refactor: refactor images

* refactor: refactor sparse

* refactor: refactor late interaction

* add model loading

* add tests

* fix: uncomment models in tests

* fix: fix variable declaration order

* fix: fix device id assignment

* tests: add multi gpu tests

* fix: fix device id assignment for sparse embeddings

* tests: update multi gpu tests

---------

Co-authored-by: George Panchuk <george.panchuk@qdrant.tech>

* refactor: remove redundant declarations

* fix: rollback redundant changes

* fix: remove num workers device ids dep, fix type hint

* fix: fix post process for sparse models

* fix: remove redundant model loading

* new: add lazy load and new gpu support to cross encoders

* fix: add rerankers to multi gpu tests

* fix: unlock multilingual test

* fix: fix gpu test with cross encoder

---------

Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
Co-authored-by: George Panchuk <george.panchuk@qdrant.tech>

2024-10-16 23:42:38 +02:00

..

misc

Clip (#219)

2024-05-09 11:12:25 +02:00

__init__.py

Fix to avoid overfloat and get rid of model_max_length (#319)

2024-08-14 15:59:22 +03:00

config.py

Clip (#219)

2024-05-09 11:12:25 +02:00

profiling.py

Api cross encoder (#355)

2024-10-09 22:14:57 +02:00

test_attention_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_image_onnx_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_late_interaction_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_multi_gpu.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_sparse_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_text_cross_encoder.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_text_onnx_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00