Hossam Hagag 1deb830328 Tsk 374 add jina colbert v2 (#378) ...

* feat: Added support for jina-colbert-v2

* chore: Generalized query marker and document marker

* nit: remove github action on dispatch

* chore: updated license

* fix: Fix attention mask to be all 1 in xlmrobertatokenizer

* feat: Added class for JinaColbertV2

* feat: Added jina colbert

* chore: Change tolerance of the test

* chore: Changed encoding of attention mask to 1 to be only in queries

* chore: Changed the replacable token to be ' @' as its considered as one token

* chore: Removed redundant functions

* chore: Updated supported models docs

* nit: Remove print statement

* nit: visual stuff

* fix: Fix dimention of jina colbert in description

* fix: canonical query and document values for jina colbert

2024-11-03 11:02:41 +02:00

..

misc

Clip (#219)

2024-05-09 11:12:25 +02:00

__init__.py

Fix to avoid overfloat and get rid of model_max_length (#319)

2024-08-14 15:59:22 +03:00

config.py

Clip (#219)

2024-05-09 11:12:25 +02:00

profiling.py

Api cross encoder (#355)

2024-10-09 22:14:57 +02:00

test_attention_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_image_onnx_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_late_interaction_embeddings.py

Tsk 374 add jina colbert v2 (#378)

2024-11-03 11:02:41 +02:00

test_multi_gpu.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_sparse_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_text_cross_encoder.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00

test_text_onnx_embeddings.py

Multi gpu support (#358)

2024-10-16 23:42:38 +02:00