George
4261c651e4
new: gpu package ( #224 )
2024-11-07 12:05:31 +01:00
George Panchuk
a5f3f11829
bump version to v0.4.2
2024-11-07 12:03:34 +01:00
Hossam Hagag
12b06ece51
chore: Lock onnxruntime version to be < 1.20.0 ( #386 )
2024-11-04 22:53:50 +02:00
George Panchuk
aba8fb43cf
bump version to v0.4.1
2024-10-21 23:56:19 +04:00
Dmitrii Ogn
69ffaa0f48
Pystemmer -> py-rust_stemmers ( #366 )
...
* bump version to 0.4.0
* py-rust-stemmers support instead of snowball stemmer and pystemmer
* py-rust-stemmers support instead of snowball stemmer and pystemmer
---------
Co-authored-by: George Panchuk <george.panchuk@qdrant.tech >
2024-10-21 23:46:20 +04:00
Dmitrii Ogn
65c2efd6f1
Tf-idf fix: punctuation removal + lowercasing ( #339 )
...
* Tf-idf fix:
Remove punctuation properly + lowercase
* Test fix
* Test fix
* Test fix
* Redudant accum removal
* Redudant accum removal
* 0.878890950070688
* Latest changes with
Average recall: 0.8915516690721613
* Support of special characters
* Removal of debug print
* Type annotations
* Type annotation support for python 3.8
* Type annotation support for python 3.8
2024-09-24 13:21:07 +02:00
George Panchuk
9445f95a32
bump version to v0.3.6
2024-08-23 21:15:43 +02:00
George Panchuk
08925c9cfc
bump version to v0.3.5
2024-08-23 19:52:42 +02:00
George Panchuk
fd116dd507
bump version to 0.3.4
2024-07-15 15:59:52 +03:00
generall
9387ca3205
bump version to v0.3.3
2024-07-06 00:53:45 +02:00
generall
1fe42d8d18
bump version to v0.3.2
2024-07-05 13:31:04 +02:00
Anush
35c535aae3
chore: Pin numpy <2 ( #278 )
2024-06-17 23:33:09 +05:30
George Panchuk
bf4ef9d513
bump version to v0.3.0
2024-06-05 18:03:25 +02:00
George
14c067e15e
new: unlock huggingface hub and ruff ( #250 )
2024-05-31 17:41:44 +02:00
Andrey Vasnetsov
dfd25d41c9
Attention sparse embeddings ( #235 )
...
* WIP: sparse embeddings using attention
* support for stopwords
* apply stopwords
* proceed implementation of sparse attention embeddings (#234 )
* complete inference
* query embed + comment
* use simpler weights formula instead of sorting of words
* update tests
* fix: fix bm42 usage, add query_embed to SparseTextEmbedding, update tests
---------
Co-authored-by: George <george.panchuk@qdrant.tech >
2024-05-24 15:25:34 +02:00
George
490c340a76
new: update tokenizers dep ( #244 )
2024-05-22 13:27:30 +02:00
George
99164c9050
Clip ( #219 )
...
* wip: init image embeddings
* new: add clip
* new: fix clip text embedding
* fix: fix image parallel
* fix: add test images
* fix: add PIL
* fix: fix generics
* fix: fix sparse worker
* fix: fix image test path
* fix: replace models repo
* new: follow-up for onnx providers and local_files_only option
* fix: add types, refactor a bit
* refactoring: move onnxprovider type alias to types
* fix: fix type alias import
2024-05-09 11:12:25 +02:00
Andrey Vasnetsov
6ecab6d40d
bump v0.2.7
2024-05-03 16:33:06 +00:00
George Panchuk
8184acbb39
new: update tokenizers
2024-05-03 16:57:45 +02:00
Nirant
3d2254d215
Bump version to 0.2.6 in pyproject.toml ( #175 )
2024-04-01 17:16:07 +05:30
George
25671ec349
Update ruff ( #172 )
...
* refactoring: reduce max line-length
* new: update ruff
---------
Co-authored-by: Nirant <NirantK@users.noreply.github.com >
2024-04-01 12:55:15 +05:30
Nirant
4db4839995
[PyPi Publish] Bump version to 0.2.5 in pyproject.toml ( #156 )
...
* Bump version to 0.2.5 in pyproject.toml
* chore: case insensitive check (#157 )
2024-03-20 19:11:44 +05:30
Anush
6a94994038
Release v0.2.4 ( #149 )
2024-03-13 23:56:01 +05:30
Nirant Kasliwal
8d368889c0
Update version and add pre-commit dependency
2024-03-13 18:07:31 +05:30
Nirant
defb6183c1
* feat(pyproject): updated version to '0.2.2' ( #124 )
...
* chore(pyproject): updated dev dependencies versions
2024-02-19 14:46:01 +05:30
Nirant
81bab0cd1d
Make 0.2.1 Release + Update docs ( #116 )
...
* Update version from 0.2.0 (yanked) to 0.2.1
* Update text embedding to include prefix for passages and queries
* Update supported models to use the latest API
* * fix(text_embedding_base.py): remove unnecessary prefix from texts in embed method
* feat(text_embedding_base.py): update query_embed method to updated instruction for the v1.5 model
* Remove comparison, since the ranking is identical even with varying embedding
* Refactor text embedding query handling
2024-02-08 09:06:00 +05:30
Nirant Kasliwal
3948f0db2e
Update fastembed v0.2.0
2024-02-07 20:36:46 +05:30
Nirant
cf66d0e5e1
Update Python and dependency versions ( #111 )
2024-02-05 12:37:52 +01:00
Anush
ede507e2cf
feat: HuggingFace download support for FlagEmbedding ( #94 )
...
* feat: HF support for FlagEmbedding
* chore: update docstring embedding.py
* refactor: GCS URLs models.json
* chore: toLower() models.json
* chore: update tqdm declarative
* chore: exclude keys list_supported_models
* chore: review changes
2024-01-23 12:47:55 +05:30
Nirant
3b32619a4c
Update Python version and add pre-commit dependency ( #93 )
...
* Update Python version and add pre-commit dependency
* Remove Python 3.8.x from matrix
* Update Python version and pre-commit configuration
2024-01-16 19:30:47 +05:30
Anush
9b63427118
chore: pre-commit formatting ( #91 )
...
* chore: formatting
* chore: formatting
* chore: remove other hooks
* Update poetry lock
---------
Co-authored-by: Nirant Kasliwal <nirant.bits@gmail.com >
2024-01-16 15:06:54 +05:30
NirantK
ea85e7430f
Bump version
2023-12-13 13:27:30 +05:30
Anush
e274dd0fc2
chore: bump tokenizers ( #75 )
2023-12-12 18:50:47 +05:30
Nirant
d64b8f42f0
* chore(pyproject.toml): add huggingface-hub dependency ( #66 )
...
* chore(pyproject.toml): update pytest version to 7.4.2
2023-11-20 15:10:56 +05:30
NirantK
5f40fc2f14
* chore(pyproject.toml): update tokenizers dependency version to be at least 0.14
2023-11-01 20:14:01 +05:30
NirantK
ab2f41ef8b
* chore(pyproject.toml): update tokenizers dependency version to ^0.14.1
2023-11-01 20:12:18 +05:30
generall
219185e677
pass embed arguments in passage_embed method
2023-10-16 14:57:51 +02:00
generall
24dc24b02d
implement data-parallel inference and up version
2023-10-16 13:07:07 +02:00
generall
3fbc878ddd
bump version 0.0.5
2023-10-04 10:20:58 +02:00
generall
288cee1d16
upd dependencies
2023-10-03 21:35:46 +02:00
generall
8c6d4d2b52
remove optimum + more test + fix batching embed + ci on other machines
2023-10-03 21:19:58 +02:00
NirantK
ac6b8c9402
* chore(pyproject.toml): add onnx dependency to the project
2023-09-27 13:26:27 +05:30
NirantK
b28ff3f8d6
* chore(pyproject.toml): update version from 0.0.4 to 0.0.5a1
...
* chore(pyproject.toml): remove onnxruntime-silicon dependency for macOS
2023-09-26 21:25:59 +05:30
NirantK
206a633eb1
Fix for # https://github.com/pytorch/pytorch/issues/100974
2023-09-25 17:12:03 +05:30
NirantK
5dfdddbdb6
Another attempt at fixing versions
2023-09-25 16:53:14 +05:30
NirantK
464b12ab15
* chore(pyproject.toml): update optimum dependency version to be greater than 1.12.0
2023-09-25 16:14:24 +05:30
NirantK
f007b19272
Add optimum as a dependency
2023-09-25 15:33:28 +05:30
NirantK
88b595f3ec
* chore: update project description in pyproject.toml
...
* docs: update project description in README.md and docs/index.md
2023-08-24 13:16:46 +05:30
NirantK
1809e8cd80
* chore(pyproject.toml): update version from 0.0.4a1 to 0.0.4
2023-08-24 13:14:13 +05:30
NirantK
d1c5aa91e5
* chore(pyproject.toml): update version from 0.0.3a1 to 0.0.4a1
2023-08-23 11:19:24 +05:30
