upstream-archive/fastembed
1
0
Fork 0
mirror of https://github.com/qdrant/fastembed.git synced 2026-08-05 09:31:10 -05:00
Code Issues Packages Projects Releases Wiki Activity
324 Commits 46 Branches 59 Tags
38ecb33eff0db1beefce53a4b36147ed148e72ea
Commit Graph

324 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nirant Kasliwal
38ecb33eff Add new dependencies: optimum, sentence-transformers, python-dotenv 2024-01-15 12:02:46 +05:30
Nirant Kasliwal
f3bf86ee4e ONNX Port 2024-01-15 12:02:40 +05:30
Nirant Kasliwal
6fa4331771 Add saved models to .gitignore 2024-01-15 12:02:22 +05:30
Nirant
b01f882df7 Revert "feat: embedding progress bar (#71)" (#77) 
This reverts commit 2c7fee3b95.
v0.1.3 		2023-12-13 15:13:00 +05:30
Nirant
55379539ef * chore(docs): update Getting Started.ipynb with progressbar + New Models 
* * feat(Supported_Models.ipynb): add support for BAAI/bge-small-zh-v1.5 model
* feat(Supported_Models.ipynb): add support for jinaai/jina-embeddings-v2-base-en model
* feat(Supported_Models.ip

* * chore(docs): update Getting Started.ipynb with progressbar
 2023-12-13 14:17:25 +05:30
NirantK
ea85e7430f Bump version 2023-12-13 13:27:30 +05:30
Anush
2c7fee3b95 feat: embedding progress bar (#71) 
* feat: embedding progress

* refactor: with auto __close__

* refactor: with __exit__ tqdm
v0.1.2 		2023-12-12 19:33:12 +05:30
Anush
e274dd0fc2 chore: bump tokenizers (#75) 2023-12-12 18:50:47 +05:30
Anush
0a94425735 feat: Added support for FASTEMBED_CACHE_PATH env var (#68) 
* chore: FASTEMBED_CACHE_PATH env

* chore: temp directory fallback

* chore: tempdir fallback JinaEmbedding
 2023-11-22 10:39:18 +05:30
Joan Fontanals
f222d7cd87 add JinaEmbeddings class (#67) 
* add JinaEmbeddings class

* fix tests dimensions

---------

Co-authored-by: Joan Fontanals Martinez <joan.fontanals.martinez@jina.ai>
 2023-11-20 16:37:23 +05:30
Nirant
d64b8f42f0 * chore(pyproject.toml): add huggingface-hub dependency (#66) 
* chore(pyproject.toml): update pytest version to 7.4.2
 2023-11-20 15:10:56 +05:30
dependabot[bot]
2f95205b23 build(deps): bump urllib3 from 2.0.6 to 2.0.7 (#65) 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.0.6 to 2.0.7.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.0.6...2.0.7)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-16 11:37:48 +05:30
Nirant
a39ee46c0b Update EmbeddingModel class to remove ABC (#57) 
inheritance
 2023-11-02 15:37:43 +05:30
Dominik Weckmüller
bb86b30707 Add typing and numpy import 
typing and numpy import were missing
 2023-11-01 20:20:47 +05:30
Andrey Vasnetsov
8c20c7c172 Merge pull request #55 from qdrant/tokenizers-upgrade 
Update tokenizers dependency version to >=0.14
 2023-11-01 15:50:27 +01:00
NirantK
5f40fc2f14 * chore(pyproject.toml): update tokenizers dependency version to be at least 0.14 2023-11-01 20:14:01 +05:30
NirantK
ab2f41ef8b * chore(pyproject.toml): update tokenizers dependency version to ^0.14.1 2023-11-01 20:12:18 +05:30
Nirant
78416dd728 Merge pull request #48 from qdrant/remove-docs-clutter 
Docs: Move cluttered notebook + Fix typos
 2023-10-30 23:07:09 +05:30
NirantK
9c85a899c9 * docs(experimental): update dataset size in Binary Quantization with Qdrant.ipynb from 10K to 100K 2023-10-30 23:02:18 +05:30
NirantK
299042d592 * docs(examples): add explanation of Qdrant Client usage with FastEmbed library and Qdrant API 2023-10-30 23:01:26 +05:30
NirantK
d35ff16994 * chore(docs): rename Throughput_Across_Models.ipynb to fooling_around/Throughput_Across_Models.ipynb 2023-10-30 23:01:19 +05:30
Nirant
f8f8316fea Merge pull request #38 from qdrant/explain_cossim 
* docs(examples): update FastEmbed_vs_HF_Comparison.ipynb
 2023-10-19 22:56:04 +05:30
NirantK
4999fa17b5 * docs(examples): update FastEmbed_vs_HF_Comparison.ipynb 
with cosine similarity values for BAAI/bge-small-en and BAAI/bge-small-en-v1.5 embeddings
 2023-10-19 22:49:25 +05:30
Nirant
7535d0e49f Merge pull request #34 from qdrant/fix-broken-link-for-docs 
Fix broken link in README
 2023-10-19 20:21:33 +05:30
Nirant
eaa8c534f3 Fix broken link in README 2023-10-19 15:54:04 +05:30
Nirant
e04f0b161b Merge pull request #32 from qdrant/supported-models-doc-update 
Documentation Improvements
 2023-10-19 14:06:37 +05:30
NirantK
ad297c4f13 * chore(Usage_With_Qdrant.ipynb): remove unnecessary outputs in code cells 2023-10-18 23:03:52 +05:30
NirantK
c1fdaf3303 * chore(Supported_Models.ipynb): update supported models table 
* feat(Supported_Models.ipynb): add size_in_GB column to supported models table
 2023-10-18 23:02:50 +05:30
Nirant
1608599bcb Merge pull request #31 from qdrant/fix-defaults 
Consistent Default to v1.5
 2023-10-18 20:56:28 +05:30
NirantK
b61f8a48cc Update to v1.5 model 2023-10-18 20:49:31 +05:30
NirantK
fd55b46f4b * fix(embedding.py): update default model_name to "BAAI/bge-small-en-v1.5" 2023-10-18 20:49:01 +05:30
NirantK
a14aab8ef4 * refactor(Getting Started.ipynb): simplify code for initializing DefaultEmbedding class 2023-10-18 20:48:51 +05:30
Nirant
72591fe5d2 Merge pull request #27 from qdrant/add-bge-small-zh 
* feat(embedding.py): add "BAAI/bge-small-zh-v1.5" model
 2023-10-18 19:32:45 +05:30
Nirant
911b51d01c Merge pull request #28 from qdrant/fix-parallel-in-embed-passage 
pass embed arguments in `passage_embed` method
v0.1.1 		2023-10-16 19:00:52 +05:30
generall
219185e677 pass embed arguments in passage_embed method 2023-10-16 14:57:51 +02:00
NirantK
f28087c71a * fix(embedding.py): change dim value from 384 to 512 for the "BAAI/bge-small-zh-v1.5" model 
* fix(test_onnx_embeddings.py): add canonical vector values for the "BAAI/bge-small-zh-v1.5"
 2023-10-16 18:23:02 +05:30
NirantK
0203b0ae9e * feat(embedding.py): add support for BAAI/bge-small-zh-v1.5 Chinese model 2023-10-16 18:20:56 +05:30
Andrey Vasnetsov
f02d713e93 Merge pull request #24 from qdrant/streaming-inference 
implement data-parallel inference and up version
v0.1.0 0.1.0 		2023-10-16 14:31:40 +02:00
Andrey Vasnetsov
c901da0820 Merge pull request #26 from qdrant/add_model_size 
* feat(embedding.py): add size_in_GB information for each model
 2023-10-16 14:26:13 +02:00
Nirant
f79de09ff7 Merge branch 'streaming-inference' into add_model_size 2023-10-16 17:54:33 +05:30
NirantK
7799180b18 * fix(embedding.py): update return type of list_supported_models method to include Union[int, float] for values in the dictionary 2023-10-16 17:52:43 +05:30
NirantK
e24ea64e21 * test(test_onnx_embeddings.py): skip specific model if size_in_GB is greater than 1 2023-10-16 17:52:35 +05:30
NirantK
299c76c099 * feat(embedding.py): add size_in_GB information for each model 2023-10-16 17:50:28 +05:30
generall
35ec40b3a3 review fixes 2023-10-16 14:19:58 +02:00
NirantK
b35cb28eeb * refactor(embedding.py): reorder import statements in alphabetical order 
* feat(embedding.py): add optional 'threads' parameter to DefaultEmbedding constructor
 2023-10-16 17:39:21 +05:30
Nirant
c953a083cc Merge branch 'main' into streaming-inference 2023-10-16 17:33:36 +05:30
Nirant
66c5cf76c6 Merge pull request #25 from qdrant/support-v1.5-models 
* feat(embedding.py): add support for v1.5 models
 2023-10-16 17:29:33 +05:30
NirantK
9e5d37846c * feat(embedding.py): add support for BAAI/bge-small-en-v1.5 and BAAI/bge-base-en-v1.5 models 
* feat(embedding.py): change default model to v1.5
 2023-10-16 17:08:58 +05:30
generall
c719fc696d disable large models on non-ubuntu CI 2023-10-16 13:27:28 +02:00
generall
24dc24b02d implement data-parallel inference and up version 2023-10-16 13:07:07 +02:00