upstream-archive/fastembed
1
0
Fork 0
mirror of https://github.com/qdrant/fastembed.git synced 2026-10-03 19:37:46 -05:00
Code Issues Packages Projects Releases Wiki Activity
335 Commits 38 Branches 61 Tags
text-splitter
Commit Graph
335 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Anush008 4e88e7609f chore: source reference 2024-01-05 12:01:32 +05:30
Anush008 fb72191e40 chore: rename types to models 2024-01-05 11:53:07 +05:30
NirantK 56f813008f Update ruff version to 0.1.11 2024-01-05 11:25:16 +05:30
NirantK 4997dcd930 Refactor embedding and splitter configuration 2024-01-05 11:25:11 +05:30
NirantK 2652faa6bc Update pyproject.toml with new dependencies 2024-01-05 10:57:49 +05:30
NirantK d061e6a57c Refactor TextSplitter initialization to use a configuration object 2024-01-05 10:55:19 +05:30
NirantK abe144f78d Add Splitter Config as a Type 2024-01-05 10:55:10 +05:30
NirantK 08dffc580e Change from splitter_kwargs to splitter config + Ruff Auto Fix 2024-01-05 10:55:01 +05:30
NirantK de60dd2bdb Change TextSplitter and FastEmbedRecursiveSplitter defaults 2024-01-05 10:17:52 +05:30
Anush008 2235fbbc4d chore: read as utf-8 2024-01-04 19:21:03 +05:30
Anush008 0641f6fee0 chore: move split_text to abstract class 2024-01-03 18:26:28 +05:30
Anush008 737835026c chore: docstrings update 2024-01-03 17:19:38 +05:30
Anush008 a154a80a64 chore: Langchain reference 2024-01-03 17:02:14 +05:30
Anush008 31403d935c feat: tokenizer text splitter 2024-01-03 16:57:05 +05:30
Nirant b01f882df7 Revert "feat: embedding progress bar (#71)" (#77) 
This reverts commit 2c7fee3b95.
v0.1.3 		2023-12-13 15:13:00 +05:30
Nirant 55379539ef * chore(docs): update Getting Started.ipynb with progressbar + New Models 
* * feat(Supported_Models.ipynb): add support for BAAI/bge-small-zh-v1.5 model
* feat(Supported_Models.ipynb): add support for jinaai/jina-embeddings-v2-base-en model
* feat(Supported_Models.ip

* * chore(docs): update Getting Started.ipynb with progressbar
 2023-12-13 14:17:25 +05:30
NirantK ea85e7430f Bump version 2023-12-13 13:27:30 +05:30
Anush 2c7fee3b95 feat: embedding progress bar (#71) 
* feat: embedding progress

* refactor: with auto __close__

* refactor: with __exit__ tqdm
v0.1.2 		2023-12-12 19:33:12 +05:30
Anush e274dd0fc2 chore: bump tokenizers (#75) 2023-12-12 18:50:47 +05:30
Anush 0a94425735 feat: Added support for FASTEMBED_CACHE_PATH env var (#68) 
* chore: FASTEMBED_CACHE_PATH env

* chore: temp directory fallback

* chore: tempdir fallback JinaEmbedding
 2023-11-22 10:39:18 +05:30
Joan FontanalsandJoan Fontanals Martinez f222d7cd87 add JinaEmbeddings class (#67) 
* add JinaEmbeddings class

* fix tests dimensions

---------

Co-authored-by: Joan Fontanals Martinez <joan.fontanals.martinez@jina.ai>
 2023-11-20 16:37:23 +05:30
Nirant d64b8f42f0 * chore(pyproject.toml): add huggingface-hub dependency (#66) 
* chore(pyproject.toml): update pytest version to 7.4.2
 2023-11-20 15:10:56 +05:30
dependabot[bot] 2f95205b23 build(deps): bump urllib3 from 2.0.6 to 2.0.7 (#65) 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.0.6 to 2.0.7.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.0.6...2.0.7)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-16 11:37:48 +05:30
Nirant a39ee46c0b Update EmbeddingModel class to remove ABC (#57) 
inheritance
 2023-11-02 15:37:43 +05:30
Dominik Weckmüller bb86b30707 Add typing and numpy import 
typing and numpy import were missing
 2023-11-01 20:20:47 +05:30
Andrey Vasnetsov 8c20c7c172 Merge pull request #55 from qdrant/tokenizers-upgrade 
Update tokenizers dependency version to >=0.14
 2023-11-01 15:50:27 +01:00
NirantK 5f40fc2f14 * chore(pyproject.toml): update tokenizers dependency version to be at least 0.14 2023-11-01 20:14:01 +05:30
NirantK ab2f41ef8b * chore(pyproject.toml): update tokenizers dependency version to ^0.14.1 2023-11-01 20:12:18 +05:30
Nirant 78416dd728 Merge pull request #48 from qdrant/remove-docs-clutter 
Docs: Move cluttered notebook + Fix typos
 2023-10-30 23:07:09 +05:30
NirantK 9c85a899c9 * docs(experimental): update dataset size in Binary Quantization with Qdrant.ipynb from 10K to 100K 2023-10-30 23:02:18 +05:30
NirantK 299042d592 * docs(examples): add explanation of Qdrant Client usage with FastEmbed library and Qdrant API 2023-10-30 23:01:26 +05:30
NirantK d35ff16994 * chore(docs): rename Throughput_Across_Models.ipynb to fooling_around/Throughput_Across_Models.ipynb 2023-10-30 23:01:19 +05:30
Nirant f8f8316fea Merge pull request #38 from qdrant/explain_cossim 
* docs(examples): update FastEmbed_vs_HF_Comparison.ipynb
 2023-10-19 22:56:04 +05:30
NirantK 4999fa17b5 * docs(examples): update FastEmbed_vs_HF_Comparison.ipynb 
with cosine similarity values for BAAI/bge-small-en and BAAI/bge-small-en-v1.5 embeddings
 2023-10-19 22:49:25 +05:30
Nirant 7535d0e49f Merge pull request #34 from qdrant/fix-broken-link-for-docs 
Fix broken link in README
 2023-10-19 20:21:33 +05:30
Nirant eaa8c534f3 Fix broken link in README 2023-10-19 15:54:04 +05:30
Nirant e04f0b161b Merge pull request #32 from qdrant/supported-models-doc-update 
Documentation Improvements
 2023-10-19 14:06:37 +05:30
NirantK ad297c4f13 * chore(Usage_With_Qdrant.ipynb): remove unnecessary outputs in code cells 2023-10-18 23:03:52 +05:30
NirantK c1fdaf3303 * chore(Supported_Models.ipynb): update supported models table 
* feat(Supported_Models.ipynb): add size_in_GB column to supported models table
 2023-10-18 23:02:50 +05:30
Nirant 1608599bcb Merge pull request #31 from qdrant/fix-defaults 
Consistent Default to v1.5
 2023-10-18 20:56:28 +05:30
NirantK b61f8a48cc Update to v1.5 model 2023-10-18 20:49:31 +05:30
NirantK fd55b46f4b * fix(embedding.py): update default model_name to "BAAI/bge-small-en-v1.5" 2023-10-18 20:49:01 +05:30
NirantK a14aab8ef4 * refactor(Getting Started.ipynb): simplify code for initializing DefaultEmbedding class 2023-10-18 20:48:51 +05:30
Nirant 72591fe5d2 Merge pull request #27 from qdrant/add-bge-small-zh 
* feat(embedding.py): add "BAAI/bge-small-zh-v1.5" model
 2023-10-18 19:32:45 +05:30
Nirant 911b51d01c Merge pull request #28 from qdrant/fix-parallel-in-embed-passage 
pass embed arguments in `passage_embed` method
v0.1.1 		2023-10-16 19:00:52 +05:30
generall 219185e677 pass embed arguments in passage_embed method 2023-10-16 14:57:51 +02:00
NirantK f28087c71a * fix(embedding.py): change dim value from 384 to 512 for the "BAAI/bge-small-zh-v1.5" model 
* fix(test_onnx_embeddings.py): add canonical vector values for the "BAAI/bge-small-zh-v1.5"
 2023-10-16 18:23:02 +05:30
NirantK 0203b0ae9e * feat(embedding.py): add support for BAAI/bge-small-zh-v1.5 Chinese model 2023-10-16 18:20:56 +05:30
Andrey Vasnetsov f02d713e93 Merge pull request #24 from qdrant/streaming-inference 
implement data-parallel inference and up version
v0.1.0 0.1.0 		2023-10-16 14:31:40 +02:00
Andrey Vasnetsov c901da0820 Merge pull request #26 from qdrant/add_model_size 
* feat(embedding.py): add size_in_GB information for each model
 2023-10-16 14:26:13 +02:00