upstream-archive/fastembed
1
0
Fork 0
mirror of https://github.com/qdrant/fastembed.git synced 2026-07-25 20:21:10 -05:00
Code Issues Packages Projects Releases Wiki Activity
355 Commits 38 Branches 59 Tags
dynamic_quantization
Commit Graph

97 Commits

Author SHA1 Message Date
Anush
1e298a00b3 feat: Added gte-large, nomic-text 1.5, cleanup (#130) 2024-02-21 17:54:32 +05:30
Armaghan
406f432edc feat: Support sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 (#129) 
* feat: Support sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2

* test: Include sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2

* docs: supported models update
 2024-02-21 13:35:49 +05:30
Anush
98141cc8d3 feat: Added nomic-embed-text-v1 support + formatting changes + import fixes (#118) 
* feat: Added nomic-embed-text-v1 support

* chore: xenova/nomic-embed-text-v1 -> nomic-ai/nomic-embed-text-v1

---------

Co-authored-by: Nirant <NirantK@users.noreply.github.com>
 2024-02-19 14:17:33 +05:30
Nirant
81bab0cd1d Make 0.2.1 Release + Update docs (#116) 
* Update version from 0.2.0 (yanked) to 0.2.1

* Update text embedding to include prefix for passages and queries

* Update supported models to use the latest API

* * fix(text_embedding_base.py): remove unnecessary prefix from texts in embed method
* feat(text_embedding_base.py): update query_embed method to updated instruction for the v1.5 model

* Remove comparison, since the ranking is identical even with varying embedding

* Refactor text embedding query handling
 2024-02-08 09:06:00 +05:30
Nirant
973da354ae Fix query to align with Qdrant mixin usage (#115) 
* fix: query in text_embedding_base to work with both Iterable and str as users might supply both

* Fix Qdrant query to align with future usage

* * refactor(text_embedding_base.py): change query parameter type from str to Union[str, Iterable[str]] in query_embed method

* Update return type of query_embed method

* Update return type in TextEmbeddingBase
 2024-02-07 22:01:31 +05:30
Anush
96f7d83d33 feat: Support xenova/multilingual-e5-large, xenova/paraphrase-multili… (#103) 
* feat: Support xenova/multilingual-e5-large, xenova/paraphrase-multilingual-mpnet-base-v2

* chore: updated exclude_token_type_ids check

* docs: supported models update
 2024-02-02 15:16:35 +05:30
Anush
9b63427118 chore: pre-commit formatting (#91) 
* chore: formatting

* chore: formatting

* chore: remove other hooks

* Update poetry lock

---------

Co-authored-by: Nirant Kasliwal <nirant.bits@gmail.com>
 2024-01-16 15:06:54 +05:30
Nirant
55379539ef * chore(docs): update Getting Started.ipynb with progressbar + New Models 
* * feat(Supported_Models.ipynb): add support for BAAI/bge-small-zh-v1.5 model
* feat(Supported_Models.ipynb): add support for jinaai/jina-embeddings-v2-base-en model
* feat(Supported_Models.ip

* * chore(docs): update Getting Started.ipynb with progressbar
 2023-12-13 14:17:25 +05:30
NirantK
9c85a899c9 * docs(experimental): update dataset size in Binary Quantization with Qdrant.ipynb from 10K to 100K 2023-10-30 23:02:18 +05:30
NirantK
299042d592 * docs(examples): add explanation of Qdrant Client usage with FastEmbed library and Qdrant API 2023-10-30 23:01:26 +05:30
NirantK
d35ff16994 * chore(docs): rename Throughput_Across_Models.ipynb to fooling_around/Throughput_Across_Models.ipynb 2023-10-30 23:01:19 +05:30
Nirant
f8f8316fea Merge pull request #38 from qdrant/explain_cossim 
* docs(examples): update FastEmbed_vs_HF_Comparison.ipynb
 2023-10-19 22:56:04 +05:30
NirantK
4999fa17b5 * docs(examples): update FastEmbed_vs_HF_Comparison.ipynb 
with cosine similarity values for BAAI/bge-small-en and BAAI/bge-small-en-v1.5 embeddings
 2023-10-19 22:49:25 +05:30
NirantK
ad297c4f13 * chore(Usage_With_Qdrant.ipynb): remove unnecessary outputs in code cells 2023-10-18 23:03:52 +05:30
NirantK
c1fdaf3303 * chore(Supported_Models.ipynb): update supported models table 
* feat(Supported_Models.ipynb): add size_in_GB column to supported models table
 2023-10-18 23:02:50 +05:30
NirantK
b61f8a48cc Update to v1.5 model 2023-10-18 20:49:31 +05:30
NirantK
a14aab8ef4 * refactor(Getting Started.ipynb): simplify code for initializing DefaultEmbedding class 2023-10-18 20:48:51 +05:30
NirantK
c408b7e13e * chore(main.html): add utm parameters to Qdrant Cloud link 2023-10-10 19:01:49 +05:30
NirantK
d2bdfee4e0 * docs(examples): update comparison notebook with more accurate description of embeddings similarity 2023-10-10 17:56:25 +05:30
NirantK
ac4375516f Rename nbs; add Cosine similarity check 2023-10-10 17:55:37 +05:30
NirantK
ca6f9d629a Add skeleton 2023-10-05 19:20:01 +05:30
NirantK
bc402694bd Update code to handle Generator 2023-10-05 19:17:18 +05:30
NirantK
050d80ab51 * chore(docs): update index.md with FastEmbed library information and usage examples 
* feat(docs): add installation instructions for FastEmbed with Qdrant Client
 2023-09-28 10:52:38 +05:30
NirantK
49c2b3e7a9 * chore(docs): update installation command for fastembed in Getting Started.ipynb 
* fix(docs): remove unnecessary casting of generator to list in code cell
 2023-09-28 10:43:14 +05:30
NirantK
4949158eff * chore(Usage_With_Qdrant.ipynb): update notebook title and remove experimental note 
* docs(Usage_With_Qdrant.ipynb): add support for qdrant-client[fastembed] installation
 2023-09-27 17:53:05 +05:30
NirantK
dd2a9e9bcc * docs(Supported_Models.ipynb): update model descriptions 2023-09-27 17:41:39 +05:30
NirantK
71289926c0 * feat(Supported_Models.ipynb): add example notebook for supported models 2023-09-27 17:40:40 +05:30
NirantK
547130a4c3 Move throughput comparison to docs 2023-09-25 17:40:38 +05:30
NirantK
eaafd59277 wip 2023-09-18 22:29:39 +05:30
NirantK
34f9982af3 add benchmarking 2023-09-18 18:32:50 +05:30
NirantK
6f284f6466 * feat(docs): update execution counts in Binary Quantization from Scratch.ipynb 
* fix(docs): fix typo in Binary Quantization from Scratch.ipynb
* feat(docs): add outputs to code cells in Binary Quantization from Scratch.ipynb
 2023-09-18 08:47:28 +05:30
NirantK
ac989e249a Add BQ with Qdrant draft 2023-09-18 08:47:11 +05:30
NirantK
b72cae1e9b * chore(docs): rename HF_vs_FastEmbed.ipynb to 02_HF_vs_FastEmbed.ipynb 2023-09-18 08:46:13 +05:30
NirantK
ecfaba9e60 Fix yield/iterator issue 2023-09-18 08:42:34 +05:30
NirantK
fc0341333e * chore(docs): remove experimental notebook for 1M Embedding Creation 2023-09-18 08:41:58 +05:30
NirantK
5afa103d45 Remove attention pooling 2023-09-18 07:35:52 +05:30
NirantK
e1e5975193 * docs(experimental): rename Binary Quantization.ipynb to Binary Quantization from Scratch.ipynb 2023-09-15 15:33:28 +05:30
NirantK
a7a599d932 * chore(main.html): update Discord server link and name to Qdrant Discord server 2023-09-13 20:53:21 +05:30
NirantK
9c5d32f271 move nbs 2023-09-07 15:25:32 +05:30
Nirant
defbe0cce2 Merge pull request #8 from qdrant/add_qdrant_client_example 
Add Qdrant Usage back to the example
 2023-09-07 15:22:43 +05:30
NirantK
1292ded017 Add Qdrant Usage back to the example 2023-09-07 15:19:46 +05:30
Rishav Dash
bcf3cee8b8 Updated the hyperlink for "Retrieval with FastEmbed" 
prev -: https://qdrant.github.io/fastembed/examples/Retrieval%20with%20FastEmbed/

now -: https://qdrant.github.io/fastembed/examples/Retrieval_with_FastEmbed/
 2023-09-03 13:37:14 +05:30
NirantK
728ac49a91 * docs(experimental): update headings in Binary Quantization.ipyn, add emoji everywhere 2023-08-25 14:11:03 +05:30
NirantK
3d1b80e9de * docs(experimental): fix typo in Binary Quantization.ipynb 
* chore(experimental): update description of binary transformation step
 2023-08-25 14:06:16 +05:30
NirantK
86e3b12e84 Improved readability 2023-08-25 14:05:21 +05:30
NirantK
e62ed5edb2 * chore(docs): rename "Binary Quantisation.ipynb" to "Binary Quantization.ipynb" 
* docs(experimental/Binary Quantization.ipynb): update markdown headings
* docs(experimental/Binary Quantization.ipynb): update markdown heading for loading data
 2023-08-25 13:58:45 +05:30
NirantK
ee87685fa5 * docs(experimental): add table with sampling rate, limit, and accuracy for binary quantisation 2023-08-25 13:54:36 +05:30
NirantK
750c9b340e * chore(Binary Quantisation.ipynb): update execution counts to null 
* refactor(Binary Quantisation.ipynb): remove unnecessary outputs
 2023-08-25 13:54:31 +05:30
NirantK
5a16ce8c63 * chore(docs): rename notebook files 
* - Rename '03_HF_vs_FastEmbed.ipynb' to 'HF_vs_FastEmbed.ipynb'
* - Rename '01_Retrieval_with_FastEmbed.ipynb' to 'Retrieval_with_FastEmbed
 2023-08-25 13:41:32 +05:30
NirantK
5f229b2bc3 Binary Quantisation 2023-08-25 13:40:23 +05:30