upstream-archive/fastembed
1
0
Fork 0
mirror of https://github.com/qdrant/fastembed.git synced 2026-08-03 16:41:00 -05:00
Code Issues Packages Projects Releases Wiki Activity
408 Commits 38 Branches 59 Tags
gpu-runtime-debug
Commit Graph

408 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
NirantK
f2e711eeda * fix(embedding.py): add type hinting to the encode method in the Embedding class 2023-07-31 16:26:53 +05:30
NirantK
bb01f26031 * feat(embedding.py): add import statements for os, shutil, tarfile, tempfile, typing, requests, tqdm 2023-07-31 16:10:51 +05:30
NirantK
7a23c6a25d * chore(.gitignore): add nbs/*.tar.gz to ignore list 2023-07-31 16:10:42 +05:30
NirantK
247a03fe62 * feat(embedding.py): add DefaultEmbedding class with methods for downloading file from GCS and decompressing to cache 
* fix(embedding.py): fix missing self parameter in DefaultEmbedding class methods
 2023-07-31 16:10:35 +05:30
NirantK
c1048b5e38 * feat(embedding.py): add GeneralTextEmbedding class for SoTA text embedding model 
* fix(embedding.py): fix average_pool method signature in GeneralTextEmbedding class
 2023-07-31 16:10:13 +05:30
NirantK
31b0f6e929 * refactor(ONNX_Port.ipynb): rename notebook file from ONNX_Port.ipynb to 01_ONNX_Port.ipynb 
* chore(ONNX_Port.ipynb): comment out timeit magic command in code cells
 2023-07-31 16:07:52 +05:30
NirantK
2746ebbdca * chore(pyproject.toml): add tqdm and requests dependencies 2023-07-31 16:06:04 +05:30
NirantK
1640e6f40e * chore(.gitignore): add .DS_Store to the ignore list 2023-07-31 13:52:42 +05:30
NirantK
58d88b923a * feat(ONNX_Port.ipynb): add notebook for ONNX porting process 
* chore(ONNX_Port.ipynb): remove unnecessary commented code
 2023-07-31 13:52:35 +05:30
NirantK
caf2c28d7d * chore(pyproject.toml): update version from 0.0.1.alpha1 to 0.0.1.alpha2 2023-07-31 13:51:44 +05:30
NirantK
6500bd06ac * refactor(embedding.py): Rename fastvector directory to fastembed 
* refactor(qdrant_client.py): Rename fastvector directory to fastembed
* refactor(qdrant_mixin.py): Rename fastvector directory to fastembed
 2023-07-17 14:59:59 +05:30
NirantK
b7a21ef713 * chore(README.md): change library name from FastVector to FastEmbed 
* docs(README.md): update installation instructions to use FastEmbed instead of FastVector
 2023-07-17 14:59:46 +05:30
NirantK
e3e310d73c * chore(pyproject.toml): update project name from "fastvector" to "fastembed" 
* chore(pyproject.toml): update version from "0.0.1" to "0.0.1.alpha1"
 2023-07-17 14:59:38 +05:30
NirantK
c9a21837da * chore(usage.py): update metadata source from "Linkedin-docs" to "LlamaIndex-docs" 2023-07-13 08:56:31 +05:30
NirantK
4a368f89b5 * chore(pyproject.toml): remove qdrant-client dependency 2023-07-13 08:56:24 +05:30
NirantK
fc46684d0c * chore(README.md): clean up and reformat code examples in README.md 
* feat(README.md): update metadata sources in example code
 2023-07-12 19:42:04 +05:30
NirantK
9638de0a40 * chore(usage.py): remove unused code and comments 
* feat(usage.py): update add method to remove batch_size and wait parameters
* feat(usage.py): update query method to remove n_results parameter
 2023-07-12 19:41:58 +05:30
NirantK
67c2e1838e Lockfile updates 2023-07-12 19:14:50 +05:30
NirantK
5c61ff5347 * chore(pyproject.toml): update python dependency version to >=3.8.0,<3.12 
* feat(pyproject.toml): add packages, homepage, repository, and keywords
 2023-07-12 19:14:34 +05:30
NirantK
23e16b5498 * chore(pyproject.toml): remove empty lines 2023-07-12 19:08:37 +05:30
NirantK
0b15cee945 * refactor(pyproject.toml): update dependencies and create dev-dependencies 
* feat(pyproject.toml): add onnxruntime-silicon as a dependency with macOS specific marker
 2023-07-12 19:08:17 +05:30
NirantK
3e36f1fde4 * refactor(qdrant_mixin.py): remove unused import statement 
* refactor(qdrant_mixin.py): remove warning message when creating collection
 2023-07-12 19:07:59 +05:30
NirantK
16a05c561d * docs(README.md): update installation instructions to include Qdrant client installation 2023-07-12 18:50:14 +05:30
NirantK
1f59b7c494 * chore(README.md): add installation and usage instructions 
* feat(README.md): add features section
 2023-07-12 18:48:36 +05:30
NirantK
f0162731dd * fix(qdrant_mixin.py): make embeddings field in QueryResponse optional 
* feat(qdrant_mixin.py): add with_payload parameter to QdrantClientMixin.search method
* fix(usage.py): remove with_vectors and with_payload parameters from client.query method
 2023-07-12 18:47:12 +05:30
NirantK
6e2b7c8bb3 * fix(qdrant_mixin.py): change method call from create_collection to recreate_collection 
* fix(qdrant_mixin.py): change method call from recreate_collection to create_collection
* fix(usage.py): change method call from add to upsert_docs
 2023-07-12 18:37:42 +05:30
NirantK
0d15e14886 * chore(usage.py): update document IDs in the ids list 
* docs(usage.py): add usage of the upsert_docs method
 2023-07-12 18:36:39 +05:30
NirantK
334221ae54 * refactor(qdrant_mixin.py): remove unused imports, explicit imports from http.models 2023-07-12 18:35:44 +05:30
NirantK
fd44f7fd22 * chore(qdrant_mixin.py): remove unused code in search_docs method 
* feat(qdrant_mixin.py): add aliases for add and query methods
 2023-07-12 18:27:25 +05:30
NirantK
b85bcf0203 * fix(usage.py): change method name from upsert_docs to add in client method call 2023-07-12 18:27:17 +05:30
NirantK
dbfb70290c * chore(qdrant_mixin.py): add aliases for the upsert_docs and search_docs methods 2023-07-12 18:27:04 +05:30
NirantK
0f513b3f61 * feat(qdrant_mixin.py): add docstring and update default values for search_params and embedding_model in the search method 2023-07-12 18:25:25 +05:30
NirantK
a05723ec40 * fix(qdrant_mixin.py): rename query method to search_docs for clarity and consistency 2023-07-12 18:23:26 +05:30
NirantK
a789766574 * feat(qdrant_mixin.py): add docstring to the constructor of QdrantClientMixin class 2023-07-12 18:23:14 +05:30
NirantK
1c683d6a17 * fix(qdrant_mixin.py): change default value of embedding_model parameter from None to SentenceTransformersEmbedding 2023-07-12 18:23:05 +05:30
NirantK
81dcb3ae05 * chore(usage.py): update comment to clarify the behavior of the ids list 
* fix(usage.py): change comment to reflect that random IDs can lead to duplicates
 2023-07-12 16:49:38 +05:30
NirantK
d077bcb67f * refactor(qdrant_mixin.py): remove unused variable 'n' in QdrantClientMixin class 2023-07-12 16:48:42 +05:30
NirantK
71549ac299 * refactor(qdrant_mixin.py): refactor QdrantClientMixin's search method to return QueryResponse objects instead of a list of dictionaries 2023-07-12 16:48:29 +05:30
NirantK
d4e62fcf57 * refactor(qdrant_mixin.py): refactor search functionality to support batch processing of query texts 
* fix(qdrant_mixin.py): fix variable name in loop to iterate over query_texts_batch
 2023-07-12 16:47:51 +05:30
NirantK
e65b2256d2 * feat(qdrant_mixin.py): add batch_iterable method to QdrantClientMixin class 
* fix(qdrant_mixin.py): fix typo in method name, change "upsert_docs" to "upsert_documents"
 2023-07-12 16:47:20 +05:30
NirantK
cffb443756 * refactor(qdrant_mixin.py): change argument types and add default values for query method 
* feat(qdrant_mixin.py): add batch_size argument to query method
* fix(qdrant_mixin.py): fix return type of query method
 2023-07-12 16:46:21 +05:30
NirantK
d74ffea4d0 * fix(qdrant_mixin.py): remove unused code for generating sequential IDs 
* feat(qdrant_mixin.py): add support for generating UUIDs as document IDs
* feat(qdrant_mixin.py): add support for including document text in payload
 2023-07-12 16:45:43 +05:30
NirantK
296ca48d29 * feat(qdrant_mixin.py): add support for QueryResponse model 
* feat(qdrant_mixin.py): add support for additional kwargs in upsert_docs method
 2023-07-12 16:45:07 +05:30
NirantK
bed955961b * fix(qdrant_mixin.py): remove print statement for upserting points 
* feat(qdrant_mixin.py): add support for multiple query texts in search method
 2023-07-11 19:37:54 +05:30
NirantK
c1ebdfb734 * refactor(qdrant_mixin.py): 
* - Move embedding model initialization to a separate parameter in the methods `index_documents` and `search_documents`
* - Remove unused import `OpenAIEmbedding`
* - Remove unused import `models` from `qdrant_client.http`
* - Remove unused import
 2023-07-11 19:33:06 +05:30
NirantK
ea2584dd59 * feat(embedding.py): add abstract base class Embedding and two concrete implementations SentenceTransformersEmbedding and OpenAIEmbedding 2023-07-11 19:32:53 +05:30
NirantK
964749d9f2 * feat(qdrant_mixin.py): add support for generating sequential IDs if "ids" field is not present in the input documents 2023-07-11 19:23:54 +05:30
NirantK
a76790d043 wip 2023-07-11 19:22:00 +05:30
NirantK
1c30491623 * chore(pyproject.toml): add sentence-transformers package 
* chore(pyproject.toml): update black line-length to 120
* chore(pyproject.toml): update isort profile to "black"
* chore(pyproject.toml): update ruff line-length to 120
 2023-07-11 19:21:46 +05:30
NirantK
f0df5040a4 * feat(.pre-commit-config.yaml): add pre-commit hooks for trailing whitespace, end-of-file-fixer, check-yaml, check-added-large-files, and black 2023-07-11 19:21:35 +05:30