Commit Graph

360 Commits

Author SHA1 Message Date
generall
da16752e57 rollback dependency changes 2024-02-05 15:12:32 +01:00
Nirant Kasliwal
683fb1a6df Update poetry install command to exclude dev dependencies 2024-02-05 18:01:09 +05:30
Nirant Kasliwal
f22383fcf3 Merge branch 'main' into onnx-pipeline 2024-02-05 17:49:59 +05:30
Nirant
cf66d0e5e1 Update Python and dependency versions (#111) 2024-02-05 12:37:52 +01:00
Nirant Kasliwal
69c00f5a9c chore: Update poetry.lock 2024-02-05 11:03:24 +05:30
Nirant Kasliwal
2be2d8c8fe Merge branch 'main' into onnx-pipeline 2024-02-05 11:01:48 +05:30
Kumar Shivendu
d3f5f29ee0 docs: Improve README (#109) 2024-02-05 10:49:45 +05:30
Kumar Shivendu
05885a36dd refactor: Introduce experiments dir (#108) 2024-02-05 10:49:12 +05:30
Andrey Vasnetsov
a3bc73c556 Merge pull request #105 from qdrant/refactoring-off-everything
Refactoring of internal structure
2024-02-02 16:48:04 +01:00
generall
fcdc5690b9 rename models 2024-02-02 15:51:19 +01:00
generall
7883fa3c41 new multilingual models 2024-02-02 15:32:42 +01:00
generall
5dbd0073e2 rename flag -> onnx 2024-02-02 15:12:57 +01:00
generall
8b800da7bc ruff 2024-02-02 15:12:57 +01:00
generall
3e6f69e2eb review fixes 2024-02-02 15:12:57 +01:00
generall
4813b18854 refactoring
Co-authored-by: George Panchuk <george.panchuk@qdrant.tech>
2024-02-02 15:12:57 +01:00
Anush
96f7d83d33 feat: Support xenova/multilingual-e5-large, xenova/paraphrase-multili… (#103)
* feat: Support xenova/multilingual-e5-large, xenova/paraphrase-multilingual-mpnet-base-v2

* chore: updated exclude_token_type_ids check

* docs: supported models update
2024-02-02 15:16:35 +05:30
Nirant Kasliwal
c064af5eb9 Merge branch 'main' into onnx-pipeline 2024-01-30 21:50:01 +05:30
Nirant
2e3e5508c0 Update poetry lock to latest versions (#98)
* Update poetry lock to latest versions

* Update poetry lock to latest versions
2024-01-30 21:39:52 +05:30
Anush
87decb0d53 chore: port to Xenova Jina source (#102)
* chore: xenova jina

* chore: try recusive model location

* chore: updated doc string, blob pattern
2024-01-30 21:27:16 +05:30
Nirant Kasliwal
79b2c837d3 Update poetry lock to latest versions 2024-01-23 12:52:24 +05:30
Nirant Kasliwal
e71073cc20 Merge branch 'main' into onnx-pipeline 2024-01-23 12:51:22 +05:30
Anush
ede507e2cf feat: HuggingFace download support for FlagEmbedding (#94)
* feat: HF support for FlagEmbedding

* chore: update docstring embedding.py

* refactor: GCS URLs models.json

* chore: toLower() models.json

* chore: update tqdm declarative

* chore: exclude keys list_supported_models

* chore: review changes
2024-01-23 12:47:55 +05:30
David Janes
f87330fcd1 use "with" to open JSON files (#96) 2024-01-22 12:20:06 +05:30
Nirant Kasliwal
f02bd57570 Merge branch 'main' into onnx-pipeline 2024-01-17 13:01:52 +05:30
Nirant Kasliwal
68fa679422 Update poetry lock 2024-01-17 11:07:39 +05:30
Nirant Kasliwal
5ac9a19cd3 Add pre-commit package to pyproject.toml 2024-01-17 11:06:34 +05:30
Nirant Kasliwal
8407d122e1 Merge branch 'main' into onnx-pipeline 2024-01-17 11:02:39 +05:30
Nirant Kasliwal
f087e4bd89 Update typing imports and fix formatting in documentation files 2024-01-17 11:01:30 +05:30
Nirant Kasliwal
559854f76d Update poetry lock 2024-01-17 11:00:34 +05:30
Nirant Kasliwal
3c62ee7283 Update dependencies in pyproject.toml 2024-01-17 10:59:49 +05:30
Nirant
3b32619a4c Update Python version and add pre-commit dependency (#93)
* Update Python version and add pre-commit dependency

* Remove Python 3.8.x from matrix

* Update Python version and pre-commit configuration
2024-01-16 19:30:47 +05:30
Anush
9b63427118 chore: pre-commit formatting (#91)
* chore: formatting

* chore: formatting

* chore: remove other hooks

* Update poetry lock

---------

Co-authored-by: Nirant Kasliwal <nirant.bits@gmail.com>
2024-01-16 15:06:54 +05:30
Nirant Kasliwal
e17421634e Update installation instructions in To_ONNX.ipynb 2024-01-15 13:04:30 +05:30
Nirant Kasliwal
126fdb0d31 Update optimum library version to 1.15 2024-01-15 12:51:07 +05:30
Nirant Kasliwal
30fddf688d Add local_cache to .gitignore 2024-01-15 12:34:23 +05:30
Nirant Kasliwal
ee96fc7f64 Add jupyter-nbextensions-configurator package 2024-01-15 12:34:18 +05:30
Nirant Kasliwal
38ecb33eff Add new dependencies: optimum, sentence-transformers, python-dotenv 2024-01-15 12:02:46 +05:30
Nirant Kasliwal
f3bf86ee4e ONNX Port 2024-01-15 12:02:40 +05:30
Nirant Kasliwal
6fa4331771 Add saved models to .gitignore 2024-01-15 12:02:22 +05:30
Nirant
b01f882df7 Revert "feat: embedding progress bar (#71)" (#77)
This reverts commit 2c7fee3b95.
v0.1.3
2023-12-13 15:13:00 +05:30
Nirant
55379539ef * chore(docs): update Getting Started.ipynb with progressbar + New Models
* * feat(Supported_Models.ipynb): add support for BAAI/bge-small-zh-v1.5 model
* feat(Supported_Models.ipynb): add support for jinaai/jina-embeddings-v2-base-en model
* feat(Supported_Models.ip

* * chore(docs): update Getting Started.ipynb with progressbar
2023-12-13 14:17:25 +05:30
NirantK
ea85e7430f Bump version 2023-12-13 13:27:30 +05:30
Anush
2c7fee3b95 feat: embedding progress bar (#71)
* feat: embedding progress

* refactor: with auto __close__

* refactor: with __exit__ tqdm
v0.1.2
2023-12-12 19:33:12 +05:30
Anush
e274dd0fc2 chore: bump tokenizers (#75) 2023-12-12 18:50:47 +05:30
Anush
0a94425735 feat: Added support for FASTEMBED_CACHE_PATH env var (#68)
* chore: FASTEMBED_CACHE_PATH env

* chore: temp directory fallback

* chore: tempdir fallback JinaEmbedding
2023-11-22 10:39:18 +05:30
Joan Fontanals
f222d7cd87 add JinaEmbeddings class (#67)
* add JinaEmbeddings class

* fix tests dimensions

---------

Co-authored-by: Joan Fontanals Martinez <joan.fontanals.martinez@jina.ai>
2023-11-20 16:37:23 +05:30
Nirant
d64b8f42f0 * chore(pyproject.toml): add huggingface-hub dependency (#66)
* chore(pyproject.toml): update pytest version to 7.4.2
2023-11-20 15:10:56 +05:30
dependabot[bot]
2f95205b23 build(deps): bump urllib3 from 2.0.6 to 2.0.7 (#65)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.0.6 to 2.0.7.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.0.6...2.0.7)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-16 11:37:48 +05:30
Nirant
a39ee46c0b Update EmbeddingModel class to remove ABC (#57)
inheritance
2023-11-02 15:37:43 +05:30
Dominik Weckmüller
bb86b30707 Add typing and numpy import
typing and numpy import were missing
2023-11-01 20:20:47 +05:30