Commit Graph

170 Commits

Author SHA1 Message Date
Arnaud Gourlay
fe94fdc5ce Bump Python 3.13 on CI (#7365)
* Bump Python 3.13 on CI

* Regenerate tls certificates

---------

Co-authored-by: tellet-q <elena.dubrovina@qdrant.com>
2025-10-08 12:50:34 +02:00
tellet-q
c3ca182423 Refactor bash tests: storage-compatibility (#7299)
* Add e2e test for compatibility
2025-10-08 08:33:55 +02:00
dependabot[bot]
372747799b build(deps): bump sigstore/cosign-installer from 3.9.2 to 3.10.0 (#7259)
Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.9.2 to 3.10.0.
- [Release notes](https://github.com/sigstore/cosign-installer/releases)
- [Commits](https://github.com/sigstore/cosign-installer/compare/v3.9.2...v3.10.0)

---
updated-dependencies:
- dependency-name: sigstore/cosign-installer
  dependency-version: 3.10.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-16 09:29:18 +02:00
dependabot[bot]
6fcc3f8de3 build(deps): bump actions/setup-python from 5 to 6 (#7231)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 5 to 6.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v5...v6)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-09 10:26:46 +02:00
Bastian Hofmann
c975f01193 Fix permissions in Docker Image pipeline (#7152) 2025-08-27 10:17:06 +02:00
Kumar Shivendu
3b1ef64ebd fix dockerhub username in builds (#7128)
* fix dockerhub username in builds

* avoid explicitly setting dockerhub url

* Use --password-stdin instead of --password
2025-08-25 16:35:03 +05:30
Bastian Hofmann
4e8e9daf91 Sign container images with cosign (#7119)
* Sign container images with cosign

This allows users to securely verify that a Qdrant container image was created by us

* Add contents read permission
2025-08-25 11:45:23 +02:00
Kumar Shivendu
ad08d64372 Push dev branch images to dockerhub (#7107)
* Push dev branch images to dockerhub

* temporarily update dockerhub push condition

* Temporarily disable dockerhub push

* Suggestions

* Add back code to push to dockerhub

* Use github.ref_name instead of github.ref.name
2025-08-22 17:51:40 +05:30
Bastian Hofmann
49c25a9cc5 Generate SBOM during Docker build (#7111) 2025-08-21 13:25:23 +02:00
dependabot[bot]
90f39208c9 build(deps): bump actions/download-artifact from 4 to 5 (#7018)
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 4 to 5.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 11:02:15 +02:00
dependabot[bot]
8ffae5b2cb build(deps): bump actions/checkout from 4 to 5 (#7026)
Bumps [actions/checkout](https://github.com/actions/checkout) from 4 to 5.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-08-12 11:00:41 +02:00
Tim Visée
6c592c7b6d Fix GPU build in CI due to outdated package index (#7010)
* Update APT package index before installing

* Install clang and other packages with single command

* Don't quiet package index update
2025-08-11 14:16:40 +02:00
tellet-q
f87e505439 Refactor bash tests: low-ram (#6911)
* Refactor low-ran bash test

* Address review
2025-08-05 13:05:39 +02:00
tellet-q
f84e1f1f4a Refactor bash tests: low-disk (#6845)
* Add e2e_tests pytest test suite

* Remove old bash test
2025-07-14 12:42:06 +02:00
Arnaud Gourlay
96db34e522 Bump poetry version to avoid potential compat. issues (#6818)
* Bump poetry version to avoid potential compat. issues

* Poetry does not run bash script anymore

* fix path

* use new --project flag

* migrate also coverage for good measure
2025-07-08 10:45:45 +02:00
xzfc
e54def39dd Move .github/workflows/actions to .github/actions (#6697) 2025-06-17 01:48:53 +00:00
xzfc
ff0df47714 Move codespell config to tools/codespell.toml (#6707) 2025-06-16 22:06:06 +00:00
n0x29a
5dfe4b1db3 Add stopwords support (#6635)
* Add stopwords support

* Update codespell configuration and improve stopword assertion message

* Add stopwords schema to OpenAPI definition

* Rename StopwordsOption to StopwordsInterface

* Add stopwords support for multiple languages

* Update codespell configuration to skip all Rust files in stop_words directory

* Normalize stopwords to lowercase during insertion

* Add language aliases for stopwords

* + grpc

* Unspecified Language

* clippy fmt

* openapi

* Refactor to use BTreeSet

* update tokenizer test to include custom stopwords with contractions

* simplified grpc StopwordsInterface

* alias for languages

* use `lowercase` flag for stop word normalizing

* grpc: enum -> string

* consistent naming

* Remove UnspecifiedLanguage and use From for conversions

* fix conversions

* fmt

* use stopwords inside different tokenizer

* use ahash

* fix tests

* fix no-rocks-db feature

* simplify code and fix test

* update test

* fix clippy

* fmt

---------

Co-authored-by: generall <andrey@vasnetsov.com>
2025-06-16 12:48:21 +02:00
Tim Visée
7c3e7dc7eb Run unit tests in CI without RocksDB flag (#6675)
* Add temporary job for unit tests on CI without RocksDB feature

* Remove trailing white spaces

* Fix artifact name collision

* Don't upload test report for tests without RocksDB
2025-06-12 13:08:26 +02:00
Jayant Pranjal
1184e2500c Replaced ::set-output(deprecated) with (#6641)
Co-authored-by: Jayant <jayant@Jayants-MacBook-Air.local>
2025-06-05 10:20:12 +02:00
Jayant Pranjal
4b2bf54898 Added major and minor docker tags (#6611)
Co-authored-by: Jayant <jayant@Jayants-MacBook-Air.local>
2025-06-04 17:56:55 +02:00
Tim Visée
97ea705ae4 Use Ubuntu 22.04 CI runner image, because 20.04 is deprecated (#6590) 2025-05-26 10:38:31 +02:00
Kumar Shivendu
5b7daee8d1 Fix dev branch coverage (#6538)
* Fix dev branch coverage

* Add comments
2025-05-16 09:17:35 +02:00
Tim Visée
098cfb16f3 Revert "Downgrade cmake 3.x (#6306)" (#6484)
This reverts commit 21fb1652ab.
2025-05-05 12:58:11 +02:00
Arnaud Gourlay
ce39fa30f2 Use mold for building tests (#6436) 2025-04-28 12:34:16 +02:00
Roman Titov
228d4b23a7 Generate less debug symbols in dev profile (#6443)
* Generate less debug symbols in `dev` profile

* Retain `integration-tests-consensus` logs for 10 days (instead of 90)
2025-04-28 12:28:39 +02:00
Kumar Shivendu
c8a960604a Introduce coverage reports for integration tests (#6414)
* Introduce coverage reports for integration tests

* Install cargo-llvm-cov

* Use multiline script

* Explicityl setup COVERAGE env var

* fix integration tests and log generated data

* fix ls path

* upload lcov file to GH artifacts

* integration profraw dynamic filename

* Fix llvm profile filename template

* Use interrupt instead of kill and merge consensus test results into same file

* Drop upload artifact stage

* install llvm-cov

* upload as artifact and export coverage files

* try simplifying workflow

* Migrate coverage generation to existing dedicated gh workflow

* trigger on coverage related branches

* Build only if qdrant binary with cov doesnt exist

* Use valid yaml

* include mode in profraw filename

* split coverage workflow into parallel jobs

* add poetry version to env

* log poetry version to install

* clean up integration test workflow

* Simplify comments
2025-04-25 16:42:41 +05:30
Roman Titov
b77a1a356e Optimize GitHub Actions workflows (#6362)
* Add shared rust-cache key for integration test jobs

* Disable debug symbols

* Remove non-necessary setup steps...

...from `test-low-resources` and `test-snapshot-operations-s3-minio` jobs

* Always upload `test-consensus`/`integration-tests-consensus` logs...

...even when tests passed successfully

* Reduce poll interval for `wait_for` checks in integration tests
2025-04-16 12:00:20 +02:00
Roman Titov
7bc8f2f77a Rename some GHA jobs, so that default rust-cache keys are unique for all workflows/jobs (#6280) 2025-04-14 16:04:33 +02:00
Kumar Shivendu
c11be87d7a Fix codecov branch issue (#6345) 2025-04-08 14:10:01 +05:30
Arnaud Gourlay
2eae9a2ec1 Fixing failing CI due to missing liblzma (#6329)
* Fixing failing CI due to missing liblzma

* Try again
2025-04-07 10:51:23 +02:00
Arnaud Gourlay
21fb1652ab Downgrade cmake 3.x (#6306)
* Downgrade cmake 3.x

* Only where needed

* Add comments
2025-04-02 17:00:05 -03:00
Kumar Shivendu
babd9a616c Code cov override branch (#6262) 2025-03-28 20:09:03 +05:30
tellet-q
ced9dbe216 Use common actions pattern in workflows (#6061)
* Use common actions pattern

* Update gpu workflow
2025-03-05 14:14:49 +01:00
tellet-q
efdae1592f Add workflow that can be triggered (#6059)
an experiment
2025-02-25 14:56:10 +01:00
Tim Visée
16734b9a5b Revert "Temporarily run code coverage on merging to dev (#5911)" (#5982)
This reverts commit efcbce195e.
2025-02-13 15:49:04 +05:30
Kumar Shivendu
b09ae8dd7c Fix coverage test OOD on CI (#5927)
* Fix coverage test OOD on CI

* Temporarily run coverage CI on PR

* Clean artifacts per package and store in tmp dir

* fix typo in gh workflow

* Add monitoring script again for debugging

* trigger script

* Fix monitor script path

* dont checkout dev branch

* Merge .info file only if test passed

* Try merging .info file only if it exists

* trigger ci

* fix workflow

* trigger ci

* Customize branch to check out

* Remove monitor.sh script

* remove unused env var
2025-02-05 21:45:47 +05:30
dependabot[bot]
28f9370bbe build(deps): bump codecov/codecov-action from 3 to 5 (#5940)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 3 to 5.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v3...v5)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-02-04 15:07:36 +05:30
Arnaud Gourlay
548ba1f026 Use cargo --locked on CI for reproducible builds (#5913) 2025-02-03 10:26:52 +01:00
Kumar Shivendu
efcbce195e Temporarily run code coverage on merging to dev (#5911) 2025-01-31 13:43:14 +01:00
Kumar Shivendu
b2ba0f966f Setup code coverage reports (#5751)
* Setup code coverage for Rust tests

* Add API key env var for codecov

* Save code coverage report for upload

* Trigger CI

* Try without explicit build step

* Run coverage job on self hosted runner

* Fix mistake because of which is was running fewer tests

* Run coverage on ubuntu latest

* Trigger CI

* fix name

* run coverage on all os

* Adjust after rebase to dev

* Avoid running coverage in other jobs

* fix test job

* reset test workflow

* Trigger CI

* run coverage after tests

* Add script to monitor resources

* fix indentation

* remove coverage dependency on test job

* fix needs field

* add monitoring script

* Run tail -f to monitor resources concurrently with tests

* Split commands

* Use --jobs=1 to possibly minimize RAM

* Try generating coverage one by one

* Dont clean coverage artifacts

* Merge .lcov files with lcov command

* Upload merged lcov.info file

* Run coverage for fewer packages

* Improve coverage script

* Move coverage.sh to tools dir

* Prepare for review

* Improve CI output and failure handling

* Generate HTML report if running locally

* Cleanup

* Run coverage on schedule and only for dev branch
2025-01-29 23:51:22 +05:30
xzfc
a923f6b6f9 Update codespell config (#5846) 2025-01-22 09:48:08 +01:00
Tim Visée
d1bf354874 Experiment: enable bindgen-runtime for RocksDB (#5768)
* Enable bindgen-runtime feature for RocksDB

* Test without libclang and llvm on CI
2025-01-10 15:34:51 +01:00
Arnaud Gourlay
821afded47 Update rocksdb 0.23.0 (#5765)
* Update Rocksdb 0.23.0

* make it work
2025-01-10 11:48:06 +01:00
Ivan Pleshkov
dc6bdcc622 unique workflow job names for gpu (#5758) 2025-01-08 14:32:23 +01:00
Ivan Pleshkov
2cf42d7167 Add GPU into github workflows (#5752)
* parent 88f68d95b5
author Ivan Pleshkov <pleshkov.ivan@gmail.com> 1736245999 +0100
committer Ivan Pleshkov <pleshkov.ivan@gmail.com> 1736331073 +0100

gpu test and release workflows

no unprivileged, add sdk

fix ci

include llvm

try to use external sdk

use another vk sdk script

remove ninja

native sdk installation

debug vulkan version

use non-dev packages

debug vkinfo

remove llvm dep

ubuntu process-results

ghcr

* remove running gpu test while pr
2025-01-08 13:51:15 +01:00
Arnaud Gourlay
1d92c18b85 Fix poetry version in CI (#5734)
* Fix poetry version in CI

* extract version
2025-01-06 11:29:22 +01:00
Arnaud Gourlay
843220e458 Track slow pytest integration tests (#5722)
* Track slow pytest integration tests

* gofor top 10
2025-01-03 12:08:48 +01:00
Andrey Vasnetsov
5cba8ace43 Explict configuration for deb package build (#5630)
* explicit configuration of deb package

* use special build feature

* Review suggestions

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
2024-12-10 11:04:41 +01:00
xzfc
54e6afedf6 Fix shard snapshot operations for s3 (#5227)
* Fix shard snapshot operations for s3

* tests/shard-snapshot-api.sh: Improve error reporting

* Drop SnapshotStorageManager::get_shard_snapshot_path

* Fix s3 test on CI
2024-10-14 22:35:01 +00:00