Commit Graph

84 Commits

Author SHA1 Message Date
dependabot[bot]
a76b755767 build(deps): bump lukemathwalker/cargo-chef (#5046)
Bumps lukemathwalker/cargo-chef from latest-rust-1.80.1 to latest-rust-1.81.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-10 06:53:25 +02:00
dependabot[bot]
a035938c1f build(deps): bump lukemathwalker/cargo-chef (#4877)
Bumps lukemathwalker/cargo-chef from latest-rust-1.80.0 to latest-rust-1.80.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-13 09:54:54 +02:00
dependabot[bot]
d5823cfe5b build(deps): bump lukemathwalker/cargo-chef (#4776) 2024-07-30 14:55:48 +00:00
dependabot[bot]
425de5d27e Bump lukemathwalker/cargo-chef (#4483)
Bumps lukemathwalker/cargo-chef from latest-rust-1.78.0 to latest-rust-1.79.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-18 07:52:31 +02:00
Roman Titov
535f4e206c Dockerfile updates (#4414) 2024-06-07 23:24:17 +02:00
dependabot[bot]
81549cd479 Bump lukemathwalker/cargo-chef (#4181)
Bumps lukemathwalker/cargo-chef from latest-rust-1.77.2 to latest-rust-1.78.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-07 08:09:46 +02:00
dependabot[bot]
84b57f51e1 Bump lukemathwalker/cargo-chef (#4039)
Bumps lukemathwalker/cargo-chef from latest-rust-1.77.1 to latest-rust-1.77.2.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-16 06:14:05 +02:00
dependabot[bot]
158e32dc67 Bump lukemathwalker/cargo-chef (#3986)
Bumps lukemathwalker/cargo-chef from latest-rust-1.77.0 to latest-rust-1.77.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-09 16:23:57 +02:00
dependabot[bot]
8b15035e94 Bump lukemathwalker/cargo-chef (#3909)
Bumps lukemathwalker/cargo-chef from latest-rust-1.76.0 to latest-rust-1.77.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-26 09:56:51 +01:00
Kumar Shivendu
cf9f5aab98 fix: Include git commit id while building docker image if possible (#3640)
* feat: Print commit id in dev container build workflow

* fix: Keep .git while building Qdrant binary in docker

* fix: Remove redundant printing of git commit id

* fix: Copy only git files first

* fix: Docker build should have commit id if present

* refactor: Use fewer lines of code

* feat: Use git commit id from build arg

* refactor: Use cleaner code

* Fix string reference issue

* fix: Dont print info log if commit is not set

* fix: Include git commit id in release containers

---------

Co-authored-by: timvisee <tim@visee.me>
2024-02-22 21:26:44 +05:30
dependabot[bot]
700e0510a1 Bump lukemathwalker/cargo-chef (#3603)
Bumps lukemathwalker/cargo-chef from latest-rust-1.75.0 to latest-rust-1.76.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-13 08:17:30 +01:00
Matt Busche
8696e73ce2 Only install the main packages (#3462)
* Only install the main packages

and ignore recommended packages

Fix consistency with `AS` for alias

* install all packages

* don't worry about deleting sources

Co-authored-by: Tim Visée <tim+github@visee.me>

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
2024-01-30 09:37:30 +01:00
Andrey Vasnetsov
5afe7defc4 Revert "fix: Include git commit id while building docker image if possible" (#3468) 2024-01-26 00:29:20 +01:00
Kumar Shivendu
85a08adcb8 fix: Include git commit id while building docker image if possible (#3419)
* feat: Print commit id in dev container build workflow

* fix: Keep .git while building Qdrant binary in docker

* fix: Remove redundant printing of git commit id

* fix: Copy only git files first

* fix: Docker build should have commit id if present

* refactor: Use fewer lines of code
2024-01-25 23:24:19 +05:30
dependabot[bot]
b5df126686 Bump lukemathwalker/cargo-chef (#3306)
Bumps lukemathwalker/cargo-chef from latest-rust-1.74.1 to latest-rust-1.75.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-02 13:19:38 +01:00
dependabot[bot]
73dc6255b6 Bump lukemathwalker/cargo-chef (#3208)
Bumps lukemathwalker/cargo-chef from latest-rust-1.74.0 to latest-rust-1.74.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-13 11:50:48 +00:00
Tim Visée
21a61bc1a8 Bump Rust to v1.74.0 (#3032) 2023-11-17 12:29:09 +01:00
Roman Titov
14bea38555 Update mold in the Dockerfile to 2.3.2 (#2990)
* Update `mold` in the Dockerfile to 2.3.2

* Use absolute paths when creating `storage`/`snapshots` directories...

...for unpriveleged Docker container builds
2023-11-14 09:51:04 +01:00
ilkecan
8bec3bc0c1 Precreate and chown snapshots and storage dirs (#2921)
... in unprivileged mode to avoid Docker named volumes being owned by
the root user.
2023-11-03 19:29:45 +01:00
Roman Titov
48889ec5a3 Update mold in the Dockerfile to 2.3.1 (#2859) 2023-10-24 20:31:30 +02:00
Andrey Vasnetsov
98604d1334 Revert "Bump lukemathwalker/cargo-chef (#2781)" (#2794)
This reverts commit ec25c666c2.
2023-10-11 15:20:38 +02:00
dependabot[bot]
ec25c666c2 Bump lukemathwalker/cargo-chef (#2781)
Bumps lukemathwalker/cargo-chef from latest-rust-1.72.1 to latest-rust-1.73.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-10 08:46:47 +02:00
dependabot[bot]
ebb2e53bbd Bump lukemathwalker/cargo-chef (#2727)
Bumps lukemathwalker/cargo-chef from latest-rust-1.72.0 to latest-rust-1.72.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-26 10:03:32 +02:00
Roman Titov
84c91c01bb Update mold in the Dockerfile to 2.2.0 (#2726) 2023-09-25 23:58:54 +02:00
Roman Titov
8b031ae302 Fix unprivileged Docker container build (#2725) 2023-09-25 23:58:43 +02:00
Bastian Hofmann
c8ab08a057 Build an unprivileged container image (#2613)
* Build an unprivileged container image

This adds building an additional container image with the `-unprivileged` suffix. The resulting container is not running with a root user. Otherwise it is the same as the standard qdrant container image.

Having an image that is running as nonRoot is necessary in a lot of enterprise environments due to security and compliance restrictions.

* Update to use only one Dockerfile with buildargs and one action job to reuse the cached layers from the privileged image

* Also build latest-unprivileged and address feedback
2023-09-11 12:27:46 +02:00
Tim Visée
1b858a6fc4 Fix pkg-config installation for cross compilation in Docker (#2604) 2023-09-07 13:53:07 +02:00
Arnaud Gourlay
c276e6cd31 add OCI labels on docker image (#2576)
* add OCI labels on docker image

* set version in build script

* Update .github/workflows/docker-image.yml

Co-authored-by: Tim Visée <tim+github@visee.me>

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
2023-09-04 16:09:43 +02:00
dependabot[bot]
dc924030ec Bump lukemathwalker/cargo-chef (#2516)
Bumps lukemathwalker/cargo-chef from latest-rust-1.71.1 to latest-rust-1.72.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-29 09:46:22 +02:00
Andrey Vasnetsov
f5ee26d290 Fix unwind-sys (dependency of rstack-self) cross-compilation in Docker (#2499)
Co-authored-by: Roman Titov <ffuugoo@users.noreply.github.com>
2023-08-24 21:17:47 +02:00
Andrey Vasnetsov
d382bbef44 Stacktrace API (#2457)
* enable /stacktrace API in docker builds

* fmt

* fix ci
2023-08-17 13:50:34 +02:00
dependabot[bot]
05f31c7ac3 Bump lukemathwalker/cargo-chef (#2394)
Bumps lukemathwalker/cargo-chef from latest-rust-1.71.0 to latest-rust-1.71.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-08 09:36:51 +02:00
Roman Titov
41ccc98b7a Update mold in the Dockerfile to 2.0.0 (#2393) 2023-08-07 14:25:24 +02:00
dependabot[bot]
c8837dd753 Bump lukemathwalker/cargo-chef (#2274)
Bumps lukemathwalker/cargo-chef from latest-rust-1.70.0 to latest-rust-1.71.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 08:53:34 +02:00
dependabot[bot]
970d654510 Bump debian from 11-slim to 12-slim (#2105)
Bumps debian from 11-slim to 12-slim.

---
updated-dependencies:
- dependency-name: debian
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-20 13:26:28 +02:00
Andrey Vasnetsov
967d387a37 Web UI integration (#2009)
* wip: integrate UI web interface

* fmt

* Api key exclusion rule + fixes

* upd welcome url

* rollback api key in config
2023-06-06 21:42:24 +02:00
dependabot[bot]
220d866f27 Bump lukemathwalker/cargo-chef (#2025)
Bumps lukemathwalker/cargo-chef from latest-rust-1.69.0 to latest-rust-1.70.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-06 09:33:07 +02:00
dependabot[bot]
d8efe7aa59 Bump lukemathwalker/cargo-chef (#1984)
Bumps lukemathwalker/cargo-chef from latest-rust-1.68.1 to latest-rust-1.69.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-30 08:40:19 +02:00
Roman Titov
abffa27ff0 Refactor Dockerfile (#1594)
* Refactor Dockerfile

- fix cross-compilation
- improve caching

TODO:
- check if `lld` is used/works for linkage (and enable if not used, or remove if doesn't work)

* Remove `aarch64` linker config from `.cargo/config.toml` (seems to be unnecessary)

* Expose `LINKER` argument and enable `lld` linker

* Add `mold` linker support

* Document Dockerfile

* Add closing ` in the Dockerfile comments

Co-authored-by: Tim Visée <tim+github@visee.me>

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
2023-05-26 16:01:43 +02:00
Andrey Vasnetsov
72c3b9070d temporary disable mold to let the docker build (#1954) 2023-05-23 20:44:37 +02:00
Andrey Vasnetsov
5f0e3585db move linker to docker (#1863)
* move linker to docker

* move mold install to builder

* use release profile by default

* fix mold download

* add build-args to CI builds

* add missing buil args
2023-05-09 11:57:31 +02:00
Jesse
34055f0ddf Custom build profile for CI docker builds (#1859)
* Use custom build profile for docker builds

* trigger ci

* change source code to trigger ci with rebuild one more time

---------

Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
2023-05-08 20:39:59 +02:00
Roman Titov
16b7fb7688 Improve handling out-of-RAM errors during Qdrant startup (#1777)
* WIP: Start working on out-of-RAM errors handling [skip ci]

* Implement basic handling of out-of-RAM errors during Qdrant startup

* Try to fix CI fail by allowing both V1 and V2 cgroups

* Try to fix CI fail by improving cgroups handling

* Fix cgroups path detection/handling (+ some minor stylistic changes)

* fixup! Fix cgroups path detection/handling (+ some minor stylistic changes)

* Add test

* Enable low RAM test

* fixup! Add test

* free memory checks

* rm unused function

* Oom fallback script (#1809)

* add recover mode in qdrant + script for handelling OOM

* fix clippy

* reformat entrypoint.sh

* fix test

* add logging to test

* fix test

* fix test

---------

Co-authored-by: Andrey Vasnetsov <andrey@vasnetsov.com>
2023-05-02 20:54:13 +02:00
dependabot[bot]
be36fae111 Bump lukemathwalker/cargo-chef (#1778)
Bumps lukemathwalker/cargo-chef from latest-rust-1.68.2 to latest-rust-1.69.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-25 06:32:13 +02:00
Andrey Vasnetsov
e034b0ea35 Try to fix dying shards (#1682)
* use common channel pool for healthcheck requests

* add dynamic channel pool

* fmt

* lower parallel connections num

* fmt

* fix clippy

* fix clippy

* better status error message

* smarter channel dropping conditions

* per-channel stats

* refactor pool

* rollback dockerfile

* health-check timeout

* prevent reporting last active peer as dead

* introduce update rate limit

* only rate-limit client requests

* ability to save snapshot without locking wal (#1685)

* ability to save snapshot without locking wal

* fix empty wal saving

* skip waiting on local shard in listener mode even if it is a direct request to listener shard

* snapshot recovery test + better handling of segment versions

* use latest wal

* review changes
2023-04-10 15:29:39 +02:00
dependabot[bot]
0d6f53cc9e Bump lukemathwalker/cargo-chef (#1646)
Bumps lukemathwalker/cargo-chef from latest-rust-1.68.1 to latest-rust-1.68.2.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-04 10:33:11 +02:00
dependabot[bot]
39abbd2155 Bump lukemathwalker/cargo-chef (#1611)
Bumps lukemathwalker/cargo-chef from latest-rust-1.68.0 to latest-rust-1.68.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-28 10:14:23 +02:00
dependabot[bot]
24a4cd6156 Bump lukemathwalker/cargo-chef (#1584)
Bumps lukemathwalker/cargo-chef from latest-rust-1.67.1 to latest-rust-1.68.0.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-21 12:18:30 +01:00
Tim Visée
3caab75386 Make gcc-multilib optional in Docker build (#1531) 2023-03-07 17:03:20 +01:00
dependabot[bot]
479675a6cd Bump lukemathwalker/cargo-chef (#1469)
Bumps lukemathwalker/cargo-chef from latest-rust-1.67.0 to latest-rust-1.67.1.

---
updated-dependencies:
- dependency-name: lukemathwalker/cargo-chef
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-13 22:22:08 +01:00