Ryan Gonzalez
8ab8398c50
Use github.com/saracen/walker for file walk operations
...
In some local tests w/ a slowed down filesystem, this massively cut down
on the time to clean up a repository by ~3x, bringing a total 'publish
update' time from ~16s to ~13s.
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2024-04-24 16:46:16 +02:00
André Roth
53c4a567c0
README: add new gitter url
2024-04-21 13:22:06 +02:00
dependabot[bot]
ff8f79f883
Bump golang.org/x/net from 0.17.0 to 0.23.0
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.17.0 to 0.23.0.
- [Commits](https://github.com/golang/net/compare/v0.17.0...v0.23.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-04-20 22:51:50 +02:00
André Roth
06be6f23a6
Revert "Bump requests from 2.28.2 to 2.31.0 in /system"
...
This reverts commit 24e62b58bc .
2024-04-17 22:08:27 +02:00
dependabot[bot]
24e62b58bc
Bump requests from 2.28.2 to 2.31.0 in /system
...
Bumps [requests](https://github.com/psf/requests ) from 2.28.2 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.28.2...v2.31.0 )
---
updated-dependencies:
- dependency-name: requests
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-04-17 21:35:16 +02:00
André Roth
b37a3341e8
trigger pipeline
2024-04-17 18:39:45 +02:00
André Roth
eee6ccc311
trigger pipeline
2024-04-17 18:19:29 +02:00
André Roth
f233a21787
github CI: nightly builds for multiple distributions
...
Since the pipeline changed to use ucuntu22.04 runners, the nighty debian packages do not work on debian buster anymore.
This change updates the pipeline to build for Ubuntu 20.04 and 22.04 as well as for
Debian 10, 11 and 12.
The distribution specific apt sources are as follows:
"deb http://repo.aptly.info/nightly-bookworm bookworm main"
(replace bookworm with focal, buster, bullseye. Install aptly repo key with: curl -fsS https://www.aptly.info/pubkey.txt | sudo gpg --dearmor -o /etc/apt/trusted.gpg.d/aptly.gpg)
The builds on focal will also release to the legacy nightly apt repo: https://github.com/aptly-dev/aptly/actions/runs/8723898496/job/23933824692#step:7:24
This only affects nightly builds, for now.
Pipeline example: [](https://github.com/aptly-dev/aptly/actions/runs/8723898496 )
2024-04-17 17:48:37 +02:00
dependabot[bot]
940538e39b
Bump google.golang.org/protobuf from 1.31.0 to 1.33.0
...
Bumps google.golang.org/protobuf from 1.31.0 to 1.33.0.
---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-04-11 23:34:38 +02:00
André Roth
3a29e08ff2
fix typo
2024-04-11 19:40:25 +02:00
André Roth
2a2e35c096
add test for publishing distribution with slash (/)
2024-04-11 19:37:51 +02:00
Ariel D'Alessandro
287a947c62
Revert "Don't allow '/' in distribution name, auto-replace '/' with '-' while guessing. #110 "
...
This reverts commit 1daa076d65 .
Signed-off-by: Ariel D'Alessandro <ariel.dalessandro@collabora.com >
2024-04-11 19:37:51 +02:00
André Roth
32595e7cb7
openpgp: export full key for internal gpg
2024-04-11 10:15:02 +02:00
André Roth
9deb031c44
fix system tests
...
- use s3 mirror instead of internet download
- reduce download verbosity
- do not use venv in docker-system-tests
- be more verbose on test output
- do not run golangci-lint in system-tests
2024-04-11 10:15:02 +02:00
André Roth
6be4f5e8d0
gpg api: allow self signed and use default gpg version
2024-04-03 10:16:56 +02:00
André Roth
b5b0a52cbe
s3 api: get publish root list
2024-04-03 10:14:01 +02:00
André Roth
a0af6a25aa
fix lint complaints
2024-04-03 10:13:24 +02:00
Robert LeBlanc
c2ee086487
Fix the installer path for Ubuntu Focal
...
Ubuntu has started depreciating the Debian installer in focal
and moved the installer images to a different path. In versions
after focal, they are completly removed. This basically gives
us more time to figure out how to use the new system.
2024-04-03 10:13:24 +02:00
xinhangzhou
43a0ceb350
chore: remove repetitive words
...
Signed-off-by: xinhangzhou <shuangcui@aliyun.com >
2024-04-03 10:12:06 +02:00
André Roth
50eaf6c0bb
update docker / makefile
2024-03-06 12:46:44 +01:00
André Roth
e564b7c150
cleanup Makefile
2024-03-06 08:08:47 +01:00
André Roth
943e76ae8b
golangci-lint: add new github workflow
2024-03-06 08:08:42 +01:00
André Roth
72a7780054
fix golint complaints
2024-03-06 06:21:36 +01:00
dependabot[bot]
1001ca92c8
Bump golang.org/x/crypto from 0.14.0 to 0.17.0
...
Bumps [golang.org/x/crypto](https://github.com/golang/crypto ) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/crypto/compare/v0.14.0...v0.17.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/crypto
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-02-06 21:19:55 +01:00
dependabot[bot]
d060ad7200
Bump github.com/cloudflare/circl from 1.3.3 to 1.3.7
...
Bumps [github.com/cloudflare/circl](https://github.com/cloudflare/circl ) from 1.3.3 to 1.3.7.
- [Release notes](https://github.com/cloudflare/circl/releases )
- [Commits](https://github.com/cloudflare/circl/compare/v1.3.3...v1.3.7 )
---
updated-dependencies:
- dependency-name: github.com/cloudflare/circl
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-02-06 20:50:27 +01:00
Ludovico Cavedon
eeb5bd79d0
s3: fix test
2024-02-06 20:49:35 +01:00
Ludovico Cavedon
fad660450c
Cache bucket content by prefix
...
When a publishing uses a publish prefix, instead of listing the contents
of the whole bucket under the storage prefix, only list the contents of
the bucket under the storage prefix and publish prefix, and cache it by
publish prefix.
This speeds up publish operations under a prefix.
2024-02-06 20:49:35 +01:00
André Roth
01893a492f
s3: call s3.ListFiles only on publish path in LinkFromPool
...
instead of caching the whole s3 bucket, cache only the pool path. this
requires an additional parameter, and since this is an interface, all
implementations need to follow. might help in other backends too.
closes #1181
2024-02-06 20:49:35 +01:00
André Roth
e61a4dd53c
fix golangci-lint errors
2024-02-06 20:49:35 +01:00
André Roth
183e6ec436
fix indentation
2024-02-06 20:49:35 +01:00
André Roth
ebd5aa5fe9
s3: respect default ACLs
2024-02-06 20:49:35 +01:00
André Roth
1b6e5e5b3b
s3: clear / invalidate pathCache for repeated operations
2024-02-06 20:49:35 +01:00
André Roth
7b7ebc5711
s3: fix FileExists not working in some go versions
2024-02-06 20:49:35 +01:00
Nic Waller
92e16c81df
Update AUTHORS
...
as per contributor instructions
2024-02-06 20:49:35 +01:00
Nic Waller
5c1fd4dd2c
clean pathCache
2024-02-06 20:49:35 +01:00
André Roth
d7cc9b89d1
system tests: use repository mirrors on S3 for reproducibility
...
no direct internet download from apt repositories,
which over time will change or cease to exist.
also migrate to gpg2 on newer ubuntu.
2024-02-05 13:04:45 +01:00
André Roth
a69aa7c533
system-tests: add Dockerfile
2024-02-05 13:04:45 +01:00
André Roth
a71186bcc3
gitlab: use ubuntu22.04 runners and gpg2
2024-02-05 13:04:45 +01:00
Paul Cacheux
aeef41bf70
add support for EdDSA keys in pubkeyAlgorithmName
2023-11-23 11:40:58 +01:00
Paul Cacheux
99dbe31d20
fix t09_repo/IncludeRepo21Test_gold gold error
2023-11-23 11:40:58 +01:00
Paul Cacheux
5ca3a97bd3
add name to authors
2023-11-23 11:40:58 +01:00
Paul Cacheux
cfcab13c2a
replace golang.org/x/crypto/openpgp with github.com/ProtonMail/go-crypto/openpgp
2023-11-23 11:40:58 +01:00
dependabot[bot]
f1649a647b
Bump golang.org/x/net from 0.15.0 to 0.17.0
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.15.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.15.0...v0.17.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-11-01 19:32:49 +00:00
Ryan Gonzalez
11deb9425b
Shut down cleanly when 'api serve' is interrupted
...
This will properly close the db and, more particularly, flush out any
profile files being written. Otherwise, they can end up empty or
truncated.
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2023-10-24 15:35:41 +02:00
Sylvain Baubeau
3aaf0a8c44
Switch to aws-sdk-go-v2
2023-10-24 15:30:52 +02:00
Ryan Gonzalez
322e5c1587
Add myself to authors
...
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2023-10-03 08:31:39 +02:00
Ryan Gonzalez
ed45c44931
Fix the test output regex on Go 1.20
...
1.20 changes the output format of coverage checks slightly to include
a package name on each line, followed by `coverage:`, but the current
regex assumes that the line *starts* with `coverage:`.
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2023-10-03 08:31:39 +02:00
Ryan Gonzalez
889fcc2158
Improve test output regex for better perf
...
The current regex runs in exponential time, which massively impacts the
runtime of the test suite, taking several seconds (~4s on my system)
just to perform a single match. By replacing the mix of re.findall + the
initial capture group with re.search + some string slicing, the time
spent matching the regex becomes nearly instant, e.g.:
$ make system-test TESTS='Config*'
goes from taking ~10s to ~1.5s.
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2023-10-03 08:31:39 +02:00
Mauro Regli
f155ed3ba9
Set Golangci-lint timeout to 5m
2023-09-21 11:25:18 +02:00
Mauro Regli
0d20c59a98
Fix: Change expected output for malformed input that changed in Go
2023-09-21 11:25:18 +02:00