Commit Graph
61 Commits
Author SHA1 Message Date
Lorenzo Bolla f89350e6cd Timeout CI build job after 30 minutes
Fix #1032
2022-02-13 21:07:50 +01:00
Lorenzo Bolla fd404064c9 Use University of Utah mirror in tests
Fix #1034
2022-02-13 20:44:28 +01:00
Lorenzo Bolla e8ec6385f3 Fix linting errors 2022-02-08 11:18:50 +01:00
Lorenzo Bolla 1361bf20dd Revive skipped tests 2022-02-08 11:18:50 +01:00
Lorenzo Bolla 5d98546e1d Use a more recent GPG key server 2022-02-08 11:18:50 +01:00
Lorenzo Bolla 2c68175b5c Update man pages 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 551a370c13 Basic tests for Grab downloader 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 1afcd68e01 Make downloader type configurable 2022-01-31 10:32:54 +01:00
Lorenzo Bolla cc30ef3ee2 Remove vendor directory
We use go modules now.
2022-01-31 10:32:54 +01:00
Lorenzo Bolla 235e35a2f3 Rate limit 0 effectively disables rate limiting 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 4c54f967b7 Fix error checking 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 8925949be3 Support rate limiting in grab downloader 2022-01-31 10:32:54 +01:00
Lorenzo Bolla e96372c999 Implement ignore checksum mismatch
Also, update "pkg/errors" library.
2022-01-31 10:32:54 +01:00
Lorenzo Bolla e5d9d27069 Wrap errors with more context 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 853c990b6e Handle checksums 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 86c1ffab2a Add logs for checksum 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 952287a787 Reenable checksums 2022-01-31 10:32:54 +01:00
Lorenzo Bolla b5d90b7b13 Add more logging 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 3e06af8515 Disable checksum for now 2022-01-31 10:32:54 +01:00
Lorenzo Bolla eff2e56d0d Specify output filename instead of directory
"temp" downloader uses its own naming for downloaded files.
2022-01-31 10:32:54 +01:00
Lorenzo Bolla eaac04ccf6 Improve logging in grab downloader 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 894192851e Grab downloader 2022-01-31 10:32:54 +01:00
Lorenzo Bolla 035d5314b0 Convert tests to Python 3
Fix #938
2022-01-27 15:06:33 +01:00
Lorenzo Bolla 70f7d7409a Allow to check for empty output in tests 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 48635c8057 Strip irrelevant lines from test output
It may happen that aptly retries to download data during tests (maybe because
of a network issue), but our fixtures doesn't account for it. So, we strip
those irrelevant lines before comparison.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 30e94064e5 Ignore dates in test 2022-01-27 09:30:14 +01:00
Lorenzo Bolla d60e575af5 Re-enable testing on go 1.17 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 91c3ed8ec4 Fix failing tests 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 0dc49d2a70 Silence unhelpful linter error
See #1012
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 9bf1a44f75 Fix test after merge 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 8ecd01be1f Temporarily skip test failing on CI 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 4933e3caf4 Try to fix test failing on CI
PublishRepo26Test fails to run because something in the CI environment forces
gpg to ask for the user's password. Try to require gpg1 for the test, which
seems to run fine in other environments.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 4a9a5bc713 Fix some failing system tests 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 7412b84e04 Fix flake8 lint errors 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 3775d69a60 Fix linting errors 2022-01-27 09:30:14 +01:00
Lorenzo Bolla b281819cba Make truthy function less surprising 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 6826efc723 Fix pure-go unittests
So they can run on e.g. LXC containers as root, or other conceivable setups.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 370e3cdfea Fix unittests 2022-01-27 09:30:14 +01:00
Lorenzo Bolla fb8b05e7fd Fix rebase 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 8c94973cf9 Fix indentation 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 787cc8e3ee Fix system tests 2022-01-27 09:30:14 +01:00
Lorenzo Bolla ff51c46915 More informative return value for task.Process 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 0914cd16af Use global async flag as fallback on per-request flag
This way, if no pre-request flag is specified, the globally configured default
is used.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 9b28d8984f Configurable background task execution 2022-01-27 09:30:14 +01:00
Lorenzo Bolla bd4c3a246d Add new AUTHORS 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 914ddf4859 Fix syntax error 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 2fa3adee1d Don't use transactions when direct db access is enough
For read-only action transactions are not necessary and they risk to deadlock
if multiple go-routines try to read the database.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla fd83c1a5bf Cap delay to sleep to avoid overflow 2022-01-27 09:30:14 +01:00
Lorenzo Bolla de2be9b8ae Sleep between retries to download from http
Fix #1
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 5a65ce6adb mirror: add more logging 2022-01-27 09:30:14 +01:00
Lorenzo Bolla 79a7cf864e mirror: interrupt goroutine when done
This should avoid deadlocking when context is destroyed.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla 19f7b0fe8d mirror: increase logging for easier debugging 2022-01-27 09:30:14 +01:00
Lorenzo Bolla faf2d588b1 Use verifier from context 2022-01-27 09:30:14 +01:00
Lorenzo Bolla af2564c580 Use newer Go for mod file 2021-02-12 09:23:24 +01:00
Lorenzo Bolla b385b1e975 Fix test breaking on newer versions of Go
Apparently, Go error message slightly changed in newer versions.
2021-02-12 09:23:24 +01:00
Lorenzo Bolla ce1d4b852a Test against more recent versions of Go
Run basic tests for all minor versions since 1.11 and full tests for the last
two most recent versions.

Fix #939
2021-02-12 09:23:24 +01:00
Lorenzo Bolla c43d31f693 Don't fail hard if we can't clean Swift up 2021-02-08 10:52:27 +01:00
Lorenzo Bolla e4259c5045 Always try to get a version
Even if a simple git hash.
2021-02-08 10:52:27 +01:00
Lorenzo Bolla 993dd2ad1c Print test exception right away, in case the full test run crashes 2021-02-08 10:52:27 +01:00
Lorenzo Bolla 3201244d9b Fix tests and fixtures relying on expired pgp keys
PGP tests relied on expired gpg keys: upgrade with newer Debian keys from
https://ftp-master.debian.org/keys.html.
Download new fixtures files from http://ftp.debian.org/debian/dists/buster/
2021-02-08 10:52:27 +01:00
Lorenzo Bolla f4dc87fa44 Use a hostname more likely to be non-existent than localhost
Otherwise, it's possible that certain network configuration defining
*.localhost cause the tests to fail.
2021-02-08 10:52:27 +01:00