33a2f70d07
system-test: Allow skipping coverage
...
Enabling coverage near-doubles the incremental build time and adds
overhead to individual tests on the order of **5-10x** or more. It's not
essential to have this for quick local system-test runs, so add an option
to disable it.
2025-09-23 16:25:46 -05:00
5b04d4fbe1
system-tests: abort on failure
2025-06-09 13:17:54 +02:00
98c82a3684
improve Makefile
...
- simplify Makefile
- improve devserver
- improve make clean
2024-10-08 01:22:10 +02:00
dbc336f921
system-tests: show execution time
2024-10-03 21:53:43 +02:00
caf55bb8e0
ci: cleanup step names
2024-10-03 01:15:56 +02:00
640c202ee5
etcd: implement separate system tests
...
- add t13_etcd test directory
- etcd will be started for the unit tests and each system test
- etcd will load fixture DB export if requested by the test
- existing tests are reused for etcd testing
2024-07-31 22:16:00 +02:00
4a0bdcbb64
improve system tests
...
- log import errors for test modules
- log output only on test failure
- improve docker system test container
- use go 1.19 in docker system tests
- download go dependencies in docker container
- system tests: color failues output
- imrpove test result output
- do not install golangci-lint in system tests
2024-07-24 21:19:47 +02:00
440c3debdc
improve api tests and error output
...
show only relevant aptly logs if a test fails.
for async tasks, show task output, as it contains the error message.
2024-07-24 21:19:47 +02:00
91574b53d9
Add functional tests for Azure publishing
...
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2024-06-17 11:51:18 +02:00
f0bf519d36
cleanup
2024-06-15 19:18:14 +02:00
d8cfafccc9
system tests: improve log output
2024-06-15 19:18:14 +02:00
34c1c1f83a
system-tests: make docker abortable and use colors
2024-06-15 19:18:14 +02:00
d7cc9b89d1
system tests: use repository mirrors on S3 for reproducibility
...
no direct internet download from apt repositories,
which over time will change or cease to exist.
also migrate to gpg2 on newer ubuntu.
2024-02-05 13:04:45 +01:00
1d4e6183be
Capture coverage of integration tests
...
To capture the coverage also for the integration tests,
a test only executing the cmd.Run function is used.
The test always exits with code 0 and prints the
real exit code to stdout. Otherwise no coverage
report is generated.
Those changes enable a more accurate coverage report
for future contributions.
2022-07-13 08:33:48 +02:00
035d5314b0
Convert tests to Python 3
...
Fix #938
2022-01-27 15:06:33 +01:00
8e309b57b3
Workaround differences in the GHA Ubuntu 18.04 environment compared to the Travis CI Ubuntu 16.04 environment.
2022-01-27 09:30:14 +01:00
787cc8e3ee
Fix system tests
2022-01-27 09:30:14 +01:00
993dd2ad1c
Print test exception right away, in case the full test run crashes
2021-02-08 10:52:27 +01:00
ca5b7758ce
Print when test is skipped
2019-07-11 00:49:36 +03:00
4718625388
Avoid exception when failing tests doesn't have a doc string
2017-11-30 09:46:02 +01:00
bd5fc8ae62
Varnish repos got moved
2017-09-15 23:43:51 +03:00
589dc93380
Sort package lists when searching or showing objects
...
Fixes #135
Fixes #214
2017-05-05 18:42:46 +03:00
c798db8056
Add system's requirements.txt, enforce flake8 linter
...
Fix style issues in functional tests.
2017-04-28 00:05:11 +03:00
25f9c29f00
Implemented filesystem endpoint with support for hardlinks, symlinks and copy.
2017-04-13 20:25:40 +02:00
2943422d5d
Automatic versioning for aptly
...
New version format:
* for releases, `x.y.z` (follows tag without leading `v`)
* for nightly builds, `x.y.z+N+hash` (previous version, not the upcoming one)
This means that each nightly build `aptly` would report
correct version now.
Version is now complied into the aptly binary, system tests
automatically check for current version, no need to update them
anymore.
2017-03-25 00:18:45 +03:00
0f328ec1fe
Seed Python random generator on start.
2015-05-28 11:40:11 +03:00
bc357a19a1
Added swift python tests
2015-02-05 17:56:09 +01:00
523d0d0945
Library for API system tests. #116
2014-10-10 17:43:04 +04:00
5d69871ca4
Tests for publishing to Amazon S3.
2014-10-01 17:48:51 +04:00
1a92d8bfe9
Add --capture to auto-create 'gold' results when fail.
2014-07-07 23:29:36 +04:00
d9b35cea01
Allow running system tests by mask.
...
E.g. system/run.py 'ListSnapshot*'.
2014-07-07 23:13:49 +04:00
20513e1c16
Specify individual long tests to run
...
The test script currently only allows to run all the long test. This
change will allow a user to specify individual long tests to run.
2014-07-01 00:51:58 +01:00
803570bf26
Support for running individual suites.
2014-02-07 20:00:21 +04:00
62d3c625ed
Support for internal webserver in tests.
2014-02-03 23:15:50 +04:00
a1258f2125
Revert: run all tests.
2014-01-31 21:14:13 +04:00
59d72c8112
System tests for aptly publish snapshot.
2014-01-31 19:04:44 +04:00
86f3a0b463
Add support for pool/db fixtures, outuput match prepare.
2014-01-24 14:12:52 +04:00
a3df28ec4b
aptly mirror update tests.
2014-01-21 18:07:06 +04:00
1728691462
Don't hard require colors, exit with 1 on errors.
2014-01-21 16:36:40 +04:00
e1ca459329
aptly mirror create system tests.
2014-01-21 14:21:22 +04:00
362cdbcd57
Refactor system tests to live together in one package.
2014-01-21 12:15:28 +04:00
0f902ee74b
System test, first sketch.
2014-01-20 23:39:25 +04:00
Ryan Gonzalez
André Roth
Benj Fassbind
Lorenzo Bolla
Ximon Eighteen
Andrey Smirnov
Oliver Sauder
Clemens Rabe
Sebastien Badia
Simon Aquino