Ryan Gonzalez
33a2f70d07
system-test: Allow skipping coverage
...
Enabling coverage near-doubles the incremental build time and adds
overhead to individual tests on the order of **5-10x** or more. It's not
essential to have this for quick local system-test runs, so add an option
to disable it.
2025-09-23 16:25:46 -05:00
André Roth
5b04d4fbe1
system-tests: abort on failure
2025-06-09 13:17:54 +02:00
André Roth
98c82a3684
improve Makefile
...
- simplify Makefile
- improve devserver
- improve make clean
2024-10-08 01:22:10 +02:00
André Roth
dbc336f921
system-tests: show execution time
2024-10-03 21:53:43 +02:00
André Roth
caf55bb8e0
ci: cleanup step names
2024-10-03 01:15:56 +02:00
André Roth
640c202ee5
etcd: implement separate system tests
...
- add t13_etcd test directory
- etcd will be started for the unit tests and each system test
- etcd will load fixture DB export if requested by the test
- existing tests are reused for etcd testing
2024-07-31 22:16:00 +02:00
André Roth
4a0bdcbb64
improve system tests
...
- log import errors for test modules
- log output only on test failure
- improve docker system test container
- use go 1.19 in docker system tests
- download go dependencies in docker container
- system tests: color failues output
- imrpove test result output
- do not install golangci-lint in system tests
2024-07-24 21:19:47 +02:00
André Roth
440c3debdc
improve api tests and error output
...
show only relevant aptly logs if a test fails.
for async tasks, show task output, as it contains the error message.
2024-07-24 21:19:47 +02:00
Ryan Gonzalez
91574b53d9
Add functional tests for Azure publishing
...
Signed-off-by: Ryan Gonzalez <ryan.gonzalez@collabora.com >
2024-06-17 11:51:18 +02:00
André Roth
f0bf519d36
cleanup
2024-06-15 19:18:14 +02:00
André Roth
d8cfafccc9
system tests: improve log output
2024-06-15 19:18:14 +02:00
André Roth
34c1c1f83a
system-tests: make docker abortable and use colors
2024-06-15 19:18:14 +02:00
André Roth
d7cc9b89d1
system tests: use repository mirrors on S3 for reproducibility
...
no direct internet download from apt repositories,
which over time will change or cease to exist.
also migrate to gpg2 on newer ubuntu.
2024-02-05 13:04:45 +01:00
Benj Fassbind
1d4e6183be
Capture coverage of integration tests
...
To capture the coverage also for the integration tests,
a test only executing the cmd.Run function is used.
The test always exits with code 0 and prints the
real exit code to stdout. Otherwise no coverage
report is generated.
Those changes enable a more accurate coverage report
for future contributions.
2022-07-13 08:33:48 +02:00
Lorenzo Bolla
035d5314b0
Convert tests to Python 3
...
Fix #938
2022-01-27 15:06:33 +01:00
Ximon Eighteen
8e309b57b3
Workaround differences in the GHA Ubuntu 18.04 environment compared to the Travis CI Ubuntu 16.04 environment.
2022-01-27 09:30:14 +01:00
Lorenzo Bolla
787cc8e3ee
Fix system tests
2022-01-27 09:30:14 +01:00
Lorenzo Bolla
993dd2ad1c
Print test exception right away, in case the full test run crashes
2021-02-08 10:52:27 +01:00
Andrey Smirnov
ca5b7758ce
Print when test is skipped
2019-07-11 00:49:36 +03:00
Oliver Sauder
4718625388
Avoid exception when failing tests doesn't have a doc string
2017-11-30 09:46:02 +01:00
Andrey Smirnov
bd5fc8ae62
Varnish repos got moved
2017-09-15 23:43:51 +03:00
Andrey Smirnov
589dc93380
Sort package lists when searching or showing objects
...
Fixes #135
Fixes #214
2017-05-05 18:42:46 +03:00
Andrey Smirnov
c798db8056
Add system's requirements.txt, enforce flake8 linter
...
Fix style issues in functional tests.
2017-04-28 00:05:11 +03:00
Clemens Rabe
25f9c29f00
Implemented filesystem endpoint with support for hardlinks, symlinks and copy.
2017-04-13 20:25:40 +02:00
Andrey Smirnov
2943422d5d
Automatic versioning for aptly
...
New version format:
* for releases, `x.y.z` (follows tag without leading `v`)
* for nightly builds, `x.y.z+N+hash` (previous version, not the upcoming one)
This means that each nightly build `aptly` would report
correct version now.
Version is now complied into the aptly binary, system tests
automatically check for current version, no need to update them
anymore.
2017-03-25 00:18:45 +03:00
Andrey Smirnov
0f328ec1fe
Seed Python random generator on start.
2015-05-28 11:40:11 +03:00
Sebastien Badia
bc357a19a1
Added swift python tests
2015-02-05 17:56:09 +01:00
Andrey Smirnov
523d0d0945
Library for API system tests. #116
2014-10-10 17:43:04 +04:00
Andrey Smirnov
5d69871ca4
Tests for publishing to Amazon S3.
2014-10-01 17:48:51 +04:00
Andrey Smirnov
1a92d8bfe9
Add --capture to auto-create 'gold' results when fail.
2014-07-07 23:29:36 +04:00
Andrey Smirnov
d9b35cea01
Allow running system tests by mask.
...
E.g. system/run.py 'ListSnapshot*'.
2014-07-07 23:13:49 +04:00
Simon Aquino
20513e1c16
Specify individual long tests to run
...
The test script currently only allows to run all the long test. This
change will allow a user to specify individual long tests to run.
2014-07-01 00:51:58 +01:00
Andrey Smirnov
803570bf26
Support for running individual suites.
2014-02-07 20:00:21 +04:00
Andrey Smirnov
62d3c625ed
Support for internal webserver in tests.
2014-02-03 23:15:50 +04:00
Andrey Smirnov
a1258f2125
Revert: run all tests.
2014-01-31 21:14:13 +04:00
Andrey Smirnov
59d72c8112
System tests for aptly publish snapshot.
2014-01-31 19:04:44 +04:00
Andrey Smirnov
86f3a0b463
Add support for pool/db fixtures, outuput match prepare.
2014-01-24 14:12:52 +04:00
Andrey Smirnov
a3df28ec4b
aptly mirror update tests.
2014-01-21 18:07:06 +04:00
Andrey Smirnov
1728691462
Don't hard require colors, exit with 1 on errors.
2014-01-21 16:36:40 +04:00
Andrey Smirnov
e1ca459329
aptly mirror create system tests.
2014-01-21 14:21:22 +04:00
Andrey Smirnov
362cdbcd57
Refactor system tests to live together in one package.
2014-01-21 12:15:28 +04:00
Andrey Smirnov
0f902ee74b
System test, first sketch.
2014-01-20 23:39:25 +04:00
