22 Commits

Author SHA1 Message Date
Gyorgy Sarvari 03328f6c73 tinyproxy: add ptest support
It takes <10s to execute.

Sample output:

root@qemux86-64:~# ptest-runner
START: ptest-runner
2025-12-23T17:45
BEGIN: /usr/lib/tinyproxy/ptest
starting web server... done (listening on 127.0.0.3:32123)
starting tinyproxy... done (listening on 127.0.0.2:12321)
waiting for 1 seconds.. done
checking direct connection to web server... ok
testing connection through tinyproxy... ok
requesting statspage via stathost url... ok
signaling tinyproxy to reload config...ok
checking direct connection to web server... ok
testing connection through tinyproxy... ok
requesting statspage via stathost url... ok
checking bogus request... ok, got expected error code 400
testing connection to filtered domain... ok, got expected error code 403
requesting connect method to denied port... ok, got expected error code 403
testing unavailable backend... ok, got expected error code 502
0 errors
killing tinyproxy... ok
killing webserver... ok
done
PASS: run_tests.sh
DURATION: 1
END: /usr/lib/tinyproxy/ptest
2025-12-23T17:45
STOP: ptest-runner
TOTAL: 1 FAIL: 0

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-12-24 13:18:25 -08:00
Gyorgy Sarvari 70a2b417c6 unbound: complete ptest support
The recipe had already an almost working ptest config which
wasn't enabled, it just needed some small fixes to make it work:
correct the output of the run-ptest script, and install some
extra testdata.

Execution is quick, single digit seconds:

root@qemux86-64:/usr/lib/unbound/ptest/tests# ptest-runner
START: ptest-runner
2025-12-16T11:53
BEGIN: /usr/lib/unbound/ptest
Start of unbound 1.24.2 unit test.
test authzone functions
test negative cache functions
test ub_random functions
[...many lines...]
PASS: ./testdata/val_unsecds_negcache.rpl
PASS: ./testdata/val_unsecds_qtypeds.rpl
PASS: ./testdata/val_wild_pos.rpl
PASS: ./testdata/version_bind.rpl
PASS: ./testdata/version_bind_hide.rpl
PASS: ./testdata/views.rpl
DURATION: 4
END: /usr/lib/unbound/ptest
2025-12-16T11:53
STOP: ptest-runner
TOTAL: 1 FAIL: 0

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-12-16 19:57:34 -08:00
Gyorgy Sarvari 237efae216 python3-scapy: fix ptests
1. Install missing test files
2. Enable network access by setting a nameserver in resolv.conf
   because some tests require this
3. One test tries to ping Google through IPv6 - this test requires
   ipv6 DISTRO_FEATURE. In case ipv6 is not enabled, skip this test
   from the run-ptest script.

NB: the last mentioned test to work  also requires IPv6 support from
your ISP. My ISP is IPv4-only, and I couldn't try it out. The above
comes from my reading of the testcode.

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-10-28 23:31:28 -07:00
Gyorgy Sarvari 020d38d39a lksctp-tools: move ptest from problem-list to slow-list
The tests execute and pass successfully - I managed to run them
successfully, without a change on x86-64 and aarch64.

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-10-28 23:31:28 -07:00
Gyorgy Sarvari 227dca8861 net-snmp: fix ptests
Add missing dependencies.

Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-10-28 23:31:28 -07:00
Yoann Congal bf400cd73f reproducibility: move known non-repro list to layer.conf
The current include file that stores the known non-reproducible packages
is layer dependent and that forces the user of the layers to maintain
the list of the files (for example, see AB config[0]).

By moving the exclude list to each layer.conf and extending the common
OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES variable, the known non-reproducible
packages will be automatically excluded for each layer used in the
reproducibility test without any special knowledge in the test
environment.

NB: the empty list for meta-initramfs was just removed not moved.

[0]: https://git.yoctoproject.org/yocto-autobuilder-helper/tree/config.json?id=7d8933e75bdf7fb821a25617cb2dcabf1f3f8700#n322

Suggested-by: Quentin Schulz <quentin.schulz@cherry.de>
Co-Developed-by: Guillaume Swaenepoel <guillaume.swaenepoel@smile.fr>
Signed-off-by: Guillaume Swaenepoel <guillaume.swaenepoel@smile.fr>
Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-06-20 10:34:11 -07:00
Khem Raj 34b4c40f47 ptest-packagelists-meta-networking: Adjust ptests as per pass status
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-04-12 10:06:29 -07:00
Yoann Congal 26dab6c956 reproducibility: Mark phytool{,-dbg} as known non-reproducible
From AB run:
https://autobuilder.yoctoproject.org/valkyrie/#/builders/87/builds/36/steps/28/logs/stdio

Diffoscope output is at:
https://valkyrie.yocto.io/pub/repro-fail-openembedded/meta-networking/oe-reproducible-20250315-xxydi74w/packages/diff-html/

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-15 23:05:31 -07:00
Yoann Congal d7cef19fcc reproducibility: update known non-reproducible packages
Those reproducible failures are from AB runs:
* https://autobuilder.yoctoproject.org/valkyrie/#/builders/87/builds/34
* https://autobuilder.yoctoproject.org/valkyrie/#/builders/87/builds/35

https://valkyrie.yocto.io/pub/repro-fail-openembedded/

NB: diffoscope output can be found in
Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-11 19:34:55 -07:00
Sofiane HAMAM 06a5e82a83 Wolfssl: add ptest
Add ptest for Wolfssl package.
Set IMAGE_ROOTFS_EXTRA_SPACE:virtclass-mcextend-wolfssl to 700M
enough to avoid a "No space left on device".

BEGIN: /usr/lib/wolfssl/ptest
Wolfssl ptest logs are stored in /tmp/wolfss_temp.qvuQ9h/ptest.log
Test script returned: 0
unit_test: Success for all configured tests.
PASS: Wolfssl
DURATION: 7
END: /usr/lib/wolfssl/ptest

Signed-off-by: Sofiane HAMAM <sofiane.hamam@smile.fr>
Reviewed-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-06 06:58:00 -08:00
Jiaying Song bea74f838b openvpn: add ptest support
All test cases PASS.
Add openvpn to PTESTS_SLOW because test duration longer than 30s Below is parts of the run log:
[==========] xkey provider tests: Running 3 test(s).
[ RUN      ] xkey_provider_test_fetch
[       OK ] xkey_provider_test_fetch
[ RUN      ] xkey_provider_test_mgmt_sign_cb
[       OK ] xkey_provider_test_mgmt_sign_cb
[ RUN      ] xkey_provider_test_generic_sign_cb
[       OK ] xkey_provider_test_generic_sign_cb
[==========] xkey provider tests: 3 test(s) run.
[  PASSED  ] 3 test(s).
PASS: provider_testdriver

The files t_client.sh.in and t_cltsrv.sh were not added because they
require specific environment configuration files. It is recommended that
users configure these based on their environment before testing.

Since the recipe enables iproute2, the condition for t_net.sh based on
HAVE_SITNL is not met, so t_net.sh will not be included in the build.

Signed-off-by: Jiaying Song <jiaying.song.cn@windriver.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-11-19 22:26:45 -08:00
Yoann Congal 7fe2259571 non-repro-meta-networking: update known non-reproducible list
Add ncp, ncp-dbg: symbols are not sorted the same way

from: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/46/steps/28/logs/stdio

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-07 08:08:26 -07:00
Yoann Congal 1b3738d85c non-repro-meta-networking: update known non-reproducible list
Add:
* ntopng: date in version
* opensaf: build host hostname in /etc/ files

from: https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/45/steps/28/logs/stdio

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-02 19:49:53 -07:00
Yoann Congal 22677f96c2 non-repro-meta-networking: update known non-reproducible list
Remove packages seen reproducible in the last 3 completed tests:
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/44/steps/28/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/43/steps/28/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/41/steps/28/logs/stdio

Add babeld & babeld-dbg from:
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/44/steps/28/logs/stdio

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-09-23 09:47:34 -07:00
Yoann Congal af469bd2a5 non-repro-meta-networking: exclude packages that failed previously
Those are the non-reproducible packages from:
https://autobuilder.yoctoproject.org/typhoon/#/builders/155/builds/43

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-09-14 08:43:56 -07:00
Yoann Congal d161de0b00 mdio-tools: fix mdio-netlink kernel module reproducibility
mdio-netlink source make reference to ${S}/.. which breaks
-fdebug-prefix-map and results in the full TMPDIR path being present in
the -dbg package and, also, change a related CRC in the main package.

This changes ${S} to enclose the whole SRC_URI repo and adapt relative paths to
build (MODULES_MODULE_SYMVERS_LOCATION)

This make mdio-netlink reproducible and fixes this warning:
WARNING: mdio-netlink-1.3.1-r0 do_package_qa: QA Issue: File /lib/modules/6.6.29-yocto-standard/updates/.debug/mdio-netlink.ko in package mdio-netlink-dbg contains reference to TMPDIR [buildpaths]

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Reviewed-by: Alexandre Truong <alexandre.truong@smile.fr>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-05-21 14:15:10 -07:00
Yoann Congal d3751ce994 reproducibility: move repro excludes from AB config.json to meta-oe
For now, the known non-reproducible packages list is stored inside the
autobuilder config.json file. This is not ideal. Let's move this list
into each layers of meta-openembedded.

These lists can be used with, in local.conf:
  include conf/include/non-repro-meta-oe.inc
  OEQA_REPRODUCIBLE_EXCLUDED_PACKAGES = "${KNOWN_NON_REPRO_META_OE}"

Signed-off-by: Yoann Congal <yoann.congal@smile.fr>
Acked-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-04-29 11:11:51 -07:00
Khem Raj 47ccb88d94 freediameter: Upgrade to latest on master 1.5.0+
This also fixes all ptests, therefore move freediameter
out of PTESTS_PROBLEMS_META_NETWORKING to PTESTS_FAST_META_NETWORKING

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-04-15 21:01:12 -07:00
Khem Raj 2b416eb0d6 squid: Add missing bash dependency for ptest package
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-26 08:13:21 -08:00
Khem Raj c9844a43e0 openhpi: Fix ptest run time failures
It needs make and build tools in order to run

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-26 08:13:21 -08:00
Khem Raj 7aff0f399b ptest-packagelists-meta-networking: firewalld hangs therefore disabled
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-26 08:13:21 -08:00
Khem Raj b757ba3028 meta-networking-image-ptest: Add images to enable BBCLASSEXTEND parallel execution
In line with other layers like meta-oe, meta-python add capability to
run recipe ptests

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-02-22 19:24:00 -08:00