fune/testing
Erich Gubler af02a85436 Bug 1720941, part 1: build(ci): integrate WebGPU CTS into CI r=webgpu-reviewers,taskgraph-reviewers,jmaher,jimb
Vendor in WebGPU CTS so that we can run it against our implementation of WebGPU. This patch includes:

1. Some linting configuration tweaks, to silence issues that weren't straightforward to fix in CTS upstream.
2. Some WPT runner configuration to enable preferences, and skip MacOS testing altogether (since it's not targeted by our current work).
3. A new Rust binary crate that, when run from a development environment:
    1. Creates a vendored copy of WebGPU CTS in `<gecko>/dom/webgpu/tests/cts/checkout/`.
    2. Generates private Web Platform Tests (see also `<gecko>/testing/web-platform/docs/index.rst`). To do this, we:
        1. Use upstream test generation via `npm` scripts, which creates a single `cts.https.html` file with thousands of variants.
        2. Chunk the `cts.https.html` file into parts that Taskcluster can distribute without timing out individual jobs. IMO, this is the most likely part of these changes to need further iteration, because:
            1. We currently naively divide tests by number of variant, and have made no effort to empirically prove that we're dividing execution time of chunks.
            2. There is currently no stability in the distribution of tests per chunk. Test variants are essentially a flattened list of the tree structure used to organize tests. Adding a few tests that end up being placed in the middle of the list can cause the chunk with new tests _and all subsequent chunks_ to have their contents changed, which will probably cause a disproportionate number of line changes to review.:
        3. Fix `script` tag(s) so they actually work with the WPT test runner for private tests (viz., in the `testing/web-platform/mozilla` directory).

The output of the new vendoring binary is designed make the above steps transparent. N.B. that no actual vendoring in of files has happened yet; the next patch will add the results of running this script.

Differential Revision: https://phabricator.services.mozilla.com/D169951
2023-03-15 20:13:45 +00:00
..
awsy
condprofile
config Backed out 5 changesets (bug 1809843) for causing Cargo related build bustages. CLOSED TREE 2023-03-13 13:53:26 +02:00
crashtest
docs
extensions
firefox-ui
geckodriver
gtest
jsshell
marionette Bug 1818173 - [marionette-client] Sort marionette-client unit-tests.ini alphabetically r=webdriver-reviewers,whimboo 2023-03-10 09:31:15 +00:00
mochitest Bug 1776694 - Return profile with additional info from GetProfileDataAsGzippedArrayBuffer r=mstange 2023-03-15 18:19:31 +00:00
modules
mozbase Backed out 5 changesets (bug 1809843) for causing Cargo related build bustages. CLOSED TREE 2023-03-13 13:53:26 +02:00
mozharness Bug 1818502 - Install webtransport requirements for WPT when run through mozharness r=ahal 2023-03-13 20:34:36 +00:00
perfdocs Bug 1822182 - Update Speedometer 3 repo r=perftest-reviewers,sparky 2023-03-14 22:42:09 +00:00
performance
profiles
raptor Bug 1821791 - Use kmeans filter in raptor extra-summary-methods. r=AlexandruIonescu,perftest-reviewers 2023-03-15 13:10:46 +00:00
runtimes
specialpowers Bug 1820498 - Convert PerTestCoverageUtils to an ES module. r=marco,webdriver-reviewers,perftest-reviewers,sparky,whimboo 2023-03-06 19:13:58 +00:00
talos Bug 1815500 - [devtools] Migrate location to convey source and sourceActor objects. r=bomsy,perftest-reviewers,devtools-reviewers,kshampur 2023-03-15 13:48:32 +00:00
tools Backed out 5 changesets (bug 1809843) for causing Cargo related build bustages. CLOSED TREE 2023-03-13 13:53:26 +02:00
tps Bug 1818349 Part 2: Update tabs TPS tests to allow using data: schema r=markh 2023-03-07 07:42:14 +00:00
web-platform Bug 1720941, part 1: build(ci): integrate WebGPU CTS into CI r=webgpu-reviewers,taskgraph-reviewers,jmaher,jimb 2023-03-15 20:13:45 +00:00
webcompat Bug 1805409 - Ship v112.0.0 of the WebCompat System Addon r=webcompat-reviewers,twisniewski 2023-03-07 00:41:48 +00:00
webdriver
xpcshell Backed out 5 changesets (bug 1809843) for causing Cargo related build bustages. CLOSED TREE 2023-03-13 13:53:26 +02:00
addtest.py
cppunittest.ini
mach_commands.py
moz.build
parse_build_tests_ccov.py
README.txt
remotecppunittests.py
runcppunittests.py
testinfo.py
testsuite-targets.mk

Common testing tools for mozilla codebase projects, test suite definitions
for automated test runs, tests that don't fit anywhere else, and other fun
stuff