Commit graph

71 commits

Author SHA1 Message Date
Joel Maher
decb18e6ab Bug 1836274 - remove windows 7 from taskcluster configs and scheduling. r=ahal,taskgraph-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D180153
2023-07-02 04:06:27 +00:00
Kash Shampur
bbf4157b54 Bug 1833417 - Add OSX Chromium-as-Release to cron. r=perftest-reviewers,taskgraph-reviewers,bhearsum,sparky
This patch updates the CaR cron with OSX builds.
Additionally, the time between building and running perftests is increased from 8 hours to 9 hours,
just to provide a bit more of a buffer in case of failures and in particular for OSX builds which take quite long.

Differential Revision: https://phabricator.services.mozilla.com/D180826
2023-06-19 13:20:01 +00:00
Heitor Neiva
b74ee2c8b9 Bug 1836078 - Update gecko taskgraph to support ESR115 r=releng-reviewers,taskgraph-reviewers,jcristau
Differential Revision: https://phabricator.services.mozilla.com/D180026
2023-06-09 20:58:21 +00:00
Erich Gubler
63bb3e1538 Bug 1831263: test(webgpu): simplify when tests runs r=taskgraph-reviewers,bhearsum
1. Mark 32-bit, `asan`, `tsan` tasks as `UNCOMMON_TRY_TASK_LABELS`,
   which means they'll only be presented for selection when `--full` is
   passed to Try.
2. Just run Mochitest on every `trunk` push, minus the platforms we disable.

Co-Authored-By: Kelsey Gilbert <jgilbert@mozilla.com>

Differential Revision: https://phabricator.services.mozilla.com/D179816
2023-06-07 02:46:10 +00:00
Norisz Fay
87945aac49 Backed out changeset 1ceebfa927ec (bug 1831263) for causing TypeError related webgpu failures CLOSED TREE 2023-06-06 23:25:44 +03:00
Erich Gubler
ebf22d73c0 Bug 1831263: test(webgpu): simplify when tests runs r=taskgraph-reviewers,bhearsum
1. Mark 32-bit, `asan`, `tsan` tasks as `UNCOMMON_TRY_TASK_LABELS`,
   which means they'll only be presented for selection when `--full` is
   passed to Try.
2. Just run Mochitest on every `trunk` push, minus the platforms we disable.

Co-Authored-By: Kelsey Gilbert <jgilbert@mozilla.com>

Differential Revision: https://phabricator.services.mozilla.com/D179816
2023-06-06 14:54:12 +00:00
Kash Shampur
3ab856b5a0 Bug 1824829 - Add a daily cron for building and running performance tests on custom-car. r=perftest-reviewers,afinder
This patch adds a daily cron task to build the custom chromium-as-release (CaR) application and running
raptor browsertime tests with it.

Differential Revision: https://phabricator.services.mozilla.com/D177545
2023-05-16 13:36:22 +00:00
andrej
b1c129b98d Bug 1826440 - Enable all the performance tests on android chrome. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D174691
2023-04-13 15:01:02 +00:00
andrej
11a6ea9dcb Bug 1825574 - Create a daily cron to run Chrome release tests against Speedometer 3 for android and desktop. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D174163
2023-04-01 19:51:29 +00:00
andrej
eff115ed96 Bug 1780817 - Android Chrome a51 test perma fails. r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D173765
2023-03-28 14:57:27 +00:00
Kash Shampur
83494b8504 Bug 1816421 - Disable mobile fission performance tests on all branches. r=perftest-reviewers,sparky
This patch should disable fenix/geckoview *fission* performance tests only.
The tests are still available to select through Try.

Differential Revision: https://phabricator.services.mozilla.com/D171133
2023-02-28 18:30:05 +00:00
Julien Cristau
1c30e93e7f Bug 1818452 - remove osx 10.14 from test configs. r=jmaher,MasterWayZ
There are no jobs remaining on 10.14, but we still had some lingering
supporting code.

Also change the treeherder label for the generate-profile task to match
the actual worker type.

Differential Revision: https://phabricator.services.mozilla.com/D170735
2023-02-23 16:41:17 +00:00
Olek Czubiak
dbed88654b Bug 1806105 - Fix Pylint errors and warnings on taskcluster/ r=jmaher
Differential Revision: https://phabricator.services.mozilla.com/D166473
2023-02-07 12:14:28 +00:00
Julien Cristau
a037a48638 Bug 1814661 - add specific task selection for holly. r=releng-reviewers,bhearsum DONTBUILD
Differential Revision: https://phabricator.services.mozilla.com/D168697
2023-02-02 17:11:18 +00:00
Julien Cristau
eae629b3f5 Bug 1814418 - don't include android/geckoview builds in esr staging releases. r=releng-reviewers,gbrown DONTBUILD
Instead of excluding android builds based on the `project` parameter, use
`release_type`, which is properly set to e.g. `esr102` by `mach try release`.

Differential Revision: https://phabricator.services.mozilla.com/D168563
2023-02-01 16:55:37 +00:00
serge-sans-paille
7b79ce9a2d Bug 1805656 - Honor extra filters in filter_by_uncommon_try_tasks r=taskgraph-reviewers,jcristau
As a side effect, avoid a deepcopy when a simple itertools.chain can do
the trick.

Differential Revision: https://phabricator.services.mozilla.com/D164652
2023-01-17 07:52:59 +00:00
Greg Mierzwinski
5e453e33b1 Bug 1806035 - Enable Windows Speedometer 3 tests. r=perftest-reviewers,kshampur
This patch updates the S3 commit used, fixes an issue with local Windows benchmark runs, and enables the windows S3 tests in CI.

Differential Revision: https://phabricator.services.mozilla.com/D166323
2023-01-11 13:39:09 +00:00
Greg Mierzwinski
5fa5bdba69 Bug 1806035 - Run Speedometer 3 in CI. r=perftest-reviewers,afinder
This patch adds the speedometer 3 benchmark test to raptor enables it for CI. In CI, it'll start by running on Linux, and MacOSX on Firefox, Chrome, and Chromium. The patch also adds a new method for parsing benchmark tests that is more generic and works in conjunction with the `custom_data` option.

Differential Revision: https://phabricator.services.mozilla.com/D165988
2023-01-09 18:13:40 +00:00
Joel Maher
235e74e24f Bug 1805503 - Add Pixel 5 and run jittest/reftest/crashtests on there. r=bxbrenden
Differential Revision: https://phabricator.services.mozilla.com/D165688
2022-12-29 18:01:54 +00:00
Ben Hearsum
073422c0d6 Bug 1805989: run non-shippable MSIX tests on autoland and try r=jmaher
I gave this a good on Try with a bunch of retriggers - no new failures came up, so I think this is good to go.

Differential Revision: https://phabricator.services.mozilla.com/D164939
2022-12-19 16:51:50 +00:00
Cristian Tuns
9966f020fe Backed out changeset 079d34eb51b0 (bug 1805989) for causing bc failures on win 10 2004 msix CLOSED TREE 2022-12-16 18:27:20 -05:00
Ben Hearsum
b6cc4d37e1 Bug 1805989: run non-shippable MSIX tests on autoland and try r=jmaher
I gave this a good on Try with a bunch of retriggers - no new failures came up, so I think this is good to go.

Differential Revision: https://phabricator.services.mozilla.com/D164939
2022-12-16 21:14:04 +00:00
Marco Castelluccio
faa5410de1 Bug 1790816 - Reformat taskcluster/ with isort. r=#linter-reviewers CLOSED TREE
# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D162661
2022-12-16 11:14:02 +00:00
Ben Hearsum
cd7d832ee8 Bug 1712329: Ensure msix tests show up on try without --full r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D164083
2022-12-12 14:36:41 +00:00
Marian-Vasile Laza
b94fb931fa Backed out 7 changesets (bug 1712329) for causing mochitest certificate integration failures. CLOSED TREE
Backed out changeset 9812a580faff (bug 1712329)
Backed out changeset 108f339bf13e (bug 1712329)
Backed out changeset a64c580e31d0 (bug 1712329)
Backed out changeset 7cce6af9c6b5 (bug 1712329)
Backed out changeset e7f1b3c8f532 (bug 1712329)
Backed out changeset 71562a7b9060 (bug 1712329)
Backed out changeset d249b4468265 (bug 1712329)
2022-12-08 19:25:57 +02:00
Ben Hearsum
2ab4b48ebb Bug 1712329: Ensure msix tests show up on try without --full r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D164083
2022-12-08 15:16:45 +00:00
Marian-Vasile Laza
0f9f899589 Backed out 7 changesets (bug 1712329) for breaking the decision task landing. CLOSED TREE
Backed out changeset 6663585b720e (bug 1712329)
Backed out changeset 054c8b42c54d (bug 1712329)
Backed out changeset 86bc88c293fe (bug 1712329)
Backed out changeset 16b42b3c4f49 (bug 1712329)
Backed out changeset a937a2551259 (bug 1712329)
Backed out changeset 81a9fa3a88c2 (bug 1712329)
Backed out changeset c8e40be18e99 (bug 1712329)
2022-12-08 16:29:30 +02:00
Ben Hearsum
583bfc97be Bug 1712329: Ensure msix tests show up on try without --full r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D164083
2022-12-08 14:15:30 +00:00
Kash Shampur
2aa3c9900d Bug 1803792 - Add Safari performance tests to general_perf_testing cron. r=perftest-reviewers,sparky
Now that we can run performance tests on Safari, this patch adds these tests to the general_perf_testing cron.
This let's us run the existing Safari live and benchmark tests at the same frequency as Chrome tests.

Differential Revision: https://phabricator.services.mozilla.com/D163987
2022-12-07 14:24:13 +00:00
Mark Banner
e59ef8d6fd Bug 1801283 - Fix eslint-build tester running from cron, and make sure it doesn't run at other times. r=releng-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D162385
2022-11-24 16:18:14 +00:00
Cristian Tuns
1e7840b129 Backed out changeset cbbd3bc4d731 (bug 1801283) as requested by Standard8. CLOSED TREE 2022-11-24 03:51:42 -05:00
Mark Banner
ac16fdb8c0 Bug 1801283 - Fix eslint-build tester running from cron, and make sure it doesn't run at other times. r=releng-reviewers,ahal
Differential Revision: https://phabricator.services.mozilla.com/D162385
2022-11-23 23:21:46 +00:00
Nick Alexander
9e831a03d2 Bug 1666491 - Add a eslint-build tester (tier 3) that depends on xpt artifacts. r=nalexander,releng-reviewers,gbrown
Depends on D161641

Differential Revision: https://phabricator.services.mozilla.com/D162072
2022-11-17 10:57:41 +00:00
Alex Finder
d9f1a25427 Bug 1793823 disable p2 perf tests r=perftest-reviewers,sparky
Differential Revision: https://phabricator.services.mozilla.com/D159375
2022-11-03 14:42:39 +00:00
Andrew Halberstadt
7ec4c7a689 Bug 1795921 - Back out changeset b7380df3b9a8, r=releng-reviewers,gbrown
This was causing `always-target` tasks to no longer be eligible for
optimization on try.

Differential Revision: https://phabricator.services.mozilla.com/D160411
2022-10-31 13:14:21 +00:00
Andrew Halberstadt
1b90c899f3 Bug 1759030 - [gecko_taskgraph] Move 'always_target' implementation outside of generator.py, r=releng-reviewers,gbrown
The `always_target` attribute is a feature which I believe I previously
mis-implemented. It doesn't belong in `generator.py` and should instead be
implemented somewhere in `target_tasks.py`. I chose to wrap the registration
decorator to guarantee backwards compatibility within Gecko. Though we may wish
to move it out to a filter in the future.

I'm making this change now to facilitate merging standalone and Gecko
taskgraphs. The `always_target` feature will be removed from standalone (as it
isn't being used and should consumers need something like it, they can roll
their own implementations).

With the feature removed from both Gecko and standalone in generator.py, this
file will now be identical across both Taskgraphs and can therefore be removed
from Gecko.

Differential Revision: https://phabricator.services.mozilla.com/D159181
2022-10-14 14:19:15 +00:00
Johan Lorenzo
b984b3449b Bug 1786291 - Remove esr91 references r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D156972
2022-09-19 13:23:03 +00:00
Kash Shampur
d846d1454f Bug 1790887 - Mitigate duplicate daily browsertime tests on beta branch. r=sparky,perftest-reviewers,gbrown
This patch is to help address scenarios where duplicate graphs are created for the daily browsertime tests on mozilla-beta, off of the same revision. This occurs when the 2nd cron job finishes before the 1st one finishes. Here, the logic prevents a 2nd graph from being created.

Differential Revision: https://phabricator.services.mozilla.com/D157366
2022-09-15 13:05:47 +00:00
Kash Shampur
0948667bc6 Bug 1790476 - Add a cron to run browsertime tests weekly on the mozilla-release branch. r=sparky,perftest-reviewers
This patch limits the frequency of performance tests running on the mozilla-release branch. In particular, we need to reduce the load on our android devices for the time being, similar to how we did this for the beta branch in bug 1788026.

Differential Revision: https://phabricator.services.mozilla.com/D157159
2022-09-13 18:39:43 +00:00
andrej
650e7d97a3 Bug 1789948 - Disable Android Tests. r=perftest-reviewers,sparky
What we are doing:
- Disabling the view/main-fenix and the cpu-memory jobs

Differential Revision: https://phabricator.services.mozilla.com/D156913
2022-09-12 20:32:55 +00:00
Kash Shampur
3722794efd Bug 1788968 - Rename nightly beta cron for perftest to daily. r=sparky,perftest-reviewers
Renaming `nightly` to `daily` is intended for avoiding confusion with Nightly builds and better reflect what we are doing with these performance tests.

Differential Revision: https://phabricator.services.mozilla.com/D156324
2022-09-02 20:12:36 +00:00
Kash Shampur
f01f36cf9c Bug 1788026 - Run browsertime tests nightly on the mozilla-beta branch. r=sparky,perftest-reviewers
There will be changes in mozilla-beta that will increase the frequency of pushes. This will increase the load on our android devices so this patch will limit the amount of tests to be run nightly rather than on every push.

Differential Revision: https://phabricator.services.mozilla.com/D156198
2022-09-02 12:34:22 +00:00
andrej
e95c209d76 Bug 1781237 - Skip chrome tests on Pixel2. r=perftest-reviewers,AlexandruIonescu
What we are doing:
- Disabling chrome-m tests to run on Pixel2 devices

Why:
- Recent bitbar cleanup script update is causing permafails on chrome

Differential Revision: https://phabricator.services.mozilla.com/D154274
2022-08-15 14:20:53 +00:00
Joel Maher
5f60f5d071 Bug 1780817 - skip chrome tests on a51. r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D152562
2022-07-22 18:51:52 +00:00
Alexandre Lissy
6c46b2fb17 Bug 1780509 - Add system-symbols-reprocess to cron system_symbols r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D152358
2022-07-21 08:05:37 +00:00
Andrew Halberstadt
9d3c858dfa Bug 1780273 - Use target_task method registration from standalone taskgraph, r=taskgraph-reviewers,aki
Differential Revision: https://phabricator.services.mozilla.com/D152211
2022-07-20 13:17:32 +00:00
Yulia
89693fb77a Bug 1771587 - Implement are-we-esmified-yet check on ci; r=marco,jmaher
Differential Revision: https://phabricator.services.mozilla.com/D150369
2022-07-06 08:24:18 +00:00
Joel Maher
1f03dcc175 Bug 1777556 - enable tp6m live tests on A51. r=sparky,perftest-reviewers
Differential Revision: https://phabricator.services.mozilla.com/D150797
2022-06-30 19:43:53 +00:00
Geoff Brown
59d08fbf1c Bug 1776774 - Run debug tests on beta; r=jmaher
Add non-android debug builds/tests back to mozilla-beta, to catch
post-central leaks and debug-only test failures before reaching esr.

Differential Revision: https://phabricator.services.mozilla.com/D150621
2022-06-29 20:02:02 +00:00
Alex Ionescu
93637541c8 Bug 1766433 Create a daily cron job for triggering backfill-all-browsertime r=jmaher,ahal
This patch adds a cron job that runs daily and triggers the backfill-all-browsertime action task for the revisions containing commits that were reviewed by #perftest for the daay before the job is running.

Differential Revision: https://phabricator.services.mozilla.com/D144713
2022-05-17 09:15:20 +00:00