Commit graph

300 commits

Author SHA1 Message Date
Gregory Mierzwinski
a009f016fa Bug 1652451 - Disable 2020 youtube-playback tests temporarily. r=perftest-reviewers,davehunt
This patch disables all failing youtube-playback tests.

Differential Revision: https://phabricator.services.mozilla.com/D83368
2020-07-13 19:29:12 +00:00
Tom Prince
388e735d63 Bug 1649168: Add scriptworker-canary action and corresponding task; r=rail
Add an action that will trigger a task that runs
`mach release push-scriptworker-canary`
to test a new scriptworker deployment.

Differential Revision: https://phabricator.services.mozilla.com/D82821
2020-07-10 16:12:05 +00:00
Gregory Mierzwinski
8d10f86507 Bug 1650871 - Add all browsertime desktop tests. r=perftest-reviewers,AlexandruIonescu
This patch adds all desktop pageload tests to browsertime. It adds taskcluster tasks for these but doesn't enable them in production. They can only be run when --full is used.

Differential Revision: https://phabricator.services.mozilla.com/D82432
2020-07-08 07:48:16 +00:00
Justin Wood
bff89afddf Bug 1649383 - don't do geckoview builds on esr. r=jcristau
Differential Revision: https://phabricator.services.mozilla.com/D81742
2020-07-07 16:09:35 +00:00
Gregory Mierzwinski
23288e112e Bug 1649641 - Re-enable live site Fenix tests. r=perftest-reviewers,Bebe
Differential Revision: https://phabricator.services.mozilla.com/D81786
2020-07-01 09:24:15 +00:00
Andi-Bogdan Postelnicu
68409df6ba Bug 1648709 - run Coverity Static Analysis on mozilla-central once per day. r=sylvestre
Right now we are running `Coverity Static Analysis` for each merge to `mozilla-central`,
this is suboptimal since the resources required to do so are very expensive. It's
enough to run it once a day.

Differential Revision: https://phabricator.services.mozilla.com/D81510
2020-06-29 12:44:51 +00:00
Andrew Creskey
76d2dabaea Bug 1648183 - Disable live site testing for 1 day, or otherwise disable telemetry pings r=davehunt
Disabling these unsheriffed tests to determine if they are causing the spikes in new users that telemetry reveals.

Differential Revision: https://phabricator.services.mozilla.com/D81326
2020-06-26 16:59:38 +00:00
Gregory Mierzwinski
2868ced012 Bug 1645874 - Simplify the perftest crons and remove some tests in production. r=perftest-reviewers,davehunt
This patch does a few small things to clean up our CI tests:
(1) The GPT cron is simplified so that it can be more manageable. In this change I also include a new helper method to make sure we run our android tests on the build variants that we should be running them on (and no others).
(2) The geckoview browsertime warm tests were running on 1 platform too many - this is no longer the case.
(3) Fennec vismet tests were previously excluded but are now included.
(4) All fennec tests that were in GPT cron have been moved to the Fennec_v68 cron so they only run once a week.

Differential Revision: https://phabricator.services.mozilla.com/D79891
2020-06-22 10:26:39 +00:00
Justin Wood
f66f5a235e Bug 1646588 - Add esr78 support. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D79731
2020-06-18 19:57:20 +00:00
Ben Hearsum
0462efd54d Bug 1642004: -p all try syntax selects shippable builds instead of opt r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D79169
2020-06-12 19:08:54 +00:00
Gregory Mierzwinski
83d7628dc7 Bug 1641878 - Migrate fennec68 raptor tests to browsertime. r=perftest-reviewers,davehunt
This patch disables and removes the raptor-webext fennec68 tests and replaces them with the browsertime variants. The raptor tests which ran through a cron are also swapped for the browsertime tests.

Differential Revision: https://phabricator.services.mozilla.com/D77674
2020-06-12 11:38:26 +00:00
Gregory Mierzwinski
5222ae9898 Bug 1644491 - Run fennec68 youtube tests once a week. r=perftest-reviewers,davehunt
This patch disables fennec68 youtube playback tests on mozilla-central and runs them once a week through the fennec_v68 cron job.

Differential Revision: https://phabricator.services.mozilla.com/D78937
2020-06-10 17:02:17 +00:00
Joel Maher
eeadf81538 Bug 1643284 - require --full to schedule talos/raptor profiling jobs on try. r=davehunt,ahal
require --full to schedule talos/raptor profiling jobs on try.

Differential Revision: https://phabricator.services.mozilla.com/D78250
2020-06-08 15:19:55 +00:00
Andrew Halberstadt
c40751d405 Bug 1641131 - [taskgraph] Filter out devedition builds and tests with |mach try auto|, r=marco
Differential Revision: https://phabricator.services.mozilla.com/D78569
2020-06-05 20:28:44 +00:00
Nathan Froyd
40348063b3 Bug 1643029 - remove build-.*-aarch64 from being hidden behind --full; r=ahal
It's not good to hide Android AArch64 builds, a tier 1 platform, behind `--full`.

Differential Revision: https://phabricator.services.mozilla.com/D78070
2020-06-03 16:15:43 +00:00
Gregory Mierzwinski
621397543d Bug 1641555 - Disable some chrome live site tests. r=perftest-reviewers,Bebe
This patch prevents some extra live site tests from running on chrome.

Differential Revision: https://phabricator.services.mozilla.com/D77255
2020-05-28 13:42:58 +00:00
Gregory Mierzwinski
008827b6ac Bug 1638376 - Run recorded sites as live sites once a week. r=perftest-reviewers,alexandru.irimovici
This patch enables a new cron job that runs our recorded sites as live sites once a week through browsertime so we can continuously monitor how well our recordings match with what page the user is seeing.

Differential Revision: https://phabricator.services.mozilla.com/D75575
2020-05-26 11:20:27 +00:00
Ben Hearsum
d7624bd580 Bug 1638014: blacklist shippable tests from try when there is an opt version of the test available r=ahal
Differential Revision: https://phabricator.services.mozilla.com/D76012
2020-05-22 17:45:06 +00:00
Justin Wood
6c368aa658 Bug 1617481 - Remove most of nightly attribute from taskcluster/taskgraph. r=aki
We leave the nightly index in place for now in order to support Geckodriver until Bug 1577110 sticks.

Differential Revision: https://phabricator.services.mozilla.com/D74510
2020-05-21 16:31:04 +00:00
Justin Wood
ec5c1d56da Bug 1623355 - Part 9/9 - Remove 'pgo' support from performance testing target tasks. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74961
2020-05-21 16:29:51 +00:00
Justin Wood
f9bb21ade0 Bug 1623355 - Part 2/9 - Add shippable as a valid target for performance test cron targets. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74960
2020-05-21 16:31:23 +00:00
Tom Prince
ca0e268b05 No bug: Rename list of labels to ignore on try to UNCOMMON_TRY_TASK_LABELS; r=ahal
Give it a more descriptive name, and avoid using `blacklist` in the name.

Differential Revision: https://phabricator.services.mozilla.com/D76031
2020-05-20 13:18:19 +00:00
Narcis Beleuzu
da52584dcb Backed out 13 changesets (bug 1636637, bug 1623355, bug 1636635, bug 1617481) buid signing failures. CLOSED TREE
Backed out changeset 1b340fa71d16 (bug 1617481)
Backed out changeset 607d65d6e48a (bug 1617481)
Backed out changeset d3b4ed0caa09 (bug 1636637)
Backed out changeset bff6ecc8bb12 (bug 1636637)
Backed out changeset 12774c2e7cfc (bug 1636635)
Backed out changeset f94e3f8179a5 (bug 1623355)
Backed out changeset 001eb6623a75 (bug 1623355)
Backed out changeset 87331010321a (bug 1623355)
Backed out changeset fd76f6bc0797 (bug 1623355)
Backed out changeset b4ffd5ccbfc7 (bug 1623355)
Backed out changeset 888df247ba6e (bug 1623355)
Backed out changeset dc3076515342 (bug 1623355)
Backed out changeset de5f01ae37fa (bug 1623355)
2020-05-18 21:37:31 +03:00
Justin Wood
00c6b05b37 Bug 1617481 - Remove most of nightly attribute from taskcluster/taskgraph. r=aki
We leave the nightly index in place for now in order to support Geckodriver until Bug 1577110 sticks.

Differential Revision: https://phabricator.services.mozilla.com/D74510
2020-05-18 14:41:58 +00:00
Justin Wood
1c7ec3acc9 Bug 1623355 - Part 8/8 - Remove 'pgo' support from performance testing target tasks. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74961
2020-05-18 14:41:02 +00:00
Justin Wood
c3084ae2b4 Bug 1623355 - Part 1/8 - Add shippable as a valid target for performance test cron targets. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D74960
2020-05-18 14:38:56 +00:00
Justin Wood
08844e597d Bug 1623082 - Use shippable_product for tests, so we can better disable devedition on 'not beta'. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D67156
2020-05-18 14:37:45 +00:00
Justin Wood
d55e3df106 Bug 1623081 - Remove unused Fennec-only android release/nightly tasks. r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D67152
2020-05-18 14:37:12 +00:00
Justin Wood
36ea2ece85 Bug 1617482 - Switch asan-reporter-nightly to shippable naming. Changes only nightly graph. r=aki
Differential Revision: https://phabricator.services.mozilla.com/D63950
2020-05-18 14:35:28 +00:00
Tom Prince
35510c1f78 Bug 1628832: [KaiOS] Add kaios specific taskgraph paramters and target tasks; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D75243
2020-05-14 18:48:00 +00:00
Tarek Ziadé
c84c8756b8 Bug 1637231 - add applink tests r=acreskey
Adds tests for applink for gve/fenix on p2/g5

Differential Revision: https://phabricator.services.mozilla.com/D75097
2020-05-14 13:01:59 +00:00
Gregory Mierzwinski
2f4810de2e Bug 1636504 - Re-enable Fenix browsertime cron tasks. r=perftest-reviewers,AlexandruIonescu
This patch re-enables the Fenix browsertime tasks in mozilla-central that run through a cron job.

Differential Revision: https://phabricator.services.mozilla.com/D74421
2020-05-11 12:55:09 +00:00
Mitchell Hentges
95310794d0 Bug 1632429: Improve py3-compatiblity of taskgraph; r=tomprince,ahal
As |./mach| commands are migrated to python3, "taskgraph" needs to be compatible while still working with python2.

This patch migrates several iter*() calls and python2-specific imports to work with "six" instead.

Note that there's still python2-specific parts of taskgraph, I'm just modifying the pieces that are affecting
the code paths that I'm currently migrating (in this case, |./mach try|

Differential Revision: https://phabricator.services.mozilla.com/D73397
2020-05-07 04:47:17 +00:00
Gregory Mierzwinski
f0f846338c Bug 1613487 - Disable Raptor-webext and enable Raptor-btime Fenix tests. r=perftest-reviewers,Bebe
This patch does a few things:
(1) Prevents Amazon and Youtube Fenix Browsertime tests from running on each push.
(2) Prevents Chrome Browsertime tests from running on each push (these should only run through the cron task).
(3) Prevents Speedometer Fenix Browsertime tests from running on each m-c push.
(4) Replaces the Raptor Fenix speedometer test in the general cron task with the Browsertime variant.
(5) Replaces the Raptor Fenix Amazon test with in the tp6m cron task with the Browsertime variant.

Differential Revision: https://phabricator.services.mozilla.com/D68190
2020-05-07 13:49:27 +00:00
Gregory Mierzwinski
0b3a27bfae Bug 1634184 - Pick up visual metrics tasks in the cron task. r=tarek
The visual metrics tasks were not being picked up by the cron task. This patch fixes this by correctly parsing for vismet tasks in the general_perf_testing cron task.

Differential Revision: https://phabricator.services.mozilla.com/D73294
2020-05-04 16:42:55 +00:00
Edwin Takahashi
f2f63e6f32 Bug 1627085 - apply mach try task blacklist filter to mach try auto r=jmaher,marco
Changes:

Apply the `filter_tasks_by_blacklist` filter on `mach try auto` pushes.

Differential Revision: https://phabricator.services.mozilla.com/D73376
2020-05-01 10:26:48 +00:00
Edwin Takahashi
e1fc47fa66 Bug 1631990 - additional filters on mach try selectors r=jmaher
Changes:

Add several build types to the blacklist, so that for `try fuzzy/try chooser` users, these will not show unless `--full` is applied. For `try syntax` users, these will become non-schedulable.

Differential Revision: https://phabricator.services.mozilla.com/D72068
2020-04-30 22:55:50 +00:00
Gregory Mierzwinski
d84ec8ca2c Bug 1633513 - Prevent browsertime tests from running on opt android builds. r=perftest-reviewers,AlexandruIonescu
This patch prevents speedometer tests from running on all android builds and also prevents chrome tests from running there.

Differential Revision: https://phabricator.services.mozilla.com/D72727
2020-04-28 12:47:55 +00:00
Gregory Mierzwinski
5b8e43c99f Bug 1625470 - Part 3: Add CI tasks for Chrome and Fenix live site tests. r=perftest-reviewers,Bebe
This patch adds the new live site tests as Raptor-Browsertime tasks in CI. These will be scheduled to run through the general-perf-testing cron task on Monday/Wednesday/Friday.

Differential Revision: https://phabricator.services.mozilla.com/D69053
2020-04-23 13:05:15 +00:00
Joel Maher
c788dd3c4b Bug 1572820 - run wpt components we are not implementing as tier-2 on m-c only. r=jgraham
Differential Revision: https://phabricator.services.mozilla.com/D71746
2020-04-22 16:24:57 +00:00
Edwin Takahashi
e2f3473016 Bug 1630350 - apply mach try filter to try syntax selector r=jmaher,gbrown
Changes:

Applies the `filter_tasks_by_blacklist` method to try syntax pushes as well.

  - moved `TARGET_TASK_BLACKLIST`and `filter_tasks_by_blacklist` method to live in `taskcluster/taskgraph/target_tasks.py`.
  - removed existing filters against `ccov, windows10-aarch64` and `android-hw` filters against try syntax pushes.
  - update imports for `fuzzy` and `chooser` selectors to refer to the new location of `filter_tasks_by_blacklist` method.

The reason for moving the logic (again) from `tools/tryselect` to `taskcluster/` is due to the placement of `try_option_syntax` and `target_tasks` files and both of those files handle the processing of `mach try syntax` pushes.

Differential Revision: https://phabricator.services.mozilla.com/D71698
2020-04-21 19:51:25 +00:00
Simon Fraser
f15beb98d7 Bug 1626933 Support bump_esr action in merge automation action r=jlorenzo
The action now requires a 'behavior' and not a 'merge_flavor'. An example log is https://firefox-ci-tc.services.mozilla.com/tasks/Qzsu8CY2QnylZSpO66Dy-g/runs/0/logs/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FQzsu8CY2QnylZSpO66Dy-g%2Fruns%2F0%2Fartifacts%2Fpublic%2Flogs%2Fesr68.diff

Differential Revision: https://phabricator.services.mozilla.com/D69425

--HG--
extra : moz-landing-system : lando
2020-04-03 10:36:42 +00:00
Tom Prince
5f37a68c8b Bug 1508504: [tryselect] Handle try syntax --setenv like --env; r=ahal
This converts `--setenv` into `env` in `try_task_config` at parameter
generation time.

Differential Revision: https://phabricator.services.mozilla.com/D66537

--HG--
extra : moz-landing-system : lando
2020-03-14 01:18:44 +00:00
Tom Prince
a917dc47e9 No bug: [taskgraph] Extract common setting from try_options to try_task_config in parameters; r=ahal
There are a number of settings that have equivalent expressions in
`try_options` (used for try syntax) and `try_task_config` (used for other try
selectors). Rather than requiring task generation code to understand both
formats, this converts the try syntax specification to `try_task_config` at
parameter generation time.

Differential Revision: https://phabricator.services.mozilla.com/D66536

--HG--
extra : moz-landing-system : lando
2020-03-14 01:18:34 +00:00
Andrew Halberstadt
56ba8a9ddf Bug 1603463 - Implement |mach try auto| which selects tasks on try automatically, r=tomprince
The 'auto' in 'mach try auto' stands for two things:

1. It automatically picks tasks for you.
2. It runs the same scheduling algorithms as autoland.

It accomplishes this by creating a new target_tasks method that spoofs the
'project' parameter to autoland.

Differential Revision: https://phabricator.services.mozilla.com/D60184

--HG--
extra : moz-landing-system : lando
2020-03-13 20:35:43 +00:00
Simon Fraser
ae80827888 Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D65323

--HG--
rename : taskcluster/ci/pipfile-update/kind.yml => taskcluster/ci/python-dependency-update/kind.yml
rename : taskcluster/docker/pipfile-updates/Dockerfile => taskcluster/docker/python-dependency-update/Dockerfile
rename : taskcluster/docker/pipfile-updates/README.md => taskcluster/docker/python-dependency-update/README.md
rename : taskcluster/docker/pipfile-updates/runme.sh => taskcluster/docker/python-dependency-update/runme.sh
rename : taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh => taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh
rename : taskcluster/docker/pipfile-updates/setup.sh => taskcluster/docker/python-dependency-update/setup.sh
rename : taskcluster/taskgraph/transforms/pipfile_update.py => taskcluster/taskgraph/transforms/python_update.py
extra : moz-landing-system : lando
2020-03-05 13:49:24 +00:00
Ciure Andrei
6fb6ae2327 Backed out changeset 7e16fe72804a (bug 1619944) for causing gecko decision bustage CLOSED TREE
--HG--
rename : taskcluster/ci/python-dependency-updates/kind.yml => taskcluster/ci/pipfile-update/kind.yml
rename : taskcluster/docker/python-dependency-update/Dockerfile => taskcluster/docker/pipfile-updates/Dockerfile
rename : taskcluster/docker/python-dependency-update/README.md => taskcluster/docker/pipfile-updates/README.md
rename : taskcluster/docker/python-dependency-update/runme.sh => taskcluster/docker/pipfile-updates/runme.sh
rename : taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh => taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh
rename : taskcluster/docker/python-dependency-update/setup.sh => taskcluster/docker/pipfile-updates/setup.sh
rename : taskcluster/taskgraph/transforms/python_update.py => taskcluster/taskgraph/transforms/pipfile_update.py
2020-03-05 13:05:34 +02:00
Simon Fraser
c8f4578a7f Bug 1619944 Migrate partials and pipfile-updates to use requirements.txt r=bhearsum
Differential Revision: https://phabricator.services.mozilla.com/D65323

--HG--
rename : taskcluster/ci/pipfile-update/kind.yml => taskcluster/ci/python-dependency-updates/kind.yml
rename : taskcluster/docker/pipfile-updates/Dockerfile => taskcluster/docker/python-dependency-update/Dockerfile
rename : taskcluster/docker/pipfile-updates/README.md => taskcluster/docker/python-dependency-update/README.md
rename : taskcluster/docker/pipfile-updates/runme.sh => taskcluster/docker/python-dependency-update/runme.sh
rename : taskcluster/docker/pipfile-updates/scripts/update_pipfiles.sh => taskcluster/docker/python-dependency-update/scripts/update_pipfiles.sh
rename : taskcluster/docker/pipfile-updates/setup.sh => taskcluster/docker/python-dependency-update/setup.sh
rename : taskcluster/taskgraph/transforms/pipfile_update.py => taskcluster/taskgraph/transforms/python_update.py
extra : moz-landing-system : lando
2020-03-04 17:47:49 +00:00
Johan Lorenzo
0ab7d3836f Bug 1619603 - Ship Geckoview at the ship_rc phase r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D65341

--HG--
extra : moz-landing-system : lando
2020-03-05 10:25:18 +00:00
Simon Fraser
9415049f64 Bug 1615311 Add merge day action r=mtabara
Calling the merge day automation requires an action so that we can pass in parameters such as source and destination repository and branch.

Differential Revision: https://phabricator.services.mozilla.com/D62763

--HG--
extra : moz-landing-system : lando
2020-02-25 10:48:54 +00:00