Commit graph

1153 commits

Author SHA1 Message Date
Greg Mierzwinski
9b2b126a32 Bug 1473048 - Prevent code coverage builds from running when using try option syntax. r=ahal
This patch completely disables *ccov, and *jsdcov builds and tests when scheduling them through try option syntax as these build variations use a lot of resources and are rarely needed to be scheduled. The only way to schedule code coverage from now on will be with the |mach try fuzzy| tool.

Differential Revision: https://phabricator.services.mozilla.com/D3921

--HG--
extra : moz-landing-system : lando
2018-08-22 20:45:51 +00:00
Joel Maher
da8f6490c3 Bug 1439588 - run xperf in os administrator group. r=pmoore
run xperf in os groups=administrators and support os_groups in taskcluster

Differential Revision: https://phabricator.services.mozilla.com/D4001

--HG--
extra : moz-landing-system : lando
2018-08-22 18:27:54 +00:00
Mike Hommey
0d3c801ae9 Bug 1484882 - Disable sccache idle shutdown on Windows builds. r=gps
Bug 1472610 did this for Linux builds. It was overlooked that Windows
builds needed the same.
2018-08-21 09:54:04 +09:00
Andrew Halberstadt
76da0cced6 Bug 1482344 - [raptor] Fix fetch tasks for native-engine mozharness_test based tasks, r=jmaher
This unbreaks some tier 3 raptor tasks. There are a few fixes rolled together here:
1) Stop overwriting the 'env' in mozharness_test.py's 'native-engine' implementation
2) Set the workdir to /home/cltbld (which makes sure the fetches are downloaded to there)
3) Download the fetches via mozharness in the 'raptor' script (since they don't use run-task anymore)

Depends on D3651

Differential Revision: https://phabricator.services.mozilla.com/D3652

--HG--
extra : moz-landing-system : lando
2018-08-20 14:04:57 +00:00
Johan Lorenzo
f62dcf37a1 Bug 1470942 - part 3: Make beetmover-geckoview tier-2 r=mtabara
Depends on D2421

Differential Revision: https://phabricator.services.mozilla.com/D3784

--HG--
extra : moz-landing-system : lando
2018-08-20 14:08:19 +00:00
Johan Lorenzo
d82f70b45e Bug 1470942 - part 2: Upload geckoview to maven repository via beetmover r=mtabara
Depends on D2420

Differential Revision: https://phabricator.services.mozilla.com/D2421

--HG--
extra : moz-landing-system : lando
2018-08-16 16:23:15 +00:00
Nick Thomas
a2c9c54f17 Bug 1483409 - provide node toolchain in mac partner repackage r=tomprince
Followup to bug 1478995 to ensure node is available for mac repackage tasks for partner and eme-free repacks.

Differential Revision: https://phabricator.services.mozilla.com/D3383

--HG--
extra : moz-landing-system : lando
2018-08-15 23:47:42 +00:00
Andrew Halberstadt
5dbfd833bb Bug 1472992 - [jsshell] Run javascript shell benchmarks against Google V8, r=jmaher
This runs the jsshell benchmarks against Google's V8 engine in addition to spidermonkey.
Both shells will run in the same task to keep things simple and decluttered. Though we
could split them out to separate tasks at a later date if needed.

Differential Revision: https://phabricator.services.mozilla.com/D3356

--HG--
extra : moz-landing-system : lando
2018-08-15 13:52:47 +00:00
Ionut Goldan
958d7d166b Bug 1472979 - Add Web Tooling Benchmark as a jsshell-bench test r=jmaher
Add Web Tooling Benchmark & (WIP) setup fetch task

Differential Revision: https://phabricator.services.mozilla.com/D2646

--HG--
extra : moz-landing-system : lando
2018-08-13 07:29:07 +00:00
Margareta Eliza Balazs
f617807241 Merge inbound to mozilla-central. a=merge 2018-08-10 12:17:09 +03:00
Nick Thomas
98d4d3ba20 Bug 1481619: Upload symbols for the main Android builds r=ted
Differential Revision: https://phabricator.services.mozilla.com/D2925

--HG--
extra : moz-landing-system : lando
2018-08-09 10:09:27 +00:00
Joel Maher
2b40e273de Bug 1482048 - run raptor linux tests on hardware, not AWS vms. r=rwood
raptor linux tests are currently run on AWS VM images, these should be run on raw hardware

Differential Revision: https://phabricator.services.mozilla.com/D2994

--HG--
extra : moz-landing-system : lando
2018-08-09 14:49:47 +00:00
Justin Wood
48b3246876 Bug 1481018 - While here Remove unused beetmover defines, that are only a source of confusion. r=tomprince
This beetmover transform is only relevant for Fennec and *-Source platforms at this time.

Differential Revision: https://phabricator.services.mozilla.com/D2754

--HG--
extra : moz-landing-system : lando
2018-08-08 20:57:00 +00:00
Justin Wood
aa9ae72062 Bug 1481018 - Add language packs to nightly beetmover. r=tomprince
This isn't the cleanest addition but it solves our immediate needs.

Differential Revision: https://phabricator.services.mozilla.com/D2755

--HG--
extra : moz-landing-system : lando
2018-08-08 14:38:17 +00:00
Noemi Erli
be6ab34c54 Merge mozilla-central to inbound. a=merge CLOSED TREE
--HG--
extra : rebase_source : 691b5b30b6c3b2ddece605c045ad913e466fdbab
2018-08-10 00:35:58 +03:00
Tom Prince
1206a0cc12 Bug 1477706: [test-verify] Only look at locally changed files on try and in try-select; r=ahal
The taskgraph code for test-verify currently looks at locally changed files to
determine how many chunks should be run. This code exists so that
`mach try fuzzy` show the same chunks that would be run on a try push.

This changes it, so that local commts are only considered on try and when
called from try-select. This makes generating the taskgraph locally faster,
when not using `mach try`. It also makes test-verfiy not consider too many
files, if the try push happens to contain commits that have landed but havent
been pushed to try yet (i.e. the first push to try after a merge, or beta try
pushes).

Differential Revision: https://phabricator.services.mozilla.com/D2698

--HG--
extra : rebase_source : 68b1ea583730ff3086949aa6c7b6a1046b406d23
extra : histedit_source : 68bbc7ca2062c7f425353e6caf6b8959786dc42d
2018-08-03 10:26:17 -06:00
Justin Wood
9d6baea4f5 Bug 1463749 - Langpack Checksums r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D2446

--HG--
extra : rebase_source : cea1217e92466617f43df998d14c9dfefa6ab436
2018-07-26 15:16:45 -04:00
Brindusan Cristian
91ec49bade Merge mozilla-central to autoland. a=merge CLOSED TREE 2018-08-08 00:57:25 +03:00
Andrew Halberstadt
7dde9cf26e Bug 1472800 - [ci] Add the raptor unity-webgl benchmark to taskcluster r=rwood
Enables the benchmark in CI, uses a fetch task to download the benchmark.

Depends on D2307.

Differential Revision: https://phabricator.services.mozilla.com/D2469

--HG--
extra : moz-landing-system : lando
2018-08-07 18:22:40 +00:00
Geoff Brown
aff5a6af05 Bug 1460411 - Add taskcluster config support for Android x86 7.0 tests on packet.net in docker-worker; r=jmaher 2018-08-07 10:05:38 -06:00
Tom Prince
caf815cd8b Bug 1479506: Fix permissions on taskcluster/taskgraph/transforms/task.py; r=me DONTBUILD
--HG--
extra : rebase_source : ba6ffa417b5ae083ad61a71defeb3cc1719b49dd
extra : amend_source : d1e1d2ce82dbc27a3d0878373da02cb1a88befa4
2018-08-03 11:55:48 -06:00
Tudor-Gabriel Vîjială
62e4daad39 Bug 1473313 - Part 4: Add build and test platforms for android emulator code coverage. r=gbrown
MozReview-Commit-ID: IkSKdB7ZeYi

--HG--
extra : rebase_source : 1cff84a03c8f590ac3df5e0dc1ccf217fd2589c3
2018-07-24 11:53:37 +01:00
Tudor-Gabriel Vîjială
3912821304 Bug 1473313 - Part 3: Extend CodeCoverageMixin to handle java code coverage tools. r=gbrown,marco
MozReview-Commit-ID: Lld5XLUMb3Y

--HG--
extra : rebase_source : 503650f2610d3ee021222666a6e619486472e82d
2018-07-24 11:51:54 +01:00
Noemi Erli
58e27f3dd9 Merge mozilla-central to inbound. a=merge CLOSED TREE 2018-08-02 12:04:24 +03:00
Geoff Lankow
4a5d7d86c6 Bug 1480274 - Add "fetches" to test schema; r=gps
--HG--
extra : amend_source : f9479243ca0af15ea30be7dc84bbb4ff7594ca1f
2018-08-01 18:13:45 -07:00
Tom Ritter
a0749a18ce Bug 1479506 Propogate group symbol into upload-symbols task r=Callek
MozReview-Commit-ID: 6KC60mdPI6F

--HG--
extra : rebase_source : 012b090de02500dfcc7c310f51199c1e9d82281a
2018-07-30 12:20:35 -05:00
Dan Mosedale
d2201e2b26 Bug 1478995 - Add node toolchains to each automated build, r=gps
MozReview-Commit-ID: BQCAVP0nk4S

--HG--
extra : rebase_source : bcd0d3a8b26058ed3354f72d626362660bf7b5b9
2018-07-26 13:34:44 -07:00
Chris AtLee
182e3f8445 Bug 733530: Use .tar.gz for test archives r=gps
Differential Revision: https://phabricator.services.mozilla.com/D1743

--HG--
extra : moz-landing-system : lando
2018-08-01 16:00:03 +00:00
shindli
f0d8729e09 Merge inbound to mozilla-central. a=merge 2018-07-31 12:50:32 +03:00
Chris AtLee
38cced543a Bug 1466537: Disable full crashsymbols by branch r=ted
Differential Revision: https://phabricator.services.mozilla.com/D1558

--HG--
extra : moz-landing-system : lando
2018-07-30 20:23:14 +00:00
rahul-shiv
8f8c3957ea Bug 1478883 - Tagging operations should use DONTBUILD in commit message r=Callek
MozReview-Commit-ID: 6QBQG3m907I

--HG--
extra : rebase_source : e3f77cf81b809940cfb9b59b89ff4cf3f2a63056
2018-07-28 02:12:59 +05:30
Csoregi Natalia
3708e71462 Merge inbound to mozilla-central. a=merge 2018-07-27 00:58:11 +03:00
Andrew Halberstadt
15c53b6d46 Bug 1468812 - [ci] Support MOZ_FETCHES and fetch-content in run-task r=gps
This removes the 'use-artifacts' mechanism in favour of fetches. There are a
few pieces here that need to land atomically:

1. Remove use-artifact related code
2. Call 'fetch-content' from the run-task script
3. Convert existing tasks on top of fetches (jsshell, python unittest)
4. Stop calling 'fetch-content' from toolchain setup tasks (as this now gets handled in run-task)

Depends on D2166.

Differential Revision: https://phabricator.services.mozilla.com/D2167

--HG--
extra : moz-landing-system : lando
2018-07-26 17:13:39 +00:00
Sebastian Hengst
943a6cf31a Backed out changeset 61f33f8c8750 (bug 1468812) for Linux ccov mass failures (bug 1478211). a=backout 2018-07-25 18:05:09 +03:00
Ben Hearsum
49d4d780ee bug 1477021: create pipfile-update task for funsize-update-generator. r=sfraser
--HG--
extra : rebase_source : 8a7bc1b481b6d477dc6b1ea6a0bd392e73f16f74
2018-07-26 08:56:08 -04:00
Andrew Halberstadt
a3174ac509 Bug 1468812 - [ci] Support MOZ_FETCHES and fetch-content in run-task r=gps
This removes the 'use-artifacts' mechanism in favour of fetches. There are a
few pieces here that need to land atomically:

1. Remove use-artifact related code
2. Call 'fetch-content' from the run-task script
3. Convert existing tasks on top of fetches (jsshell, python unittest)
4. Stop calling 'fetch-content' from toolchain setup tasks (as this now gets handled in run-task)

Depends on D2166.

Differential Revision: https://phabricator.services.mozilla.com/D2167

--HG--
extra : moz-landing-system : lando
2018-07-24 13:11:25 +00:00
Andi-Bogdan Postelnicu
d890dfdfe3 Bug 1461777 - Taskcluster Sa target should also run on Windows. r=gps
MozReview-Commit-ID: 7o7iPneK34e

--HG--
extra : rebase_source : ea5f003fea925267b79b5f3f7f3fd0d5a03e26b1
2018-06-26 16:06:13 +01:00
Roland Mutter Michael
d024714803 Bug 1467555 - Make Android single-locale nightlies tier-2. r=Callek
--HG--
extra : rebase_source : 99ce0a742de3a0e65defe988c412b382033e998b
2018-07-21 21:30:12 -04:00
Christian Holler
37f45cc5e9 Bug 1473259 - Windows updates for ASan reporter nightly build. r=catlee
MozReview-Commit-ID: 6DQD5DnzyqB
2018-07-03 23:41:31 +02:00
Andrew Halberstadt
e8a36b30d0 Bug 1468812 - [fetch-content] Implement ability to specify a per-fetch subdirectory to extract into r=gps
Currently 'fetch' artifacts are all extracted in the same directory, this could
make the extdir messy, or in the worst case, cause file name collisions.

Some artifacts are ok to extract into the same directory as they're already
bundled within the archive. But other artifacts are not. This patch keeps the
default behaviour (extracting everything into the same directory), but allows
task authors to specify per-artifact directories to extract into.

The syntax is:
path[>dest]@<task>

The 'dest' value will be a subdirectory of the MOZ_FETCHES_DIR environment
variable.

Depends on D2102.

Differential Revision: https://phabricator.services.mozilla.com/D2166

--HG--
extra : moz-landing-system : lando
2018-07-18 17:52:43 +00:00
Andrew Halberstadt
d380a59c66 Bug 1468812 - [taskgraph] Support artifacts from any dependency via fetches r=gps
Fetches no longer need to be artifacts exposed via a 'fetch' task, they can
also be artifacts from a task's dependencies. The new format is:

fetches:
    fetch:
        - fetch-artifact-1.zip
        - fetch-artifact-2.zip
    build:
        - build-artifact-1.zip
        ...

Specifying 'build' artifacts to fetch will error out if the task doesn't have
any build dependencies.

The 'fetch' key works the same as before, but it is now a special case. Unlike
'build' (or other dependencies), adding a fetch task's artifact here will
implicitly make our task depend on the corresponding fetch task. It will not
be an error.

Depends on D2028.

Differential Revision: https://phabricator.services.mozilla.com/D2102

--HG--
extra : moz-landing-system : lando
2018-07-17 13:05:06 +00:00
Csoregi Natalia
8f3547a60b Backed out changeset f68b31440829 (bug 1468812) for gecko decision task failures. CLOSED TREE 2018-07-17 00:03:48 +03:00
Andrew Halberstadt
276f80b504 Bug 1468812 - [taskgraph] Support artifacts from any dependency via fetches r=gps
Fetches no longer need to be artifacts exposed via a 'fetch' task, they can
also be artifacts from a task's dependencies. The new format is:

fetches:
    fetch:
        - fetch-artifact-1.zip
        - fetch-artifact-2.zip
    build:
        - build-artifact-1.zip
        ...

Specifying 'build' artifacts to fetch will error out if the task doesn't have
any build dependencies.

The 'fetch' key works the same as before, but it is now a special case. Unlike
'build' (or other dependencies), adding a fetch task's artifact here will
implicitly make our task depend on the corresponding fetch task. It will not
be an error.

Depends on D2028.

Differential Revision: https://phabricator.services.mozilla.com/D2102

--HG--
extra : moz-landing-system : lando
2018-07-16 20:16:55 +00:00
Andrew Halberstadt
a4378ab77d Bug 1468812 - [taskgraph] Move 'use_fetches' transform to the job section r=gps
The 'use_fetches' transform is currently only being used by toolchain tasks,
but we'd like to expand this to more kinds (like 'test' and 'source_test').

The problem is that 'use_fetches' doesn't have a schema, and assumes things
about the kinds of keys that will be set in the job. For example, it assumes
that job['worker']['env'] is going to be forwarded up to the jobdesc properly.

By moving this transform into the set applied to all 'job' tasks, we:

A) Have a task schema we can reliably depend on
B) Can automatically use it from any 'job' task without kind specific
modifications

Since the toolchain tasks apply the 'job' transforms (almost) right after
the 'use_fetches' transform, this change just works.

Differential Revision: https://phabricator.services.mozilla.com/D2028

--HG--
extra : moz-landing-system : lando
2018-07-16 16:47:04 +00:00
Kartikaya Gupta
047b6d3cb6 Bug 1475541 - Make QR test jobs tier-1 by default. r=aryx
This patch makes the QR test platforms tier-1 by default, and removes
the ad-hoc bits that were making individual QR jobs tier-1 before.
However, it also explicitly downgrades some QR jobs to tier-2 or tier-3;
comments in the yml files indicate why.

MozReview-Commit-ID: 1UfPuhcMvIW

--HG--
extra : rebase_source : a2347f6a5929246aaba7656b59c0b8f7aa4ca081
2018-07-13 09:44:06 -04:00
Justin Wood
31b8682d56 Bug 1469436 - Create a multi_dep loader and assign a first consumer in l10n. r=tomprince r=aki
Differential Revision: https://phabricator.services.mozilla.com/D1696

--HG--
extra : rebase_source : d6a9c1b12bbf53dba3e78ecdaaf30c5964e43d2e
2018-06-15 11:50:50 -07:00
Justin Wood
a2773825ad Bug 1469436 - Make repackage-signing distinct from its l10n, so we can depend on it in l10n for windows. r=tomprince
This is needed to not have a circular kind dependency when we actually spell out all dependencies (in a following patch)

Differential Revision: https://phabricator.services.mozilla.com/D1695

--HG--
rename : taskcluster/ci/repackage-signing/kind.yml => taskcluster/ci/repackage-signing-l10n/kind.yml
extra : rebase_source : c2998ba23f213090d27495eb44c3bde3a1628dff
2018-06-18 10:49:41 -04:00
Tudor-Gabriel Vîjială
ac148d83df Bug 1473610 - Use 64-bit grcov version for windows. r=marco
MozReview-Commit-ID: 7uo8z1pycdc

--HG--
extra : rebase_source : 1b6e311baa1d6556093346fc0e844d3bcc33b20c
2018-07-09 19:44:03 +01:00
Tudor-Gabriel Vîjială
d9bff781b2 Bug 1472236 - Add grcov code coverage builds by using a fetch task. r=dustin,marco
MozReview-Commit-ID: 3PZMNDRqxRM

--HG--
extra : rebase_source : 31c0104bf03d702db5766b40b145a9a342d0e8b2
2018-07-02 16:55:56 +01:00
David Major
2d44c25242 Bug 1463190 - Add forced-MSVC builds to CI to keep that platform green. r=ted 2018-07-09 18:22:45 -04:00