Commit graph

90 commits

Author SHA1 Message Date
Dustin J. Mitchell
cb2baa945a Bug 1525703 - remove repetitive debugging line r=aki
Differential Revision: https://phabricator.services.mozilla.com/D18871

--HG--
extra : moz-landing-system : lando
2019-02-06 21:01:17 +00:00
Tom Prince
ff1ba692a9 Bug 1524639: [taskgraph] Add a helper to Schema to allow referencing downstream schema entries; r=dustin
Differential Revision: https://phabricator.services.mozilla.com/D18377

--HG--
extra : moz-landing-system : lando
2019-02-04 22:42:00 +00:00
Tom Prince
3b43c82fd4 Bug 1522380: [win64-aarch64] Don't beetmove win64-aarch64 installers on release branches; r=nthomas
These builds aren't ready for general availability, so we don't want to publish
them. But we want to start building them now.

Differential Revision: https://phabricator.services.mozilla.com/D17453

--HG--
extra : moz-landing-system : lando
2019-01-25 16:07:31 +00:00
David Major
aba5821724 Bug 1512822 - Remove "MSVC" from the name of AArch64 builds r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D17024

--HG--
extra : moz-landing-system : lando
2019-01-24 15:02:06 +00:00
Justin Wood
720b949436 Bug 1485861 - Define many treeherder symbols based on the parent task. r=aki
This changes a bunch of symbols, notably:
* Group name BMR-L10n(*) ==> BMR(*)
* Group name BM-L10n(*) ==> BM(*)
* Groups the BMR symbol itself for en-US Nightly [so BMR ==> BMR(N)]
* Groups the BM symbol itself for en-US Nightly [so BM ==> BM(N)]
* Changes Source Signing fron symbol Bs to Srcs
* Groups Source signing beetmoving as BM(Srcs) instead of symbol BM-S
* Balrog complete update submission changes from c-Up(N) to c-Up(Ns) [Fennec Only]
* Beetmover en-US changes from symbol BM-S to BM(Ns) [used in Fennec]
* Beetmover Checksums (en-US) changes from BMcs(N) => BMcs(Ns) [fennec]
* Checksums signing (en-US, fennec) changes from cs(N) => cs(Ns)
* [Asan] Balrog changed [c-UP(N) ==> c-UP(BoR)]
* [Asan] signing changed from Ns to BoRs
* [Asan] checksums signing changed from cs(N) to cs(BoR)
* [Asan] Change generated source uploading from Ugs ==> UgsBoR

Differential Revision: https://phabricator.services.mozilla.com/D4178

--HG--
extra : moz-landing-system : lando
2019-01-02 21:53:25 +00:00
Dustin J. Mitchell
536dc55522 Bug 1492664 - add {artifact-reference: ..}; r=tomprince
This provides an easy way to encode an artifact URL in static data such as
taskcluster/ci/nightly-l10n/kind.yml, without knowing in advance the format of
the URL.

--HG--
extra : rebase_source : 5b5229d96aad2916b1b3c8e72045c1d461fc1c02
extra : source : 9c35dd209c6b407bc3a45ce7b4c27272ef1bb486
2018-09-25 20:26:55 +00:00
Tom Prince
83aee3f163 No bug: [taskgraph] Remove an unused global variable; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D14615

--HG--
extra : moz-landing-system : lando
2018-12-24 21:33:54 +00:00
Sebastian Hengst
767c971623 Backed out 21 changesets (bug 1492664) for breaking cron task for nightlies. a=backout
Backed out changeset a7d50dbb2c8e (bug 1492664)
Backed out changeset 2d876c4ece8b (bug 1492664)
Backed out changeset c82285d253de (bug 1492664)
Backed out changeset bf6d089640eb (bug 1492664)
Backed out changeset d9a7f2ce49c3 (bug 1492664)
Backed out changeset 06c466ab4323 (bug 1492664)
Backed out changeset c1ea4a10cc8d (bug 1492664)
Backed out changeset 4c63a04fdd47 (bug 1492664)
Backed out changeset 742b038bb1dd (bug 1492664)
Backed out changeset 911b4b0fb683 (bug 1492664)
Backed out changeset 870c8cec99e5 (bug 1492664)
Backed out changeset 77699b51336b (bug 1492664)
Backed out changeset 29f33f22fd8b (bug 1492664)
Backed out changeset e7f305408708 (bug 1492664)
Backed out changeset 335a92b1f424 (bug 1492664)
Backed out changeset c566f1c8dcdf (bug 1492664)
Backed out changeset c77ae59aba41 (bug 1492664)
Backed out changeset 9c35dd209c6b (bug 1492664)
Backed out changeset a972d6b4434e (bug 1492664)
Backed out changeset 5ea6f03f845e (bug 1492664)
Backed out changeset 0699d3873e44 (bug 1492664)

--HG--
extra : histedit_source : 5cb1f7e50f25d4a875c1a58c86b7dce902e1a89c%2C20f1ab1a843b612cfcc67cf5c6ff745d65abf076
2018-12-20 12:43:22 +02:00
Razvan Maries
f658ebcbab Merge mozilla-inbound to mozilla-central a=merge 2018-12-20 07:04:06 +02:00
Tom Prince
dbdaa6c12c Bug 1512699: [win64-aarch64] Publish win64-aarch64 installer r=aki
Differential Revision: https://phabricator.services.mozilla.com/D14663

--HG--
extra : moz-landing-system : lando
2018-12-17 20:22:46 +00:00
Tom Prince
243a40c5b1 Bug 1514407: [win64-aarch64] Add windows aarch64 nightly builds; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D14659

--HG--
extra : moz-landing-system : lando
2018-12-17 21:17:35 +00:00
Margareta Eliza Balazs
2e5e28f518 Backed out 16 changesets (bug 1492664) for breaking developer artifact builds, requested by standard8 a=backout
Backed out changeset 31e500489665 (bug 1492664)
Backed out changeset f4945658d45f (bug 1492664)
Backed out changeset 6d17291b8b92 (bug 1492664)
Backed out changeset 90f3faa36137 (bug 1492664)
Backed out changeset 0b229b00818a (bug 1492664)
Backed out changeset 5eb2c77d70a9 (bug 1492664)
Backed out changeset e1ebad5d89c5 (bug 1492664)
Backed out changeset 3017e5890739 (bug 1492664)
Backed out changeset c8b7e620eabf (bug 1492664)
Backed out changeset d3dfbd848236 (bug 1492664)
Backed out changeset 5c92bb5ac895 (bug 1492664)
Backed out changeset fb7cfca6ebc3 (bug 1492664)
Backed out changeset 0c4101230d4d (bug 1492664)
Backed out changeset b93a0fcc86f3 (bug 1492664)
Backed out changeset 6dc9522ee0bf (bug 1492664)
Backed out changeset 85d7f8b330eb (bug 1492664)
2018-12-19 11:45:29 +02:00
Dustin J. Mitchell
a63677c332 Bug 1492664 - add {artifact-reference: ..} r=tomprince
This provides an easy way to encode an artifact URL in static data such as
taskcluster/ci/nightly-l10n/kind.yml.  This could be used in
mozharness_test.py, for example, as well -- but other code (such as to support
backfilling) expects `task-reference` there.  To avoid breaking such subtle
bits, those can continue using `task-reference` with URLs generated based on
TASKCLUSTER_ROOT_URL.

Differential Revision: https://phabricator.services.mozilla.com/D14197

--HG--
extra : moz-landing-system : lando
2018-12-18 17:22:40 +00:00
Aki Sasaki
a604a76176 Bug 1501878 - required_signoffs attribute. r=tomprince
If a task has `required_signoffs` that match a release's `required_signoffs`, we should defer running that task until we have a matching `signoff_url`.

- add filter_out_missing_signoffs
- add transforms changes to inherit upstream `required_signoffs`
- add `mar-signing` `required_signoffs` to the `partials-signing`, `mar-signing`, and `mar-signing-l10n` kinds

Differential Revision: https://phabricator.services.mozilla.com/D11734

--HG--
extra : moz-landing-system : lando
2018-11-20 21:26:18 +00:00
Aki Sasaki
041b7255f8 Bug 1501878 - beetmove complete mars. r=tomprince,Callek
Differential Revision: https://phabricator.services.mozilla.com/D11732

--HG--
extra : moz-landing-system : lando
2018-11-21 19:04:03 +00:00
Aki Sasaki
eb8512553d Bug 1501878 - drop complete mar from repackage-signing. r=tomprince
We want to defer mar-signing to the second half of the promote phase,
but we want to keep Windows repackaged exe signing in the first half of
the promote phase. This means we need to stop signing the complete MAR
in repackage-signing, and defer it to another kind.

Differential Revision: https://phabricator.services.mozilla.com/D11730

--HG--
extra : moz-landing-system : lando
2018-11-20 21:26:06 +00:00
Tom Prince
becc9482f9 Bug 1507898: [taskgraph] Factor out schema validation in transformations; r=dustin
Most jobs include at least one transform that verifies the input of all the
tasks against a schema. This code is duplicated in each transform. Refactor it,
so that we only need one copy of the logic.

Differential Revision: https://phabricator.services.mozilla.com/D12165

--HG--
extra : moz-landing-system : lando
2018-11-20 23:44:12 +00:00
Narcis Beleuzu
8a7fef1076 Backed out changeset e947694d0ed7 (bug 1507898) for Linting failure. CLOSED TREE 2018-11-21 00:29:17 +02:00
Tom Prince
4d5bceb588 Bug 1507898: [taskgraph] Factor out schema validation in transformations; r=dustin
Most jobs include at least one transform that verifies the input of all the
tasks against a schema. This code is duplicated in each transform. Refactor it,
so that we only need one copy of the logic.

Differential Revision: https://phabricator.services.mozilla.com/D12165

--HG--
extra : moz-landing-system : lando
2018-11-20 22:09:34 +00:00
Andreea Pavel
616d7d4c51 Backed out 7 changesets (bug 1501878) for breaking win partial generation nightlies a=backout
Backed out changeset 00f109437e82 (bug 1501878)
Backed out changeset f1843fdd4c0f (bug 1501878)
Backed out changeset af0ea80f7b08 (bug 1501878)
Backed out changeset 01311f87d287 (bug 1501878)
Backed out changeset 4e2dc6c23463 (bug 1501878)
Backed out changeset 050c4bba5d71 (bug 1501878)
Backed out changeset 9198c5a03b59 (bug 1501878)

--HG--
rename : taskcluster/taskgraph/transforms/mar_signing.py => taskcluster/taskgraph/transforms/partials_signing.py
2018-11-17 18:37:39 +02:00
Aki Sasaki
b1f0bfc26f Bug 1501878 - required_signoffs attribute. r=tomprince
If a task has `required_signoffs` that match a release's `required_signoffs`, we should defer running that task until we have a matching `signoff_url`.

- add filter_out_missing_signoffs
- add transforms changes to inherit upstream `required_signoffs`
- add `mar-signing` `required_signoffs` to the `partials-signing`, `mar-signing`, and `mar-signing-l10n` kinds

Differential Revision: https://phabricator.services.mozilla.com/D11734

--HG--
extra : moz-landing-system : lando
2018-11-16 21:04:01 +00:00
Aki Sasaki
3f0291802e Bug 1501878 - beetmove complete mars. r=tomprince
Differential Revision: https://phabricator.services.mozilla.com/D11732

--HG--
extra : moz-landing-system : lando
2018-11-16 21:03:04 +00:00
Aki Sasaki
78d5fe5b81 Bug 1501878 - drop complete mar from repackage-signing. r=tomprince
We want to defer mar-signing to the second half of the promote phase,
but we want to keep Windows repackaged exe signing in the first half of
the promote phase. This means we need to stop signing the complete MAR
in repackage-signing, and defer it to another kind.

Differential Revision: https://phabricator.services.mozilla.com/D11730

--HG--
extra : moz-landing-system : lando
2018-11-16 21:01:25 +00:00
Tom Prince
a351ba3251 No bug: [taskgraph] Don't mutate a dictionary while iterating it in beetmover_repackage; r=dustin
Iterating a container while mutating it has undefined behavior. This caused a
decision task[1] to fail once, so stop doing it here.


[1] https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=decision&revision=3c9736576736aba5810577e6b89ae00e5e9a6b98

Differential Revision: https://phabricator.services.mozilla.com/D12062

--HG--
extra : moz-landing-system : lando
2018-11-15 20:30:17 +00:00
Justin Wood
85b6855540 Bug 1475512 - Beetmove .msi's for nightlies and releases. r=mtabara
Differential Revision: https://phabricator.services.mozilla.com/D10960

--HG--
extra : moz-landing-system : lando
2018-11-09 15:05:45 +00:00
Dustin J. Mitchell
e860ab8925 Bug 1492664 - add {artifact-reference: ..}; r=tomprince
This provides an easy way to encode an artifact URL in static data such as
taskcluster/ci/nightly-l10n/kind.yml, without knowing in advance the format of
the URL.

--HG--
extra : rebase_source : 25c99d392e9b71c514f236379a816fae971e161a
2018-09-25 20:26:55 +00:00
Tom Prince
3163ffe3fd Bug 1501776: [taskgraph] Don't duplicate definition of multi_dep schema; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D9721

--HG--
extra : moz-landing-system : lando
2018-10-24 22:16:49 +00:00
Aki Sasaki
11a546c5d1 Bug 1499254 - beetmover_repackage{,_l10n} multi-dep. r=tomprince
Depends on D9198

Differential Revision: https://phabricator.services.mozilla.com/D9200

--HG--
extra : moz-landing-system : lando
2018-10-23 21:12:39 +00:00
Tom Prince
d9d6f34977 Bug 1498019: [release] Don't set shipping phase based on target_tasks; r=aki
The phase of a task doesn't depend on which phase graph it is being generated in.

Differential Revision: https://phabricator.services.mozilla.com/D8303

--HG--
extra : moz-landing-system : lando
2018-10-10 23:08:18 +00:00
Johan Lorenzo
96fe434cb7 Bug 1488127 - Make 52 -> 60 updates signed with the old mar scheme (instead of mar_384)
Make 52 -> 60 updates signed with the old mar scheme (instead of mar_384)

Differential Revision: https://phabricator.services.mozilla.com/D5244

--HG--
extra : moz-landing-system : lando
2018-09-07 10:18:21 +00:00
Tom Prince
a9aeea0cd3 Bug 1481121: [release] Use existing release-artifact metadata in beetmover_repackage; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D3817

--HG--
extra : rebase_source : 1137564eb7bc32406b15059cc89e91b1f2a978c1
extra : histedit_source : b7ba4f2be262c10e86c5635a959425c9585678c9
2018-08-20 12:40:21 -06:00
Tom Prince
571ddb0c2e Bug 1481121: [release] Rationalize beetmover_repacakge dependency names; r=Callek
Differential Revision: https://phabricator.services.mozilla.com/D3812

--HG--
extra : rebase_source : 47c2c7919c6388f56b16cef7749a9f464400784f
extra : histedit_source : d408de6e20265852378ae1fcba4b3481c0a398e9
2018-08-17 13:15:07 -06:00
Justin Wood
aa9ae72062 Bug 1481018 - Add language packs to nightly beetmover. r=tomprince
This isn't the cleanest addition but it solves our immediate needs.

Differential Revision: https://phabricator.services.mozilla.com/D2755

--HG--
extra : moz-landing-system : lando
2018-08-08 14:38:17 +00:00
Chris AtLee
182e3f8445 Bug 733530: Use .tar.gz for test archives r=gps
Differential Revision: https://phabricator.services.mozilla.com/D1743

--HG--
extra : moz-landing-system : lando
2018-08-01 16:00:03 +00:00
Christian Holler
37f45cc5e9 Bug 1473259 - Windows updates for ASan reporter nightly build. r=catlee
MozReview-Commit-ID: 6DQD5DnzyqB
2018-07-03 23:41:31 +02:00
Justin Wood
a2773825ad Bug 1469436 - Make repackage-signing distinct from its l10n, so we can depend on it in l10n for windows. r=tomprince
This is needed to not have a circular kind dependency when we actually spell out all dependencies (in a following patch)

Differential Revision: https://phabricator.services.mozilla.com/D1695

--HG--
rename : taskcluster/ci/repackage-signing/kind.yml => taskcluster/ci/repackage-signing-l10n/kind.yml
extra : rebase_source : c2998ba23f213090d27495eb44c3bde3a1628dff
2018-06-18 10:49:41 -04:00
Bogdan Tara
6eafe1c00b Backed out changeset 9c75cab2e322 (bug 733530) for breaking artifact builds 2018-07-04 14:50:22 +03:00
Chris AtLee
8745339529 Bug 733530: Use .tar.gz for test archives r=gps
Differential Revision: https://phabricator.services.mozilla.com/D1743

--HG--
extra : moz-landing-system : lando
2018-07-03 18:33:02 +00:00
Lisa Guo
2aea743d55 Bug 1443873 - update beetmover in-tree payload to include buildhub. r=mtabara a=release
--HG--
extra : rebase_source : dd4131d9a6411975fefd2981ac6041af05c0c2fc
extra : source : ed0b4efd4f93f47a8e71934bed013a1a06822fd7
2018-06-18 18:45:22 +03:00
Justin Wood
4a7ee168bf Bug 1286092 - Stub installer attribute. r=aki
for L10n jobs should run per-push based on the corresponding builds

Differential Revision: https://phabricator.services.mozilla.com/D1406

--HG--
extra : rebase_source : 207d1c25e37ab2619a09fb209282ffe55025de26
2018-05-22 18:22:37 -04:00
Bogdan Tara
933c5069bd Backed out 16 changesets (bug 1286092) for L10n bustages CLOSED TREE
Backed out changeset ef828badfd93 (bug 1286092)
Backed out changeset 57a592e33f36 (bug 1286092)
Backed out changeset c9cf945aa4f9 (bug 1286092)
Backed out changeset d8c01d976acd (bug 1286092)
Backed out changeset 5d68dfd6325c (bug 1286092)
Backed out changeset 878e174255ff (bug 1286092)
Backed out changeset fa3e38422d49 (bug 1286092)
Backed out changeset fc6aebca89e3 (bug 1286092)
Backed out changeset f2271cd6af26 (bug 1286092)
Backed out changeset 7b828445f551 (bug 1286092)
Backed out changeset 5617053b1740 (bug 1286092)
Backed out changeset 556f54c5e209 (bug 1286092)
Backed out changeset db19ea492b02 (bug 1286092)
Backed out changeset 6eb40b38f9c9 (bug 1286092)
Backed out changeset 3eb4e39b9bcd (bug 1286092)
Backed out changeset b3c05f6e6a57 (bug 1286092)
2018-05-30 16:16:24 +03:00
Justin Wood
25f766f68a Bug 1286092 - Stub installer attribute. r=aki
for L10n jobs should run per-push based on the corresponding builds

Differential Revision: https://phabricator.services.mozilla.com/D1406

--HG--
extra : rebase_source : 902aaff764db6df06b96e7ba8c7d717afd6869e3
2018-05-22 18:22:37 -04:00
Justin Wood
36648e7085 Bug 1453033 - Define taskgraph logic for signing and shipping devedition language packs as well. r=aki
This merely extends the logic involved in shipping language packs to AMO. All devedition language packs will be shipped as 'unlisted' for now, meaning that there is no extra AMO work involved. The extension ID is taken from the langpack itself.

Differential Revision: https://phabricator.services.mozilla.com/D1104

--HG--
extra : rebase_source : a6fcc953c79531377540216343e9d0037a2879d6
2018-05-02 14:20:32 -04:00
Justin Wood
e9432bbb09 Bug 1458395 - Do not use stub installer on esr60. r=aki
On ESR[60] stub installer isn't designed to work, and we expect most users of esr will have no use for a stub installer. However this poses some problems where the taskgraph assumes that any Nightly generates a stub installer and thus it should be available along the way.

The patch hardcodes the list of branches that do not need a stub installer, though we'll want to clean up this specification in some way, as Thunderbird will likely need it to be cleaner and we may want on-change builds to use this logic (e.g. for on-change l10n).

Differential Revision: https://phabricator.services.mozilla.com/D1082

--HG--
extra : source : 2f091908b8839650961c3968b6beee1dd8d1084b
2018-05-01 19:32:38 -04:00
Chris AtLee
96d067df95 Bug 1403548: Enable nightly asan reportor builds and updates r=Callek
MozReview-Commit-ID: 2X03vU5bO32

--HG--
extra : rebase_source : 70d25b081ed874d4f88944e05f40764f948a45a7
2018-04-19 09:28:59 -04:00
Dorel Luca
b78d790273 Backed out changeset a63caceffcee (bug 1403548) for liniting failure on builds/worker/checkouts/gecko/taskcluster/taskgraph/transforms/beetmover_repackage.py. CLOSED TREE 2018-04-26 00:07:21 +03:00
Chris AtLee
a8def10cc3 Bug 1403548: Enable nightly asan reportor builds and updates r=Callek
MozReview-Commit-ID: 2X03vU5bO32

--HG--
extra : rebase_source : d4b6672eae5b378ac5a5d80d7f14d193d201f517
2018-04-19 09:28:59 -04:00
Aki Sasaki
d135d86205 bug 1442793 - beetmover artifact_prefix. r=bhearsum
MozReview-Commit-ID: 6asTyW9T3OM

--HG--
extra : rebase_source : 795ab3f662ea095a710ef505427dad0c8c95116e
2018-03-07 14:27:49 -08:00
Johan Lorenzo
0ee2315067 Bug 1441353 - part 2: Add beetmover job to publish signed langpacks r=Callek
MozReview-Commit-ID: HXjcclf3OeX

--HG--
extra : rebase_source : 6373b17fc730d6d1b301a874ae0686991f3fdbb2
2018-04-06 16:04:27 +02:00
Tom Prince
59dd18e6c4 Bug 1421062: Configure beetmover workers via global taskgraph config; r=aki
Differential Revision: https://phabricator.services.mozilla.com/D781

--HG--
extra : rebase_source : 40bc39af068fc5877a5fd6423739e4248105e089
extra : histedit_source : 77483e68671290e5a2882e681c16f5e0abe79069
2018-03-20 11:24:06 -06:00