Commit graph

1510 commits

Author SHA1 Message Date
Johan Lorenzo
76246ea977 Bug 1445890 - Fennec: Fix bad FTP path on bouncer submission r=mtabara a=release
MozReview-Commit-ID: 2zfBA6ksoNT

--HG--
extra : rebase_source : 9096aa3350f892aca6fd31a9d9292269fbf20a3c
extra : intermediate-source : 4fe0615c6be1744ad9cbdcb6c917fabfac094a88
extra : source : 69685faa0bb4db6b19d44cca4fa9c1b7c39bbebc
2018-03-16 09:36:59 +01:00
Csoregi Natalia
7e68d80ef1 Backed out changeset 4dc6a0427030 (bug 1445890) for failing taskcluster/taskgraph/transforms/bouncer_submission.py:33. CLOSED TREE 2018-03-16 15:53:20 +02:00
Johan Lorenzo
ee742107fd Bug 1445890 - Fennec: Fix bad FTP path on bouncer submission r=mtabara
MozReview-Commit-ID: 2zfBA6ksoNT

--HG--
extra : rebase_source : 69685faa0bb4db6b19d44cca4fa9c1b7c39bbebc
2018-03-16 09:36:59 +01:00
Johan Lorenzo
7aa77a37aa Bug 1445672 - Do not rely on release-type to define alias name r=aki
MozReview-Commit-ID: ErWI9JhUqG7


G: changed taskcluster/taskgraph/transforms/bouncer_aliases.py

--HG--
extra : rebase_source : 0df8cba7937144e6c5168ce4df753629ce288ce5
2018-03-14 19:11:16 +01:00
Mihai Tabara
1f26261cf5 Bug 1444131 - Strip whitespaces in bouncer check partials processing transforms. r=jlorenzo
MozReview-Commit-ID: 5cM1NUL2N5I
2018-03-09 14:06:32 +00:00
Csoregi Natalia
2bb80b6666 Merge mozilla-central to mozilla-inbound. a=merge CLOSED TREE 2018-03-08 20:43:00 +02:00
Mihai Tabara
e3d6476239 Bug 1443104 - Properly fix the missing en-US and win4 stub installer for release-bouncer-submission. r=jlorenzo. a=release DONTBUILD
MozReview-Commit-ID: 6tEcjiprg91
2018-03-08 17:15:15 +00:00
Geoff Lankow
14fa91f0be Bug 1442851 - Use comm-central revision in routes; r=dustin,tomprince
MozReview-Commit-ID: 4XV3SGQVT54

--HG--
extra : rebase_source : 28d1765a2d1fc8761e966a8aba135734553c961f
2018-03-08 11:23:00 +13:00
Simon Fraser
1003fa56fd Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : amend_source : fb6f5356c2ad1b6a4b1ac39460109bd91cbb2f7d
2018-03-06 15:27:58 +00:00
Andreea Pavel
ecb8a6e568 Backed out changeset 514feaa0c698 (bug 1436369) for taskcluster-images bustage on a CLOSED TREE
--HG--
rename : taskcluster/docker/periodic-updates/.eslintrc.js => taskcluster/docker/periodic_updates/.eslintrc.js
rename : taskcluster/docker/periodic-updates/Dockerfile => taskcluster/docker/periodic_updates/Dockerfile
rename : taskcluster/docker/periodic-updates/README.md => taskcluster/docker/periodic_updates/README.md
rename : taskcluster/docker/periodic-updates/runme.sh => taskcluster/docker/periodic_updates/runme.sh
rename : taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh
2018-03-07 14:22:54 +02:00
Simon Fraser
f5ed24fa70 Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : amend_source : fd74227ccb8cd0a89b623e042cf3aea84d753702
2018-03-06 15:27:58 +00:00
Bogdan Tara
d89cfbc667 Backed out changeset 6ba388ca08da (bug 1436369) for taskcluster-images bustage and linting failure at taskcluster/ci/repo-update/kind.yml:49:1 on a CLOSED TREE
--HG--
rename : taskcluster/docker/periodic-updates/.eslintrc.js => taskcluster/docker/periodic_updates/.eslintrc.js
rename : taskcluster/docker/periodic-updates/Dockerfile => taskcluster/docker/periodic_updates/Dockerfile
rename : taskcluster/docker/periodic-updates/README.md => taskcluster/docker/periodic_updates/README.md
rename : taskcluster/docker/periodic-updates/runme.sh => taskcluster/docker/periodic_updates/runme.sh
rename : taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh
2018-03-07 13:21:46 +02:00
Simon Fraser
c83da63a75 Bug 1436369 periodic file updates migration, stage 1 r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681
***
Bug 1436369 Add taskcluster periodic file updates r=callek

Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683
***
Bug 1436469 Fix task definition r=callek
***
Bug 1436469 Move periodic-file updates docker image r=callek

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
rename : taskcluster/docker/periodic_updates/.eslintrc.js => taskcluster/docker/periodic-updates/.eslintrc.js
rename : taskcluster/docker/periodic_updates/Dockerfile => taskcluster/docker/periodic-updates/Dockerfile
rename : taskcluster/docker/periodic_updates/README.md => taskcluster/docker/periodic-updates/README.md
rename : taskcluster/docker/periodic_updates/runme.sh => taskcluster/docker/periodic-updates/runme.sh
rename : taskcluster/docker/periodic_updates/scripts/genHPKPStaticPins.js => taskcluster/docker/periodic-updates/scripts/genHPKPStaticPins.js
rename : taskcluster/docker/periodic_updates/scripts/getHSTSPreloadList.js => taskcluster/docker/periodic-updates/scripts/getHSTSPreloadList.js
rename : taskcluster/docker/periodic_updates/scripts/periodic_file_updates.sh => taskcluster/docker/periodic-updates/scripts/periodic_file_updates.sh
extra : histedit_source : 08bfe7e842d5e516ba6453f458796fd8d2aa3ae0%2C25d60af8fa6da24131eb23756259399abb1de41d
2018-03-06 15:27:58 +00:00
Johan Lorenzo
0e0caacad5 Bug 1433459 - part 3: Fix bad scopes for aliases task r=mtabara
--HG--
extra : rebase_source : c8cef8a0c03a00a1ac18f98d52d5a71204a9b17d
2018-03-06 18:00:01 +01:00
Csoregi Natalia
3758b8fe3e Backed out 3 changesets (bug 1436469) for Gecko Decision task failure. CLOSED TREE
Backed out changeset a03dea399278 (bug 1436469)
Backed out changeset 370c9dbdd572 (bug 1436369)
Backed out changeset b3b9609544ec (bug 1436369)

--HG--
rename : taskcluster/ci/repo-update-bb/kind.yml => taskcluster/ci/repo-update/kind.yml
2018-03-06 17:36:19 +02:00
Simon Fraser
a1890ef267 Bug 1436369 Add taskcluster periodic file updates r=callek
Reviewers: Callek

Reviewed By: Callek

Differential Revision: https://phabricator.services.mozilla.com/D683

--HG--
extra : rebase_source : f7f6d69c092903118b6a41aa8b69fe0419910253
2018-03-06 15:10:46 +00:00
Simon Fraser
c9bb5232b8 Bug 1436369 Move buildbot periodic file updates to clearer name r=callek
Summary:
We'll be adding the new periodic file updates task to run in parallel. This patch
moves the existing one to make it clear it's running on buildbot, so we don't get confused
later on.

Reviewers: Callek

Reviewed By: Callek

Bug #: 1436369

Differential Revision: https://phabricator.services.mozilla.com/D681

--HG--
rename : taskcluster/ci/repo-update/kind.yml => taskcluster/ci/repo-update-bb/kind.yml
extra : rebase_source : c1386a05c378589efdd508199d97cb8121308686
2018-03-06 15:09:48 +00:00
Ben Hearsum
5b3af06a90 bug 1443190: fix watersheds for all platforms and branches in update verify config tasks. r=nthomas 2018-03-05 18:01:36 -05:00
Mihai Tabara
1286d6d33e Bug 1443104 - fix update folder in bouncer submission release job. r=jlorenzo,Callek a=release CLOSED TREE
MozReview-Commit-ID: E1vqqaG1PE9

--HG--
extra : source : f149ea88f20108dec9d7937b8f45138744461150
2018-03-05 14:10:21 +00:00
Mihai Tabara
ba7d00b19b Bug 1432219 - fix release generate checksums signing scopes in-tree. r=me a=release CLOSED TREE
MozReview-Commit-ID: G0b9T0Q5IIs

--HG--
extra : source : a1098c825a9c5e07f03ec4ad7a760c868bf20d75
2018-03-02 18:57:25 +00:00
Joel Maher
dbcf1f2f59 Bug 1433761 - ensure that max-run-time is working from taskcluster -> talos. r=dustin 2018-02-09 10:08:44 -05:00
Johan Lorenzo
92b0f666f8 Bug 1432219 - part 3: Fix bad beetmover worker type in production r=bhearsum
--HG--
extra : source : dbe9214d56355abb026839a145a0580068f75e33
extra : amend_source : 9d8077e6f71c5e322548870206b6aa6a0ccb8345
2018-03-02 15:20:50 +01:00
Sebastian Hengst
118e03a936 merge mozilla-central to mozilla-inbound 2018-03-01 20:32:20 +02:00
Tiberius Oros
61d400da1c Merge inbound to mozilla-central. a=merge 2018-03-01 19:29:00 +02:00
Tiberius Oros
1a3b814e9c Merge autoland to mozilla-central. a=merge 2018-03-01 19:10:44 +02:00
Johan Lorenzo
171f489600 Bug 1424482 - part 2: Remove upstream artifact when no path is defined r=mtabara a=bustage 2018-03-01 14:07:23 +01:00
Ben Hearsum
8b71e3533a bug 1432219: fix linting errors. r=me 2018-02-28 13:43:37 -05:00
Mihai Tabara
642a4b0975 bug 1432219: migrate release checksums builder off of BBB to TC. r=aki, rail
--HG--
extra : transplant_source : %09u%E1%BD%FER%92T%0EE%B5%F5%CB%BF%918%D6%B53%9B
2018-02-28 10:03:20 -05:00
Ben Hearsum
815b9a36ef bug 1441185: use new update verify configs for final verify. r=aki
--HG--
extra : transplant_source : %1D%18%1D%09%B4%F0%1A%D4%DD%B67%94lk%08%FC%E5%1C%04%ED
2018-02-27 16:59:11 -05:00
Joel Maher
d4da45b8ac backout Bug 1431161 for win10 hardware failures. r=me 2018-02-28 11:14:57 -05:00
Johan Lorenzo
77a4f5d36b Bug 1432817 - [in-tree relpro] Delete push-apk-breakpoint task r=aki
MozReview-Commit-ID: G5nvGfNIVNN

--HG--
extra : rebase_source : 4554c1b7ce44edd9f6cef3dd9e2990d7ff2e5b05
2018-02-22 17:10:29 +00:00
Johan Lorenzo
69fb87824b Bug 1424482 - beetmover: Get rid of balrog_props in favor of task payload r=mtabara
MozReview-Commit-ID: 5eRwwQ10BQD
2018-02-15 14:46:19 +01:00
Justin Wood
a97cfe398f Bug 1439876 - Add scriptworker version bumping. r=aki
--HG--
extra : rebase_source : c6fa2cd85f599278d1e854d1f12ed7d0ae586352
2018-02-21 12:06:38 +00:00
Johan Lorenzo
03c8a9b27c Bug 1433459 - part 2: Move aliases tasks to scriptworker r=mtabara,rail
MozReview-Commit-ID: Ld6ZQPBZYjX

--HG--
extra : rebase_source : 83ce7b0d783bf90b362711958f5963c46f5bedf2
2018-02-26 15:21:54 +01:00
Johan Lorenzo
084a9fc1fe Bug 1433459 - part 1: Move bouncer submission tasks to scriptworker r=mtabara,rail
MozReview-Commit-ID: 6SKhjf1ywoH

--HG--
extra : rebase_source : dc2206f232f3552f3871972abc8c1f2db3beb56a
2018-02-26 15:14:46 +01:00
Rail Aliiev
0e5f8a4da7 Bug 1398796 - Add push phase to PARTIAL_UPDATES_FLAVORS r=aki
--HG--
extra : rebase_source : a071517974cc93c1757cf6f50d6d027ee4f1ef0b
2018-02-27 11:16:20 -05:00
Marco Castelluccio
ffd695dcbf Bug 1434729 - Never optimize test suites for coverage builds. r=jmaher
--HG--
extra : rebase_source : 0c2080cb2856c331fe6b3f2106e71be05777afda
2018-02-20 12:20:19 +01:00
Marco Castelluccio
32fddd2e38 Bug 1434729 - Make it possible to overwrite 'optimization' in tests transforms. r=dustin
--HG--
extra : rebase_source : e03d99e02359f2f560829244ac4e496a07d126a2
2018-02-20 19:26:32 +01:00
arthur.iakab
9bffb6aa72 Merge inbound to mozilla-central. a=merge 2018-02-27 11:58:55 +02:00
Geoff Brown
f1756229b6 Bug 1412349 - Avoid SETA optimization of SCHEDULES.inclusive suites, like test-verify; r=dustin 2018-02-26 13:58:08 -07:00
Aki Sasaki
af3a7de077 bug 1438735 - balrog scriptworker push and schedule support. r=bhearsum
- add balrog submit-toplevel - this replaces the final portion of the updates builder.
- rename balrog transform to balrog_submit, because it's for balrog locale submission
  - make this default to the 'promote' phase. balrog and beetmover currently take the current
    phase, which isn't always the wanted behavior.
- rename balrog publish to balrog schedule
- add balrog secondary push and secondary scheduling, for RCs
- remove the release_updates transforms
- make the task.py balrog transforms smarter
- get rid of the release_balrog_publishing transforms; ad a generic worker_type transform
- add BALROG_ACTIONS to scriptworker.py
- add get_balrog_action_scope()
- remove the unused balrog channel scopes

MozReview-Commit-ID: 369ACiOAd5F

--HG--
rename : taskcluster/taskgraph/transforms/balrog.py => taskcluster/taskgraph/transforms/balrog_submit.py
extra : rebase_source : 9311522460ae6790af14a6b8b9600019702f8cbd
2018-02-15 18:14:26 -08:00
Ben Hearsum
fb77983863 bug 1398799: switch to in-tree mozharness update verify config creator. r=aki 2018-02-23 06:03:27 -05:00
Rob Wood
4465328597 Bug 1431161 - Temporarily turn off coalescing on new win tc h/w; r=pmoore
MozReview-Commit-ID: Ju6F3ewBvJX

--HG--
extra : rebase_source : 3d9c5e242f5bd2b641bb4c621dc971bb76658dfd
2018-02-21 15:30:02 -05:00
Rob Wood
05ce9d95f9 Bug 1431161 - run windows 32 and 64 bit builds on windows10-64 hardware for talos performance tests; r=jmaher
MozReview-Commit-ID: EVIHh42fpHU

--HG--
extra : rebase_source : a8f8cc907ed909bf16a983a66324c104899f6ecb
2018-02-06 13:18:09 -05:00
Aki Sasaki
e4e5d75a3d bug 1438023 - stop running old-id android builds in promote_fennec. r=bhearsum
MozReview-Commit-ID: 6XqcXoHkSlF

--HG--
extra : rebase_source : 87b5b5b71b8361027e11d0de73d270b7bb0ce6a7
2018-02-22 13:30:09 +00:00
Jordan Lund
c3d8c022bc Bug 1423058 - intermittent - funsize-update-generator docker image hangs while installing packages, CLOSED TREE r=bustage
MozReview-Commit-ID: EnKpG5EttrR

--HG--
extra : amend_source : 1688098a5438f281dce5f98907731e90f795862e
2018-02-21 13:36:22 -08:00
aselagea@mozilla.com
af5c627e88 Bug 1423058 - intermittent - funsize-update-generator docker image hangs while installing packages, r=jlund
MozReview-Commit-ID: COpnWQGuEeM

--HG--
extra : rebase_source : 8ada907404b7de22e7bb51d6af0e4c7230bb20b2
2018-02-21 13:00:48 -08:00
Gregory Szorc
6d0ba89f9a Bug 1430878 - Use larger EC2 instances for Clang toolchain tasks; r=glandium
We now have access to workers running on EC2 instances with dozens of
vCPUs. gecko-<L>-b-linux-large is m4.10xlarge, m5.12xlarge, c5.9xlarge,
or c4.8xlarge. gecko-<L>-b-linux-xlarge is m5.24xlarge, m4.16xlarge,
or c5.18xlarge.

Experimentation reveals that Clang tasks are the only tasks that
are CPU efficient enough (read: cost effective) to run on these
larger worker types.

This commit defines the new worker types and switches Clang toolchain
tasks to run on the new workers. clang5 and clang6 tasks take ~30 minutes
on the -large variant but ~17 minutes on the -xlarge variant. All other
tasks don't show as linear of a speedup. So running them on the
-xlarge variant isn't justified.

As part of this change, Mac toolchain tasks have been converted
to run on gecko-<L>-b-linux* workers. The gecko-<L>-b-macosx64 workers
are actually Linux. IMO the b-macosx64 worker type is no longer needed.
Moving the toolchain tasks off the worker should hopefully not be very
controversial.

MozReview-Commit-ID: HynQPMWiWHo

--HG--
extra : rebase_source : 1142767e2a51c17880909ec6f15b694db8a43af2
2018-02-20 13:35:54 -08:00
Tom Prince
eb430111ab Bug 1439258: Set SCCACHE controlling environment variables on windows workers; r=dustin
Since comm-central doesn't have integration branches like autoland, we want to
always disable sccache on nightly builds, rather than being able to key off of
the tree to determine whether to enable it. This is currently done by not
including the sccache toolchain. However, the mozconfig files expect sccache to be
available if `SCCACHE_DISABLE` isn't set, which wasn't the case on windows.

Differential Revision: https://phabricator.services.mozilla.com/D603

--HG--
extra : rebase_source : 565d0b6a3b24a23f6ae844a8cd97b9824e9f5282
extra : amend_source : 8c1679a71a2baf04a0dc83074234c5101705b806
2018-02-18 14:01:57 -07:00
Tom Prince
903c53c463 Bug 1421062: Use correct scope prefixes in repackage signing tasks; r=jlorenzo
Differential Revision: https://phabricator.services.mozilla.com/D611

--HG--
extra : rebase_source : ddd122dc61eb77196eb8f96dd176a495a4851191
extra : histedit_source : 040d3db277cc4d0ae3b700a008b98d999356439a
2018-02-19 21:09:11 -07:00