Commit graph

6990 commits

Author SHA1 Message Date
Butkovits Atila
a07f790e42 Backed out changeset e1921c5112d8 (bug 1696251) for causing bustages complaining about 'CommandContext'. CLOSED TREE 2021-07-16 20:35:55 +03:00
Mitchell Hentges
09c7c7c9dc Bug 1720591: Remove unused patch_main() for Python < 3.4 on Windows r=ahal
Now that we use Python 3.6+, this code is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119929
2021-07-16 16:34:42 +00:00
Alex Lopez
190e03aaab Bug 1696251 - Replace self with command_context where possible in existing mach commands. r=mhentges,webdriver-reviewers,perftest-reviewers,whimboo
This step removes all the dependencies of mach commands to
having a MachCommandBase as the `self` by using the `command_context`
argument instead. This also removes any remaining statefulness from those
classes that implement mach commands, ultimately making it easier to move
existing commands out of classes in a follow-up.

Differential Revision: https://phabricator.services.mozilla.com/D118058
2021-07-16 15:51:29 +00:00
Mike Hommey
43e5bb336f Bug 1720822 - Don't install lucetc during mach bootstrap. r=firefox-build-system-reviewers,andi
At the moment, lucetc is not useful by default, only when enabling wasm
sandboxed libraries manually, and in that case, configure knows to
bootstrap lucetc itself. Furthermore, lucetc is set to be replaced with
wasm2c, which is in-tree and doesn't require bootstrapping at all.

Differential Revision: https://phabricator.services.mozilla.com/D120051
2021-07-16 08:36:26 +00:00
Sandor Molnar
c40ce62c3c Backed out 10 changesets (bug 1718341) for causing wrench bustages. CLOSED TREE
Backed out changeset e5bd150a58b2 (bug 1718341)
Backed out changeset e82e752b8f44 (bug 1718341)
Backed out changeset d9462c727c8f (bug 1718341)
Backed out changeset 2bd647754780 (bug 1718341)
Backed out changeset 31dfce45985f (bug 1718341)
Backed out changeset 03266cea345d (bug 1718341)
Backed out changeset 3920b27acecb (bug 1718341)
Backed out changeset 2b17603c5e65 (bug 1718341)
Backed out changeset ebc0d5d4f537 (bug 1718341)
Backed out changeset 1c8844157b8d (bug 1718341)
2021-07-16 03:40:56 +03:00
Agi Sferro
ea13a76521 Bug 1718341 - Download Android AVD from TL job artifact. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D119542
2021-07-15 23:22:18 +00:00
Agi Sferro
3c257f8ca5 Bug 1718341 - Update Android cmdtools to 4.0. r=nalexander,glandium
The SDK Tools version we're currently using is deprecated and was last released
in 2017. It's time for an upgrade!

Differential Revision: https://phabricator.services.mozilla.com/D119226
2021-07-15 23:22:17 +00:00
Agi Sferro
36dcc7ce37 Bug 1718341 - Remove redundant override in MobileAndroidBootstrapper. r=nalexander
Differential Revision: https://phabricator.services.mozilla.com/D119998
2021-07-15 23:22:17 +00:00
Agi Sferro
9ee3064894 Bug 1718341 - Prewarm AVD before packaging r=nalexander
The very first time an Android AVD starts it runs some one time jobs to
properly set up the AVD.

To avoid running the setup every time we run tests in automation, we can boot
the AVD before packaging it so that the testing jobs can use a "prewarmed" AVD
instead.

Differential Revision: https://phabricator.services.mozilla.com/D119225
2021-07-15 23:22:17 +00:00
Agi Sferro
164fc2191d Bug 1718341 - Generate Android AVD in TL job instead of using tooltool r=aklotz,nalexander
Tooltool images are hard to update because we don't provide a script to
generate the image and documentation is often inaccurate.

This patch makes it so we generate the AVD in the android-sdk TL job instead.

Differential Revision: https://phabricator.services.mozilla.com/D119221
2021-07-15 23:22:15 +00:00
Cosmin Sabou
3cd7630738 Backed out changeset 2c1257a95130 (bug 1720591) for causing build bustages complaining about patch_main. CLOSED TREE 2021-07-16 02:49:45 +03:00
Mitchell Hentges
b5d3b00394 Bug 1720591: Remove unused patch_main() for Python < 3.4 on Windows r=ahal
Now that we use Python 3.6+, this code is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119929
2021-07-15 21:44:37 +00:00
surajeet310
ec79e93bd5 Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozversioncontrol r=mhentges
Since Python 2 is no longer used in python/mozversioncontrol, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119905
2021-07-15 21:34:08 +00:00
amy churchwell
0c7d4a9357 Bug 1719727 - Change "Personalize" on New Tab to gear icon. r=prathiksha,fluent-reviewers,Gijs,thecount
Differential Revision: https://phabricator.services.mozilla.com/D119657
2021-07-15 19:36:50 +00:00
Anuj Gautam
557acb4135 Bug 1720761: Added kali to the list of debian configurations. r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D120003
2021-07-15 19:06:10 +00:00
Mike Hommey
77f0b36028 Bug 1720595 - Don't install dump_syms during mach bootstrap. r=firefox-build-system-reviewers,nalexander
Bug 1719229 broke the install by accident, but configure takes care of
it by default since bug 1716911, bug 1716912 or bug 1717585 depending on
the platform, so we can just stop installing it from mach bootstrap.

Differential Revision: https://phabricator.services.mozilla.com/D119933
2021-07-15 04:47:10 +00:00
surajeet310
1903d302ab Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozperftest r=mhentges
Since Python 2 is no longer used in python/mozperftest, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119898
2021-07-14 16:33:46 +00:00
surajeet310
88365fbe52 Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mozbuild r=mhentges
Since Python 2 is no longer used in python/mozbuild, hence 'ensure_subprocess_env' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D119791
2021-07-14 15:17:27 +00:00
Mike Hommey
487119e349 Bug 1719229 - Allow the build system to use a sysroot for the host part of the build. r=firefox-build-system-reviewers,andi
Differential Revision: https://phabricator.services.mozilla.com/D119847
2021-07-14 08:54:43 +00:00
Jonathan Kew
0132f4c4df Bug 1720308 - Support VSCode installed as a snap package on Linux. r=firefox-build-system-reviewers,nalexander
Differential Revision: https://phabricator.services.mozilla.com/D119769
2021-07-13 15:04:06 +00:00
Kimberly Sereduck
210d1cc333 Bug 1705420: Report the version of the application being tested in our perfherder data r=perftest-reviewers,sparky
implementing get_browser_meta for mozperftest

Differential Revision: https://phabricator.services.mozilla.com/D113861
2021-07-13 12:13:38 +00:00
surajeet310
f2e1419d77 Bug 1717651 - Removed instances of 'ensure_subprocess_env' from python/mach r=mhentges
Since Python 2 is no longer used in python/mach, hence 'ensure_subprocess_env' is obsolete .

Differential Revision: https://phabricator.services.mozilla.com/D119185
2021-07-12 21:38:13 +00:00
Mitchell Hentges
1256637095 Bug 1720113: Temporarily add "python" to default clobber set r=firefox-build-system-reviewers,nalexander
Until virtualenvs are more dependably consistent, we should purge them
by default when "./mach clobber" is run.

Differential Revision: https://phabricator.services.mozilla.com/D119651
2021-07-12 16:43:09 +00:00
Florin Strugariu
2b3375937c Bug 1715478 - Automated recording for desktop with a list sites r=sparky
Differential Revision: https://phabricator.services.mozilla.com/D117298
2021-07-09 07:12:27 +00:00
june wilde
7db7c6efaf Bug 1716398 - support tracking tagged releases in mach vendor; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D118422
2021-07-08 18:20:04 +00:00
Mitchell Hentges
f20cdb0c12 Bug 1712804: Check if comm directory is empty in TB identification r=ahal
Some developers hold onto a `comm` directory as a mount point
that they conditionally populate depending on whether they're working on
Firefox or Thunderbird.
The "`comm` directory exists == is a thunderbird checkout"
assumption isn't compatible with this workflow.

The fix embraced by this patch is to check if the `comm` directory has
any contents.

Differential Revision: https://phabricator.services.mozilla.com/D119193
2021-07-06 18:33:58 +00:00
Emilio Cobos Álvarez
780f3a05d2 Bug 1719144 - Fix various imports for Python 3.10. r=firefox-build-system-reviewers,mhentges
These are enough for me to run bootstrap+configure+build.

Some touch third-party code (gyp), but per discussion in the earlier
versions of this revision that seems fine.

Differential Revision: https://phabricator.services.mozilla.com/D119080
2021-07-06 15:26:29 +00:00
Mike Hommey
544436ed03 Bug 1718156 - Avoid some configure tests creating the common virtualenv. r=firefox-build-system-reviewers,mhentges,andi
When running `mach python-test` on a clobbered tree, we create both the
python-test and common virtualenvs, but the former should be enough. The
latter is only created when running tests that use the BaseConfigureTest
class, when it indirectly includes init.configure, which makes the
configure sandbox run the virtualenv_python3 function, which ends up
initializing the common virtualenv. We only don't end up re-executing
that virtualenv python thanks to 6680ca0acc27 which was a workaround
that would allow any virtualenv in $objdir/_virtualenvs, while still
creating a virtualenv it won't use.

Tests now tell virtualenv_python3 to not use the normal virtualenv
manager, and remove the workaround.

Differential Revision: https://phabricator.services.mozilla.com/D118775
2021-07-05 22:33:56 +00:00
Mitchell Hentges
c25aec1f74 Bug 1717104: Update "pth" docs for virtualenvs r=ahal
The "pth" action no longer has a customizable filename, and the docs
should be updated accordingly.

Depends on D118609

Differential Revision: https://phabricator.services.mozilla.com/D118610
2021-07-05 22:10:35 +00:00
Mitchell Hentges
86ae5fbc84 Bug 1717104: Remove obsolete "set-variable" notes from virtualenv docs r=ahal
Since https://phabricator.services.mozilla.com/D115921, "set-variable"
is no longer a valid action. Looks like that patch forgot to remove the
associated docs

Differential Revision: https://phabricator.services.mozilla.com/D118609
2021-07-05 22:10:35 +00:00
surajeet310
498013ddc6 Bug 1717651 - Removed instances of 'ensure_subprocess_env()' from virtualenv.py r=mhentges
Since Python 2 is no longer used in virtualenv.py ,hence 'ensure_subprocess_env()' is obsolete.

Differential Revision: https://phabricator.services.mozilla.com/D118883
2021-07-05 19:59:53 +00:00
Sandor Molnar
fe63cb08df Backed out 2 changesets (bug 1719144) for causing build bustages. CLOSED TREE
Backed out changeset 8e4b00b9d57c (bug 1719144)
Backed out changeset d2a88c5423a0 (bug 1719144)
2021-07-05 21:15:50 +03:00
Emilio Cobos Álvarez
52a85aaca1 Bug 1719144 - Fix various imports for Python 3.10. r=firefox-build-system-reviewers,mhentges
These are enough for me to run bootstrap+configure+build.

Some touch third-party code (gyp), but per discussion in the earlier
versions of this revision that seems fine.

Differential Revision: https://phabricator.services.mozilla.com/D119080
2021-07-05 17:55:41 +00:00
Mitchell Hentges
9ee9a69ade Bug 1717905: M1 Macs don't support Android targets r=glandium
Also filter out bootstrapping for Android targets.

Differential Revision: https://phabricator.services.mozilla.com/D118727
2021-07-05 17:44:20 +00:00
Mitchell Hentges
733d1bb939 Bug 1717905: Fix M1 Mac bootstrap choice offset r=glandium
When we customized the list of possible `applications` for M1 Macs, the
change was only applying to the displayed list, but not the actual
list that the choice was indexed against.

This is fixed by properly using `applications` instead of
`APPLICATIONS` where relevant.

Note that it's still possible to manually request an
`artifact_mode` if you provide it as an argument for `./mach bootstrap`,
but this workflow is usually only done by devs who are familiar with all
the applications, and therefore likely know what they're doing.

Differential Revision: https://phabricator.services.mozilla.com/D118625
2021-07-05 17:44:19 +00:00
june wilde
68adbeeae5 Bug 1703066 - add tracking key to mozyaml file schema; r=tjr
Differential Revision: https://phabricator.services.mozilla.com/D110829
2021-06-29 14:01:58 +00:00
Mike Hommey
81228f00cd Bug 1717947 - Remove packager support for brotli in Jars. r=firefox-build-system-reviewers,nalexander
This was added ing bug 1352595. It has only been used briefly, and we
since then have gone all the way to never compress omni.ja. Even if we
did go back to compressing, we'd probably go with zstd rather than
brotli.
The gecko-side support for this has only ever been nightly-only.

Differential Revision: https://phabricator.services.mozilla.com/D118655
2021-06-25 00:20:10 +00:00
Mitchell Hentges
b7dde05a8d Bug 1717786: Update mozperfest runner's list of in-tree Python packages r=kimberlythegeek
After replacing a bunch of vendored source packages with wheels, the
paths to the raw source changed.

Differential Revision: https://phabricator.services.mozilla.com/D118723
2021-06-24 18:02:53 +00:00
Mitchell Hentges
43949e4a1c Bug 1717702: Resolve print-checks python unpacking typo r=andi
`_get_infer_config()` returns 3 items, but the existing code expects 2.
Add a third `_` to capture the other unwanted item.

Differential Revision: https://phabricator.services.mozilla.com/D118535
2021-06-24 13:21:57 +00:00
Alexander J. Vincent
b12c2e5817 Bug 1717650 - Support RockyLinux 8.4. r=mhentges
Differential Revision: https://phabricator.services.mozilla.com/D118539
2021-06-22 20:34:13 +00:00
Alexander J. Vincent
2c7ff94a69 Bug 1717650 - Drop requirement for wireless-tools-devel package. r=mhentges
wireless-tools-devel isn't available on Rocky Linux. Fortunately, it doesn't appear to be needed for the build anymore, and it was added almost a decade ago, so it should be safe to remove.

Differential Revision: https://phabricator.services.mozilla.com/D118532
2021-06-22 20:34:13 +00:00
Tarik Eshaq
453be8c6fd Bug 1716450 - Removes fxa-client rust code from Desktop. r=rfkelly
Differential Revision: https://phabricator.services.mozilla.com/D118238
2021-06-22 17:04:35 +00:00
Marian-Vasile Laza
4728ef73b2 Bug 1700534 - black lint fix r=fix CLOSED TREE 2021-06-22 09:22:33 +03:00
Mike Hommey
744db845c6 Bug 1700534 - Coalesce RLBox wasmboxed libraries. r=firefox-build-system-reviewers,shravanrn,bholley,andi,mhentges
Differential Revision: https://phabricator.services.mozilla.com/D116440
2021-06-22 05:31:33 +00:00
Mitchell Hentges
ee5a948268 Bug 1716600: Don't use node/npm that are too old or have no version r=firefox-build-system-reviewers,nalexander
In the existing behaviour, we would return a node/npm executable from
`find_executable()`, even if we couldn't extract a version from it or if
the extracted version was insufficient.

Now, we fail early if the detected node/npm is insufficient.

Differential Revision: https://phabricator.services.mozilla.com/D118377
2021-06-21 16:47:56 +00:00
Mitchell Hentges
00d96c3fed Bug 1716600: Remove looping from Node's find_executable() r=firefox-build-system-reviewers,nalexander
Since we're no longer checking for both "nodejs" and "node",
`find_executable()` can be simplified.

Differential Revision: https://phabricator.services.mozilla.com/D118376
2021-06-21 16:47:55 +00:00
Mitchell Hentges
73814a7f0f Bug 1716600: Always search for "node" instead of "nodejs" r=firefox-build-system-reviewers,nalexander
As :julienw beautifully described on Bugzilla,
we no longer need to search for "nodejs" since all
packages providing Node >= v12 will provide the `node`
binary.
See his comment here:
https://bugzilla.mozilla.org/show_bug.cgi?id=1716600#c4

Base-toolchain tasks with Node v10 should still be
happy because, unlike Debian's Node v10, they provide
a `node` binary instead of `nodejs`.

Differential Revision: https://phabricator.services.mozilla.com/D118375
2021-06-21 16:47:55 +00:00
Aki Sasaki
5b64d5df25 Bug 1659691 - Update cross-channel algorithm to not replay history. r=firefox-build-system-reviewers,releng-reviewers,bhearsum,mhentges
(Tl;dr: The original author of this patch was axel@mozilla.com (:pike).
This patch has been modified to run in production automation.)

Cross-channel takes all the en-US strings from the shipping train branches
and consolidates them into a single repository. Originally, this ran out of
https://hg.mozilla.org/users/axel_mozilla.com/cross-channel-experimental/ .
The original version was coupled tightly with specific hg internals, making
hg upgrades fragile. Axel wrote
https://bug1659691.bmoattachments.org/attachment.cgi?id=9170636 before
handing off project ownership; this is the original patch to stop replaying
history to simplify the logic.

This patch also automates the previously manual preparation steps, allows
for running both in automation and locally, and adds retries for production
robustness.

Differential Revision: https://phabricator.services.mozilla.com/D116537
2021-06-17 18:52:58 +00:00
Mitchell Hentges
2438ea8889 Bug 1712133: Validate that pypi dependencies are installed r=ahal
Check that all expected pypi packages are installed
when checking if a virtualenv is up-to-date.

Differential Revision: https://phabricator.services.mozilla.com/D117712
2021-06-17 14:58:17 +00:00
Mitchell Hentges
2fa59acd4f Bug 1712133: Adds "pypi" action to virtualenv handle_package() r=ahal
The `pypi` action uses `pip` to fetch a package and its dependencies

Differential Revision: https://phabricator.services.mozilla.com/D115925
2021-06-17 14:58:17 +00:00