fune/taskcluster/taskgraph/transforms/upload_generated_sources.py
Ricky Stewart 02a7b4ebdf Bug 1654103: Standardize on Black for Python code in mozilla-central.
Allow-list all Python code in tree for use with the black linter, and re-format all code in-tree accordingly.

To produce this patch I did all of the following:

1. Make changes to tools/lint/black.yml to remove include: stanza and update list of source extensions.

2. Run ./mach lint --linter black --fix

3. Make some ad-hoc manual updates to python/mozbuild/mozbuild/test/configure/test_configure.py -- it has some hard-coded line numbers that the reformat breaks.

4. Make some ad-hoc manual updates to `testing/marionette/client/setup.py`, `testing/marionette/harness/setup.py`, and `testing/firefox-ui/harness/setup.py`, which have hard-coded regexes that break after the reformat.

5. Add a set of exclusions to black.yml. These will be deleted in a follow-up bug (1672023).

# ignore-this-changeset

Differential Revision: https://phabricator.services.mozilla.com/D94045
2020-10-26 18:34:53 +00:00

43 lines
1.7 KiB
Python

# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0. If a copy of the MPL was not distributed with this
# file, You can obtain one at http://mozilla.org/MPL/2.0/.
"""
Transform the upload-generated-files task description template,
taskcluster/ci/upload-generated-sources/kind.yml, into an actual task description.
"""
from __future__ import absolute_import, print_function, unicode_literals
from taskgraph.transforms.base import TransformSequence
transforms = TransformSequence()
@transforms.add
def add_task_info(config, jobs):
for job in jobs:
dep_task = job["primary-dependency"]
del job["primary-dependency"]
# Add a dependency on the build task.
job["dependencies"] = {"build": dep_task.label}
# Label the job to match the build task it's uploading from.
job["label"] = dep_task.label.replace("build-", "upload-generated-sources-")
# Copy over some bits of metdata from the build task.
dep_th = dep_task.task["extra"]["treeherder"]
job.setdefault("attributes", {})
job["attributes"]["build_platform"] = dep_task.attributes.get("build_platform")
if dep_task.attributes.get("shippable"):
job["attributes"]["shippable"] = True
plat = "{}/{}".format(
dep_th["machine"]["platform"], dep_task.attributes.get("build_type")
)
job["treeherder"]["platform"] = plat
job["treeherder"]["tier"] = dep_th["tier"]
if dep_th["symbol"] != "N":
job["treeherder"]["symbol"] = "Ugs{}".format(dep_th["symbol"])
job["run-on-projects"] = dep_task.attributes.get("run_on_projects")
job["optimization"] = dep_task.optimization
yield job