Commit graph

112 commits

Author SHA1 Message Date
Andrew Halberstadt
795728d89d Bug 1293295 - Replace all mochitest 'flavor' options with a single --flavor argument, r=jmaher
This accomplishes three things:

1) Easier to use CLI when running without the benefit of testing/mochitest/mach_commands.py
2) Guarantees these arguments are mutually exclusive
3) Simplifies a bunch of logic in the test harness

The primary motivation for this change is to slightly improve the UX when running mochitest
from a taskcluster interactive loaner. However, this is more of a bandaid solution that was
easy to implement before the proper fix in bug 1293259 can be landed.

MozReview-Commit-ID: IeHBGrJ0Sji

--HG--
extra : rebase_source : ba1b7e437881e363fe0051dccd3d732221311c59
2016-08-08 11:48:49 -04:00
Andrew Halberstadt
e920337e70 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : 3a94debda3dbed839074094707cadf32e7f7337c
2016-07-20 11:13:30 -04:00
Andrew Halberstadt
dee8b08ce5 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7

--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : c50792dfe82e688b52aa07150ddab03e5d0d3f36
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
extra : source : edcbd7c0aa36be0846f2e8e989fb57c9e4449cc4
2016-01-25 09:55:57 -05:00
Wes Kocher
aaf89c475e Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)

--HG--
rename : testing/mochitest/start_b2g.js => testing/mochitest/b2g_start_script.js
extra : commitid : DLurSs6PJ1G
2016-02-03 17:38:12 -08:00
Andrew Halberstadt
ae410fb5a9 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : 0a041c36b59c79c1bea755b22fe07017cb3d0aa5
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
2016-01-25 09:55:57 -05:00
Simon Gareste
f2c7f460ab Bug 1231806 - Fix abnormal blank lines quantity. r=ted 2015-12-28 03:23:37 -05:00
Nigel Babu
7ea33b2999 Bug 1208725 - Increase the timeout for b2g tests, r=ahal
--HG--
extra : rebase_source : f84ae6531a723c1cb33386f20129b4d4748ece35
2015-12-22 20:02:11 +05:30
Andrew Halberstadt
629335ccca Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : jAe5IJxAQp
extra : rebase_source : 5f163aea70fb99a95667fdafeb7b3361bed1f82d
2015-11-18 13:35:38 -05:00
Wes Kocher
480b4c994e Backed out changeset 6ab228593820 (bug 1225903) for android robocop bustage CLOSED TREE
--HG--
extra : commitid : Jt9KCML2G2Y
2015-11-19 11:54:17 -08:00
Andrew Halberstadt
60681c7eb8 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : 6wYdpJe0jU0
extra : rebase_source : 69d997a523551210b156e09de339fd6bc8cf2504
extra : amend_source : aed1da36f41210339ab91d53cb34ac2e7b0d770c
2015-11-18 13:35:38 -05:00
Andrew Halberstadt
1252d85394 Bug 1219442 - Re-write specialpowers as a restartless addon, r=jmaher
In order to meet the addon signing requirement for tests, specialpowers
needs to be installed at gecko runtime. This means it must be restartless.
This patch packages specialpowers as a restartless addon, but it does not
yet install it at runtime.

--HG--
rename : testing/specialpowers/components/SpecialPowersObserver.js => testing/specialpowers/content/SpecialPowersObserver.jsm
extra : commitid : Bbg8gFten8S
extra : rebase_source : 99d0b841a1f8f9eb6b6ca846363a158836482e57
2015-11-05 10:00:59 -05:00
Nathan Froyd
21e096a42c Bug 1196430 - part 7 - teach process_leak_log how to symbolicate leaked object stacks; r=mccr8 2015-08-26 19:41:43 -04:00
Kaustabh Datta Choudhury
34307268d1 Bug 1162003 - Enable run-by-dir mode on Fx desktop opt builds. r=jmaher 2015-08-11 08:25:00 -04:00
Andrew Halberstadt
2be5ff0c10 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.

--HG--
rename : testing/mozbase/docs/mozlog_structured.rst => testing/mozbase/docs/mozlog.rst
rename : testing/mozbase/mozlog/mozlog/structured/commandline.py => testing/mozbase/mozlog/mozlog/commandline.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/__init__.py => testing/mozbase/mozlog/mozlog/formatters/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/base.py => testing/mozbase/mozlog/mozlog/formatters/base.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/errorsummary.py => testing/mozbase/mozlog/mozlog/formatters/errorsummary.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/__init__.py => testing/mozbase/mozlog/mozlog/formatters/html/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/html.py => testing/mozbase/mozlog/mozlog/formatters/html/html.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/main.js => testing/mozbase/mozlog/mozlog/formatters/html/main.js
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/style.css => testing/mozbase/mozlog/mozlog/formatters/html/style.css
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/xmlgen.py => testing/mozbase/mozlog/mozlog/formatters/html/xmlgen.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/machformatter.py => testing/mozbase/mozlog/mozlog/formatters/machformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/tbplformatter.py => testing/mozbase/mozlog/mozlog/formatters/tbplformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/unittest.py => testing/mozbase/mozlog/mozlog/formatters/unittest.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/xunit.py => testing/mozbase/mozlog/mozlog/formatters/xunit.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/__init__.py => testing/mozbase/mozlog/mozlog/handlers/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/base.py => testing/mozbase/mozlog/mozlog/handlers/base.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/bufferhandler.py => testing/mozbase/mozlog/mozlog/handlers/bufferhandler.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/statushandler.py => testing/mozbase/mozlog/mozlog/handlers/statushandler.py
rename : testing/mozbase/mozlog/mozlog/structured/logtypes.py => testing/mozbase/mozlog/mozlog/logtypes.py
rename : testing/mozbase/mozlog/mozlog/structured/reader.py => testing/mozbase/mozlog/mozlog/reader.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/__init__.py => testing/mozbase/mozlog/mozlog/scripts/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/format.py => testing/mozbase/mozlog/mozlog/scripts/format.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/logmerge.py => testing/mozbase/mozlog/mozlog/scripts/logmerge.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/unstable.py => testing/mozbase/mozlog/mozlog/scripts/unstable.py
rename : testing/mozbase/mozlog/mozlog/structured/stdadapter.py => testing/mozbase/mozlog/mozlog/stdadapter.py
rename : testing/mozbase/mozlog/mozlog/structured/structuredlog.py => testing/mozbase/mozlog/mozlog/structuredlog.py
rename : testing/mozbase/mozlog/mozlog/logger.py => testing/mozbase/mozlog/mozlog/unstructured/logger.py
rename : testing/mozbase/mozlog/mozlog/loggingmixin.py => testing/mozbase/mozlog/mozlog/unstructured/loggingmixin.py
rename : testing/mozbase/mozlog/mozlog/loglistener.py => testing/mozbase/mozlog/mozlog/unstructured/loglistener.py
extra : commitid : 3JWk75JY4N0
extra : rebase_source : 229bad7a7bf8ead013ce62d128c0896a75cad393
2015-07-16 10:38:40 -04:00
Julien Pagès
addba42d69 Bug 1091274 - Move leak log functions out of automationutils and into mozbase. r=jgriffin 2015-07-03 07:04:22 +02:00
Andrew Halberstadt
42888ae5f5 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester
--HG--
extra : commitid : KbQllMAJdfl
extra : rebase_source : 2069e41c760e4993b1d6d0ddd70799e426a19089
2015-06-05 13:28:29 -04:00
Andrew Halberstadt
7aa80fb529 Bug 1164597 - Consolidate all mochitest mach commands into single |mach mochitest|, r=chmanchester
--HG--
extra : rebase_source : 0a0d8a454df10ae9df9678c98e11b5eaf8249f51
2015-05-05 16:41:59 -04:00
Jonathan Griffin
479984afe5 Bug 1149618 - Remove SpecialPowers from Marionette, r=dburns 2015-05-18 16:36:15 -07:00
Jonathan Griffin
8824722da9 Backout cc15c275b1e3 (Bug 1149618) on a CLOSED TREE for suspected debug emulator bustage, a=bustage 2015-05-19 19:35:38 -07:00
Jonathan Griffin
ac2f6d8d6e Bug 1149618 - Remove SpecialPowers from Marionette, r=dburns 2015-05-18 16:36:15 -07:00
Andrew Halberstadt
457f496287 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 60275814c319afd866de426cb8b2937a3adbcb34
extra : source : f4f4e2be37652cb1dc23f066725a0f8868bb411b
2015-04-30 13:47:01 -04:00
Phil Ringnalda
c805f510d5 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt
a0e4007522 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 68cc709ec5a9ab9bec563e555d6fc25cf149dd38
2015-04-30 13:47:01 -04:00
Geoff Brown
beb4222eab Bug 1152994 - Kill orphan ssltunnel and xpcshell in B2G emulator tests; r=kmoir 2015-04-10 14:41:36 -06:00
Andrew Halberstadt
5ffa684d03 Bug 1147129 - upgrade mochitest from optparse to argparse and move android cli to mochitest_options.py, r=chmanchester
--HG--
extra : rebase_source : ce81dffa5feb0be28e30c250eda4ad66cc0cb199
2015-03-24 17:42:24 -04:00
JW Wang
a5b5e83548 Bug 1043403 - Support clear-key in Mochitest on B2G. r=ted. 2015-03-31 10:32:15 +08:00
Andrew Halberstadt
7086f00c8a Bug 1127376 - PEP8-ify all mochitest .py files (auto-generated), r=ted
This change was generated using the `autopep8` module [1]. To replicate:

    $ pip install --upgrade autopep8
    $ cd gecko
    $ autopep8 -i -a -a -r testing/mochitest --exclude 'testing/mochitest/pywebsocket/*'

[1] https://github.com/hhatto/autopep8

--HG--
extra : rebase_source : fb127187cd488b977981338373d66cc8c735214f
2015-02-13 14:42:02 -05:00
Geoff Brown
c9776740d9 Bug 797164 - Support chrome tests on b2g emulator; r=ahal 2014-12-23 14:17:42 -07:00
Geoff Brown
75611a763f Bug 797164 - Push chrome files to b2g when needed; r=ahal 2014-12-23 14:17:41 -07:00
Chris Manchester
d2ce264928 Bug 1075240 - Log disabled tests as skips in mochitests. r=ahal 2014-10-02 11:08:41 -04:00
Andrew McCreight
f3d650b7c0 Bug 1076969 - processLeakLog should come up with reasonable defaults itself. r=jmaher
Instead of grabbing attributes off options at every call site, pass
in the options object to processLeakLog, and attempt to get the attributes
there. If not present, use a restrictive default value.

This will prevent silent harness failures if one of the many ways to invoke
processLeakLog fails to set up these options, and makes it so they
don't have to set it up if they don't care.
2014-10-06 14:23:17 -07:00
Andrew McCreight
b71a75b37a Bug 1068276, part 1 - Allow configuring which type of processes we complain about when there's no leak log. r=jmaher
Then don't warn for missing logs from tab and geckomediaplugin processes, or default processes on B2G.
2014-09-30 14:17:27 -07:00
Andrew McCreight
3a5312793b Bug 1067664, part 1 - Allow different leak thresholds for different types of processes. r=jmaher 2014-09-30 09:54:25 -07:00
Ryan VanderMeulen
8bcef57acc Backed out 4 changesets (bug 1068276, bug 1067664) for Android leaktest complaints.
Backed out changeset 846faaa68219 (bug 1068276)
Backed out changeset 35e71ffcf8e1 (bug 1068276)
Backed out changeset 605f59a806fd (bug 1067664)
Backed out changeset 2d5b7ea96b70 (bug 1067664)

--HG--
extra : rebase_source : 7a90c78ba35f31acce7609d5d8375a593cb9825d
2014-09-26 16:02:12 -04:00
Andrew McCreight
7630b62a5b Bug 1068276, part 1 - Allow configuring which type of processes we complain about when there's no leak log. r=jmaher
Then don't warn for missing logs from tab and geckomediaplugin processes, or default processes on B2G.
2014-09-26 10:34:09 -07:00
Andrew McCreight
ddb5b793b3 Bug 1067664, part 1 - Allow different leak thresholds for different types of processes. r=jmaher 2014-09-26 10:34:08 -07:00
Ahmed Kachkach
1b49fb456b Bug 1039833 - Add structured logging command line arguments for mochitest/mach. r=chmanchester, r=ahal 2014-08-13 12:03:00 -04:00
Ed Morley
6bd8fc7c1e Bug 1039019 - Set MOZ_DISABLE_NONLOCAL_CONNECTIONS for opt B2G mochitests; r=froydnj 2014-08-13 16:51:50 +01:00
Kyle Huey
66021be422 Bug 1038943: Turn on leak checking on B2G with an initial threshold of 400000 bytes. r=ahal,dbaron 2014-08-05 14:11:53 -07:00
Ahmed Kachkach
af98d35b3f Bug 1034267 - Structured Logging for robocop. r=gbrown 2014-07-29 14:11:00 +02:00
Ted Mielczarek
6344615ad6 bug 1041347 - Package and provide path to fake GMP plugin for Mochitests. r=jmaher 2014-07-25 07:01:13 -04:00
Ahmed Kachkach
4b03d2c025 Bug 886570 - Initial integration of structured logs in mochitest; r=ahal,Ms2ger 2014-07-17 09:02:00 +02:00
Carsten "Tomcat" Book
ce57787693 Backed out changeset cf85693280c7 (bug 886570) frequent mochitest-3 errors on windows 2014-07-11 14:15:29 +02:00
Ahmed Kachkach
50db9012f6 Bug 886570 - Initial integration of structured logs in mochitest. r=ahal,Ms2ger 2014-07-10 13:33:00 +02:00
Vaibhav Agrawal
be65f1bbce Bug 1014125 - Bisection Base Patch. r=ahal 2014-07-04 13:55:00 +02:00
Vaibhav Agrawal
b057114758 Bug 925699 - pymake/mach mochitest-plain don't delete the temporary profile. r=jmaher 2014-06-23 11:24:00 +02:00
Andrew Halberstadt
e60605718c Bug 997244 - Move emulator.py out of marionette and into mozrunner, r=wlach,mdas,jgriffin 2014-06-19 14:17:26 -04:00
Armen Zambrano Gasparnian
93d68b29e0 Bug 989583 - Install all tests (even disabled) from manifests. r=jmaher 2014-06-16 14:51:22 -04:00
Martin Thomson
2739930979 Bug 907770 - Part 1: Making ssltunnel run for android and b2g mochitests. r=jmaher 2014-03-14 11:25:41 -07:00
Jonathan Griffin
05107f9406 Bug 979650 - Always build with Marionette for Firefox, b2g desktop, r=ted 2014-03-11 13:22:34 -07:00