Commit graph

146 commits

Author SHA1 Message Date
Andrew McCreight
c177086383 Bug 1299871 - Increase leak threshold on OS X to paper over increased layers leak. r=erahm
MozReview-Commit-ID: 2QQa5uxmO5J

--HG--
extra : rebase_source : 9de6443d39bc472ca7c1c0087ce92eb494d663a1
2016-09-01 11:04:09 -07:00
Andrew Halberstadt
795728d89d Bug 1293295 - Replace all mochitest 'flavor' options with a single --flavor argument, r=jmaher
This accomplishes three things:

1) Easier to use CLI when running without the benefit of testing/mochitest/mach_commands.py
2) Guarantees these arguments are mutually exclusive
3) Simplifies a bunch of logic in the test harness

The primary motivation for this change is to slightly improve the UX when running mochitest
from a taskcluster interactive loaner. However, this is more of a bandaid solution that was
easy to implement before the proper fix in bug 1293259 can be landed.

MozReview-Commit-ID: IeHBGrJ0Sji

--HG--
extra : rebase_source : ba1b7e437881e363fe0051dccd3d732221311c59
2016-08-08 11:48:49 -04:00
Andrew Halberstadt
e920337e70 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : 3a94debda3dbed839074094707cadf32e7f7337c
2016-07-20 11:13:30 -04:00
Carsten "Tomcat" Book
e7b290ff7c Backed out changeset 6dcb52d270c7 (bug 1288827) for breaking mochitests 2016-07-28 17:04:42 +02:00
Andrew Halberstadt
142c93927d Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : d5aa12dbdb8acd116a27f768eb8ce7f10293504b
2016-07-20 11:13:30 -04:00
Geoff Brown
dd65ba7f12 Bug 1274395 - Delete pending crash reports before running tests; r=jmaher 2016-05-25 14:48:42 -06:00
Andrew Halberstadt
0c9c35e1fc Bug 1274002 - Disable e10s when running mochitest-chrome locally with mach, r=jmaher
MozReview-Commit-ID: 1r2aZtnB3lo

--HG--
extra : rebase_source : 7cc01168a37b2c79d1de1250932c63033c744a3b
2016-05-18 15:17:13 -04:00
Andrew McCreight
9f333887e3 Bug 1273246 - Fix use of bindir in mochitest mach --dmd code. r=ahal 2016-05-17 07:55:49 -07:00
Andrew Halberstadt
1092076e36 Bug 1243083 - Enable e10s by default when running mochitests, r=jmaher
MozReview-Commit-ID: NlTGwdQ2nw

--HG--
extra : rebase_source : 65ec39f39b1e231fe8b9e3228f4f604736b2cb84
2016-04-01 10:59:12 -04:00
Myk Melez
db9a40ca42 Bug 1238079 - remove the desktop web runtime; r=fabrice,mossop,gps,jryans,jmaher,marco 2016-03-07 13:33:12 -08:00
Stanley Mwangi
ecaaff970b Bug 1243083 - Added --disable-e10s to mochitest_options.py and reftestcommandline.py. r=ahal
MozReview-Commit-ID: I3UIS8eEZ8D

--HG--
extra : rebase_source : cad52821f891915b2d174f60c250fb80ec307525
extra : amend_source : fe1a47030662a58c409e3cf2b42dc0ace452178d
2016-03-02 16:33:13 -05:00
Andrew Halberstadt
a9e74f4c7e Bug 1248056 - Increase marionette connection timeouts in mochitest when running with valgrind, r=chmanchester
MozReview-Commit-ID: 71d5XIgqcCJ

--HG--
extra : rebase_source : 79cfc293e2a1306d56f8633b7d3b1c5bafcb059a
2016-02-16 10:04:52 -05:00
Andrew Halberstadt
5d58b96304 Bug 1247639 - Fix uncaught exception when running |mach mochitest| on Android, r=gbrown
MozReview-Commit-ID: 1s8x4zIhZSS

--HG--
extra : rebase_source : 825af84cba25068adf6f04dc55030659da7e174d
extra : amend_source : 3876dcf3749a7bc6d6bc5275954de6fc84d26d6a
2016-02-11 16:09:45 -05:00
Andrew Halberstadt
dee8b08ce5 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7

--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : c50792dfe82e688b52aa07150ddab03e5d0d3f36
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
extra : source : edcbd7c0aa36be0846f2e8e989fb57c9e4449cc4
2016-01-25 09:55:57 -05:00
Andrew McCreight
042eee4a3e Bug 1091917 - Stop ignoring failures to leak log on Windows. r=chmanchester 2016-02-10 10:29:20 -08:00
Julian Seward
b2b2af9d30 Bug 1246719 - mach mochitest --valgrind: use comma as separator for --valgrind-args. r=james@hoppipolla.co.uk.
--HG--
extra : rebase_source : 05d9cc3c3eda46f602ac6c46f0b0895d31101be1
2016-02-09 14:38:55 +01:00
Wes Kocher
aaf89c475e Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)

--HG--
rename : testing/mochitest/start_b2g.js => testing/mochitest/b2g_start_script.js
extra : commitid : DLurSs6PJ1G
2016-02-03 17:38:12 -08:00
Andrew Halberstadt
ae410fb5a9 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : 0a041c36b59c79c1bea755b22fe07017cb3d0aa5
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
2016-01-25 09:55:57 -05:00
Julian Seward
25a02db5ac Bug 1229348 - Add a "valgrind-plain" suite to all_mochitest_suites. r=cmanchester. 2016-02-03 18:43:05 +01:00
Chris Manchester
45068b730c Bug 1229598 - Add a mode to browser-chrome tests to summarize per-test code coverage. r=ahal
--HG--
extra : commitid : 25ib6OSlxuz
2015-12-23 14:04:49 -08:00
Andrew Halberstadt
629335ccca Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : jAe5IJxAQp
extra : rebase_source : 5f163aea70fb99a95667fdafeb7b3361bed1f82d
2015-11-18 13:35:38 -05:00
Wes Kocher
480b4c994e Backed out changeset 6ab228593820 (bug 1225903) for android robocop bustage CLOSED TREE
--HG--
extra : commitid : Jt9KCML2G2Y
2015-11-19 11:54:17 -08:00
Andrew Halberstadt
60681c7eb8 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : 6wYdpJe0jU0
extra : rebase_source : 69d997a523551210b156e09de339fd6bc8cf2504
extra : amend_source : aed1da36f41210339ab91d53cb34ac2e7b0d770c
2015-11-18 13:35:38 -05:00
Andrew Halberstadt
1252d85394 Bug 1219442 - Re-write specialpowers as a restartless addon, r=jmaher
In order to meet the addon signing requirement for tests, specialpowers
needs to be installed at gecko runtime. This means it must be restartless.
This patch packages specialpowers as a restartless addon, but it does not
yet install it at runtime.

--HG--
rename : testing/specialpowers/components/SpecialPowersObserver.js => testing/specialpowers/content/SpecialPowersObserver.jsm
extra : commitid : Bbg8gFten8S
extra : rebase_source : 99d0b841a1f8f9eb6b6ca846363a158836482e57
2015-11-05 10:00:59 -05:00
Chris Manchester
f7d1d2246a Bug 1224305 - Add an option to the mochitest harness to provide a copy of the extra chrome manifest it writes. r=ahal
--HG--
extra : commitid : 93RvsmK2rA0
2015-11-13 16:14:40 -08:00
Nick Alexander
ade40baf2d Bug 938994 - Move build/mobile/robocop into mobile/android/tests/browser/robocop. r=gbrown
This builds the Robocop tests with |mach build mobile/android|, making
it easier for developers to build Fennec and the tests at the same
time.

--HG--
rename : build/mobile/robocop/AndroidManifest.xml.in => mobile/android/tests/browser/robocop/AndroidManifest.xml.in
rename : build/mobile/robocop/Makefile.in => mobile/android/tests/browser/robocop/Makefile.in
rename : build/mobile/robocop/README => mobile/android/tests/browser/robocop/README
rename : build/mobile/robocop/moz.build => mobile/android/tests/browser/robocop/moz.build
rename : build/mobile/robocop/res/values/strings.xml => mobile/android/tests/browser/robocop/res/values/strings.xml
rename : build/mobile/robocop/robotium-solo-4.3.1.jar => mobile/android/tests/browser/robocop/robotium-solo-4.3.1.jar
extra : commitid : BuNBjgXdm1d
extra : rebase_source : c36b8bf0183d8f5821b7f7839668ca963065d894
extra : histedit_source : a86fef3b834420ea496a9c2644ca72786a2d7da9
2015-11-09 12:55:38 -08:00
Edgar Chen
e0ac6671b5 Bug 1211407 - Make |mach mochitest| use the adb under out/host/*/bin if no --adbpath specified. r=ahal
--HG--
extra : transplant_source : %E8%EF%D5%B0%BF%EA6%AA%A1Y%07%8C%DC%82%8B%D6%E0%FE%0F%21
2015-10-05 19:11:52 +08:00
Julian Seward
0ce48c0f5e Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-28 12:01:42 +02:00
Wes Kocher
d4897fa1ef Backed out changeset feceb41f1c3c (bug 1185244) for breaking running tests locally CLOSED TREE a=backout 2015-09-22 17:08:37 -07:00
Julian Seward
b3bc139b1e Bug 1185244 - Improve mach support for running mochitests on Valgrind. r=jgraham, njn. 2015-09-22 12:00:57 +02:00
Gijs Kruitbosch
65cebe32be Bug 1196320 - ensure --appname is included in mochitest's ./mach command help, r=ahal
--HG--
extra : commitid : 7dLnFjQ6aCp
extra : rebase_source : ef3d2b65426b04acf1542206487d6611fd2bd5b0
extra : amend_source : 7b8d363f0cffb762d64e9254205ae25c092ed521
2015-09-14 19:28:55 +01:00
Nathan Froyd
2e6b84568b Bug 1198944 - remove vmware recording support from mochitest; r=khuey
VMWare's record/replay bits are unsupported, and they only work with
programs compiled with VS2010, which we no longer support.
2015-08-27 16:00:14 -04:00
Karl Tomlinson
17f4cfb8c4 revert 521e2b4d97b8 given workaround from bug 1193922
--HG--
extra : rebase_source : bba70f332a76b53ded3db6e956cad4faf3423663
2015-09-01 18:38:07 +12:00
Vaibhav Agrawal
457d89b5f6 Bug 1197543 - Add --extra-mozinfo-json option in mochitest to filter tests for a given mozinfo file. r=ahal
CLOSED TREE

--HG--
extra : transplant_source : %3Di%5D%DF%05%94e%DB%1D0o%11%AB%8C%29%B2N%E4%E4/
2015-08-22 18:57:19 -07:00
Vaibhav Agrawal
7ec736a594 Bug 1197541 - Add --dump-tests option to mochitest and xpcshell for all tests that will be run. r=ahal 2015-08-21 17:16:11 -07:00
Andrew Halberstadt
e318244a76 Bug 1185761 - [mochitest] Allow boolean values to --keep-open for overriding the default, r=ted
Most of the time the default is to close the browser after tests run. And that can be overridden with
--keep-open. But in some corner cases, the default is to leave the browser open after tests have run.
In these cases, it is not currently possible to override.

This patch allows the syntax --keep-open or --keep-open=false, the latter overrides the edge case
default.

--HG--
extra : commitid : 52IHmZFn1uj
extra : rebase_source : 50ce300ccb08f87e5c9337b945d538c0a17ac04d
2015-08-06 17:40:54 -04:00
Andrew McCreight
547d66402f Bug 1193917 - Paper over web audio leaks revealed by event loop changes. r=erahm CLOSED TREE 2015-08-12 12:47:43 -07:00
Andrew Halberstadt
fc0a211e9e Bug 1192235 - Update misleading mochitest usage string, r=chmanchester, DONTBUILD
--HG--
extra : commitid : vPzPVmJn6u
extra : rebase_source : 1968f4b433ff67d84789a721ab4f0eb96e7cdf57
extra : amend_source : b9f917da7d2c202827cf69fb99cc3d439f0f3a0c
2015-08-07 10:19:32 -04:00
Chris Manchester
2363f7c137 Bug 1188730 - Select tests in the plugins subsuite by manifest rather than path to fix unintended interaction with mach try. r=ahal
This prevents mach try's filtering of the master mochitest manifest from
interacting with the plugins subsuite by selecting by manifest rather than
test path. The way we run mochitest other could use a lot of cleanup --
this is a quick fix to prevent misleading output on treeherder when using
mach try.

--HG--
extra : commitid : AqQfTnQKIYv
2015-07-29 00:10:06 -07:00
Andrew Halberstadt
2be5ff0c10 Bug 1014760 - Move mozlog.structured to mozlog; Move mozlog to mozlog.unstructured, r=jgraham
Mozlog currently has two implementations. The top level package is based on the logging module and is
deprecated. The newer structured logging implementation lives in mozlog.structured. This patch swaps the
two, so the top level mozlog module contains the recommended implementation, while mozlog.unstructured
contains the old one.

--HG--
rename : testing/mozbase/docs/mozlog_structured.rst => testing/mozbase/docs/mozlog.rst
rename : testing/mozbase/mozlog/mozlog/structured/commandline.py => testing/mozbase/mozlog/mozlog/commandline.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/__init__.py => testing/mozbase/mozlog/mozlog/formatters/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/base.py => testing/mozbase/mozlog/mozlog/formatters/base.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/errorsummary.py => testing/mozbase/mozlog/mozlog/formatters/errorsummary.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/__init__.py => testing/mozbase/mozlog/mozlog/formatters/html/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/html.py => testing/mozbase/mozlog/mozlog/formatters/html/html.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/main.js => testing/mozbase/mozlog/mozlog/formatters/html/main.js
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/style.css => testing/mozbase/mozlog/mozlog/formatters/html/style.css
rename : testing/mozbase/mozlog/mozlog/structured/formatters/html/xmlgen.py => testing/mozbase/mozlog/mozlog/formatters/html/xmlgen.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/machformatter.py => testing/mozbase/mozlog/mozlog/formatters/machformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/tbplformatter.py => testing/mozbase/mozlog/mozlog/formatters/tbplformatter.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/unittest.py => testing/mozbase/mozlog/mozlog/formatters/unittest.py
rename : testing/mozbase/mozlog/mozlog/structured/formatters/xunit.py => testing/mozbase/mozlog/mozlog/formatters/xunit.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/__init__.py => testing/mozbase/mozlog/mozlog/handlers/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/base.py => testing/mozbase/mozlog/mozlog/handlers/base.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/bufferhandler.py => testing/mozbase/mozlog/mozlog/handlers/bufferhandler.py
rename : testing/mozbase/mozlog/mozlog/structured/handlers/statushandler.py => testing/mozbase/mozlog/mozlog/handlers/statushandler.py
rename : testing/mozbase/mozlog/mozlog/structured/logtypes.py => testing/mozbase/mozlog/mozlog/logtypes.py
rename : testing/mozbase/mozlog/mozlog/structured/reader.py => testing/mozbase/mozlog/mozlog/reader.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/__init__.py => testing/mozbase/mozlog/mozlog/scripts/__init__.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/format.py => testing/mozbase/mozlog/mozlog/scripts/format.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/logmerge.py => testing/mozbase/mozlog/mozlog/scripts/logmerge.py
rename : testing/mozbase/mozlog/mozlog/structured/scripts/unstable.py => testing/mozbase/mozlog/mozlog/scripts/unstable.py
rename : testing/mozbase/mozlog/mozlog/structured/stdadapter.py => testing/mozbase/mozlog/mozlog/stdadapter.py
rename : testing/mozbase/mozlog/mozlog/structured/structuredlog.py => testing/mozbase/mozlog/mozlog/structuredlog.py
rename : testing/mozbase/mozlog/mozlog/logger.py => testing/mozbase/mozlog/mozlog/unstructured/logger.py
rename : testing/mozbase/mozlog/mozlog/loggingmixin.py => testing/mozbase/mozlog/mozlog/unstructured/loggingmixin.py
rename : testing/mozbase/mozlog/mozlog/loglistener.py => testing/mozbase/mozlog/mozlog/unstructured/loglistener.py
extra : commitid : 3JWk75JY4N0
extra : rebase_source : 229bad7a7bf8ead013ce62d128c0896a75cad393
2015-07-16 10:38:40 -04:00
Geoff Brown
65e4c8cee0 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Andrew Halberstadt
4cea585419 Bug 1171602 - Run mochitest using mach from a tests.zip, r=chmanchester
--HG--
extra : commitid : 7UHH28yy81E
extra : rebase_source : e6800f9d6ff6336991f1d4b8f2d975083b9f7751
2015-05-26 10:12:51 -04:00
Andrew Halberstadt
42888ae5f5 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester
--HG--
extra : commitid : KbQllMAJdfl
extra : rebase_source : 2069e41c760e4993b1d6d0ddd70799e426a19089
2015-06-05 13:28:29 -04:00
Andrew McCreight
95802bd4a7 Bug 1157308 - part 2 - Reduce the content process leak limit on OS X. r=erahm
The intermittent media leak seems to have been fixed.
2015-05-27 09:33:00 +02:00
Andrew McCreight
aa913043f6 Bug 1157308 - part 1 - Reduce the leak threshold for content processes more. r=erahm 2015-05-27 07:53:00 +02:00
Andrew Halberstadt
c4a62dc463 Bug 1162479 - Fix mochitest make target regression with duplicate extraProfilePath, r=chmanchester
--HG--
extra : rebase_source : 863a0354460e3f08aaa2584c60583fffbf2e7dc2
2015-05-07 14:38:43 -04:00
Andrew Halberstadt
7181fbfbb8 Bug 1162226 - Fix mach mochitest regression on b2g desktop builds, r=chmanchester
--HG--
extra : rebase_source : 8badf0e647c744cd5ad802385c6a13e3bbbe3e62
2015-05-06 16:44:01 -04:00
Andrew Halberstadt
457f496287 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 60275814c319afd866de426cb8b2937a3adbcb34
extra : source : f4f4e2be37652cb1dc23f066725a0f8868bb411b
2015-04-30 13:47:01 -04:00
Phil Ringnalda
c805f510d5 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt
a0e4007522 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 68cc709ec5a9ab9bec563e555d6fc25cf149dd38
2015-04-30 13:47:01 -04:00