Commit graph

187 commits

Author SHA1 Message Date
Andrew Halberstadt
795728d89d Bug 1293295 - Replace all mochitest 'flavor' options with a single --flavor argument, r=jmaher
This accomplishes three things:

1) Easier to use CLI when running without the benefit of testing/mochitest/mach_commands.py
2) Guarantees these arguments are mutually exclusive
3) Simplifies a bunch of logic in the test harness

The primary motivation for this change is to slightly improve the UX when running mochitest
from a taskcluster interactive loaner. However, this is more of a bandaid solution that was
easy to implement before the proper fix in bug 1293259 can be landed.

MozReview-Commit-ID: IeHBGrJ0Sji

--HG--
extra : rebase_source : ba1b7e437881e363fe0051dccd3d732221311c59
2016-08-08 11:48:49 -04:00
Andrew Halberstadt
e920337e70 Bug 1288827 - Allow running mochitest from test-package without specifying --appname, r=armenzg
Because it is now possible for options.app to get set after 'parse_args' time, we need to make sure
the argument validation happens later. To accomplish this we pass in the parser instance to
'run_test_harness' and do parser.validate there. This unfortunately requires some minor uses of
global to accomplish easily due to how mach handles parsers.

MozReview-Commit-ID: s3Js1aZlSE

--HG--
extra : rebase_source : 3a94debda3dbed839074094707cadf32e7f7337c
2016-07-20 11:13:30 -04:00
Geoff Brown
058d5be563 Bug 1285663 - Optimize profile pushes and do not chmod files on /sdcard; r=bc 2016-07-14 10:36:31 -06:00
Honza Bambas
3d5960cd1f Bug 1248565 - Make test infra use MOZ_LOG_FILE and MOZ_LOG_MODULES. r=jmaher 2016-03-11 08:27:00 -05:00
Geoff Brown
2fc80985f9 Bug 1252868 - Do not install superfluous addons for Android tests; r=jmaher 2016-03-02 09:23:42 -07:00
Andrew Halberstadt
5d58b96304 Bug 1247639 - Fix uncaught exception when running |mach mochitest| on Android, r=gbrown
MozReview-Commit-ID: 1s8x4zIhZSS

--HG--
extra : rebase_source : 825af84cba25068adf6f04dc55030659da7e174d
extra : amend_source : 3876dcf3749a7bc6d6bc5275954de6fc84d26d6a
2016-02-11 16:09:45 -05:00
Andrew Halberstadt
dee8b08ce5 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
MozReview-Commit-ID: 9I56x6Vnbf7

--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : c50792dfe82e688b52aa07150ddab03e5d0d3f36
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
extra : source : edcbd7c0aa36be0846f2e8e989fb57c9e4449cc4
2016-01-25 09:55:57 -05:00
Wes Kocher
aaf89c475e Backed out 3 changesets (bug 1231784) for breaking 10.10 opt jetpack tests
Backed out changeset 653df21ca861 (bug 1231784)
Backed out changeset 0aac20bc3619 (bug 1231784)
Backed out changeset edcbd7c0aa36 (bug 1231784)

--HG--
rename : testing/mochitest/start_b2g.js => testing/mochitest/b2g_start_script.js
extra : commitid : DLurSs6PJ1G
2016-02-03 17:38:12 -08:00
Andrew Halberstadt
ae410fb5a9 Bug 1231784 - Install specialpowers and mochikit extensions at runtime via AddonManager.loadTemporaryAddon(), r=jgriffin
--HG--
rename : testing/mochitest/b2g_start_script.js => testing/mochitest/start_b2g.js
extra : commitid : CrUflHO8tRa
extra : rebase_source : 0a041c36b59c79c1bea755b22fe07017cb3d0aa5
extra : amend_source : 1dcd8ae7d74b3397e965672b6dc05d431ab4a916
2016-01-25 09:55:57 -05:00
Bob Clary
5a470be233 Bug 1237465 - Work around Android 5.1+ permission restrictions by changing pushed directory permissions to rwx, r=gbrown. 2016-01-09 15:40:17 -08:00
Geoff Brown
1798b0ab45 Bug 1228060 - Allow resource://testing-common references in Android mochitests; r=jmaher 2015-11-27 11:57:15 -07:00
Andrew Halberstadt
629335ccca Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : jAe5IJxAQp
extra : rebase_source : 5f163aea70fb99a95667fdafeb7b3361bed1f82d
2015-11-18 13:35:38 -05:00
Wes Kocher
480b4c994e Backed out changeset 6ab228593820 (bug 1225903) for android robocop bustage CLOSED TREE
--HG--
extra : commitid : Jt9KCML2G2Y
2015-11-19 11:54:17 -08:00
Andrew Halberstadt
60681c7eb8 Bug 1225903 - Drop support for b2g desktop in mochitest, r=jgriffin
Mochitests on b2g desktop are no longer being run on any trunk branches, including
b2g-inbound. Dropping support for it significantly reduces complexity
in the mochitest harness.

--HG--
extra : commitid : 6wYdpJe0jU0
extra : rebase_source : 69d997a523551210b156e09de339fd6bc8cf2504
extra : amend_source : aed1da36f41210339ab91d53cb34ac2e7b0d770c
2015-11-18 13:35:38 -05:00
Andrew Halberstadt
5330ac1f89 Bug 1042998 - Use StructuredLog.jsm for mochitest logging, r=chmanchester
--HG--
extra : commitid : 5hwiCNY4xAI
extra : rebase_source : 4f72ebe622669bb4f5df2c0be40d156e91c229f3
2015-09-04 14:37:32 -04:00
Geoff Brown
b0e201cce7 Bug 1196814 - Fail Android mochitest, robocop, reftests when Fennec is not installed; r=jmaher 2015-09-02 14:20:01 -06:00
Kaustabh Datta Choudhury
34307268d1 Bug 1162003 - Enable run-by-dir mode on Fx desktop opt builds. r=jmaher 2015-08-11 08:25:00 -04:00
Geoff Brown
8ce85e0c90 Bug 1190975 - Do not dump device info and logcat when running mochitest via mach; r=jmaher 2015-08-06 07:27:47 -06:00
Geoff Brown
65e4c8cee0 Bug 1179981 - A new test harness for robocop; r=jmaher 2015-07-09 12:30:01 -06:00
Julien Pagès
c1802eb571 Bug 1177780 - remove useless stuff in automation.py. r=jgriffin
--HG--
extra : commitid : 3mgWZQdnDa4
extra : rebase_source : f8b91fff719dbeda7923a7e8c2c3e01a856d9b14
2015-06-26 22:45:18 +02:00
Andrew Halberstadt
42888ae5f5 Bug 1171971 - Move test_paths argument out of mach and into mochitest; remove --test-path, r=chmanchester
--HG--
extra : commitid : KbQllMAJdfl
extra : rebase_source : 2069e41c760e4993b1d6d0ddd70799e426a19089
2015-06-05 13:28:29 -04:00
Geoff Brown
88ea47befb Bug 1171303 - Set pref extensions.autoupdate.enabled to false to avoid testOfflinePage failures; r=mfinkle 2015-06-05 10:10:40 -06:00
Nick Alexander
97786c5695 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!

--HG--
extra : rebase_source : a5ab08222110a20291aebe70ef1fda0d340dbe7d
extra : source : e91ac9a35f86928fcd519911476ee7d68d06f921
2015-05-29 17:18:07 -07:00
Nick Alexander
380f58055f Bug 1170332 - Fix |mach robocop SINGLE_TEST|. r=ahal,gbrown
This patch declares robocop.ini an instrumentation manifest.  It's not
currently possible to declare tests that don't correspond to files, so
we include the .java extension.  (This could be revisited.)

In |mach robocop|, we use the generic test resolving infrastructure to
select the 'instrumentation'/'robocop' flavor/subsuite tests.  In
|runtestsremote.py|, we fall back to robocop.ini, as we always have.

--HG--
extra : rebase_source : b84246ab327c7ec576d82cc4b516e729978600c7
extra : histedit_source : 9b23a6f66e6422e5f334f31cea2a21036be45543
2015-06-01 14:45:48 -07:00
Carsten "Tomcat" Book
a723ed3ad7 Backed out changeset e91ac9a35f86 (bug 1169476) for android rc2 crashes 2015-06-01 09:38:42 +02:00
Nick Alexander
f242708503 Bug 1169476 -- Implement |mach robocop --serve|. r=gbrown
This adds a flag to |mach robocop| that does everything to run a
Robocop test except launch the actual test.  Instead of launching the
test, it starts the mochi.test server and launches Fennec with a test
profile; then it sits and waits forever.

This allows regular Java IDEs (IntelliJ, but previously Eclipse) to
run Robocop tests like regular instrumentation tests, "injecting" them
into the prepared testing environment.  It's quite nice!

--HG--
extra : rebase_source : 15e9e8d5c311312e2eb317936e5d154237c1f9a3
extra : histedit_source : 050ac958ae8580f45e5011a0d353bf13e65d5ff3
2015-05-25 14:27:21 -07:00
Geoff Brown
550cacb4e3 Bug 1162285 - Remove unused environment vars on Android; r=jmaher 2015-05-07 18:49:15 -06:00
Andrew Halberstadt
457f496287 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 60275814c319afd866de426cb8b2937a3adbcb34
extra : source : f4f4e2be37652cb1dc23f066725a0f8868bb411b
2015-04-30 13:47:01 -04:00
Phil Ringnalda
c805f510d5 Back out f4f4e2be3765 (bug 1155338) for Android 4.0/debug mochitest bustage
CLOSED TREE
2015-05-04 18:28:16 -07:00
Andrew Halberstadt
a0e4007522 Bug 1155338 - Move mach command arguments into mochitest harness, r=chmanchester,gbrown
--HG--
extra : rebase_source : 68cc709ec5a9ab9bec563e555d6fc25cf149dd38
2015-04-30 13:47:01 -04:00
Nick Alexander
c1f14290e2 Bug 1160324 - Handle missing robocopApk files in runtestsremote.py. r=gbrown
--HG--
extra : source : 7d8043298e133ab903b55ba9c8530b2ea28a3180
2015-04-30 14:28:14 -07:00
Andrew Halberstadt
5ffa684d03 Bug 1147129 - upgrade mochitest from optparse to argparse and move android cli to mochitest_options.py, r=chmanchester
--HG--
extra : rebase_source : ce81dffa5feb0be28e30c250eda4ad66cc0cb199
2015-03-24 17:42:24 -04:00
JW Wang
a5b5e83548 Bug 1043403 - Support clear-key in Mochitest on B2G. r=ted. 2015-03-31 10:32:15 +08:00
Andrew Halberstadt
4a6ff3aa47 Bug 1131098 - Make mochitest use manifestparser's chunking algorithms and remove JS based ones, r=jmaher
--HG--
extra : rebase_source : 1374462488e20cbd6e2048d8d5c63aff49a87911
2015-03-10 09:55:30 -04:00
Geoff Brown
855e467da1 Bug 1134245 - Improve formatting of devicemanager getInfo() data; r=bc 2015-02-27 13:15:00 -07:00
Andrew Halberstadt
7086f00c8a Bug 1127376 - PEP8-ify all mochitest .py files (auto-generated), r=ted
This change was generated using the `autopep8` module [1]. To replicate:

    $ pip install --upgrade autopep8
    $ cd gecko
    $ autopep8 -i -a -a -r testing/mochitest --exclude 'testing/mochitest/pywebsocket/*'

[1] https://github.com/hhatto/autopep8

--HG--
extra : rebase_source : fb127187cd488b977981338373d66cc8c735214f
2015-02-13 14:42:02 -05:00
Masatoshi Kimura
d0e813632e Bug 1092835 - Workaround for old ssltunnel from hostutils. r=jmaher 2014-12-13 20:09:00 +09:00
Geoff Brown
74313d0f7e Bug 1026290 - Push chrome test files to device; r=jmaher 2014-11-26 16:51:14 -07:00
Geoff Brown
3ae9830ca4 backout 272443dba538 (bug 1026290) for maybe breaking robocop 2014-11-25 23:18:12 -07:00
Geoff Brown
859be1ac2b Bug 1026290 - Push chrome test files to device; r=jmaher 2014-11-25 17:31:45 -07:00
Bob Clary
12822efe60 Bug 1079930 - Update mochitest runtestsremote.py to support connecting to device by serial number, r=ahal. 2014-10-15 07:09:16 -07:00
Ahmed Kachkach
5aa209661f Bug 1068466 - fail the test job on a robocop process crash. r=jmaher 2014-09-17 13:42:00 -04:00
Nick Alexander
cb5f19fa1e Bug 874729 - Part 3: Make main take args and return an integer. r=jmaher 2014-09-08 16:23:11 -07:00
Nick Alexander
121ceea084 Bug 874729 - Part 2: Don't print extra logcats after running Robocop. r=jmaher
Before a Robocop test starts, |recordLogcat| clears the |adb logcat| on
device.  If a Robocop test fails, we print the logcat immediately after
the test.  The moved call avoids printing the logcat after all tests
have completed, which avoids printing a spurious second copy.  We still
print the logcat after running a Mochitest.
2014-09-08 16:23:10 -07:00
Nick Alexander
e7d0887529 Bug 929654 - Part 0: Stop pushing fennec_ids.txt; delete stale robotium.config files. r=gbrown
This patch stops pushing the obsolete fennec_ids.txt file to the testing
device and deletes the stale robotium.config file after the profile it
references is deleted.
2014-09-08 16:23:09 -07:00
Chris Manchester
7f6a9e49b0 Bug 1045525 - Convert automationutils python logging to log through mozlog.structured.;r=ahal 2014-08-29 10:37:17 -04:00
Geoff Brown
ae9e1f533d Bug 1059293 - Avoid MOZ_UPLOAD_DIR failure when running tests locally; r=dminor 2014-08-27 16:23:29 -06:00
Ahmed Kachkach
59d9c8247c Bug 1050855 - Remove --log-file and --file-level options. r=ahal 2014-08-15 15:42:00 -04:00
Ahmed Kachkach
1b49fb456b Bug 1039833 - Add structured logging command line arguments for mochitest/mach. r=chmanchester, r=ahal 2014-08-13 12:03:00 -04:00
Ed Morley
1e2086d3a6 Merge latest green fx-team changeset and mozilla-central; a=merge 2014-08-14 08:50:16 +01:00