Bug 1889241 - re-record some sites for OSX failures. r=perftest-reviewers,sparky

This bug re-records a subset of some sites that are potentially causing
an intermittent issue (Bug 1774954)
Here, only `amazon`, `imgur`, and `instagram` are re-recorded. Other
sites may be re-recorded in a follow up bug.

Differential Revision: https://phabricator.services.mozilla.com/D206572
This commit is contained in:
KS 2024-04-09 16:39:03 +00:00
parent ab89517e38
commit 4eee41c520
9 changed files with 60 additions and 64 deletions

View file

@ -16883,7 +16883,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm7-linux-firefox-amazon.manifest
* **playback pageset manifest**: mitm8-linux-firefox-amazon.manifest
* **playback version**: 8.1.1
* **secondary url**: `<https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3>`__
* **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
@ -17454,7 +17454,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#26>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#27>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -17852,7 +17852,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#30>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#31>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -18091,7 +18091,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#35>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#36>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -18572,7 +18572,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#39>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#40>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -18896,7 +18896,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#44>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#45>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -19207,7 +19207,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#49>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#50>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -19493,7 +19493,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#53>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#54>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -19859,7 +19859,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#58>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#59>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -20257,7 +20257,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#63>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#64>`__
* **lower is better**: true
* **page complete wait time**: 8000
* **page cycles**: 25
@ -20582,7 +20582,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#68>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#69>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -20905,7 +20905,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#73>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#74>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -21228,7 +21228,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#77>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#78>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -21627,7 +21627,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#83>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#84>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -22058,7 +22058,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#87>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#88>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -22363,12 +22363,12 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#99>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#100>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm6-linux-firefox-instagram.manifest
* **playback pageset manifest**: mitm8-darwin-firefox-instagram.manifest
* **playback version**: 8.1.1
* **secondary url**: `<https://www.instagram.com/nobelprize_org/>`__
* **test url**: `<https://www.instagram.com/>`__
@ -22864,7 +22864,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#104>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#105>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -23188,7 +23188,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#109>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#110>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -23512,7 +23512,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#113>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#114>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -23831,7 +23831,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#118>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#119>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -24117,7 +24117,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#122>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#123>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -24356,7 +24356,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#126>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#127>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -24674,7 +24674,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#130>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#131>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -24997,7 +24997,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#134>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#135>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -25321,7 +25321,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#140>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#141>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -25752,7 +25752,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#146>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#147>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -26076,7 +26076,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#151>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#152>`__
* **lower is better**: true
* **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
* **page cycles**: 25
@ -26402,7 +26402,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#164>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#165>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -26795,7 +26795,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#169>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#170>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -27034,7 +27034,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#174>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#175>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -27540,7 +27540,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#178>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#179>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000
@ -27938,7 +27938,7 @@ Tests for page-load performance. The links direct to the actual websites that ar
* **browser cycles**: 25
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#183>`__
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#184>`__
* **lower is better**: true
* **page cycles**: 25
* **page timeout**: 60000

View file

@ -354,7 +354,8 @@
{
"login": true,
"name": "instagram",
"test_url": "https://www.instagram.com/"
"test_url": "https://www.instagram.com/",
"secondary_url": "https://www.instagram.com/nobelprize_org/"
},
{
"login": true,

View file

@ -19,6 +19,7 @@ benchmark_page = true
# Keep this list in alphabetical order
["amazon"]
playback_pageset_manifest = "mitm8-linux-firefox-amazon.manifest"
benchmark_page = false
test_url = "https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1"
secondary_url = "https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3"
@ -97,7 +98,7 @@ secondary_url = "https://imgur.com/gallery/WuOobqV"
test_url = "https://imgur.com/gallery/uTI7fKy"
["instagram"]
playback_pageset_manifest = "mitm6-linux-firefox-instagram.manifest"
playback_pageset_manifest = "mitm8-darwin-firefox-instagram.manifest"
secondary_url = "https://www.instagram.com/nobelprize_org/"
test_url = "https://www.instagram.com/"

View file

@ -1,9 +0,0 @@
[
{
"filename": "mitm5-linux-firefox-wikia.zip",
"size": 4847101,
"algorithm": "sha512",
"digest": "c53c45c374cd924d03972f56b6a7416451861147f0a14b8c51c2c722a82582ae7ce8927a500981152aa6f4d3617b5ce455b85910981a9aabbd672e1ea47c0ff7",
"visibility": "public"
}
]

View file

@ -1,9 +0,0 @@
[
{
"size": 6548847,
"visibility": "public",
"digest": "30d26a7bd8343255bf5e9e58f9315a56719be25dcb32214de1604563a9fbd49e17e477286a9d9c4b941ba20591385ac523c153e6f290ef57f679bd9261fa9078",
"algorithm": "sha512",
"filename": "mitm6-linux-firefox-instagram.zip"
}
]

View file

@ -1,9 +0,0 @@
[
{
"size": 20477615,
"visibility": "public",
"digest": "4f588d80825cd570a702d060a8e75443f5ba564f33a37fa75179829308b7258c7989cd13966d09e3258e87ca7da18b138041d0723d28f9f0397c72bdac559bf4",
"algorithm": "sha512",
"filename": "mitm7-linux-firefox-amazon.zip"
}
]

View file

@ -0,0 +1,10 @@
[
{
"filename": "mitm8-darwin-firefox-instagram.zip",
"size": 37433674,
"algorithm": "sha512",
"digest": "677826a8d755441e374ab2fa1ef4229add5a60b7c97f1ceb547fd215f366e2dd885d6b3aa46d32664125562add33db48ecaba1e5cd4aec9164959a6ba25e2e2f",
"visibility": "public"
}
]

View file

@ -0,0 +1,10 @@
[
{
"filename": "mitm8-linux-firefox-amazon.zip",
"size": 32863692,
"algorithm": "sha512",
"digest": "c8e98e1d294fa58faaab499ccd904e7b8f98ffac7f3e8a835103eb41f54d98fad903175ae43dd1ddbabdfdefd57b1652436b287825f8474eed902b938f3dacd5",
"visibility": "public"
}
]

View file

@ -1,9 +1,10 @@
[
{
"filename": "mitm8-linux-firefox-imgur.zip",
"size": 11323543,
"size": 13808645,
"algorithm": "sha512",
"digest": "5817f3ec63d72658e0b34cc2d50069879ceee80aeaff715ab1370253d8f0ac60e7e58f284ec7b3bd50f562beeeda7d0c1a0cbdf9fd5c960cb8ae1230dcbd08e9",
"digest": "35f2bd5b9b89f0912bb8a1577c1beabb76713cbb5e8cff060529d407ebb4818bf791c4e62e3a9bb4c2e299ec0e60a1ab207e1bdc8316538e5bfc66ca2b8a4aab",
"visibility": "public"
}
]