Bug 187911

Summary: [macOS debug] Layout Test imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState.html is a flaky failure
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: eric.carlson, jacob_uphoff, jer.noble, realdawei, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   

Description Ryan Haddad 2018-07-23 10:43:53 PDT
The following layout test is flaky on macOS debug bots

imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState.html

Probable cause:

Unknown, this test has been flaky for a while.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmedia-source%2FSourceBuffer-abort-readyState.html

The test usually completes less than 2 seconds, but intermittently times out after 135 seconds with the following diff:

--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState-actual.txt
@@ -1,4 +1,7 @@
+CONSOLE MESSAGE: line 51: InvalidStateError: The object is in an invalid state.
+
+Harness Error (FAIL), message = InvalidStateError: The object is in an invalid state.
 
 FAIL SourceBuffer#abort() (video/webm; codecs="vorbis,vp8") : If the readyState attribute of the parent media source is not in the "open" state then throw an INVALID_STATE_ERR exception and abort these steps. assert_unreached: Browser doesn't support the MIME used in this test: video/webm; codecs="vorbis,vp8" Reached unreachable code
-PASS SourceBuffer#abort() (video/mp4) : If the readyState attribute of the parent media source is not in the "open" state then throw an INVALID_STATE_ERR exception and abort these steps. 
+TIMEOUT SourceBuffer#abort() (video/mp4) : If the readyState attribute of the parent media source is not in the "open" state then throw an INVALID_STATE_ERR exception and abort these steps. Test timed out
Comment 1 Truitt Savell 2018-08-30 16:56:02 PDT
Issue still occurring. 

easily can reproduce issue with a debug build and running with:

run-webkit-tests --root debug-235460 imported/w3c/web-platform-tests/media-source/SourceBuffer-abort-readyState.html --iterations 500 -f --debug
Comment 2 Radar WebKit Bug Importer 2020-04-08 12:54:56 PDT
<rdar://problem/61471458>
Comment 3 Jacob Uphoff 2020-04-08 12:55:20 PDT
Test is still flaky failing.
Comment 4 Jacob Uphoff 2020-04-08 13:05:51 PDT
Set expectations for this here: https://trac.webkit.org/changeset/259749/webkit