NEW252268
WPT testharness subtests should be unordered 
https://bugs.webkit.org/show_bug.cgi?id=252268
Summary WPT testharness subtests should be unordered
Sam Sneddon [:gsnedders]
Reported 2023-02-14 15:09:27 PST
Per the WPT testharness API contract, only the mapping from subtest name to subtest status is meaningful, not the ordering of the subtests. Note that this is one place where Chromium also doesn't match, except in the simplest all-PASS cases.
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2023-02-14 15:12:10 PST
<rdar://problem/105469778>
Sam Sneddon [:gsnedders]
Comment 2 2026-06-03 15:37:57 PDT
https://github.com/WebKit/WebKit/commit/7dc7c1f5a8abc337fb5cc365f03161e2c536480e from bug 315857 added a bunch of gnarly code to workaround the fact we don't do this, by effectively doing this when site isolation is enabled. We really should just fix this in all cases, despite the historic opposition to non-deterministic subtest ordering from some WebKit contributors, because operationally we can't really keep on making tests slower to try and make the ordering deterministic, especially when the upstream consensus is clearly in favour of quicker running tests.
Note You need to log in before you can comment on or make changes to this bug.