252268 2023-02-14 15:09:27 -0800 WPT testharness subtests should be unordered 2026-06-03 15:37:57 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=299830 https://bugs.webkit.org/show_bug.cgi?id=315857 InRadar P2 Normal --- 252269 1 gsnedders webkit-unassigned sihui_liu webkit-bug-importer oldest_to_newest 1933609 0 gsnedders 2023-02-14 15:09:27 -0800 Per the WPT testharness API contract, only the mapping from subtest name to subtest status is meaningful, not the ordering of the subtests. Note that this is one place where Chromium also doesn't match, except in the simplest all-PASS cases. 1933613 1 webkit-bug-importer 2023-02-14 15:12:10 -0800 <rdar://problem/105469778> 2217398 2 gsnedders 2026-06-03 15:37:57 -0700 https://github.com/WebKit/WebKit/commit/7dc7c1f5a8abc337fb5cc365f03161e2c536480e from bug 315857 added a bunch of gnarly code to workaround the fact we don't do this, by effectively doing this when site isolation is enabled. We really should just fix this in all cases, despite the historic opposition to non-deterministic subtest ordering from some WebKit contributors, because operationally we can't really keep on making tests slower to try and make the ordering deterministic, especially when the upstream consensus is clearly in favour of quicker running tests.