276428 2024-07-10 08:12:35 -0700 Tools/Scripts/run-webkit-tests does not recognize WPT crash tests in a crashtest directory 2024-09-28 04:40:22 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 276414 1 fred.wang webkit-unassigned ahmad.saleem792 gsnedders harpsichen ntim webkit-bug-importer oldest_to_newest 2045542 0 fred.wang 2024-07-10 08:12:35 -0700 I understand we somehow support WPT crashtests now: https://web-platform-tests.org/writing-tests/crashtest.html https://searchfox.org/wubkat/search?q=crashtests&path=Tools%2FScripts&case=false&regexp=false However, when running $ Tools/Scripts/run-webkit-tests imported/w3c/web-platform-tests/mathml/crashtests I get "All tests skipped." If instead I do $ Tools/Scripts/run-webkit-tests imported/w3c/web-platform-tests/css/css-tables/crashtests I get "All 7 tests ran as expected." So only 7 of the 24 crash tests are considered, apparently only those with an explicit *-crash* suffix. $ ls LayoutTests/imported/w3c/web-platform-tests/css/css-tables/crashtests/ | wc --lines 24 $ ls LayoutTests/imported/w3c/web-platform-tests/css/css-tables/crashtests/*-crash* | wc --lines 7 2046729 1 webkit-bug-importer 2024-07-17 08:13:14 -0700 <rdar://problem/131926145> 2046733 2 ahmad.saleem792 2024-07-17 08:20:28 -0700 Something related but might be different - it also case with SVG crash tests and editing related test case. It can import but it does not generate 'expected test files'. 2046746 3 gsnedders 2024-07-17 09:14:38 -0700 https://github.com/WebKit/WebKit/blob/6eef85d192a8f02fa74fc620854c83dd0fff6fed/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_finder.py#L612-L620 should be handling this, but clearly isn't, unless we're somehow also ignoring them. 2063769 4 harpsichen 2024-09-27 08:53:18 -0700 It seems that the tests aren't running since they're listed in `resource-files.json` wrongfully -- this commit [1] was the one that added them. I believe that the importer script used was on this revision [2], since the time lines up and it would also explain why `-crash.` tests aren't in `resource-files.json` but `crashtests` tests are (since the commit only checks for `-crash.` tests). Since it looks like the logic was fixed as part of the commit in [3], I think just removing the tests from `resource-files.json` should be good enough. [1]: https://github.com/WebKit/WebKit/commit/a31f8e4d6253f04c8d955e42985e6e018d3a1a86 [2]: https://github.com/WebKit/WebKit/commit/d8b1589e4915042608bb1a1a55bd291bcec76d51#diff-955991178e0e7971ad17ceface65532b503e98975aec31d0fc7093e0d80c3dc5R167-R169 [3]: https://github.com/WebKit/WebKit/commit/b70287103be9d7a826cb2697e7a951536dc2a04b 2063843 5 harpsichen 2024-09-27 11:59:19 -0700 Pull request: https://github.com/WebKit/WebKit/pull/34374 2063980 6 ews-feeder 2024-09-28 04:40:20 -0700 Committed 284409@main (5a279668079a): <https://commits.webkit.org/284409@main> Reviewed commits have been landed. Closing PR #34374 and removing active labels.