165222 2016-11-30 14:24:41 -0800 REGRESSION (r209144): imported/w3c/web-platform-tests/IndexedDB/idbindex-* tests are flaky in debug builds 2021-07-30 10:26:40 -0700 1 1 1 Unclassified WebKit New Bugs Other Unspecified Unspecified RESOLVED DUPLICATE 228241 https://bugs.webkit.org/show_bug.cgi?id=164974 P2 Normal --- 154968 1 ryanhaddad webkit-unassigned beidson jlewis3 sihui_liu oldest_to_newest 1254981 0 ryanhaddad 2016-11-30 14:24:41 -0800 The following tests have been flaky since https://trac.webkit.org/changeset/209144 landed. imported/w3c/web-platform-tests/IndexedDB/idbindex-multientry.htm imported/w3c/web-platform-tests/IndexedDB/idbindex-rename-abort.html imported/w3c/web-platform-tests/IndexedDB/idbindex-rename-errors.html https://build.webkit.org/results/Apple%20El%20Capitan%20Debug%20WK2%20(Tests)/r209145%20(9666)/results.html https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2FIndexedDB%2Fidbindex-multientry.htm https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2FIndexedDB%2Fidbindex-rename-abort.html https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2FIndexedDB%2Fidbindex-rename-errors.html --- /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/IndexedDB/idbindex-multientry-expected.txt +++ /Volumes/Data/slave/elcapitan-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/IndexedDB/idbindex-multientry-actual.txt @@ -1,3 +1,5 @@ -PASS IDBIndex.multiEntry - adding keys +Harness Error (TIMEOUT), message = null +NOTRUN IDBIndex.multiEntry - adding keys + 1254982 1 ryanhaddad 2016-11-30 14:25:55 -0800 This affects macOS Debug WK2 1255068 2 beidson 2016-11-30 17:03:55 -0800 Hammering these in WK2 Debug locally, all sorts of configurations of run-webkit-tests. Cannot reproduce. 1255386 3 beidson 2016-12-01 13:09:31 -0800 Wonder if there's any Database process crashes and they're just not coming up in the results? 1255387 4 ryanhaddad 2016-12-01 13:10:31 -0800 (In reply to comment #3) > Wonder if there's any Database process crashes and they're just not coming > up in the results? I'll see if I can find anything. 1255397 5 ap 2016-12-01 13:18:41 -0800 Brady, how long do these tests take when you run them? If they are slow locally, timing out on the bots wouldn't be surprising. 1255400 6 ryanhaddad 2016-12-01 13:22:14 -0800 (In reply to comment #4) > (In reply to comment #3) > > Wonder if there's any Database process crashes and they're just not coming > > up in the results? > > I'll see if I can find anything. I don't see any database process crashlogs on the bot that most recently had these failures. 1255465 7 beidson 2016-12-01 14:07:46 -0800 (In reply to comment #5) > Brady, how long do these tests take when you run them? If they are slow > locally, timing out on the bots wouldn't be surprising. Extremely quickly. With webkit-httpd running, the command: `DYLD_FRAMEWORK_PATH=~/build/Debug/ ~/build/Debug/WebKitTestRunner http://127.0.0.1:8800/IndexedDB/idbindex-multientry.htm http://127.0.0.1:8800/IndexedDB/idbindex-rename-abort.html http://127.0.0.1:8800/IndexedDB/idbindex-rename-errors.html` ...takes well under a second to successfully complete. 1255875 8 beidson 2016-12-02 14:00:47 -0800 According to the flakiness dashboard, these literally never timeout on Release builds. But on Debug builds they take *a long* time. As mentioned in comment 7, I can't reproduce these locally even with a debug build. They are very fast. 1255878 9 beidson 2016-12-02 14:02:17 -0800 I'm also trying to reason through why they could possibly be related to this patch, and I got nothin' 1255879 10 beidson 2016-12-02 14:03:56 -0800 Even completes quickly under gmalloc (locally) 1255882 11 beidson 2016-12-02 14:06:49 -0800 We should mark them flakey for debug only. 1255906 12 ryanhaddad 2016-12-02 14:43:41 -0800 (In reply to comment #11) > We should mark them flakey for debug only. Done in http://trac.webkit.org/projects/webkit/changeset/209272 1366433 13 jlewis3 2017-10-31 09:56:57 -0700 These have recently started being flaky on El Capitan Release: https://build.webkit.org/results/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/r224231%20(5639)/results.html https://build.webkit.org/builders/Apple%20El%20Capitan%20Release%20WK2%20(Tests)/builds/5639 1780859 14 sihui_liu 2021-07-30 10:26:40 -0700 Expectations updated at https://bugs.webkit.org/show_bug.cgi?id=228241 as the test is no longer flaky. *** This bug has been marked as a duplicate of bug 228241 ***