154055 2016-02-09 16:25:44 -0800 [iOS Simulator] perf/adding-radio-buttons.html is flaky 2016-03-29 12:51:52 -0700 1 1 1 Unclassified WebKit New Bugs WebKit Nightly Build iPhone / iPad iOS 9.0 NEW P2 Normal --- 152130 1 ryanhaddad webkit-unassigned cdumez oldest_to_newest 1163336 0 ryanhaddad 2016-02-09 16:25:44 -0800 [iOS Simulator] perf/adding-radio-buttons.html is flaky <https://build.webkit.org/results/Apple%20iOS%209%20Simulator%20Release%20WK2%20(Tests)/r196342%20(2979)/results.html> <http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=perf%2Fadding-radio-buttons.html> --- /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/perf/adding-radio-buttons-expected.txt +++ /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/perf/adding-radio-buttons-actual.txt @@ -1,3 +1,50 @@ Tests that adding a radio button to a radio button group is linear in the number of radio buttons. -PASS +FAIL: got indeterminate result expected O(n) +DEBUG LOG: +run iteration. magnitude 2 jsObjectCountBefore 27003 jsObjectCountAfter 3625 +run iteration. magnitude 4 jsObjectCountBefore 3625 jsObjectCountAfter 3666 +run iteration. magnitude 8 jsObjectCountBefore 3666 jsObjectCountAfter 3676 +run iteration. magnitude 16 jsObjectCountBefore 3676 jsObjectCountAfter 3691 +run iteration. magnitude 32 jsObjectCountBefore 3691 jsObjectCountAfter 3714 +run iteration. magnitude 64 jsObjectCountBefore 3714 jsObjectCountAfter 3755 +run iteration. magnitude 128 jsObjectCountBefore 3755 jsObjectCountAfter 3826 +run iteration. magnitude 256 jsObjectCountBefore 3826 jsObjectCountAfter 3961 +magnitudes: 2,4,8,16,32,64,128,256 +iterations: 182,163,164,174,161,143,117,117 +numPoints 8 slope 0.0003083047942323102 intercept 0.14838421450299621 rSquared 0.8190959726390741 +numPoints 8 slope 0.015705671658226197 intercept 0.1190501060061572 rSquared 0.7817579422359413 +numPoints 8 slope 0.08998684808093542 intercept -2.0774671952585644 rSquared 0.7976774602112154 +rSquared 0.8190959726390741 rSquaredXLog 0.7817579422359413 rSquaredXYLog 0.7976774602112154 +numTriesLeft: 2 +run iteration. magnitude 2 jsObjectCountBefore 3961 jsObjectCountAfter 3786 +run iteration. magnitude 4 jsObjectCountBefore 3786 jsObjectCountAfter 3796 +run iteration. magnitude 8 jsObjectCountBefore 3796 jsObjectCountAfter 3806 +run iteration. magnitude 16 jsObjectCountBefore 3806 jsObjectCountAfter 3821 +run iteration. magnitude 32 jsObjectCountBefore 3821 jsObjectCountAfter 3844 +run iteration. magnitude 64 jsObjectCountBefore 3844 jsObjectCountAfter 3883 +run iteration. magnitude 128 jsObjectCountBefore 3883 jsObjectCountAfter 3954 +run iteration. magnitude 256 jsObjectCountBefore 3954 jsObjectCountAfter 4094 +magnitudes: 2,4,8,16,32,64,128,256 +iterations: 185,180,179,158,153,144,126,113 +numPoints 8 slope 0.00033082968411293437 intercept 0.14498187226054143 rSquared 0.9087456646328432 +numPoints 8 slope 0.017301270084991095 intercept 0.11210679501491133 rSquared 0.9140594086062277 +numPoints 8 slope 0.10165891171198786 intercept -2.126616628959169 rSquared 0.9422336852960865 +rSquared 0.9087456646328432 rSquaredXLog 0.9140594086062277 rSquaredXYLog 0.9422336852960865 +numTriesLeft: 1 +run iteration. magnitude 2 jsObjectCountBefore 4094 jsObjectCountAfter 3885 +run iteration. magnitude 4 jsObjectCountBefore 3885 jsObjectCountAfter 3895 +run iteration. magnitude 8 jsObjectCountBefore 3895 jsObjectCountAfter 3905 +run iteration. magnitude 16 jsObjectCountBefore 3905 jsObjectCountAfter 3920 +run iteration. magnitude 32 jsObjectCountBefore 3920 jsObjectCountAfter 3943 +run iteration. magnitude 64 jsObjectCountBefore 3943 jsObjectCountAfter 3982 +run iteration. magnitude 128 jsObjectCountBefore 3982 jsObjectCountAfter 4053 +run iteration. magnitude 256 jsObjectCountBefore 4053 jsObjectCountAfter 4188 +magnitudes: 2,4,8,16,32,64,128,256 +iterations: 176,196,181,174,164,129,125,114 +numPoints 8 slope 0.00035112242388917966 intercept 0.14223243328346055 rSquared 0.8183794560817225 +numPoints 8 slope 0.018528429478365978 intercept 0.10682330886729656 rSquared 0.8381077271751465 +numPoints 8 slope 0.10930555255695275 intercept -2.1633586855455547 rSquared 0.8424972165011254 +rSquared 0.8183794560817225 rSquaredXLog 0.8381077271751465 rSquaredXYLog 0.8424972165011254 + + 1163337 1 ryanhaddad 2016-02-09 16:27:52 -0800 Marked as flaky on ios-simulator with <https://trac.webkit.org/r196346> 1178763 2 ryanhaddad 2016-03-29 12:51:52 -0700 The test also times out intermittently. Updated expectations in r198789.