198085 2019-05-21 14:40:53 -0700 REGRESSION (r244848-244849) [iOS] Several sizing , css and rendering tests are flakily failing in tandem on testers 2019-05-22 20:24:59 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED DUPLICATE 198135 InRadar P2 Normal --- 1 sroberts webkit-unassigned jlewis3 ryanhaddad tsavell webkit-bug-importer wenson_hsieh zalan oldest_to_newest 1537991 0 370344 sroberts 2019-05-21 14:40:53 -0700 Created attachment 370344 Test List The following issue is occurring only on iOS Simulator Release and Debug Close to 100 tests can fail when run in a particular order. Most tests are css, sizing and rendering tests. My notes will address the test case I am using to reproduce the failures Probable cause: After changes in either: https://trac.webkit.org/changeset/244848/webkit or https://trac.webkit.org/changeset/244849/webkit When you run the following test list on either iOS Simulator Release or Debug, 44 tests will fail at sizing differences, or image diffs there are what appears to be squares being drawn. The tests will fail/image only failure, then pass on retry. Reproduced with: run-webkit-tests --test-list=/tf --child-process 1 --ios-simulator Link to an example run of this happening to see results. https://build.webkit.org/results/Apple%20iOS%2012%20Simulator%20Debug%20WK2%20(Tests)/r245469%20(3751)/results.html The reproduction I linked with the test list will cause all 44 of those tests to fail when they are run after: fast/viewport/ios/minimum-scale-after-changing-view-scale.html ietestcenter/css3/bordersbackgrounds/border-radius-sum-of-radii-002.htm All of the ietestcenter tests will fail, and create an expected image result for themselves. Then subsequent runs fail, and pass on retry. Test case failed in spade of r244850, passed in r244840. There are no revisions to test with in between. Flakiness Dashboard: https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-radius-with-three-values-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-radius-with-two-values-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-002.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-003.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-004.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-right-radius-values-004.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-002.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-003.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-004.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fcolor-behind-images.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fnone-as-image-layer.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Forder-of-images.htm%20imported%2Fblink%2Fcompositing%2Fwill-change%2Fstacking-context-creation.html%20imported%2Fblink%2Ffast%2Fclip%2Fnested-rounded-rect.html%20imported%2Fblink%2Ffast%2Fmulticol%2Fvertical-lr%2Ffloat-break.html%20imported%2Fblink%2Ffast%2Fmulticol%2Fvertical-lr%2Ffloat-content-break.html%20imported%2Fblink%2Ffast%2Fmulticol%2Fvertical-lr%2Ffloat-edge.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-aspectparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-transformparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-viewboxparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-viewtargetparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-zoomandpanparams.html%20imported%2Fblink%2Ftransforms%2Finline-transform-and-clipping-roots.html%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--display-block--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--display-inline--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--display-inline-block--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--float-left--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--float-right--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--position-absolute--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--position-relative--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsmil%2Ftransform%2Fset-transform-1.svg%20imported%2Fmozilla%2Fsvg%2Fsmil%2Ftransform%2Ftranslate-clipPath-1.svg%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-host-namespace.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-host-rule.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-host-with-before-after.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-invisible-slot.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-nested-slot-display-override.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot-display-override.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot-fallback.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot-style.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slotted-nested.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fshadow-host-with-before-after.html 1537992 1 webkit-bug-importer 2019-05-21 14:41:37 -0700 <rdar://problem/51001306> 1538521 2 wenson_hsieh 2019-05-22 20:24:59 -0700 Sorry, I didn't see what you'd already filed a bugzilla bug :P This should be fixed after https://trac.webkit.org/changeset/245663. *** This bug has been marked as a duplicate of bug 198135 *** 370344 2019-05-21 14:40:53 -0700 2019-05-21 14:40:53 -0700 Test List tf text/plain 3206 sroberts ZmFzdC92aWV3cG9ydC9pb3MvbWluaW11bS1zY2FsZS1hZnRlci1jaGFuZ2luZy12aWV3LXNjYWxl Lmh0bWwKaWV0ZXN0Y2VudGVyL2NzczMvYm9yZGVyc2JhY2tncm91bmRzL2JvcmRlci1yYWRpdXMt c3VtLW9mLXJhZGlpLTAwMi5odG0KCmlldGVzdGNlbnRlci9jc3MzL2JvcmRlcnNiYWNrZ3JvdW5k cy9ib3JkZXItcmFkaXVzLXdpdGgtdGhyZWUtdmFsdWVzLTAwMS5odG0KaWV0ZXN0Y2VudGVyL2Nz czMvYm9yZGVyc2JhY2tncm91bmRzL2JvcmRlci1yYWRpdXMtd2l0aC10d28tdmFsdWVzLTAwMS5o dG0KaWV0ZXN0Y2VudGVyL2NzczMvYm9yZGVyc2JhY2tncm91bmRzL2JvcmRlci10b3AtbGVmdC1y YWRpdXMtdmFsdWVzLTAwMS5odG0KaWV0ZXN0Y2VudGVyL2NzczMvYm9yZGVyc2JhY2tncm91bmRz L2JvcmRlci10b3AtbGVmdC1yYWRpdXMtdmFsdWVzLTAwMi5odG0KaWV0ZXN0Y2VudGVyL2NzczMv Ym9yZGVyc2JhY2tncm91bmRzL2JvcmRlci10b3AtbGVmdC1yYWRpdXMtdmFsdWVzLTAwMy5odG0K aWV0ZXN0Y2VudGVyL2NzczMvYm9yZGVyc2JhY2tncm91bmRzL2JvcmRlci10b3AtbGVmdC1yYWRp dXMtdmFsdWVzLTAwNC5odG0KaWV0ZXN0Y2VudGVyL2NzczMvYm9yZGVyc2JhY2tncm91bmRzL2Jv cmRlci10b3AtcmlnaHQtcmFkaXVzLXZhbHVlcy0wMDQuaHRtCmlldGVzdGNlbnRlci9jc3MzL2Jv cmRlcnNiYWNrZ3JvdW5kcy9ib3gtc2hhZG93LTAwMS5odG0KaWV0ZXN0Y2VudGVyL2NzczMvYm9y ZGVyc2JhY2tncm91bmRzL2JveC1zaGFkb3ctMDAyLmh0bQppZXRlc3RjZW50ZXIvY3NzMy9ib3Jk ZXJzYmFja2dyb3VuZHMvYm94LXNoYWRvdy0wMDMuaHRtCmlldGVzdGNlbnRlci9jc3MzL2JvcmRl cnNiYWNrZ3JvdW5kcy9ib3gtc2hhZG93LTAwNC5odG0KaWV0ZXN0Y2VudGVyL2NzczMvYm9yZGVy c2JhY2tncm91bmRzL2NvbG9yLWJlaGluZC1pbWFnZXMuaHRtCmlldGVzdGNlbnRlci9jc3MzL2Jv cmRlcnNiYWNrZ3JvdW5kcy9ub25lLWFzLWltYWdlLWxheWVyLmh0bQppZXRlc3RjZW50ZXIvY3Nz My9ib3JkZXJzYmFja2dyb3VuZHMvb3JkZXItb2YtaW1hZ2VzLmh0bQppbXBvcnRlZC9ibGluay9j b21wb3NpdGluZy93aWxsLWNoYW5nZS9zdGFja2luZy1jb250ZXh0LWNyZWF0aW9uLmh0bWwKaW1w b3J0ZWQvYmxpbmsvZmFzdC9jbGlwL25lc3RlZC1yb3VuZGVkLXJlY3QuaHRtbAppbXBvcnRlZC9i bGluay9mYXN0L211bHRpY29sL3ZlcnRpY2FsLWxyL2Zsb2F0LWJyZWFrLmh0bWwKaW1wb3J0ZWQv YmxpbmsvZmFzdC9tdWx0aWNvbC92ZXJ0aWNhbC1sci9mbG9hdC1jb250ZW50LWJyZWFrLmh0bWwK aW1wb3J0ZWQvYmxpbmsvZmFzdC9tdWx0aWNvbC92ZXJ0aWNhbC1sci9mbG9hdC1lZGdlLmh0bWwK aW1wb3J0ZWQvYmxpbmsvc3ZnL2RvbS92aWV3c3BlYy1hc3BlY3RwYXJhbXMuaHRtbAppbXBvcnRl ZC9ibGluay9zdmcvZG9tL3ZpZXdzcGVjLXRyYW5zZm9ybXBhcmFtcy5odG1sCmltcG9ydGVkL2Js aW5rL3N2Zy9kb20vdmlld3NwZWMtdmlld2JveHBhcmFtcy5odG1sCmltcG9ydGVkL2JsaW5rL3N2 Zy9kb20vdmlld3NwZWMtdmlld3RhcmdldHBhcmFtcy5odG1sCmltcG9ydGVkL2JsaW5rL3N2Zy9k b20vdmlld3NwZWMtem9vbWFuZHBhbnBhcmFtcy5odG1sCmltcG9ydGVkL2JsaW5rL3RyYW5zZm9y bXMvaW5saW5lLXRyYW5zZm9ybS1hbmQtY2xpcHBpbmctcm9vdHMuaHRtbAppbXBvcnRlZC9tb3pp bGxhL3N2Zy9zaXppbmcvaW5saW5lLS1kaXNwbGF5LWJsb2NrLS0wMS54aHRtbAppbXBvcnRlZC9t b3ppbGxhL3N2Zy9zaXppbmcvaW5saW5lLS1kaXNwbGF5LWlubGluZS0tMDEueGh0bWwKaW1wb3J0 ZWQvbW96aWxsYS9zdmcvc2l6aW5nL2lubGluZS0tZGlzcGxheS1pbmxpbmUtYmxvY2stLTAxLnho dG1sCmltcG9ydGVkL21vemlsbGEvc3ZnL3NpemluZy9pbmxpbmUtLWZsb2F0LWxlZnQtLTAxLnho dG1sCmltcG9ydGVkL21vemlsbGEvc3ZnL3NpemluZy9pbmxpbmUtLWZsb2F0LXJpZ2h0LS0wMS54 aHRtbAppbXBvcnRlZC9tb3ppbGxhL3N2Zy9zaXppbmcvaW5saW5lLS1wb3NpdGlvbi1hYnNvbHV0 ZS0tMDEueGh0bWwKaW1wb3J0ZWQvbW96aWxsYS9zdmcvc2l6aW5nL2lubGluZS0tcG9zaXRpb24t cmVsYXRpdmUtLTAxLnhodG1sCmltcG9ydGVkL21vemlsbGEvc3ZnL3NtaWwvdHJhbnNmb3JtL3Nl dC10cmFuc2Zvcm0tMS5zdmcKaW1wb3J0ZWQvbW96aWxsYS9zdmcvc21pbC90cmFuc2Zvcm0vdHJh bnNsYXRlLWNsaXBQYXRoLTEuc3ZnCmltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvY3Nz L2Nzcy1zY29waW5nL2Nzcy1zY29waW5nLXNoYWRvdy1ob3N0LW5hbWVzcGFjZS5odG1sCmltcG9y dGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvY3NzL2Nzcy1zY29waW5nL2Nzcy1zY29waW5nLXNo YWRvdy1ob3N0LXJ1bGUuaHRtbAppbXBvcnRlZC93M2Mvd2ViLXBsYXRmb3JtLXRlc3RzL2Nzcy9j c3Mtc2NvcGluZy9jc3Mtc2NvcGluZy1zaGFkb3ctaG9zdC13aXRoLWJlZm9yZS1hZnRlci5odG1s CmltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvY3NzL2Nzcy1zY29waW5nL2Nzcy1zY29w aW5nLXNoYWRvdy1pbnZpc2libGUtc2xvdC5odG1sCmltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0t dGVzdHMvY3NzL2Nzcy1zY29waW5nL2Nzcy1zY29waW5nLXNoYWRvdy1uZXN0ZWQtc2xvdC1kaXNw bGF5LW92ZXJyaWRlLmh0bWwKaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0cy9jc3MvY3Nz LXNjb3BpbmcvY3NzLXNjb3Bpbmctc2hhZG93LXNsb3QtZGlzcGxheS1vdmVycmlkZS5odG1sCmlt cG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvY3NzL2Nzcy1zY29waW5nL2Nzcy1zY29waW5n LXNoYWRvdy1zbG90LWZhbGxiYWNrLmh0bWwKaW1wb3J0ZWQvdzNjL3dlYi1wbGF0Zm9ybS10ZXN0 cy9jc3MvY3NzLXNjb3BpbmcvY3NzLXNjb3Bpbmctc2hhZG93LXNsb3Qtc3R5bGUuaHRtbAppbXBv cnRlZC93M2Mvd2ViLXBsYXRmb3JtLXRlc3RzL2Nzcy9jc3Mtc2NvcGluZy9jc3Mtc2NvcGluZy1z aGFkb3ctc2xvdC5odG1sCmltcG9ydGVkL3czYy93ZWItcGxhdGZvcm0tdGVzdHMvY3NzL2Nzcy1z Y29waW5nL2Nzcy1zY29waW5nLXNoYWRvdy1zbG90dGVkLW5lc3RlZC5odG1sCmltcG9ydGVkL3cz Yy93ZWItcGxhdGZvcm0tdGVzdHMvY3NzL2Nzcy1zY29waW5nL3NoYWRvdy1ob3N0LXdpdGgtYmVm b3JlLWFmdGVyLmh0bWw=