187549 2018-07-10 22:40:02 -0700 [ews-build] EWS should unapply patch and re-run jsc tests when patch fails jsc tests 2018-07-11 21:09:20 -0700 1 1 1 Unclassified WebKit Tools / Tests Other Unspecified Unspecified RESOLVED FIXED https://bugs.webkit.org/show_bug.cgi?id=187358 InRadar P2 Normal --- 1 aakash_jain aakash_jain aakash_jain ap commit-queue ews-watchlist lforschler webkit-bug-importer oldest_to_newest 1441107 0 aakash_jain 2018-07-10 22:40:02 -0700 When a patch fails to build jsc, EWS should unapply the patch and build ToT in order to confirm that it is not a pre-existing issue (Similar to https://bugs.webkit.org/show_bug.cgi?id=187358). Also, when a patch fails jsc tests, EWS should re-run the tests (since these tests are flaky), and if the re-run still fails, it should un-apply the patch and re-run tests on clean tree (similar to current EWS). 1441111 1 344755 aakash_jain 2018-07-10 22:49:10 -0700 Created attachment 344755 Proposed patch We should also analyze the test results from all the re-runs, that would be in a separate step. 1441114 2 aakash_jain 2018-07-10 22:56:44 -0700 Tested in: http://ews-build.webkit-uat.org/#/builders/17/builds/23 1441204 3 ews-watchlist 2018-07-11 11:48:37 -0700 Attachment 344755 did not pass style-queue: ERROR: Tools/BuildSlaveSupport/ews-build/steps.py:213: [RunJavaScriptCoreTests.evaluateCommand] Use of super on an old style class [pylint/E1002] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps.py:229: [ReRunJavaScriptCoreTests.evaluateCommand] Use of super on an old style class [pylint/E1002] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:548: [TestCompileJSCOnlyToT.test_success] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:548: [TestCompileJSCOnlyToT.test_success] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:563: [TestCompileJSCOnlyToT.test_failure] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:563: [TestCompileJSCOnlyToT.test_failure] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:571: [TestCompileJSCOnlyToT.test_skip] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:571: [TestCompileJSCOnlyToT.test_skip] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:635: [TestReRunJavaScriptCoreTests.test_success] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:635: [TestReRunJavaScriptCoreTests.test_success] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:651: [TestReRunJavaScriptCoreTests.test_failure] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:651: [TestReRunJavaScriptCoreTests.test_failure] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:659: [TestReRunJavaScriptCoreTests.test_skip] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:659: [TestReRunJavaScriptCoreTests.test_skip] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:684: [TestRunJavaScriptCoreTestsToT.test_success] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:684: [TestRunJavaScriptCoreTestsToT.test_success] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:700: [TestRunJavaScriptCoreTestsToT.test_failure] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:700: [TestRunJavaScriptCoreTestsToT.test_failure] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:708: [TestRunJavaScriptCoreTestsToT.test_skip] Passing unexpected keyword argument 'state_string' in function call [pylint/E1123] [5] ERROR: Tools/BuildSlaveSupport/ews-build/steps_unittest.py:708: [TestRunJavaScriptCoreTestsToT.test_skip] No value passed for parameter 'status_text' in function call [pylint/E1120] [5] Total errors found: 20 in 4 files If any of these errors are false positives, please file a bug against check-webkit-style. 1441206 4 aakash_jain 2018-07-11 12:02:55 -0700 Style checker warnings are false positive. 1441211 5 aakash_jain 2018-07-11 12:26:10 -0700 > We should also analyze the test results from all the re-runs, that would be in a separate step. I was exploring if Build Factory can access step results and do the analysis, but it seems like they can not be. See: https://lists.buildbot.net/pipermail/devel/2018-July/012543.html The other option suggested here is to have one step dynamically add next step, but I think in this case that would result in confusing and unreadable code. Adding a separate step to do the analysis of all the re-runs seems like the best option. 1441388 6 344755 commit-queue 2018-07-11 21:08:27 -0700 Comment on attachment 344755 Proposed patch Clearing flags on attachment: 344755 Committed r233757: <https://trac.webkit.org/changeset/233757> 1441389 7 commit-queue 2018-07-11 21:08:29 -0700 All reviewed patches have been landed. Closing bug. 1441390 8 webkit-bug-importer 2018-07-11 21:09:20 -0700 <rdar://problem/42102573> 344755 2018-07-10 22:49:10 -0700 2018-07-11 21:08:27 -0700 Proposed patch ews_jsc_rerun.patch text/plain 11572 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDIzMzcyMSkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDIzIEBACisyMDE4LTA3LTEwICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBbZXdzLWJ1aWxkXSBFV1Mgc2hvdWxkIHVuYXBwbHkgcGF0Y2ggYW5kIHJl LXJ1biBqc2MgdGVzdHMgd2hlbiBwYXRjaCBmYWlscyBqc2MgdGVzdHMKKyAgICAgICAgaHR0cHM6 Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTE4NzU0OQorCisgICAgICAgIFJldmll d2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAgICAgICogQnVpbGRTbGF2ZVN1cHBvcnQvZXdz LWJ1aWxkL2ZhY3Rvcmllcy5weToKKyAgICAgICAgKEpTQ1Rlc3RzRmFjdG9yeS5fX2luaXRfXyk6 CisgICAgICAgICogQnVpbGRTbGF2ZVN1cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzLnB5OgorICAgICAg ICAoQ29tcGlsZUpTQ09ubHlUb1QpOiBCdWlsZCBUb1Qgd2l0aG91dCBwYXRjaC4KKyAgICAgICAg KENvbXBpbGVKU0NPbmx5VG9ULmRvU3RlcElmKTogUnVuIHRoaXMgc3RlcCBvbmx5IGlmIHBhdGNo IGZhaWxlZCB0byBidWlsZC4KKyAgICAgICAgKFJ1bkphdmFTY3JpcHRDb3JlVGVzdHMuZXZhbHVh dGVDb21tYW5kKTogU2V0IHBhdGNoRmFpbGVkSlNDVGVzdHMgcHJvcGVydHkgYXBwcm9wcmlhdGVs eS4KKyAgICAgICAgKFJlUnVuSmF2YVNjcmlwdENvcmVUZXN0cyk6IFJlLXJ1bnMgSlNDIHRlc3Rz LgorICAgICAgICAoUmVSdW5KYXZhU2NyaXB0Q29yZVRlc3RzLmRvU3RlcElmKTogUnVuIHRoaXMg c3RlcCBvbmx5IGlmIHBhdGNoIGZhaWxlZCBKU0MgdGVzdHMuCisgICAgICAgIChSZVJ1bkphdmFT Y3JpcHRDb3JlVGVzdHMuZXZhbHVhdGVDb21tYW5kKTogU2V0IHBhdGNoRmFpbGVkSlNDVGVzdHMg cHJvcGVydHkgYXBwcm9wcmlhdGVseS4KKyAgICAgICAgKFJ1bkphdmFTY3JpcHRDb3JlVGVzdHNU b1QpOiBSdW4gSlNDIHRlc3RzIG9uIFRvVCB3aXRob3V0IHBhdGNoLgorICAgICAgICAoUnVuSmF2 YVNjcmlwdENvcmVUZXN0c1RvVC5kb1N0ZXBJZik6IFJ1biB0aGlzIHN0ZXAgb25seSBpZiBwYXRj aCBmYWlsZWQgSlNDIHRlc3RzLgorICAgICAgICAqIEJ1aWxkU2xhdmVTdXBwb3J0L2V3cy1idWls ZC9zdGVwc191bml0dGVzdC5weTogQWRkZWQgdW5pdC10ZXN0cy4KKwogMjAxOC0wNy0xMCAgQWFr YXNoIEphaW4gIDxhYWthc2hfamFpbkBhcHBsZS5jb20+CiAKICAgICAgICAgW2V3cy1idWlsZF0g QWRkIGJ1aWxkIHN0ZXAgdG8gVW5BcHBseSBwYXRjaApJbmRleDogVG9vbHMvQnVpbGRTbGF2ZVN1 cHBvcnQvZXdzLWJ1aWxkL2ZhY3Rvcmllcy5weQo9PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9CdWlsZFNs YXZlU3VwcG9ydC9ld3MtYnVpbGQvZmFjdG9yaWVzLnB5CShyZXZpc2lvbiAyMzM3MjEpCisrKyBU b29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3MtYnVpbGQvZmFjdG9yaWVzLnB5CSh3b3JraW5nIGNv cHkpCkBAIC02OSw3ICs2OSwxMiBAQCBjbGFzcyBKU0NUZXN0c0ZhY3RvcnkoRmFjdG9yeSk6CiAg ICAgZGVmIF9faW5pdF9fKHNlbGYsIHBsYXRmb3JtLCBjb25maWd1cmF0aW9uPSdyZWxlYXNlJywg YXJjaGl0ZWN0dXJlcz1Ob25lLCBhZGRpdGlvbmFsQXJndW1lbnRzPU5vbmUsICoqa3dhcmdzKToK ICAgICAgICAgRmFjdG9yeS5fX2luaXRfXyhzZWxmLCBwbGF0Zm9ybSwgY29uZmlndXJhdGlvbiwg YXJjaGl0ZWN0dXJlcywgRmFsc2UsIGFkZGl0aW9uYWxBcmd1bWVudHMpCiAgICAgICAgIHNlbGYu YWRkU3RlcChDb21waWxlSlNDT25seSgpKQorICAgICAgICBzZWxmLmFkZFN0ZXAoVW5BcHBseVBh dGNoSWZSZXF1aXJlZCgpKQorICAgICAgICBzZWxmLmFkZFN0ZXAoQ29tcGlsZUpTQ09ubHlUb1Qo KSkKICAgICAgICAgc2VsZi5hZGRTdGVwKFJ1bkphdmFTY3JpcHRDb3JlVGVzdHMoKSkKKyAgICAg ICAgc2VsZi5hZGRTdGVwKFJlUnVuSmF2YVNjcmlwdENvcmVUZXN0cygpKQorICAgICAgICBzZWxm LmFkZFN0ZXAoVW5BcHBseVBhdGNoSWZSZXF1aXJlZCgpKQorICAgICAgICBzZWxmLmFkZFN0ZXAo UnVuSmF2YVNjcmlwdENvcmVUZXN0c1RvVCgpKQogCiAKIGNsYXNzIEdUS0ZhY3RvcnkoRmFjdG9y eSk6CkluZGV4OiBUb29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3MtYnVpbGQvc3RlcHMucHkKPT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PQotLS0gVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvZXdzLWJ1aWxkL3N0ZXBzLnB5CShy ZXZpc2lvbiAyMzM3MjEpCisrKyBUb29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3MtYnVpbGQvc3Rl cHMucHkJKHdvcmtpbmcgY29weSkKQEAgLTczLDcgKzczLDcgQEAgY2xhc3MgVW5BcHBseVBhdGNo SWZSZXF1aXJlZChDaGVja091dFNvdQogICAgICAgICBzdXBlcihVbkFwcGx5UGF0Y2hJZlJlcXVp cmVkLCBzZWxmKS5fX2luaXRfXyhhbHdheXNVc2VMYXRlc3Q9VHJ1ZSwgKiprd2FyZ3MpCiAKICAg ICBkZWYgZG9TdGVwSWYoc2VsZiwgc3RlcCk6Ci0gICAgICAgIHJldHVybiBzZWxmLmdldFByb3Bl cnR5KCdwYXRjaEZhaWxlZFRvQnVpbGQnKSBvciBzZWxmLmdldFByb3BlcnR5KCdwYXRjaEZhaWxl ZFRlc3RzJykKKyAgICAgICAgcmV0dXJuIHNlbGYuZ2V0UHJvcGVydHkoJ3BhdGNoRmFpbGVkVG9C dWlsZCcpIG9yIHNlbGYuZ2V0UHJvcGVydHkoJ3BhdGNoRmFpbGVkSlNDVGVzdHMnKQogCiAgICAg ZGVmIGhpZGVTdGVwSWYoc2VsZiwgcmVzdWx0cywgc3RlcCk6CiAgICAgICAgIHJldHVybiBub3Qg c2VsZi5kb1N0ZXBJZihzdGVwKQpAQCAtMTY5LDYgKzE2OSwxNiBAQCBjbGFzcyBDb21waWxlSlND T25seShDb21waWxlV2ViS2l0KToKICAgICBjb21tYW5kID0gWyJwZXJsIiwgIlRvb2xzL1Njcmlw dHMvYnVpbGQtanNjIiwgV2l0aFByb3BlcnRpZXMoIi0tJShjb25maWd1cmF0aW9uKXMiKV0KIAog CitjbGFzcyBDb21waWxlSlNDT25seVRvVChDb21waWxlSlNDT25seSk6CisgICAgbmFtZSA9ICdi dWlsZC1qc2MtdG90JworCisgICAgZGVmIGRvU3RlcElmKHNlbGYsIHN0ZXApOgorICAgICAgICBy ZXR1cm4gc2VsZi5nZXRQcm9wZXJ0eSgncGF0Y2hGYWlsZWRUb0J1aWxkJykKKworICAgIGRlZiBo aWRlU3RlcElmKHNlbGYsIHJlc3VsdHMsIHN0ZXApOgorICAgICAgICByZXR1cm4gbm90IHNlbGYu ZG9TdGVwSWYoc3RlcCkKKworCiBjbGFzcyBSdW5KYXZhU2NyaXB0Q29yZVRlc3RzKHNoZWxsLlRl c3QpOgogICAgIG5hbWUgPSAnanNjb3JlLXRlc3QnCiAgICAgZGVzY3JpcHRpb24gPSBbJ2pzY29y ZS10ZXN0cyBydW5uaW5nJ10KQEAgLTE4Miw2ICsxOTIsMzggQEAgY2xhc3MgUnVuSmF2YVNjcmlw dENvcmVUZXN0cyhzaGVsbC5UZXN0KQogICAgICAgICBhcHBlbmRDdXN0b21CdWlsZEZsYWdzKHNl bGYsIHNlbGYuZ2V0UHJvcGVydHkoJ3BsYXRmb3JtJyksIHNlbGYuZ2V0UHJvcGVydHkoJ2Z1bGxQ bGF0Zm9ybScpKQogICAgICAgICByZXR1cm4gc2hlbGwuVGVzdC5zdGFydChzZWxmKQogCisgICAg ZGVmIGV2YWx1YXRlQ29tbWFuZChzZWxmLCBjbWQpOgorICAgICAgICBpZiBjbWQuZGlkRmFpbCgp OgorICAgICAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgncGF0Y2hGYWlsZWRKU0NUZXN0cycsIFRy dWUpCisKKyAgICAgICAgcmV0dXJuIHN1cGVyKFJ1bkphdmFTY3JpcHRDb3JlVGVzdHMsIHNlbGYp LmV2YWx1YXRlQ29tbWFuZChjbWQpCisKKworY2xhc3MgUmVSdW5KYXZhU2NyaXB0Q29yZVRlc3Rz KFJ1bkphdmFTY3JpcHRDb3JlVGVzdHMpOgorICAgIG5hbWUgPSAnanNjb3JlLXRlc3QtcmVydW4n CisKKyAgICBkZWYgZG9TdGVwSWYoc2VsZiwgc3RlcCk6CisgICAgICAgIHJldHVybiBzZWxmLmdl dFByb3BlcnR5KCdwYXRjaEZhaWxlZEpTQ1Rlc3RzJykKKworICAgIGRlZiBoaWRlU3RlcElmKHNl bGYsIHJlc3VsdHMsIHN0ZXApOgorICAgICAgICByZXR1cm4gbm90IHNlbGYuZG9TdGVwSWYoc3Rl cCkKKworICAgIGRlZiBldmFsdWF0ZUNvbW1hbmQoc2VsZiwgY21kKToKKyAgICAgICAgc2VsZi5z ZXRQcm9wZXJ0eSgncGF0Y2hGYWlsZWRKU0NUZXN0cycsIGNtZC5kaWRGYWlsKCkpCisgICAgICAg IHJldHVybiBzdXBlcihSdW5KYXZhU2NyaXB0Q29yZVRlc3RzLCBzZWxmKS5ldmFsdWF0ZUNvbW1h bmQoY21kKQorCisKK2NsYXNzIFJ1bkphdmFTY3JpcHRDb3JlVGVzdHNUb1QoUnVuSmF2YVNjcmlw dENvcmVUZXN0cyk6CisgICAgbmFtZSA9ICdqc2NvcmUtdGVzdC10b3QnCisgICAganNvbkZpbGVO YW1lID0gJ2pzY19yZXN1bHRzLmpzb24nCisgICAgY29tbWFuZCA9IFsncGVybCcsICdUb29scy9T Y3JpcHRzL3J1bi1qYXZhc2NyaXB0Y29yZS10ZXN0cycsICctLW5vLWZhaWwtZmFzdCcsICctLWpz b24tb3V0cHV0PXswfScuZm9ybWF0KGpzb25GaWxlTmFtZSksIFdpdGhQcm9wZXJ0aWVzKCctLSUo Y29uZmlndXJhdGlvbilzJyldCisKKyAgICBkZWYgZG9TdGVwSWYoc2VsZiwgc3RlcCk6CisgICAg ICAgIHJldHVybiBzZWxmLmdldFByb3BlcnR5KCdwYXRjaEZhaWxlZEpTQ1Rlc3RzJykKKworICAg IGRlZiBoaWRlU3RlcElmKHNlbGYsIHJlc3VsdHMsIHN0ZXApOgorICAgICAgICByZXR1cm4gbm90 IHNlbGYuZG9TdGVwSWYoc3RlcCkKKwogCiBjbGFzcyBDbGVhbkJ1aWxkKHNoZWxsLkNvbXBpbGUp OgogICAgIG5hbWUgPSAiZGVsZXRlLVdlYktpdEJ1aWxkLWRpcmVjdG9yeSIKSW5kZXg6IFRvb2xz L0J1aWxkU2xhdmVTdXBwb3J0L2V3cy1idWlsZC9zdGVwc191bml0dGVzdC5weQo9PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 Ci0tLSBUb29scy9CdWlsZFNsYXZlU3VwcG9ydC9ld3MtYnVpbGQvc3RlcHNfdW5pdHRlc3QucHkJ KHJldmlzaW9uIDIzMzcyMSkKKysrIFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2V3cy1idWlsZC9z dGVwc191bml0dGVzdC5weQkod29ya2luZyBjb3B5KQpAQCAtNDgwLDYgKzQ4MCw1MiBAQCBjbGFz cyBUZXN0Q29tcGlsZUpTQ09ubHkoQnVpbGRTdGVwTWl4aW5BCiAgICAgICAgIHJldHVybiBzZWxm LnJ1blN0ZXAoKQogCiAKK2NsYXNzIFRlc3RDb21waWxlSlNDT25seVRvVChCdWlsZFN0ZXBNaXhp bkFkZGl0aW9ucywgdW5pdHRlc3QuVGVzdENhc2UpOgorICAgIGRlZiBzZXRVcChzZWxmKToKKyAg ICAgICAgc2VsZi5sb25nTWVzc2FnZSA9IFRydWUKKyAgICAgICAgcmV0dXJuIHNlbGYuc2V0VXBC dWlsZFN0ZXAoKQorCisgICAgZGVmIHRlYXJEb3duKHNlbGYpOgorICAgICAgICByZXR1cm4gc2Vs Zi50ZWFyRG93bkJ1aWxkU3RlcCgpCisKKyAgICBkZWYgdGVzdF9zdWNjZXNzKHNlbGYpOgorICAg ICAgICBzZWxmLnNldHVwU3RlcChDb21waWxlSlNDT25seVRvVCgpKQorICAgICAgICBzZWxmLnNl dFByb3BlcnR5KCdmdWxsUGxhdGZvcm0nLCAnanNjLW9ubHknKQorICAgICAgICBzZWxmLnNldFBy b3BlcnR5KCdjb25maWd1cmF0aW9uJywgJ3JlbGVhc2UnKQorICAgICAgICBzZWxmLnNldFByb3Bl cnR5KCdwYXRjaEZhaWxlZFRvQnVpbGQnLCAnVHJ1ZScpCisgICAgICAgIHNlbGYuZXhwZWN0UmVt b3RlQ29tbWFuZHMoCisgICAgICAgICAgICBFeHBlY3RTaGVsbCh3b3JrZGlyPSd3a2RpcicsCisg ICAgICAgICAgICAgICAgICAgICAgICBjb21tYW5kPVsncGVybCcsICdUb29scy9TY3JpcHRzL2J1 aWxkLWpzYycsICctLXJlbGVhc2UnXSwKKyAgICAgICAgICAgICAgICAgICAgICAgICkKKyAgICAg ICAgICAgICsgMCwKKyAgICAgICAgKQorICAgICAgICBzZWxmLmV4cGVjdE91dGNvbWUocmVzdWx0 PVNVQ0NFU1MsIHN0YXRlX3N0cmluZz0nY29tcGlsZWQnKQorICAgICAgICByZXR1cm4gc2VsZi5y dW5TdGVwKCkKKworICAgIGRlZiB0ZXN0X2ZhaWx1cmUoc2VsZik6CisgICAgICAgIHNlbGYuc2V0 dXBTdGVwKENvbXBpbGVKU0NPbmx5VG9UKCkpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2Z1 bGxQbGF0Zm9ybScsICdqc2Mtb25seScpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2NvbmZp Z3VyYXRpb24nLCAnZGVidWcnKQorICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdwYXRjaEZhaWxl ZFRvQnVpbGQnLCAnVHJ1ZScpCisgICAgICAgIHNlbGYuZXhwZWN0UmVtb3RlQ29tbWFuZHMoCisg ICAgICAgICAgICBFeHBlY3RTaGVsbCh3b3JrZGlyPSd3a2RpcicsCisgICAgICAgICAgICAgICAg ICAgICAgICBjb21tYW5kPVsncGVybCcsICdUb29scy9TY3JpcHRzL2J1aWxkLWpzYycsICctLWRl YnVnJ10sCisgICAgICAgICAgICAgICAgICAgICAgICApCisgICAgICAgICAgICArIEV4cGVjdFNo ZWxsLmxvZygnc3RkaW8nLCBzdGRvdXQ9JzEgZXJyb3IgZ2VuZXJhdGVkLicpCisgICAgICAgICAg ICArIDIsCisgICAgICAgICkKKyAgICAgICAgc2VsZi5leHBlY3RPdXRjb21lKHJlc3VsdD1GQUlM VVJFLCBzdGF0ZV9zdHJpbmc9J2NvbXBpbGVkIChmYWlsdXJlKScpCisgICAgICAgIHJldHVybiBz ZWxmLnJ1blN0ZXAoKQorCisgICAgZGVmIHRlc3Rfc2tpcChzZWxmKToKKyAgICAgICAgc2VsZi5z ZXR1cFN0ZXAoQ29tcGlsZUpTQ09ubHlUb1QoKSkKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgn ZnVsbFBsYXRmb3JtJywgJ2pzYy1vbmx5JykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnY29u ZmlndXJhdGlvbicsICdkZWJ1ZycpCisgICAgICAgIHNlbGYuZXhwZWN0SGlkZGVuKFRydWUpCisg ICAgICAgIHNlbGYuZXhwZWN0T3V0Y29tZShyZXN1bHQ9U0tJUFBFRCwgc3RhdGVfc3RyaW5nPSdj b21waWxlZCAoc2tpcHBlZCknKQorICAgICAgICByZXR1cm4gc2VsZi5ydW5TdGVwKCkKKworCiBj bGFzcyBUZXN0UnVuSmF2YVNjcmlwdENvcmVUZXN0cyhCdWlsZFN0ZXBNaXhpbkFkZGl0aW9ucywg dW5pdHRlc3QuVGVzdENhc2UpOgogICAgIGRlZiBzZXRVcChzZWxmKToKICAgICAgICAgc2VsZi5s b25nTWVzc2FnZSA9IFRydWUKQEAgLTUxOSw1ICs1NjUsMTAzIEBAIGNsYXNzIFRlc3RSdW5KYXZh U2NyaXB0Q29yZVRlc3RzKEJ1aWxkU3QKICAgICAgICAgcmV0dXJuIHNlbGYucnVuU3RlcCgpCiAK IAorY2xhc3MgVGVzdFJlUnVuSmF2YVNjcmlwdENvcmVUZXN0cyhCdWlsZFN0ZXBNaXhpbkFkZGl0 aW9ucywgdW5pdHRlc3QuVGVzdENhc2UpOgorICAgIGRlZiBzZXRVcChzZWxmKToKKyAgICAgICAg c2VsZi5sb25nTWVzc2FnZSA9IFRydWUKKyAgICAgICAgc2VsZi5qc29uRmlsZU5hbWUgPSAnanNj X3Jlc3VsdHMuanNvbicKKyAgICAgICAgcmV0dXJuIHNlbGYuc2V0VXBCdWlsZFN0ZXAoKQorCisg ICAgZGVmIHRlYXJEb3duKHNlbGYpOgorICAgICAgICByZXR1cm4gc2VsZi50ZWFyRG93bkJ1aWxk U3RlcCgpCisKKyAgICBkZWYgdGVzdF9zdWNjZXNzKHNlbGYpOgorICAgICAgICBzZWxmLnNldHVw U3RlcChSZVJ1bkphdmFTY3JpcHRDb3JlVGVzdHMoKSkKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0 eSgnZnVsbFBsYXRmb3JtJywgJ2pzYy1vbmx5JykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgn Y29uZmlndXJhdGlvbicsICdyZWxlYXNlJykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgncGF0 Y2hGYWlsZWRKU0NUZXN0cycsICdUcnVlJykKKyAgICAgICAgc2VsZi5leHBlY3RSZW1vdGVDb21t YW5kcygKKyAgICAgICAgICAgIEV4cGVjdFNoZWxsKHdvcmtkaXI9J3drZGlyJywKKyAgICAgICAg ICAgICAgICAgICAgICAgIGNvbW1hbmQ9WydwZXJsJywgJ1Rvb2xzL1NjcmlwdHMvcnVuLWphdmFz Y3JpcHRjb3JlLXRlc3RzJywgJy0tbm8tYnVpbGQnLCAnLS1uby1mYWlsLWZhc3QnLCAnLS1qc29u LW91dHB1dD17MH0nLmZvcm1hdChzZWxmLmpzb25GaWxlTmFtZSksICctLXJlbGVhc2UnXSwKKyAg ICAgICAgICAgICAgICAgICAgICAgIGxvZ2ZpbGVzPXsnanNvbic6IHNlbGYuanNvbkZpbGVOYW1l fSwKKyAgICAgICAgICAgICAgICAgICAgICAgICkKKyAgICAgICAgICAgICsgMCwKKyAgICAgICAg KQorICAgICAgICBzZWxmLmV4cGVjdE91dGNvbWUocmVzdWx0PVNVQ0NFU1MsIHN0YXRlX3N0cmlu Zz0nanNjb3JlLXRlc3RzJykKKyAgICAgICAgcmV0dXJuIHNlbGYucnVuU3RlcCgpCisKKyAgICBk ZWYgdGVzdF9mYWlsdXJlKHNlbGYpOgorICAgICAgICBzZWxmLnNldHVwU3RlcChSZVJ1bkphdmFT Y3JpcHRDb3JlVGVzdHMoKSkKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnZnVsbFBsYXRmb3Jt JywgJ2pzYy1vbmx5JykKKyAgICAgICAgc2VsZi5zZXRQcm9wZXJ0eSgnY29uZmlndXJhdGlvbics ICdkZWJ1ZycpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ3BhdGNoRmFpbGVkSlNDVGVzdHMn LCAnVHJ1ZScpCisgICAgICAgIHNlbGYuZXhwZWN0UmVtb3RlQ29tbWFuZHMoCisgICAgICAgICAg ICBFeHBlY3RTaGVsbCh3b3JrZGlyPSd3a2RpcicsCisgICAgICAgICAgICAgICAgICAgICAgICBj b21tYW5kPVsncGVybCcsICdUb29scy9TY3JpcHRzL3J1bi1qYXZhc2NyaXB0Y29yZS10ZXN0cycs ICctLW5vLWJ1aWxkJywgJy0tbm8tZmFpbC1mYXN0JywgJy0tanNvbi1vdXRwdXQ9ezB9Jy5mb3Jt YXQoc2VsZi5qc29uRmlsZU5hbWUpLCAnLS1kZWJ1ZyddLAorICAgICAgICAgICAgICAgICAgICAg ICAgbG9nZmlsZXM9eydqc29uJzogc2VsZi5qc29uRmlsZU5hbWV9LAorICAgICAgICAgICAgICAg ICAgICAgICAgKQorICAgICAgICAgICAgKyBFeHBlY3RTaGVsbC5sb2coJ3N0ZGlvJywgc3Rkb3V0 PSc5IGZhaWx1cmVzIGZvdW5kLicpCisgICAgICAgICAgICArIDIsCisgICAgICAgICkKKyAgICAg ICAgc2VsZi5leHBlY3RPdXRjb21lKHJlc3VsdD1GQUlMVVJFLCBzdGF0ZV9zdHJpbmc9J2pzY29y ZS10ZXN0cyAoZmFpbHVyZSknKQorICAgICAgICByZXR1cm4gc2VsZi5ydW5TdGVwKCkKKworICAg IGRlZiB0ZXN0X3NraXAoc2VsZik6CisgICAgICAgIHNlbGYuc2V0dXBTdGVwKFJlUnVuSmF2YVNj cmlwdENvcmVUZXN0cygpKQorICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdmdWxsUGxhdGZvcm0n LCAnanNjLW9ubHknKQorICAgICAgICBzZWxmLnNldFByb3BlcnR5KCdjb25maWd1cmF0aW9uJywg J2RlYnVnJykKKyAgICAgICAgc2VsZi5leHBlY3RIaWRkZW4oVHJ1ZSkKKyAgICAgICAgc2VsZi5l eHBlY3RPdXRjb21lKHJlc3VsdD1TS0lQUEVELCBzdGF0ZV9zdHJpbmc9J2pzY29yZS10ZXN0cyAo c2tpcHBlZCknKQorICAgICAgICByZXR1cm4gc2VsZi5ydW5TdGVwKCkKKworCitjbGFzcyBUZXN0 UnVuSmF2YVNjcmlwdENvcmVUZXN0c1RvVChCdWlsZFN0ZXBNaXhpbkFkZGl0aW9ucywgdW5pdHRl c3QuVGVzdENhc2UpOgorICAgIGRlZiBzZXRVcChzZWxmKToKKyAgICAgICAgc2VsZi5sb25nTWVz c2FnZSA9IFRydWUKKyAgICAgICAgc2VsZi5qc29uRmlsZU5hbWUgPSAnanNjX3Jlc3VsdHMuanNv bicKKyAgICAgICAgcmV0dXJuIHNlbGYuc2V0VXBCdWlsZFN0ZXAoKQorCisgICAgZGVmIHRlYXJE b3duKHNlbGYpOgorICAgICAgICByZXR1cm4gc2VsZi50ZWFyRG93bkJ1aWxkU3RlcCgpCisKKyAg ICBkZWYgdGVzdF9zdWNjZXNzKHNlbGYpOgorICAgICAgICBzZWxmLnNldHVwU3RlcChSdW5KYXZh U2NyaXB0Q29yZVRlc3RzVG9UKCkpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2Z1bGxQbGF0 Zm9ybScsICdqc2Mtb25seScpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ2NvbmZpZ3VyYXRp b24nLCAncmVsZWFzZScpCisgICAgICAgIHNlbGYuc2V0UHJvcGVydHkoJ3BhdGNoRmFpbGVkSlND VGVzdHMnLCAnVHJ1ZScpCisgICAgICAgIHNlbGYuZXhwZWN0UmVtb3RlQ29tbWFuZHMoCisgICAg ICAgICAgICBFeHBlY3RTaGVsbCh3b3JrZGlyPSd3a2RpcicsCisgICAgICAgICAgICAgICAgICAg ICAgICBjb21tYW5kPVsncGVybCcsICdUb29scy9TY3JpcHRzL3J1bi1qYXZhc2NyaXB0Y29yZS10 ZXN0cycsICctLW5vLWZhaWwtZmFzdCcsICctLWpzb24tb3V0cHV0PXswfScuZm9ybWF0KHNlbGYu anNvbkZpbGVOYW1lKSwgJy0tcmVsZWFzZSddLAorICAgICAgICAgICAgICAgICAgICAgICAgbG9n ZmlsZXM9eydqc29uJzogc2VsZi5qc29uRmlsZU5hbWV9LAorICAgICAgICAgICAgICAgICAgICAg ICAgKQorICAgICAgICAgICAgKyAwLAorICAgICAgICApCisgICAgICAgIHNlbGYuZXhwZWN0T3V0 Y29tZShyZXN1bHQ9U1VDQ0VTUywgc3RhdGVfc3RyaW5nPSdqc2NvcmUtdGVzdHMnKQorICAgICAg ICByZXR1cm4gc2VsZi5ydW5TdGVwKCkKKworICAgIGRlZiB0ZXN0X2ZhaWx1cmUoc2VsZik6Cisg ICAgICAgIHNlbGYuc2V0dXBTdGVwKFJ1bkphdmFTY3JpcHRDb3JlVGVzdHNUb1QoKSkKKyAgICAg ICAgc2VsZi5zZXRQcm9wZXJ0eSgnZnVsbFBsYXRmb3JtJywgJ2pzYy1vbmx5JykKKyAgICAgICAg c2VsZi5zZXRQcm9wZXJ0eSgnY29uZmlndXJhdGlvbicsICdkZWJ1ZycpCisgICAgICAgIHNlbGYu c2V0UHJvcGVydHkoJ3BhdGNoRmFpbGVkSlNDVGVzdHMnLCAnVHJ1ZScpCisgICAgICAgIHNlbGYu ZXhwZWN0UmVtb3RlQ29tbWFuZHMoCisgICAgICAgICAgICBFeHBlY3RTaGVsbCh3b3JrZGlyPSd3 a2RpcicsCisgICAgICAgICAgICAgICAgICAgICAgICBjb21tYW5kPVsncGVybCcsICdUb29scy9T Y3JpcHRzL3J1bi1qYXZhc2NyaXB0Y29yZS10ZXN0cycsICctLW5vLWZhaWwtZmFzdCcsICctLWpz b24tb3V0cHV0PXswfScuZm9ybWF0KHNlbGYuanNvbkZpbGVOYW1lKSwgJy0tZGVidWcnXSwKKyAg ICAgICAgICAgICAgICAgICAgICAgIGxvZ2ZpbGVzPXsnanNvbic6IHNlbGYuanNvbkZpbGVOYW1l fSwKKyAgICAgICAgICAgICAgICAgICAgICAgICkKKyAgICAgICAgICAgICsgRXhwZWN0U2hlbGwu bG9nKCdzdGRpbycsIHN0ZG91dD0nOSBmYWlsdXJlcyBmb3VuZC4nKQorICAgICAgICAgICAgKyAy LAorICAgICAgICApCisgICAgICAgIHNlbGYuZXhwZWN0T3V0Y29tZShyZXN1bHQ9RkFJTFVSRSwg c3RhdGVfc3RyaW5nPSdqc2NvcmUtdGVzdHMgKGZhaWx1cmUpJykKKyAgICAgICAgcmV0dXJuIHNl bGYucnVuU3RlcCgpCisKKyAgICBkZWYgdGVzdF9za2lwKHNlbGYpOgorICAgICAgICBzZWxmLnNl dHVwU3RlcChSdW5KYXZhU2NyaXB0Q29yZVRlc3RzVG9UKCkpCisgICAgICAgIHNlbGYuc2V0UHJv cGVydHkoJ2Z1bGxQbGF0Zm9ybScsICdqc2Mtb25seScpCisgICAgICAgIHNlbGYuc2V0UHJvcGVy dHkoJ2NvbmZpZ3VyYXRpb24nLCAnZGVidWcnKQorICAgICAgICBzZWxmLmV4cGVjdEhpZGRlbihU cnVlKQorICAgICAgICBzZWxmLmV4cGVjdE91dGNvbWUocmVzdWx0PVNLSVBQRUQsIHN0YXRlX3N0 cmluZz0nanNjb3JlLXRlc3RzIChza2lwcGVkKScpCisgICAgICAgIHJldHVybiBzZWxmLnJ1blN0 ZXAoKQorCisKIGlmIF9fbmFtZV9fID09ICdfX21haW5fXyc6CiAgICAgdW5pdHRlc3QubWFpbigp Cg==