73843 2011-12-05 10:41:04 -0800 nrwt exits early too frequently 2012-06-11 14:18:21 -0700 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) Unspecified Unspecified RESOLVED FIXED P2 Normal --- 88680 1 rniwa dpranke abarth aroben dpranke eric jberlin lforschler ojan ossy simon.fraser webkit.review.bot oldest_to_newest 515184 0 rniwa 2011-12-05 10:41:04 -0800 Exiting early after a mere 20+ tests timed out or crashed seems too disruptive. This has happened very frequently on Mac port for example: http://build.webkit.org/builders/SnowLeopard%20Intel%20Release%20%28Tests%29?numbuilds=100 We probably need to tolerate more tests to time out / crash. 515193 1 117899 rniwa 2011-12-05 10:47:33 -0800 Created attachment 117899 Patch 515206 2 aroben 2011-12-05 11:02:07 -0800 Part of the point of this policy was to avoid slowing down the bots too much when some low-level crash is introduced in WebKit. In many cases, all 20 tests will have crashed for the same reason, and any other tests that would have been run would also have crashed for the same reason, so running more tests doesn't give more diagnostic information. And since we have to wait for Crash Reporter for each crashed test, running more tests can significantly slow down the bots. 515209 3 eric 2011-12-05 11:03:57 -0800 I don't think you want to change this. At least not unless you fix https://bugs.webkit.org/show_bug.cgi?id=37797. But I don't think we want that behavior on the bots anyway. 515211 4 rniwa 2011-12-05 11:05:00 -0800 (In reply to comment #2) > Part of the point of this policy was to avoid slowing down the bots too much when some low-level crash is introduced in WebKit. In many cases, all 20 tests will have crashed for the same reason, and any other tests that would have been run would also have crashed for the same reason, so running more tests doesn't give more diagnostic information. And since we have to wait for Crash Reporter for each crashed test, running more tests can significantly slow down the bots. Right. However, in the world where we have multiple worker processes, 20 might be unrealistically low since many tests that get paged out temporarily will end up taking much longer time to run. This problem might go away once you add more RAM to Mac bots. For example, I haven't had this issue on my MacPro (has 12GB of RAM). 515214 5 eric 2011-12-05 11:07:04 -0800 It is possible we should re-evaluate this for the multi-proesss world. 515280 6 dpranke 2011-12-05 12:22:17 -0800 I don't think we need to re-evaluate this. I think we need to fix the bugs that are causing these timeouts. For comparison, we don't have these issues on the chromium bots, and no one has found the exit-early behavior to be a problem. 644979 7 ojan 2012-06-08 13:23:08 -0700 (In reply to comment #6) > I don't think we need to re-evaluate this. I think we need to fix the bugs that are causing these timeouts. If we can fix the underlying issues, that's clearly the best resolution. > For comparison, we don't have these issues on the chromium bots, and no one has found the exit-early behavior to be a problem. Is this just because we have a lot of tests listed as expected to timeout/crash flakily so they don't contribute to the count? 645158 8 146669 dpranke 2012-06-08 17:52:30 -0700 Created attachment 146669 Patch 645159 9 dpranke 2012-06-08 17:53:03 -0700 rniwa / ojan, please take a look? 645169 10 146673 dpranke 2012-06-08 18:14:53 -0700 Created attachment 146673 change 0 to None 645180 11 146673 dpranke 2012-06-08 18:26:24 -0700 Comment on attachment 146673 change 0 to None setting cq- because we should update the chromium bots to pass these flags first. 645217 12 146673 ojan 2012-06-08 19:42:15 -0700 Comment on attachment 146673 change 0 to None I'd prefer a test showing that None does what we think it does. 645442 13 dpranke 2012-06-09 20:17:37 -0700 (In reply to comment #12) > (From update of attachment 146673 [details]) > I'd prefer a test showing that None does what we think it does. I'm not entirely sure what you're looking for? It's the default argument, so the code path is being executed. However, I'm not sure how we would demonstrate that we never exit early? Given that there are many tests that include failures, is that sufficient? E.g., run_webkit_tests_integrationtest.MainTest.test_all shows that we run all of the tests and that N of them fail ... 645544 14 ojan 2012-06-10 09:09:11 -0700 (In reply to comment #13) > (In reply to comment #12) > > (From update of attachment 146673 [details] [details]) > > I'd prefer a test showing that None does what we think it does. > > I'm not entirely sure what you're looking for? It's the default argument, so the code path is being executed. However, I'm not sure how we would demonstrate that we never exit early? Given that there are many tests that include failures, is that sufficient? E.g., run_webkit_tests_integrationtest.MainTest.test_all shows that we run all of the tests and that N of them fail ... You're right. I didn't think it through very well. 646253 15 146673 webkit.review.bot 2012-06-11 14:18:15 -0700 Comment on attachment 146673 change 0 to None Clearing flags on attachment: 146673 Committed r120007: <http://trac.webkit.org/changeset/120007> 646254 16 webkit.review.bot 2012-06-11 14:18:21 -0700 All reviewed patches have been landed. Closing bug. 117899 2011-12-05 10:47:33 -0800 2012-06-08 17:52:26 -0700 Patch bug-73843-20111205104732.patch text/plain 1400 rniwa SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDEwMjAxNCkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDE0IEBACisyMDExLTEyLTA1ICBSeW9zdWtlIE5pd2EgIDxybml3YUB3ZWJraXQub3JnPgor CisgICAgICAgIG5yd3QgZXhpdHMgZWFybHkgdG9vIGZyZXF1ZW50bHkKKyAgICAgICAgaHR0cHM6 Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTczODQzCisKKyAgICAgICAgUmV2aWV3 ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgSW5jcmVhc2UgdGhlIG51bWJlciBvZiBj cmFzaGVzIGFuZCB0aW1lb3V0cyB0byB0b2xlcmFuY2UgZnJvbSAyMCB0byAxMDAuCisKKyAgICAg ICAgKiBCdWlsZFNsYXZlU3VwcG9ydC9idWlsZC53ZWJraXQub3JnLWNvbmZpZy9tYXN0ZXIuY2Zn OgorCiAyMDExLTEyLTA1ICBSeW9zdWtlIE5pd2EgIDxybml3YUB3ZWJraXQub3JnPgogCiAgICAg ICAgIFRlbXBvcmFyaWx5IHNldCAtLWNoaWxkLXByb2Nlc3M9MSBvbiBNYWMgYmVjYXVzZSAyMCsg dGVzdHMgYXJlIHRpbWluZyBvdXQKSW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2J1aWxk LndlYmtpdC5vcmctY29uZmlnL21hc3Rlci5jZmcKPT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQnVpbGRT bGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZwkocmV2aXNpb24g MTAyMDA2KQorKysgVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9yZy1jb25m aWcvbWFzdGVyLmNmZwkod29ya2luZyBjb3B5KQpAQCAtMzEzLDcgKzMxMyw3IEBAIGNsYXNzIFJ1 bldlYktpdFRlc3RzKHNoZWxsLlRlc3QpOgogICAgICAgICAgICAgICAgIi0tbWFzdGVyLW5hbWUi LCAid2Via2l0Lm9yZyIsCiAgICAgICAgICAgICAgICAiLS10ZXN0LXJlc3VsdHMtc2VydmVyIiwg InRlc3QtcmVzdWx0cy5hcHBzcG90LmNvbSIsCiAgICAgICAgICAgICAgICBXaXRoUHJvcGVydGll cygiLS0lKGNvbmZpZ3VyYXRpb24pcyIpLAotICAgICAgICAgICAgICAgIi0tZXhpdC1hZnRlci1u LWNyYXNoZXMtb3ItdGltZW91dHMiLCAiMjAiLAorICAgICAgICAgICAgICAgIi0tZXhpdC1hZnRl ci1uLWNyYXNoZXMtb3ItdGltZW91dHMiLCAiMTAwIiwKICAgICAgICAgICAgICAgICItLWV4aXQt YWZ0ZXItbi1mYWlsdXJlcyIsICI1MDAiXQogCiAgICAgZGVmIF9faW5pdF9fKHNlbGYsIGJ1aWxk SlNDVG9vbD1UcnVlLCAqYXJncywgKiprd2FyZ3MpOgo= 146669 2012-06-08 17:52:30 -0700 2012-06-08 18:14:48 -0700 Patch bug-73843-20120608175238.patch text/plain 2927 dpranke U3VidmVyc2lvbiBSZXZpc2lvbjogMTE5ODcwCmRpZmYgLS1naXQgYS9Ub29scy9DaGFuZ2VMb2cg Yi9Ub29scy9DaGFuZ2VMb2cKaW5kZXggNjE4ZGZiNDQzM2RmNWEwM2Q3OTMxZDA5YTRhZGEwYmVi YmEwNTgzMy4uYTgyMGQzMmFmNGExODkyZThmYWE4MDI1N2Q3YTI3NmI0MWRmMTY5OSAxMDA2NDQK LS0tIGEvVG9vbHMvQ2hhbmdlTG9nCisrKyBiL1Rvb2xzL0NoYW5nZUxvZwpAQCAtMSwzICsxLDMx IEBACisyMDEyLTA2LTA4ICBEaXJrIFByYW5rZSAgPGRwcmFua2VAY2hyb21pdW0ub3JnPgorCisg ICAgICAgIG5yd3QgZXhpdHMgZWFybHkgdG9vIGZyZXF1ZW50bHkKKyAgICAgICAgaHR0cHM6Ly9i dWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTczODQzCisKKyAgICAgICAgUmV2aWV3ZWQg YnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgQ2hhbmdlIHRoZSBkZWZhdWx0cyBmb3IgbmV3 LXJ1bi13ZWJraXQtdGVzdHMgZm9yIGJvdGgKKyAgICAgICAgLS1leGl0LWFmdGVyLW4tZmFpbHVy ZXMgYW5kIC0tZXhpdC1hZnRlci1uLWNyYXNoZXMtb3ItdGltZW91dHMKKyAgICAgICAgdG8gemVy byAoaS5lLiwgd2Ugd2lsbCBuZXZlciBleGl0IGVhcmx5IGJ5IGRlZmF1bHQpLgorCisgICAgICAg IElmIHBlb3BsZSB3YW50IHRoZWlyIGJ1aWxkYm90cyB0byBleGl0IGVhcmx5IGl0IGlzIHRoZWly CisgICAgICAgIHJlc3BvbnNpYmlsaXR5IHRvIHVwZGF0ZSB0aGVpciBidWlsZGJvdCBjb25maWdz IGFwcHJvcHJpYXRlbHkuCisKKyAgICAgICAgTm90ZSB0aGF0IHdlIGhhdmUgdGVzdHMgdGhhdCBl bnN1cmUgdGhhdCB0aGVzZSBmbGFncyB3b3JrIGZvcgorICAgICAgICBub24temVybyBudW1iZXJz LCBidXQgd2UgZG9uJ3QgaGF2ZSB0ZXN0cyB0aGF0IGVpdGhlciB0ZXN0IHRoZQorICAgICAgICBk ZWZhdWx0IG9yIGVuc3VyZSB0aGF0IHplcm8gbWVhbnMgInJ1biBhbGwgb2YgdGhlIHRlc3RzIi4g SQorICAgICAgICB0aGluayB0aGF0J3Mgb2theSBidXQgY2FuIGFkZCB0ZXN0cyBpZiBvdGhlcnMg ZGlzYWdyZWUuCisKKyAgICAgICAgQWxzbyBub3RlIHRoYXQgaXQgbG9va3MgbGlrZSBubyBjaGFu Z2VzIG9uIHRoZSBidWlsZC53ZWJraXQub3JnCisgICAgICAgIG1hc3Rlci5jZmcgYXJlIG5lY2Vz c2FyeTsgYWxsIG9mIHRoZSBib3RzIHNlZW0gdG8gYmUgdXNpbmcgdGhlCisgICAgICAgIFJ1bldl YktpdFRlc3RzIHdyYXBwZXIgd2hpY2ggaXMgYWxyZWFkeSBzZXR0aW5nIHRoZSBmbGFncy4gVGhl cmUKKyAgICAgICAgaXMgYSBOZXdSdW5XZWJLaXRUZXN0cyB3cmFwcGVyLCBidXQgdGhhdCBsb29r cyB0byBiZSB1bnVzZWQ7IEkKKyAgICAgICAgd2lsbCBkZWxldGUgdGhhdCBpbiBhIHNlcGFyYXRl IHBhdGNoLgorCisgICAgICAgICogU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvcnVuX3dl YmtpdF90ZXN0cy5weToKKyAgICAgICAgKHBhcnNlX2FyZ3MpOgorCiAyMDEyLTA2LTA4ICBXZWkg SmFtZXMgIDxqYW1lcy53ZWlAaW50ZWwuY29tPgogCiAgICAgICAgIEFkZCBhcHBfYWJpIG9wdGlv biBmb3IgRHVtcFJlbmRlclRyZWVfYXBrCmRpZmYgLS1naXQgYS9Ub29scy9TY3JpcHRzL3dlYmtp dHB5L2xheW91dF90ZXN0cy9ydW5fd2Via2l0X3Rlc3RzLnB5IGIvVG9vbHMvU2NyaXB0cy93ZWJr aXRweS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0cy5weQppbmRleCBkNGVjY2IwZmFmYjk3 MTg0MGVlYmViM2FlY2I5ODI5MGE0ZjgyZGM3Li42MDk2NTRmZTY5ZjQ4MDMxYWU3NWY1YWQ0YWYw YTdmMTJjODQzOWY3IDEwMDc1NQotLS0gYS9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90 ZXN0cy9ydW5fd2Via2l0X3Rlc3RzLnB5CisrKyBiL1Rvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5 b3V0X3Rlc3RzL3J1bl93ZWJraXRfdGVzdHMucHkKQEAgLTM4MywxMSArMzgzLDExIEBAIGRlZiBw YXJzZV9hcmdzKGFyZ3M9Tm9uZSk6CiAgICAgICAgICMgRklYTUU6IERpc3BsYXkgZGVmYXVsdCBu dW1iZXIgb2YgY2hpbGQgcHJvY2Vzc2VzIHRoYXQgd2lsbCBydW4uCiAgICAgICAgIG9wdHBhcnNl Lm1ha2Vfb3B0aW9uKCItZiIsICItLWZ1bGx5LXBhcmFsbGVsIiwgYWN0aW9uPSJzdG9yZV90cnVl IiwKICAgICAgICAgICAgIGhlbHA9InJ1biBhbGwgdGVzdHMgaW4gcGFyYWxsZWwiKSwKLSAgICAg ICAgb3B0cGFyc2UubWFrZV9vcHRpb24oIi0tZXhpdC1hZnRlci1uLWZhaWx1cmVzIiwgdHlwZT0i aW50IiwgZGVmYXVsdD01MDAsCisgICAgICAgIG9wdHBhcnNlLm1ha2Vfb3B0aW9uKCItLWV4aXQt YWZ0ZXItbi1mYWlsdXJlcyIsIHR5cGU9ImludCIsIGRlZmF1bHQ9MCwKICAgICAgICAgICAgIGhl bHA9IkV4aXQgYWZ0ZXIgdGhlIGZpcnN0IE4gZmFpbHVyZXMgaW5zdGVhZCBvZiBydW5uaW5nIGFs bCAiCiAgICAgICAgICAgICAidGVzdHMiKSwKICAgICAgICAgb3B0cGFyc2UubWFrZV9vcHRpb24o Ii0tZXhpdC1hZnRlci1uLWNyYXNoZXMtb3ItdGltZW91dHMiLCB0eXBlPSJpbnQiLAotICAgICAg ICAgICAgZGVmYXVsdD0yMCwgaGVscD0iRXhpdCBhZnRlciB0aGUgZmlyc3QgTiBjcmFzaGVzIGlu c3RlYWQgb2YgIgorICAgICAgICAgICAgZGVmYXVsdD0wLCBoZWxwPSJFeGl0IGFmdGVyIHRoZSBm aXJzdCBOIGNyYXNoZXMgaW5zdGVhZCBvZiAiCiAgICAgICAgICAgICAicnVubmluZyBhbGwgdGVz dHMiKSwKICAgICAgICAgb3B0cGFyc2UubWFrZV9vcHRpb24oIi0taXRlcmF0aW9ucyIsIHR5cGU9 ImludCIsIGhlbHA9Ik51bWJlciBvZiB0aW1lcyB0byBydW4gdGhlIHNldCBvZiB0ZXN0cyAoZS5n LiBBQkNBQkNBQkMpIiksCiAgICAgICAgIG9wdHBhcnNlLm1ha2Vfb3B0aW9uKCItLXJlcGVhdC1l YWNoIiwgdHlwZT0iaW50IiwgaGVscD0iTnVtYmVyIG9mIHRpbWVzIHRvIHJ1biBlYWNoIHRlc3Qg KGUuZy4gQUFBQkJCQ0NDKSIpLAo= 146673 2012-06-08 18:14:53 -0700 2012-06-11 14:18:15 -0700 change 0 to None bug-73843-20120608181500.patch text/plain 2933 dpranke U3VidmVyc2lvbiBSZXZpc2lvbjogMTE5ODcwCmRpZmYgLS1naXQgYS9Ub29scy9DaGFuZ2VMb2cg Yi9Ub29scy9DaGFuZ2VMb2cKaW5kZXggNjE4ZGZiNDQzM2RmNWEwM2Q3OTMxZDA5YTRhZGEwYmVi YmEwNTgzMy4uYTgyMGQzMmFmNGExODkyZThmYWE4MDI1N2Q3YTI3NmI0MWRmMTY5OSAxMDA2NDQK LS0tIGEvVG9vbHMvQ2hhbmdlTG9nCisrKyBiL1Rvb2xzL0NoYW5nZUxvZwpAQCAtMSwzICsxLDMx IEBACisyMDEyLTA2LTA4ICBEaXJrIFByYW5rZSAgPGRwcmFua2VAY2hyb21pdW0ub3JnPgorCisg ICAgICAgIG5yd3QgZXhpdHMgZWFybHkgdG9vIGZyZXF1ZW50bHkKKyAgICAgICAgaHR0cHM6Ly9i dWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTczODQzCisKKyAgICAgICAgUmV2aWV3ZWQg YnkgTk9CT0RZIChPT1BTISkuCisKKyAgICAgICAgQ2hhbmdlIHRoZSBkZWZhdWx0cyBmb3IgbmV3 LXJ1bi13ZWJraXQtdGVzdHMgZm9yIGJvdGgKKyAgICAgICAgLS1leGl0LWFmdGVyLW4tZmFpbHVy ZXMgYW5kIC0tZXhpdC1hZnRlci1uLWNyYXNoZXMtb3ItdGltZW91dHMKKyAgICAgICAgdG8gemVy byAoaS5lLiwgd2Ugd2lsbCBuZXZlciBleGl0IGVhcmx5IGJ5IGRlZmF1bHQpLgorCisgICAgICAg IElmIHBlb3BsZSB3YW50IHRoZWlyIGJ1aWxkYm90cyB0byBleGl0IGVhcmx5IGl0IGlzIHRoZWly CisgICAgICAgIHJlc3BvbnNpYmlsaXR5IHRvIHVwZGF0ZSB0aGVpciBidWlsZGJvdCBjb25maWdz IGFwcHJvcHJpYXRlbHkuCisKKyAgICAgICAgTm90ZSB0aGF0IHdlIGhhdmUgdGVzdHMgdGhhdCBl bnN1cmUgdGhhdCB0aGVzZSBmbGFncyB3b3JrIGZvcgorICAgICAgICBub24temVybyBudW1iZXJz LCBidXQgd2UgZG9uJ3QgaGF2ZSB0ZXN0cyB0aGF0IGVpdGhlciB0ZXN0IHRoZQorICAgICAgICBk ZWZhdWx0IG9yIGVuc3VyZSB0aGF0IHplcm8gbWVhbnMgInJ1biBhbGwgb2YgdGhlIHRlc3RzIi4g SQorICAgICAgICB0aGluayB0aGF0J3Mgb2theSBidXQgY2FuIGFkZCB0ZXN0cyBpZiBvdGhlcnMg ZGlzYWdyZWUuCisKKyAgICAgICAgQWxzbyBub3RlIHRoYXQgaXQgbG9va3MgbGlrZSBubyBjaGFu Z2VzIG9uIHRoZSBidWlsZC53ZWJraXQub3JnCisgICAgICAgIG1hc3Rlci5jZmcgYXJlIG5lY2Vz c2FyeTsgYWxsIG9mIHRoZSBib3RzIHNlZW0gdG8gYmUgdXNpbmcgdGhlCisgICAgICAgIFJ1bldl YktpdFRlc3RzIHdyYXBwZXIgd2hpY2ggaXMgYWxyZWFkeSBzZXR0aW5nIHRoZSBmbGFncy4gVGhl cmUKKyAgICAgICAgaXMgYSBOZXdSdW5XZWJLaXRUZXN0cyB3cmFwcGVyLCBidXQgdGhhdCBsb29r cyB0byBiZSB1bnVzZWQ7IEkKKyAgICAgICAgd2lsbCBkZWxldGUgdGhhdCBpbiBhIHNlcGFyYXRl IHBhdGNoLgorCisgICAgICAgICogU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvcnVuX3dl YmtpdF90ZXN0cy5weToKKyAgICAgICAgKHBhcnNlX2FyZ3MpOgorCiAyMDEyLTA2LTA4ICBXZWkg SmFtZXMgIDxqYW1lcy53ZWlAaW50ZWwuY29tPgogCiAgICAgICAgIEFkZCBhcHBfYWJpIG9wdGlv biBmb3IgRHVtcFJlbmRlclRyZWVfYXBrCmRpZmYgLS1naXQgYS9Ub29scy9TY3JpcHRzL3dlYmtp dHB5L2xheW91dF90ZXN0cy9ydW5fd2Via2l0X3Rlc3RzLnB5IGIvVG9vbHMvU2NyaXB0cy93ZWJr aXRweS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0cy5weQppbmRleCBkNGVjY2IwZmFmYjk3 MTg0MGVlYmViM2FlY2I5ODI5MGE0ZjgyZGM3Li40OGZiNDNmZjAxZmE1ZjM2YjQ0Mjk3ODVjNGEx OWU1ODRhYWE1Y2VlIDEwMDc1NQotLS0gYS9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90 ZXN0cy9ydW5fd2Via2l0X3Rlc3RzLnB5CisrKyBiL1Rvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5 b3V0X3Rlc3RzL3J1bl93ZWJraXRfdGVzdHMucHkKQEAgLTM4MywxMSArMzgzLDExIEBAIGRlZiBw YXJzZV9hcmdzKGFyZ3M9Tm9uZSk6CiAgICAgICAgICMgRklYTUU6IERpc3BsYXkgZGVmYXVsdCBu dW1iZXIgb2YgY2hpbGQgcHJvY2Vzc2VzIHRoYXQgd2lsbCBydW4uCiAgICAgICAgIG9wdHBhcnNl Lm1ha2Vfb3B0aW9uKCItZiIsICItLWZ1bGx5LXBhcmFsbGVsIiwgYWN0aW9uPSJzdG9yZV90cnVl IiwKICAgICAgICAgICAgIGhlbHA9InJ1biBhbGwgdGVzdHMgaW4gcGFyYWxsZWwiKSwKLSAgICAg ICAgb3B0cGFyc2UubWFrZV9vcHRpb24oIi0tZXhpdC1hZnRlci1uLWZhaWx1cmVzIiwgdHlwZT0i aW50IiwgZGVmYXVsdD01MDAsCisgICAgICAgIG9wdHBhcnNlLm1ha2Vfb3B0aW9uKCItLWV4aXQt YWZ0ZXItbi1mYWlsdXJlcyIsIHR5cGU9ImludCIsIGRlZmF1bHQ9Tm9uZSwKICAgICAgICAgICAg IGhlbHA9IkV4aXQgYWZ0ZXIgdGhlIGZpcnN0IE4gZmFpbHVyZXMgaW5zdGVhZCBvZiBydW5uaW5n IGFsbCAiCiAgICAgICAgICAgICAidGVzdHMiKSwKICAgICAgICAgb3B0cGFyc2UubWFrZV9vcHRp b24oIi0tZXhpdC1hZnRlci1uLWNyYXNoZXMtb3ItdGltZW91dHMiLCB0eXBlPSJpbnQiLAotICAg ICAgICAgICAgZGVmYXVsdD0yMCwgaGVscD0iRXhpdCBhZnRlciB0aGUgZmlyc3QgTiBjcmFzaGVz IGluc3RlYWQgb2YgIgorICAgICAgICAgICAgZGVmYXVsdD1Ob25lLCBoZWxwPSJFeGl0IGFmdGVy IHRoZSBmaXJzdCBOIGNyYXNoZXMgaW5zdGVhZCBvZiAiCiAgICAgICAgICAgICAicnVubmluZyBh bGwgdGVzdHMiKSwKICAgICAgICAgb3B0cGFyc2UubWFrZV9vcHRpb24oIi0taXRlcmF0aW9ucyIs IHR5cGU9ImludCIsIGhlbHA9Ik51bWJlciBvZiB0aW1lcyB0byBydW4gdGhlIHNldCBvZiB0ZXN0 cyAoZS5nLiBBQkNBQkNBQkMpIiksCiAgICAgICAgIG9wdHBhcnNlLm1ha2Vfb3B0aW9uKCItLXJl cGVhdC1lYWNoIiwgdHlwZT0iaW50IiwgaGVscD0iTnVtYmVyIG9mIHRpbWVzIHRvIHJ1biBlYWNo IHRlc3QgKGUuZy4gQUFBQkJCQ0NDKSIpLAo=