<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugs.webkit.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4.1"
          urlbase="https://bugs.webkit.org/"
          
          maintainer="admin@webkit.org"
>

    <bug>
          <bug_id>64812</bug_id>
          
          <creation_ts>2011-07-19 10:33:10 -0700</creation_ts>
          <short_desc>Buildbot marks a nrwt bot red when tests are missing results</short_desc>
          <delta_ts>2011-09-19 11:02:19 -0700</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>WebKit</product>
          <component>Tools / Tests</component>
          <version>528+ (Nightly build)</version>
          <rep_platform>Unspecified</rep_platform>
          <op_sys>Unspecified</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P1</priority>
          <bug_severity>Critical</bug_severity>
          <target_milestone>---</target_milestone>
          <dependson>67268</dependson>
    
    <dependson>67855</dependson>
    
    <dependson>68247</dependson>
          <blocked>34984</blocked>
    
    <blocked>64491</blocked>
          <everconfirmed>1</everconfirmed>
          <reporter name="Ryosuke Niwa">rniwa</reporter>
          <assigned_to name="Ryosuke Niwa">rniwa</assigned_to>
          <cc>abarth</cc>
    
    <cc>aroben</cc>
    
    <cc>dpranke</cc>
    
    <cc>eric</cc>
    
    <cc>kbalazs</cc>
    
    <cc>kkristof</cc>
    
    <cc>ossy</cc>
    
    <cc>tony</cc>
    
    <cc>webkit.review.bot</cc>
    
    <cc>wsiegrist</cc>
          

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>439239</commentid>
    <comment_count>0</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 10:33:10 -0700</bug_when>
    <thetext>Missing expected results should only make the bots orange, not red.

You can see this on:
http://build.webkit.org/builders/Qt%20Linux%20Release/builds/35535</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439250</commentid>
    <comment_count>1</comment_count>
      <attachid>101342</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 10:41:51 -0700</bug_when>
    <thetext>Created attachment 101342
fixes the bug</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439252</commentid>
    <comment_count>2</comment_count>
      <attachid>101342</attachid>
    <who name="Tony Chang">tony</who>
    <bug_when>2011-07-19 10:46:49 -0700</bug_when>
    <thetext>Comment on attachment 101342
fixes the bug

View in context: https://bugs.webkit.org/attachment.cgi?id=101342&amp;action=review

&gt; Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:319
&gt; -                if result != FAILURE and (line.find(&apos;were flaky&apos;) &gt;= 0 or line.find(&apos;new passes&apos;) &gt;= 0):
&gt; +                if result != FAILURE and (line.find(&apos;flakes&apos;) &gt;= 0 or line.find(&apos;new passes&apos;) &gt;= 0 or line.find(&apos;missing results&apos;) &gt;= 0):
&gt;                      result = WARNINGS
&gt;                  else:
&gt;                      result = FAILURE

Nit: Can we just return on FAILURE and remove the check in the warnings code?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439276</commentid>
    <comment_count>3</comment_count>
      <attachid>101342</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 11:18:02 -0700</bug_when>
    <thetext>Comment on attachment 101342
fixes the bug

View in context: https://bugs.webkit.org/attachment.cgi?id=101342&amp;action=review

&gt;&gt; Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:319

&gt; 
&gt; Nit: Can we just return on FAILURE and remove the check in the warnings code?

Ok, will do.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439278</commentid>
    <comment_count>4</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 11:21:56 -0700</bug_when>
    <thetext>Committed r91273: &lt;http://trac.webkit.org/changeset/91273&gt;</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439287</commentid>
    <comment_count>5</comment_count>
    <who name="Adam Roben (:aroben)">aroben</who>
    <bug_when>2011-07-19 11:31:51 -0700</bug_when>
    <thetext>*** Bug 64514 has been marked as a duplicate of this bug. ***</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439312</commentid>
    <comment_count>6</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 11:49:34 -0700</bug_when>
    <thetext>Apparently, there is a bug.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439422</commentid>
    <comment_count>7</comment_count>
      <attachid>101378</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 13:51:15 -0700</bug_when>
    <thetext>Created attachment 101378
more fixes</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>439581</commentid>
    <comment_count>8</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-19 18:12:06 -0700</bug_when>
    <thetext>Ping reviwers</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>440291</commentid>
    <comment_count>9</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-20 23:54:05 -0700</bug_when>
    <thetext>Committed r91448: &lt;http://trac.webkit.org/changeset/91448&gt;</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>442872</commentid>
    <comment_count>10</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-07-27 05:34:46 -0700</bug_when>
    <thetext>Reopen, because it doesn&apos;t work now. :((

http://build.webkit.org/builders/Qt%20Linux%20Release/builds/35809
There is one new test, but the bot is red.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>442873</commentid>
    <comment_count>11</comment_count>
      <attachid>101378</attachid>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-07-27 05:35:07 -0700</bug_when>
    <thetext>Comment on attachment 101378
more fixes

remove r+ from landed patch</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>442976</commentid>
    <comment_count>12</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-27 09:41:57 -0700</bug_when>
    <thetext>(In reply to comment #10)
&gt; Reopen, because it doesn&apos;t work now. :((
&gt; 
&gt; http://build.webkit.org/builders/Qt%20Linux%20Release/builds/35809
&gt; There is one new test, but the bot is red.

This is because nrwt exited with 1:
http://build.webkit.org/builders/Qt%20Linux%20Release/builds/35809/steps/layout-test/logs/stdio

2011-07-27 04:00:24,024 31623 run_webkit_tests.py:110 DEBUG Testing completed, Exit status: 1
program finished with exit code 1
elapsedTime=1324.734859

Adam, does nrwt return 1 when there are missing results?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>443005</commentid>
    <comment_count>13</comment_count>
    <who name="Adam Barth">abarth</who>
    <bug_when>2011-07-27 10:52:23 -0700</bug_when>
    <thetext>Dunno.  That&apos;s a question for Eric.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>443011</commentid>
    <comment_count>14</comment_count>
    <who name="Tony Chang">tony</who>
    <bug_when>2011-07-27 11:01:39 -0700</bug_when>
    <thetext>(In reply to comment #12)
&gt; Adam, does nrwt return 1 when there are missing results?

Yes, because on build.chromium.org, missing results causes red (the gardener then adds it to test_expectations.txt or adds a baseline).

Isn&apos;t it normally a mistake of the committer to forget expected results?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>443013</commentid>
    <comment_count>15</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-07-27 11:04:44 -0700</bug_when>
    <thetext>(In reply to comment #14)
&gt; (In reply to comment #12)
&gt; &gt; Adam, does nrwt return 1 when there are missing results?
&gt; 
&gt; Yes, because on build.chromium.org, missing results causes red (the gardener then adds it to test_expectations.txt or adds a baseline).
&gt; 
&gt; Isn&apos;t it normally a mistake of the committer to forget expected results?

This is problem because committers land only mac specific expected 
results, and after it platform maintainers land platform specific results.
We can&apos;t guarantee 0-24 gardeners for all ports.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>443028</commentid>
    <comment_count>16</comment_count>
    <who name="Tony Chang">tony</who>
    <bug_when>2011-07-27 11:22:59 -0700</bug_when>
    <thetext>(In reply to comment #15)
&gt; (In reply to comment #14)
&gt; &gt; (In reply to comment #12)
&gt; &gt; &gt; Adam, does nrwt return 1 when there are missing results?
&gt; &gt; 
&gt; &gt; Yes, because on build.chromium.org, missing results causes red (the gardener then adds it to test_expectations.txt or adds a baseline).
&gt; &gt; 
&gt; &gt; Isn&apos;t it normally a mistake of the committer to forget expected results?
&gt; 
&gt; This is problem because committers land only mac specific expected 
&gt; results, and after it platform maintainers land platform specific results.
&gt; We can&apos;t guarantee 0-24 gardeners for all ports.

I see, the chromium ports all fall back to the mac results, so it doesn&apos;t have this problem.  Maybe we should special case the error if it&apos;s chromium.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>443041</commentid>
    <comment_count>17</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-07-27 11:40:36 -0700</bug_when>
    <thetext>(In reply to comment #16)
&gt; I see, the chromium ports all fall back to the mac results, so it doesn&apos;t have this problem.  Maybe we should special case the error if it&apos;s chromium.

That sounds like a good idea.

I&apos;ll note that I&apos;ve been frequently annoyed by this error because sometimes people just add -expected.txt and not -expected.png but we have to wait and ask patch authors if the pixel results are correct or not.  So it might be worth changing the behavior on chromium as well.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>448032</commentid>
    <comment_count>18</comment_count>
    <who name="Eric Seidel (no email)">eric</who>
    <bug_when>2011-08-08 09:17:36 -0700</bug_when>
    <thetext>What is the behavioral difference?  Does NRWT exit 1 while ORWT exit&apos;d 0?  Or is it just a parsing difference in the buildbot code?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>448034</commentid>
    <comment_count>19</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-08-08 09:20:56 -0700</bug_when>
    <thetext>(In reply to comment #18)
&gt; Does NRWT exit 1 while ORWT exit&apos;d 0?

Yes.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>448037</commentid>
    <comment_count>20</comment_count>
    <who name="Eric Seidel (no email)">eric</who>
    <bug_when>2011-08-08 09:24:57 -0700</bug_when>
    <thetext>Well, if we&apos;re dumping out new results by default like ORWT did, then it seems we could also exit 0.  Should be a very simple change to make.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>448042</commentid>
    <comment_count>21</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-08-08 09:30:44 -0700</bug_when>
    <thetext>(In reply to comment #20)
&gt; Well, if we&apos;re dumping out new results by default like ORWT did, then it seems we could also exit 0.  Should be a very simple change to make.

Tony says we should probably keep the old for chromium port or should modify build.chromium.org/chromium.webkit/ to still make the bots turn red.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>448048</commentid>
    <comment_count>22</comment_count>
    <who name="Eric Seidel (no email)">eric</who>
    <bug_when>2011-08-08 09:42:39 -0700</bug_when>
    <thetext>Make it so. :)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>448050</commentid>
    <comment_count>23</comment_count>
    <who name="Tony Chang">tony</who>
    <bug_when>2011-08-08 09:50:14 -0700</bug_when>
    <thetext>(In reply to comment #21)
&gt; (In reply to comment #20)
&gt; &gt; Well, if we&apos;re dumping out new results by default like ORWT did, then it seems we could also exit 0.  Should be a very simple change to make.
&gt; 
&gt; Tony says we should probably keep the old for chromium port or should modify build.chromium.org/chromium.webkit/ to still make the bots turn red.

Specifically, if the chromium bots go red because of a missing result, it&apos;s normally because someone checked in a pixel test without any pixel results.  This seems like a valid reason to go red.

We could also test for the difference between a pixel test without any pixel results (tree red) vs a pixel test without pixel results for the platform being tested (tree orange), although I&apos;m not sure it&apos;s worth the code complexity.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>457001</commentid>
    <comment_count>24</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-08-25 11:04:03 -0700</bug_when>
    <thetext>It is critical for the Qt port. 

We don&apos;t want red bots because of new tests for hours. We don&apos;t have 0-24 gardener for checking new tests, so only the orange bot is acceptable.

Kristóf, could you pick up this bug, and fix it ASAP? Please 
try to find a way make Qt and Chromium folks happy too.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>459499</commentid>
    <comment_count>25</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-08-31 01:00:43 -0700</bug_when>
    <thetext>It should block &quot;new-run-webkit-tests: MASTER BUG: Switch all webkit.org bots over&quot; too. I&apos;m sceptic a little bit why we (Qt) use NRWT, because it is slower than ORWT and it is always red because of new tests ...</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464462</commentid>
    <comment_count>26</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-08 16:07:03 -0700</bug_when>
    <thetext>Okay, let&apos;s just return the cmd.rc for now.  I think that&apos;s a net win for now since we&apos;ve never seen a case nrwt went wary and didn&apos;t spit out any line that doesn&apos;t match my regexes.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464464</commentid>
    <comment_count>27</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-08 16:07:18 -0700</bug_when>
    <thetext>(In reply to comment #26)
&gt; Okay, let&apos;s just return the cmd.rc for now.  I think that&apos;s a net win for now since we&apos;ve never seen a case nrwt went wary and didn&apos;t spit out any line that doesn&apos;t match my regexes.

I mean let&apos;s just ignore* cmd.rc.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464474</commentid>
    <comment_count>28</comment_count>
      <attachid>106811</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-08 16:15:22 -0700</bug_when>
    <thetext>Created attachment 106811
Patch</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464479</commentid>
    <comment_count>29</comment_count>
    <who name="Tony Chang">tony</who>
    <bug_when>2011-09-08 16:24:01 -0700</bug_when>
    <thetext>Are we able to tell if the process crashed?  E.g., someone made a change to NRWT that raises an exception?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464483</commentid>
    <comment_count>30</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-08 16:29:50 -0700</bug_when>
    <thetext>(In reply to comment #29)
&gt; Are we able to tell if the process crashed?  E.g., someone made a change to NRWT that raises an exception?

We&apos;ll see the bots turn orange so we should be able to.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464488</commentid>
    <comment_count>31</comment_count>
      <attachid>106811</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-08 16:36:01 -0700</bug_when>
    <thetext>Comment on attachment 106811
Patch

I found a root cause of this.  Let me fix it...</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464546</commentid>
    <comment_count>32</comment_count>
      <attachid>106823</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-08 18:03:02 -0700</bug_when>
    <thetext>Created attachment 106823
fixes this bug for good</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464760</commentid>
    <comment_count>33</comment_count>
      <attachid>106823</attachid>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-09 06:17:55 -0700</bug_when>
    <thetext>Comment on attachment 106823
fixes this bug for good

View in context: https://bugs.webkit.org/attachment.cgi?id=106823&amp;action=review

r- now, because it isn&apos;t the real fix.

&gt; Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:333
&gt; +            for line in self.incorrectLayoutLines:
&gt; +                if line.find(&apos;flakes&apos;) &gt;= 0 or line.find(&apos;new passes&apos;) &gt;= 0 or line.find(&apos;missing results&apos;) &gt;= 0:
&gt; +                    result = WARNINGS
&gt; +                else:
&gt; +                    return FAILURE
&gt;  
&gt;          if cmd.rc != 0:
&gt;              return FAILURE

If there are 5 new test, but 0 real failure, then result will 
be WARNINGS, but cmd.rc == 5 will cause return FAILURE.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464763</commentid>
    <comment_count>34</comment_count>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-09 06:27:15 -0700</bug_when>
    <thetext>(In reply to comment #33)
We should subtract the count of new/flakes tests from the cmd.rc
&gt; (From update of attachment 106823 [details])
&gt; View in context: https://bugs.webkit.org/attachment.cgi?id=106823&amp;action=review
&gt; 
&gt; r- now, because it isn&apos;t the real fix.
&gt; 
&gt; &gt; Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:333
                 count_of_new_tests = 0
                 count_of_flakey_tests = 0
&gt; &gt; +            for line in self.incorrectLayoutLines:
                     count_of_new_tests += line.find(&apos;new passes&apos;) + line.find(&apos;missing results&apos;) &gt;= 0
                     count_of_flakey_tests += line.find(&apos;flakes&apos;)
                     if count_of_new_tests + count_of_flakey_tests &gt;= 0:
&gt; &gt; +                    result = WARNINGS
&gt; &gt; +                else:
&gt; &gt; +                    return FAILURE
&gt; &gt;  
            if cmd.rc - (count_of_new_tests + count_of_flakey_tests) != 0:
&gt; &gt;              return FAILURE
&gt; 
&gt; If there are 5 new test, but 0 real failure, then result will 
&gt; be WARNINGS, but cmd.rc == 5 will cause return FAILURE.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464765</commentid>
    <comment_count>35</comment_count>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-09 06:29:53 -0700</bug_when>
    <thetext>(In reply to comment #34)
I mistyped.
count_of_new_tests += line.find(&apos;new passes&apos;) + line.find(&apos;missing results&apos;)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464767</commentid>
    <comment_count>36</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-09 06:37:38 -0700</bug_when>
    <thetext>Kristof, the idea is good, but unfortunately the return code of ORWT can be 0 or 1. Only NRWT returns the number of the failing tests.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464779</commentid>
    <comment_count>37</comment_count>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-09 07:30:56 -0700</bug_when>
    <thetext>(In reply to comment #36)
&gt; Kristof, the idea is good, but unfortunately the return code of ORWT can be 0 or 1. Only NRWT returns the number of the failing tests.

In that case we have two way to fix it:
 * check which rwt has run
    maybe like here:
      def commandComplete(self, cmd):
          shell.Test.commandComplete(self, cmd)

          logText = cmd.logs[&apos;stdio&apos;].getText()
          if logText.find(&quot;Collecting tests ...&quot;) &gt;= 0:
              self._parseNewRunWebKitTestsOutput(logText)
          else:
              self._parseOldRunWebKitTestsOutput(logText)

 * the NRWT returns with the subtracted result instead of the number of the unexpected results</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464788</commentid>
    <comment_count>38</comment_count>
    <who name="Adam Roben (:aroben)">aroben</who>
    <bug_when>2011-09-09 07:45:38 -0700</bug_when>
    <thetext>This seems like a silly difference to have between NRWT and ORWT. I&apos;d be in favor of changing NRWT to match ORWT&apos;s behavior. But I guess ORWT is going away &quot;soon&quot;.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464791</commentid>
    <comment_count>39</comment_count>
    <who name="Eric Seidel (no email)">eric</who>
    <bug_when>2011-09-09 07:46:56 -0700</bug_when>
    <thetext>Soon is still a ways off, sadly.  But I am actually working on it again. :)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464858</commentid>
    <comment_count>40</comment_count>
      <attachid>106823</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-09 10:10:38 -0700</bug_when>
    <thetext>Comment on attachment 106823
fixes this bug for good

View in context: https://bugs.webkit.org/attachment.cgi?id=106823&amp;action=review

&gt;&gt;&gt; Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:333
&gt;&gt;&gt;              return FAILURE
&gt;&gt; 
&gt;&gt; If there are 5 new test, but 0 real failure, then result will 
&gt;&gt; be WARNINGS, but cmd.rc == 5 will cause return FAILURE.
&gt; 
&gt; count_of_new_tests = 0
&gt;                  count_of_flakey_tests = 0

Nope. Because of recent nrwt change, nrwt no longer report missing. It always report them as flaky.

Also, we should fix nrwt to return 0 when some tests are missing results.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>464865</commentid>
    <comment_count>41</comment_count>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-09 10:13:46 -0700</bug_when>
    <thetext>I guess I can move that patch to elsewhere since it doesn&apos;t really match this bug.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>465540</commentid>
    <comment_count>42</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-12 02:43:31 -0700</bug_when>
    <thetext>(In reply to comment #41)
&gt; I guess I can move that patch to elsewhere since it doesn&apos;t really match this bug.

This change was necessary, but not enough to fix this bug.
( landed in http://trac.webkit.org/changeset/94868 )</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466881</commentid>
    <comment_count>43</comment_count>
      <attachid>107299</attachid>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-14 00:17:05 -0700</bug_when>
    <thetext>Created attachment 107299
proposed fix</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466893</commentid>
    <comment_count>44</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-14 00:41:27 -0700</bug_when>
    <thetext>(In reply to comment #43)
&gt; Created an attachment (id=107299) [details]
&gt; proposed fix

LGTM. Ryosuke, what do you think about it?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466895</commentid>
    <comment_count>45</comment_count>
      <attachid>107299</attachid>
    <who name="Ryosuke Niwa">rniwa</who>
    <bug_when>2011-09-14 00:43:08 -0700</bug_when>
    <thetext>Comment on attachment 107299
proposed fix

View in context: https://bugs.webkit.org/attachment.cgi?id=107299&amp;action=review

&gt; Tools/Scripts/webkitpy/layout_tests/controllers/manager.py:151
&gt; +                elif &apos;MISSING&apos; in actual:
&gt; +                    num_flaky += 1

I don&apos;t think we should be counting missing expectations as flaky.  That&apos;s at least semantically incorrect.  Eric or Dirk should take a look at this change.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466899</commentid>
    <comment_count>46</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-14 00:50:27 -0700</bug_when>
    <thetext>(In reply to comment #45)
&gt; (From update of attachment 107299 [details])
&gt; View in context: https://bugs.webkit.org/attachment.cgi?id=107299&amp;action=review
&gt; 
&gt; &gt; Tools/Scripts/webkitpy/layout_tests/controllers/manager.py:151
&gt; &gt; +                elif &apos;MISSING&apos; in actual:
&gt; &gt; +                    num_flaky += 1
&gt; 
&gt; I don&apos;t think we should be counting missing expectations as flaky.  That&apos;s at least semantically incorrect.  Eric or Dirk should take a look at this change.

It&apos;s true. 

But now a missing result is reported as flakey or missing depends on horoscope. :) Kristof&apos;s patch would eliminate this flakiness. It isn&apos;t the best solution, but it would make the bot orange if there is a new test without result.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466900</commentid>
    <comment_count>47</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-14 00:52:49 -0700</bug_when>
    <thetext>Kristof, could you check bug67268?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466905</commentid>
    <comment_count>48</comment_count>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-14 01:03:14 -0700</bug_when>
    <thetext>(In reply to comment #46)
&gt; (In reply to comment #45)
&gt; &gt; (From update of attachment 107299 [details] [details])
&gt; &gt; View in context: https://bugs.webkit.org/attachment.cgi?id=107299&amp;action=review
&gt; &gt; 
&gt; &gt; &gt; Tools/Scripts/webkitpy/layout_tests/controllers/manager.py:151
&gt; &gt; &gt; +                elif &apos;MISSING&apos; in actual:
&gt; &gt; &gt; +                    num_flaky += 1
&gt; &gt; 
&gt; &gt; I don&apos;t think we should be counting missing expectations as flaky.  That&apos;s at least semantically incorrect.  Eric or Dirk should take a look at this change.
&gt; 
&gt; It&apos;s true. 
&gt; 
&gt; But now a missing result is reported as flakey or missing depends on horoscope. :) Kristof&apos;s patch would eliminate this flakiness. It isn&apos;t the best solution, but it would make the bot orange if there is a new test without result.

The new tests sometimes get &apos;missing pass&apos; result, and sometimes only &apos;missing&apos;. When &apos;missing pass&apos; it report as flakey and the bot turn onrange, but when only &apos;missing&apos; it report as regression and the bot turn red.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>466926</commentid>
    <comment_count>49</comment_count>
    <who name="Balazs Kelemen">kbalazs</who>
    <bug_when>2011-09-14 01:45:55 -0700</bug_when>
    <thetext>&gt; 
&gt; The new tests sometimes get &apos;missing pass&apos; result, and sometimes only &apos;missing&apos;. When &apos;missing pass&apos; it report as flakey and the bot turn onrange, but when only &apos;missing&apos; it report as regression and the bot turn red.

I&apos;m not familiar with the problem neither with NRWT but it seems to me that you should teach NRWT that missing results are a separate category (not fail neither flaky) instead of hacking around smg that paints the bots to the color we would like.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>467389</commentid>
    <comment_count>50</comment_count>
      <attachid>107299</attachid>
    <who name="Dirk Pranke">dpranke</who>
    <bug_when>2011-09-14 15:13:30 -0700</bug_when>
    <thetext>Comment on attachment 107299
proposed fix

This bug has been open for too long and is generating too many non-Chromium red bots :(

I think this fix itself is probably the wrong thing to do, but it&apos;s better than doing nothing. Please add a FIXME: to break MISSING results into a different category. It sounds like we want different behavior on Chromium and non-Chromium bots, but even that&apos;s still up in the air.

At any rate, I&apos;ll be gardening Chromium for the next few days, so landing this will force me to fix things one way or another :)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>468427</commentid>
    <comment_count>51</comment_count>
      <attachid>107636</attachid>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-16 04:47:24 -0700</bug_when>
    <thetext>Created attachment 107636
mark missing result as flakey</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>468435</commentid>
    <comment_count>52</comment_count>
      <attachid>107636</attachid>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-16 05:03:59 -0700</bug_when>
    <thetext>Comment on attachment 107636
mark missing result as flakey

Landed in r95285.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>468486</commentid>
    <comment_count>53</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-16 08:04:29 -0700</bug_when>
    <thetext>Reopen, because it broke a webkitpy test:

 File &quot;/ramdisk/qt-linux-release/build/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests_integrationtest.py&quot;, line 718, in test_missing_results
    self.assertEquals(res, 2)
AssertionError: 0 != 2</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>468522</commentid>
    <comment_count>54</comment_count>
    <who name="Csaba Osztrogonác">ossy</who>
    <bug_when>2011-09-16 09:14:48 -0700</bug_when>
    <thetext>Reopened because it was rolled out</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>469339</commentid>
    <comment_count>55</comment_count>
      <attachid>107837</attachid>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-19 05:40:15 -0700</bug_when>
    <thetext>Created attachment 107837
mark missing results as flakey</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>469342</commentid>
    <comment_count>56</comment_count>
    <who name="WebKit Review Bot">webkit.review.bot</who>
    <bug_when>2011-09-19 05:42:20 -0700</bug_when>
    <thetext>Attachment 107837 did not pass style-queue:

Failed to run &quot;[&apos;Tools/Scripts/check-webkit-style&apos;, &apos;--diff-files&apos;, u&apos;Tools/ChangeLog&apos;, u&apos;Tools/Scripts/webkitpy...&quot; exit_code: 1

Tools/Scripts/webkitpy/layout_tests/controllers/manager.py:152:  indentation is not a multiple of four  [pep8/E111] [5]
Total errors found: 1 in 3 files


If any of these errors are false positives, please file a bug against check-webkit-style.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>469343</commentid>
    <comment_count>57</comment_count>
      <attachid>107838</attachid>
    <who name="Kristóf Kosztyó">kkristof</who>
    <bug_when>2011-09-19 05:42:38 -0700</bug_when>
    <thetext>Created attachment 107838
mark missing results as flakey</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>469533</commentid>
    <comment_count>58</comment_count>
      <attachid>107838</attachid>
    <who name="WebKit Review Bot">webkit.review.bot</who>
    <bug_when>2011-09-19 11:02:12 -0700</bug_when>
    <thetext>Comment on attachment 107838
mark missing results as flakey

Clearing flags on attachment: 107838

Committed r95441: &lt;http://trac.webkit.org/changeset/95441&gt;</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>469534</commentid>
    <comment_count>59</comment_count>
    <who name="WebKit Review Bot">webkit.review.bot</who>
    <bug_when>2011-09-19 11:02:19 -0700</bug_when>
    <thetext>All reviewed patches have been landed.  Closing bug.</thetext>
  </long_desc>
      
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>101342</attachid>
            <date>2011-07-19 10:41:51 -0700</date>
            <delta_ts>2011-07-19 13:51:12 -0700</delta_ts>
            <desc>fixes the bug</desc>
            <filename>bug-64812-20110719104150.patch</filename>
            <type>text/plain</type>
            <size>2368</size>
            <attacher name="Ryosuke Niwa">rniwa</attacher>
            
              <data encoding="base64">SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl
dmlzaW9uIDkxMjY5KQorKysgVG9vbHMvQ2hhbmdlTG9nCSh3b3JraW5nIGNvcHkpCkBAIC0xLDMg
KzEsMTkgQEAKKzIwMTEtMDctMTkgIFJ5b3N1a2UgTml3YSAgPHJuaXdhQHdlYmtpdC5vcmc+CisK
KyAgICAgICAgQnVpbGRib3QgbWFya3MgYSBucnd0IGJvdCByZWQgd2hlbiB0ZXN0cyBhcmUgbWlz
c2luZyByZXN1bHRzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNn
aT9pZD02NDgxMgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAg
ICAgIEFkZGVkICJtaXNzaW5nIHJlc3VsdHMiIGxhYmVsIGZvciB0ZXN0cyB0aGF0IGFyZSBtaXNz
aW5nIHJlc3VsdHMuCisKKyAgICAgICAgYnVpbGRib3QgTm93IHJlcG9ydHMgc2hvd3MgYSBsYWJl
bCAiWCBtaXNzaW5nIHJlc3VsdHMiIG9uIGEgcnVuIHdoZW4gWCB0ZXN0cyB3ZXJlIG1pc3NpbmcK
KyAgICAgICAgZXhwZWN0ZWQgcmVzdWx0cyBvbiB0aGF0IHJ1bi4KKworICAgICAgICBBbHNvIHJl
cGhyYXNlZCAiWCBmYWlsZWQiIGFuZCAiWCB3ZXJlIGZsYWt5IiB0byAiWCBmYWlsdXJlcyIgYW5k
ICJYIGZsYWtlcyIuCisKKyAgICAgICAgKiBCdWlsZFNsYXZlU3VwcG9ydC9idWlsZC53ZWJraXQu
b3JnLWNvbmZpZy9tYXN0ZXIuY2ZnOgorCiAyMDExLTA3LTE5ICBTYW0gV2VpbmlnICA8c2FtQHdl
YmtpdC5vcmc+CiAKICAgICAgICAgUmVtb3ZlIG9ic29sZXRlIE1hYyBOUldUIHRlc3QgYm90cwpJ
bmRleDogVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9yZy1jb25maWcvbWFz
dGVyLmNmZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9CdWlsZFNsYXZlU3VwcG9ydC9idWlsZC53ZWJr
aXQub3JnLWNvbmZpZy9tYXN0ZXIuY2ZnCShyZXZpc2lvbiA5MTI2NSkKKysrIFRvb2xzL0J1aWxk
U2xhdmVTdXBwb3J0L2J1aWxkLndlYmtpdC5vcmctY29uZmlnL21hc3Rlci5jZmcJKHdvcmtpbmcg
Y29weSkKQEAgLTIzNCw5ICsyMzQsMTAgQEAgY2xhc3MgUnVuV2ViS2l0VGVzdHMoc2hlbGwuVGVz
dCk6CiAgICAgZGVmIF9wYXJzZU5ld1J1bldlYktpdFRlc3RzT3V0cHV0KHNlbGYsIGxvZ1RleHQp
OgogICAgICAgICBpbmNvcnJlY3RMYXlvdXRMaW5lcyA9IFtdCiAgICAgICAgIGV4cHJlc3Npb25z
ID0gewotICAgICAgICAgICAgJ2ZhaWxlZCc6IHJlLmNvbXBpbGUocidSZWdyZXNzaW9uczogVW5l
eHBlY3RlZC4rOj9ccypcKChcZCspXCknKSwKLSAgICAgICAgICAgICd3ZXJlIGZsYWt5JzogcmUu
Y29tcGlsZShyJ1VuZXhwZWN0ZWQgZmxha2luZXNzLis6P1xzKlwoKFxkKylcKScpLAorICAgICAg
ICAgICAgJ2ZhaWx1cmVzJzogcmUuY29tcGlsZShyJ1JlZ3Jlc3Npb25zOiBVbmV4cGVjdGVkLis6
P1xzKlwoKFxkKylcKScpLAorICAgICAgICAgICAgJ2ZsYWtlcyc6IHJlLmNvbXBpbGUocidVbmV4
cGVjdGVkIGZsYWtpbmVzcy4rOj9ccypcKChcZCspXCknKSwKICAgICAgICAgICAgICduZXcgcGFz
c2VzJzogcmUuY29tcGlsZShyJ0V4cGVjdGVkIHRvIC4rLCBidXQgcGFzc2VkOlxzK1woKFxkKylc
KScpLAorICAgICAgICAgICAgJ21pc3NpbmcgcmVzdWx0cyc6IHJlLmNvbXBpbGUocidubyBleHBl
Y3RlZCByZXN1bHRzIGZvdW5kXHMqOlxzK1woKFxkKylcKScpLAogICAgICAgICB9CiAgICAgICAg
IHRlc3RGYWlsdXJlcyA9IHt9CiAKQEAgLTMxMiw3ICszMTMsNyBAQCBjbGFzcyBOZXdSdW5XZWJL
aXRUZXN0cyhSdW5XZWJLaXRUZXN0cyk6CiAgICAgICAgIHJlc3VsdCA9IFNVQ0NFU1MKICAgICAg
ICAgaWYgc2VsZi5pbmNvcnJlY3RMYXlvdXRMaW5lczoKICAgICAgICAgICAgIGZvciBsaW5lIGlu
IHNlbGYuaW5jb3JyZWN0TGF5b3V0TGluZXM6Ci0gICAgICAgICAgICAgICAgaWYgcmVzdWx0ICE9
IEZBSUxVUkUgYW5kIChsaW5lLmZpbmQoJ3dlcmUgZmxha3knKSA+PSAwIG9yIGxpbmUuZmluZCgn
bmV3IHBhc3NlcycpID49IDApOgorICAgICAgICAgICAgICAgIGlmIHJlc3VsdCAhPSBGQUlMVVJF
IGFuZCAobGluZS5maW5kKCdmbGFrZXMnKSA+PSAwIG9yIGxpbmUuZmluZCgnbmV3IHBhc3Nlcycp
ID49IDAgb3IgbGluZS5maW5kKCdtaXNzaW5nIHJlc3VsdHMnKSA+PSAwKToKICAgICAgICAgICAg
ICAgICAgICAgcmVzdWx0ID0gV0FSTklOR1MKICAgICAgICAgICAgICAgICBlbHNlOgogICAgICAg
ICAgICAgICAgICAgICByZXN1bHQgPSBGQUlMVVJFCg==
</data>

          </attachment>
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>101378</attachid>
            <date>2011-07-19 13:51:15 -0700</date>
            <delta_ts>2011-09-08 16:15:18 -0700</delta_ts>
            <desc>more fixes</desc>
            <filename>bug-64812-20110719135114.patch</filename>
            <type>text/plain</type>
            <size>2641</size>
            <attacher name="Ryosuke Niwa">rniwa</attacher>
            
              <data encoding="base64">SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl
dmlzaW9uIDkxMjk2KQorKysgVG9vbHMvQ2hhbmdlTG9nCSh3b3JraW5nIGNvcHkpCkBAIC0xLDMg
KzEsMTggQEAKKzIwMTEtMDctMTkgIFJ5b3N1a2UgTml3YSAgPHJuaXdhQHdlYmtpdC5vcmc+CisK
KyAgICAgICAgQnVpbGRib3QgbWFya3MgYSBucnd0IGJvdCByZWQgd2hlbiB0ZXN0cyBhcmUgbWlz
c2luZyByZXN1bHRzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNn
aT9pZD02NDgxMgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAg
ICAgIFRoZSBidWcgd2FzIGNhdXNlZCBieSBtdWx0aXBsZSBleHByZXNzaW9ucyBtYXRjaGluZyBv
biB0aGUgc2luZ2xlIG91dHB1dC4KKyAgICAgICAgRml4ZWQgaXQgYnkgZXhpdGluZyB0aGUgbG9v
cCBhcyBzb29uIGFzIG9uZSBleHByZXNzaW9uIG1hdGNoZXMuCisKKyAgICAgICAgQmVjYXVzZSB0
aGUgcmVndWxhciBleHByZXNzaW9uIGZvciAnZmFpbHVyZXMnIGlzIG1vc3QgZ2VuZXJhbCwKKyAg
ICAgICAgbW92ZWQgaXQgdG8gdGhlIGVuZCBvZiB0aGUgbGlzdCB0byBhdm9pZCBpdCBjYXRjaGlu
ZyBvdGhlciBjYXNlcy4KKworICAgICAgICAqIEJ1aWxkU2xhdmVTdXBwb3J0L2J1aWxkLndlYmtp
dC5vcmctY29uZmlnL21hc3Rlci5jZmc6CisKIDIwMTEtMDctMTkgIENhcnkgQ2xhcmsgIDxjYXJ5
Y2xhcmtAZ29vZ2xlLmNvbT4KIAogICAgICAgICBhZGQgbXlzZWxmIHRvIGNvbW1pdHRlcnMucHkK
SW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2J1aWxkLndlYmtpdC5vcmctY29uZmlnL21h
c3Rlci5jZmcKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Vi
a2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZwkocmV2aXNpb24gOTEyODIpCisrKyBUb29scy9CdWls
ZFNsYXZlU3VwcG9ydC9idWlsZC53ZWJraXQub3JnLWNvbmZpZy9tYXN0ZXIuY2ZnCSh3b3JraW5n
IGNvcHkpCkBAIC0yMzMsMjIgKzIzMywyMyBAQCBjbGFzcyBSdW5XZWJLaXRUZXN0cyhzaGVsbC5U
ZXN0KToKIAogICAgIGRlZiBfcGFyc2VOZXdSdW5XZWJLaXRUZXN0c091dHB1dChzZWxmLCBsb2dU
ZXh0KToKICAgICAgICAgaW5jb3JyZWN0TGF5b3V0TGluZXMgPSBbXQotICAgICAgICBleHByZXNz
aW9ucyA9IHsKLSAgICAgICAgICAgICdmYWlsdXJlcyc6IHJlLmNvbXBpbGUocidSZWdyZXNzaW9u
czogVW5leHBlY3RlZC4rOj9ccypcKChcZCspXCknKSwKLSAgICAgICAgICAgICdmbGFrZXMnOiBy
ZS5jb21waWxlKHInVW5leHBlY3RlZCBmbGFraW5lc3MuKzo/XHMqXCgoXGQrKVwpJyksCi0gICAg
ICAgICAgICAnbmV3IHBhc3Nlcyc6IHJlLmNvbXBpbGUocidFeHBlY3RlZCB0byAuKywgYnV0IHBh
c3NlZDpccytcKChcZCspXCknKSwKLSAgICAgICAgICAgICdtaXNzaW5nIHJlc3VsdHMnOiByZS5j
b21waWxlKHInbm8gZXhwZWN0ZWQgcmVzdWx0cyBmb3VuZFxzKjpccytcKChcZCspXCknKSwKLSAg
ICAgICAgfQorICAgICAgICBleHByZXNzaW9ucyA9IFsKKyAgICAgICAgICAgICgnZmxha2VzJywg
cmUuY29tcGlsZShyJ1VuZXhwZWN0ZWQgZmxha2luZXNzLis6P1xzKlwoKFxkKylcKScpKSwKKyAg
ICAgICAgICAgICgnbmV3IHBhc3NlcycsIHJlLmNvbXBpbGUocidFeHBlY3RlZCB0byAuKywgYnV0
IHBhc3NlZDpccytcKChcZCspXCknKSksCisgICAgICAgICAgICAoJ21pc3NpbmcgcmVzdWx0cycs
IHJlLmNvbXBpbGUocidubyBleHBlY3RlZCByZXN1bHRzIGZvdW5kXHMqOlxzK1woKFxkKylcKScp
KSwKKyAgICAgICAgICAgICgnZmFpbHVyZXMnLCByZS5jb21waWxlKHInUmVncmVzc2lvbnM6IFVu
ZXhwZWN0ZWQuKzo/XHMqXCgoXGQrKVwpJykpLAorICAgICAgICBdCiAgICAgICAgIHRlc3RGYWls
dXJlcyA9IHt9CiAKICAgICAgICAgZm9yIGxpbmUgaW4gbG9nVGV4dC5zcGxpdGxpbmVzKCk6CiAg
ICAgICAgICAgICBpZiBsaW5lLmZpbmQoJ0V4aXRpbmcgZWFybHknKSA+PSAwOgogICAgICAgICAg
ICAgICAgIGluY29ycmVjdExheW91dExpbmVzLmFwcGVuZChsaW5lKQogICAgICAgICAgICAgICAg
IGNvbnRpbnVlCi0gICAgICAgICAgICBmb3IgbmFtZSBpbiBleHByZXNzaW9uczoKLSAgICAgICAg
ICAgICAgICBtYXRjaCA9IGV4cHJlc3Npb25zW25hbWVdLnNlYXJjaChsaW5lKQorICAgICAgICAg
ICAgZm9yIG5hbWUsIGV4cHJlc3Npb24gaW4gZXhwcmVzc2lvbnM6CisgICAgICAgICAgICAgICAg
bWF0Y2ggPSBleHByZXNzaW9uLnNlYXJjaChsaW5lKQogICAgICAgICAgICAgICAgIGlmIG1hdGNo
OgogICAgICAgICAgICAgICAgICAgICB0ZXN0RmFpbHVyZXNbbmFtZV0gPSB0ZXN0RmFpbHVyZXMu
Z2V0KG5hbWUsIDApICsgaW50KG1hdGNoLmdyb3VwKDEpKQorICAgICAgICAgICAgICAgICAgICBi
cmVhawogCiAgICAgICAgICAgICAgICAgIyBGSVhNRTogUGFyc2UgZmlsZSBuYW1lcyBhbmQgcHV0
IHRoZW0gaW4gcmVzdWx0cwogCg==
</data>

          </attachment>
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>106811</attachid>
            <date>2011-09-08 16:15:22 -0700</date>
            <delta_ts>2011-09-08 16:36:01 -0700</delta_ts>
            <desc>Patch</desc>
            <filename>bug-64812-20110908161521.patch</filename>
            <type>text/plain</type>
            <size>1480</size>
            <attacher name="Ryosuke Niwa">rniwa</attacher>
            
              <data encoding="base64">SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl
dmlzaW9uIDk0ODE2KQorKysgVG9vbHMvQ2hhbmdlTG9nCSh3b3JraW5nIGNvcHkpCkBAIC0xLDMg
KzEsMTQgQEAKKzIwMTEtMDktMDggIFJ5b3N1a2UgTml3YSAgPHJuaXdhQHdlYmtpdC5vcmc+CisK
KyAgICAgICAgQnVpbGRib3QgbWFya3MgYSBucnd0IGJvdCByZWQgd2hlbiB0ZXN0cyBhcmUgbWlz
c2luZyByZXN1bHRzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNn
aT9pZD02NDgxMgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAg
ICAgIE9ubHkgd2FybiAoZG9uJ3QgZmFpbCkgd2hlbiBucnd0IHJldHVybnMgbm9uLXplcm8gZXhp
dCBjb2RlLgorCisgICAgICAgICogQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9yZy1j
b25maWcvbWFzdGVyLmNmZzoKKwogMjAxMS0wOS0wOCAgQnJpYW4gV2VpbnN0ZWluICA8YndlaW5z
dGVpbkBhcHBsZS5jb20+CiAKICAgICAgICAgV2ViS2l0MjogQXNzZXJ0aW9uIHdoZW4gY2FsbGlu
ZyBkaWRQZXJmb3JtKlJlZGlyZWN0IG9uIG51bGwgc291cmNlL2Rlc3RpbmF0aW9uIFVSTCBzdHJp
bmcKSW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2J1aWxkLndlYmtpdC5vcmctY29uZmln
L21hc3Rlci5jZmcKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQu
d2Via2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZwkocmV2aXNpb24gOTQ4MDYpCisrKyBUb29scy9C
dWlsZFNsYXZlU3VwcG9ydC9idWlsZC53ZWJraXQub3JnLWNvbmZpZy9tYXN0ZXIuY2ZnCSh3b3Jr
aW5nIGNvcHkpCkBAIC0zNTUsMTAgKzM1NSwxMSBAQCBjbGFzcyBOZXdSdW5XZWJLaXRUZXN0cyhS
dW5XZWJLaXRUZXN0cyk6CiAgICAgICAgIHNlbGYuX3BhcnNlTmV3UnVuV2ViS2l0VGVzdHNPdXRw
dXQobG9nVGV4dCkKIAogICAgIGRlZiBldmFsdWF0ZUNvbW1hbmQoc2VsZiwgY21kKToKKyAgICAg
ICAgcmVzdWx0ID0gU1VDQ0VTUworCiAgICAgICAgIGlmIGNtZC5yYyAhPSAwOgotICAgICAgICAg
ICAgcmV0dXJuIEZBSUxVUkUKKyAgICAgICAgICAgIHJlc3VsdCA9IFdBUk5JTkdTCiAKLSAgICAg
ICAgcmVzdWx0ID0gU1VDQ0VTUwogICAgICAgICBpZiBzZWxmLmluY29ycmVjdExheW91dExpbmVz
OgogICAgICAgICAgICAgZm9yIGxpbmUgaW4gc2VsZi5pbmNvcnJlY3RMYXlvdXRMaW5lczoKICAg
ICAgICAgICAgICAgICBpZiBsaW5lLmZpbmQoJ2ZsYWtlcycpID49IDAgb3IgbGluZS5maW5kKCdu
ZXcgcGFzc2VzJykgPj0gMCBvciBsaW5lLmZpbmQoJ21pc3NpbmcgcmVzdWx0cycpID49IDA6Cg==
</data>

          </attachment>
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>106823</attachid>
            <date>2011-09-08 18:03:02 -0700</date>
            <delta_ts>2011-09-09 10:17:33 -0700</delta_ts>
            <desc>fixes this bug for good</desc>
            <filename>bug-64812-20110908180301.patch</filename>
            <type>text/plain</type>
            <size>2875</size>
            <attacher name="Ryosuke Niwa">rniwa</attacher>
            
              <data encoding="base64">SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl
dmlzaW9uIDk0ODIzKQorKysgVG9vbHMvQ2hhbmdlTG9nCSh3b3JraW5nIGNvcHkpCkBAIC0xLDMg
KzEsMTcgQEAKKzIwMTEtMDktMDggIFJ5b3N1a2UgTml3YSAgPHJuaXdhQHdlYmtpdC5vcmc+CisK
KyAgICAgICAgQnVpbGRib3QgbWFya3MgYSBucnd0IGJvdCByZWQgd2hlbiB0ZXN0cyBhcmUgbWlz
c2luZyByZXN1bHRzCisgICAgICAgIGh0dHBzOi8vYnVncy53ZWJraXQub3JnL3Nob3dfYnVnLmNn
aT9pZD02NDgxMgorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisgICAg
ICAgIFRoZSBidWcgd2FzIGNhdXNlZCBieSB0aGUgZmFjdCBzb21lIHBvcnRzIHVzZSBSdW5XZWJL
aXRUZXN0cyBpbnN0ZWFkIG9mIE5ld1J1bldlYktpdFRlc3RzIHRvIHJ1biB0ZXN0cywKKyAgICAg
ICAgYW5kIHVzaW5nIFJ1bldlYktpdFRlc3RzLmV2YWx1YXRlQ29tbWFuZCBhZnRlciBjYWxsaW5n
IF9wYXJzZU5ld1J1bldlYktpdFRlc3RzT3V0cHV0LgorCisgICAgICAgIEZpeGVkIHRoZSBidWcg
YnkgbWVyZ2luZyBldmFsdWF0ZUNvbW1hbmQgb2YgUnVuV2ViS2l0VGVzdHMgYW5kIE5ld1J1bldl
YktpdFRlc3RzLgorCisgICAgICAgICogQnVpbGRTbGF2ZVN1cHBvcnQvYnVpbGQud2Via2l0Lm9y
Zy1jb25maWcvbWFzdGVyLmNmZzoKKwogMjAxMS0wOS0wOCAgQnJpYW4gV2VpbnN0ZWluICA8Yndl
aW5zdGVpbkBhcHBsZS5jb20+CiAKICAgICAgICAgV2ViS2l0MjogQXNzZXJ0aW9uIHdoZW4gY2Fs
bGluZyBkaWRQZXJmb3JtKlJlZGlyZWN0IG9uIG51bGwgc291cmNlL2Rlc3RpbmF0aW9uIFVSTCBz
dHJpbmcKSW5kZXg6IFRvb2xzL0J1aWxkU2xhdmVTdXBwb3J0L2J1aWxkLndlYmtpdC5vcmctY29u
ZmlnL21hc3Rlci5jZmcKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09
PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gVG9vbHMvQnVpbGRTbGF2ZVN1cHBvcnQvYnVp
bGQud2Via2l0Lm9yZy1jb25maWcvbWFzdGVyLmNmZwkocmV2aXNpb24gOTQ4MDYpCisrKyBUb29s
cy9CdWlsZFNsYXZlU3VwcG9ydC9idWlsZC53ZWJraXQub3JnLWNvbmZpZy9tYXN0ZXIuY2ZnCSh3
b3JraW5nIGNvcHkpCkBAIC0zMTUsMTggKzMxNSwyNCBAQCBjbGFzcyBSdW5XZWJLaXRUZXN0cyhz
aGVsbC5UZXN0KToKICAgICAgICAgICAgIHNlbGYuX3BhcnNlT2xkUnVuV2ViS2l0VGVzdHNPdXRw
dXQobG9nVGV4dCkKIAogICAgIGRlZiBldmFsdWF0ZUNvbW1hbmQoc2VsZiwgY21kKToKKyAgICAg
ICAgcmVzdWx0ID0gU1VDQ0VTUworCiAgICAgICAgIGlmIHNlbGYuaW5jb3JyZWN0TGF5b3V0TGlu
ZXM6CiAgICAgICAgICAgICBpZiBsZW4oc2VsZi5pbmNvcnJlY3RMYXlvdXRMaW5lcykgPT0gMToK
ICAgICAgICAgICAgICAgICBsaW5lID0gc2VsZi5pbmNvcnJlY3RMYXlvdXRMaW5lc1swXQogICAg
ICAgICAgICAgICAgIGlmIGxpbmUuZmluZCgnd2VyZSBuZXcnKSA+PSAwIG9yIGxpbmUuZmluZCgn
d2FzIG5ldycpID49IDAgb3IgbGluZS5maW5kKCcgbGVhaycpID49IDA6CiAgICAgICAgICAgICAg
ICAgICAgIHJldHVybiBXQVJOSU5HUwogCi0gICAgICAgICAgICByZXR1cm4gRkFJTFVSRQorICAg
ICAgICAgICAgZm9yIGxpbmUgaW4gc2VsZi5pbmNvcnJlY3RMYXlvdXRMaW5lczoKKyAgICAgICAg
ICAgICAgICBpZiBsaW5lLmZpbmQoJ2ZsYWtlcycpID49IDAgb3IgbGluZS5maW5kKCduZXcgcGFz
c2VzJykgPj0gMCBvciBsaW5lLmZpbmQoJ21pc3NpbmcgcmVzdWx0cycpID49IDA6CisgICAgICAg
ICAgICAgICAgICAgIHJlc3VsdCA9IFdBUk5JTkdTCisgICAgICAgICAgICAgICAgZWxzZToKKyAg
ICAgICAgICAgICAgICAgICAgcmV0dXJuIEZBSUxVUkUKIAogICAgICAgICBpZiBjbWQucmMgIT0g
MDoKICAgICAgICAgICAgIHJldHVybiBGQUlMVVJFCiAKLSAgICAgICAgcmV0dXJuIFNVQ0NFU1MK
KyAgICAgICAgcmV0dXJuIHJlc3VsdAogCiAgICAgZGVmIGdldFRleHQoc2VsZiwgY21kLCByZXN1
bHRzKToKICAgICAgICAgcmV0dXJuIHNlbGYuZ2V0VGV4dDIoY21kLCByZXN1bHRzKQpAQCAtMzU0
LDIwICszNjAsNiBAQCBjbGFzcyBOZXdSdW5XZWJLaXRUZXN0cyhSdW5XZWJLaXRUZXN0cyk6CiAg
ICAgICAgIGxvZ1RleHQgPSBjbWQubG9nc1snc3RkaW8nXS5nZXRUZXh0KCkKICAgICAgICAgc2Vs
Zi5fcGFyc2VOZXdSdW5XZWJLaXRUZXN0c091dHB1dChsb2dUZXh0KQogCi0gICAgZGVmIGV2YWx1
YXRlQ29tbWFuZChzZWxmLCBjbWQpOgotICAgICAgICBpZiBjbWQucmMgIT0gMDoKLSAgICAgICAg
ICAgIHJldHVybiBGQUlMVVJFCi0KLSAgICAgICAgcmVzdWx0ID0gU1VDQ0VTUwotICAgICAgICBp
ZiBzZWxmLmluY29ycmVjdExheW91dExpbmVzOgotICAgICAgICAgICAgZm9yIGxpbmUgaW4gc2Vs
Zi5pbmNvcnJlY3RMYXlvdXRMaW5lczoKLSAgICAgICAgICAgICAgICBpZiBsaW5lLmZpbmQoJ2Zs
YWtlcycpID49IDAgb3IgbGluZS5maW5kKCduZXcgcGFzc2VzJykgPj0gMCBvciBsaW5lLmZpbmQo
J21pc3NpbmcgcmVzdWx0cycpID49IDA6Ci0gICAgICAgICAgICAgICAgICAgIHJlc3VsdCA9IFdB
Uk5JTkdTCi0gICAgICAgICAgICAgICAgZWxzZToKLSAgICAgICAgICAgICAgICAgICAgcmV0dXJu
IEZBSUxVUkUKLQotICAgICAgICByZXR1cm4gcmVzdWx0Ci0KIGNsYXNzIFJ1blVuaXRUZXN0cyhz
aGVsbC5UZXN0KToKICAgICBuYW1lID0gInJ1bi1hcGktdGVzdHMiCiAgICAgZGVzY3JpcHRpb24g
PSBbInVuaXQgdGVzdHMgcnVubmluZyJdCg==
</data>

          </attachment>
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>107299</attachid>
            <date>2011-09-14 00:17:05 -0700</date>
            <delta_ts>2011-09-16 04:47:24 -0700</delta_ts>
            <desc>proposed fix</desc>
            <filename>14.patch</filename>
            <type>text/plain</type>
            <size>1238</size>
            <attacher name="Kristóf Kosztyó">kkristof</attacher>
            
              <data encoding="base64">ZGlmZiAtLWdpdCBhL1Rvb2xzL0NoYW5nZUxvZyBiL1Rvb2xzL0NoYW5nZUxvZwppbmRleCA1Njcz
MjIzLi45Mzc1NWI5IDEwMDY0NAotLS0gYS9Ub29scy9DaGFuZ2VMb2cKKysrIGIvVG9vbHMvQ2hh
bmdlTG9nCkBAIC0xLDMgKzEsMTIgQEAKKzIwMTEtMDktMTQgIEtyaXN0w7NmIEtvc3p0ecOzICA8
a2tyaXN0b2ZAaW5mLnUtc3plZ2VkLmh1PgorCisgICAgICAgIEJ1aWxkYm90IG1hcmtzIGEgbnJ3
dCBib3QgcmVkIHdoZW4gdGVzdHMgYXJlIG1pc3NpbmcgcmVzdWx0cworICAgICAgICBodHRwczov
L2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9NjQ4MTIKKworICAgICAgICBSZXZpZXdl
ZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICAqIFNjcmlwdHMvd2Via2l0cHkvbGF5b3V0
X3Rlc3RzL2NvbnRyb2xsZXJzL21hbmFnZXIucHk6CisKIDIwMTEtMDktMTMgIFhpYW56aHUgV2Fu
ZyAgPHdhbmd4aWFuemh1QGNocm9taXVtLm9yZz4KIAogICAgICAgICBBZGQgbXlzZWxmIGFzIGEg
Y29udHJpYnV0b3IuIE5vIHJldmlldyBuZWVkZWQuCmRpZmYgLS1naXQgYS9Ub29scy9TY3JpcHRz
L3dlYmtpdHB5L2xheW91dF90ZXN0cy9jb250cm9sbGVycy9tYW5hZ2VyLnB5IGIvVG9vbHMvU2Ny
aXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvY29udHJvbGxlcnMvbWFuYWdlci5weQppbmRleCBi
NDAyYzQzLi43YzVlZGVhIDEwMDY0NAotLS0gYS9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91
dF90ZXN0cy9jb250cm9sbGVycy9tYW5hZ2VyLnB5CisrKyBiL1Rvb2xzL1NjcmlwdHMvd2Via2l0
cHkvbGF5b3V0X3Rlc3RzL2NvbnRyb2xsZXJzL21hbmFnZXIucHkKQEAgLTE0Nyw2ICsxNDcsOCBA
QCBkZWYgc3VtbWFyaXplX3Jlc3VsdHMocG9ydF9vYmosIGV4cGVjdGF0aW9ucywgcmVzdWx0X3N1
bW1hcnksIHJldHJ5X3N1bW1hcnksIHRlcwogICAgICAgICAgICAgICAgIGlmIHJlc3VsdF90eXBl
ICE9IHJldHJ5X3Jlc3VsdF90eXBlOgogICAgICAgICAgICAgICAgICAgICBhY3R1YWwuYXBwZW5k
KGtleXdvcmRzW3JldHJ5X3Jlc3VsdF90eXBlXSkKICAgICAgICAgICAgICAgICAgICAgbnVtX2Zs
YWt5ICs9IDEKKyAgICAgICAgICAgICAgICBlbGlmICdNSVNTSU5HJyBpbiBhY3R1YWw6CisgICAg
ICAgICAgICAgICAgICAgIG51bV9mbGFreSArPSAxCiAgICAgICAgICAgICAgICAgZWxzZToKICAg
ICAgICAgICAgICAgICAgICAgbnVtX3JlZ3Jlc3Npb25zICs9IDEKIAo=
</data>
<flag name="review"
          id="103960"
          type_id="1"
          status="+"
          setter="dpranke"
    />
    <flag name="commit-queue"
          id="103961"
          type_id="3"
          status="-"
          setter="dpranke"
    />
          </attachment>
          <attachment
              isobsolete="1"
              ispatch="1"
              isprivate="0"
          >
            <attachid>107636</attachid>
            <date>2011-09-16 04:47:24 -0700</date>
            <delta_ts>2011-09-19 05:40:15 -0700</delta_ts>
            <desc>mark missing result as flakey</desc>
            <filename>16a.patch</filename>
            <type>text/plain</type>
            <size>1342</size>
            <attacher name="Kristóf Kosztyó">kkristof</attacher>
            
              <data encoding="base64">ZGlmZiAtLWdpdCBhL1Rvb2xzL0NoYW5nZUxvZyBiL1Rvb2xzL0NoYW5nZUxvZwppbmRleCBlNWNj
MGY4Li45ZjA4ZTAxIDEwMDY0NAotLS0gYS9Ub29scy9DaGFuZ2VMb2cKKysrIGIvVG9vbHMvQ2hh
bmdlTG9nCkBAIC0xLDMgKzEsMTIgQEAKKzIwMTEtMDktMTYgIEtyaXN0w7NmIEtvc3p0ecOzICA8
a2tyaXN0b2ZAaW5mLnUtc3plZ2VkLmh1PgorCisgICAgICAgIEJ1aWxkYm90IG1hcmtzIGEgbnJ3
dCBib3QgcmVkIHdoZW4gdGVzdHMgYXJlIG1pc3NpbmcgcmVzdWx0cworICAgICAgICBodHRwczov
L2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9NjQ4MTIKKworICAgICAgICBSZXZpZXdl
ZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICAqIFNjcmlwdHMvd2Via2l0cHkvbGF5b3V0
X3Rlc3RzL2NvbnRyb2xsZXJzL21hbmFnZXIucHk6CisKIDIwMTEtMDktMTUgIEphbWVzIFJvYmlu
c29uICA8amFtZXNyQGNocm9taXVtLm9yZz4KIAogICAgICAgICBBZGQgQW50b2luZSBMYWJvdXIg
YW5kIFNoYXduIFNpbmdoIHRvIHRoZSBjb250cmlidXRvcnMtYnV0LW5vdC1jb21taXR0ZXJzIGxp
c3QuCmRpZmYgLS1naXQgYS9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9jb250
cm9sbGVycy9tYW5hZ2VyLnB5IGIvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMv
Y29udHJvbGxlcnMvbWFuYWdlci5weQppbmRleCBiNDAyYzQzLi5mOGI3MDM5IDEwMDY0NAotLS0g
YS9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9jb250cm9sbGVycy9tYW5hZ2Vy
LnB5CisrKyBiL1Rvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL2NvbnRyb2xsZXJz
L21hbmFnZXIucHkKQEAgLTE0Nyw2ICsxNDcsOSBAQCBkZWYgc3VtbWFyaXplX3Jlc3VsdHMocG9y
dF9vYmosIGV4cGVjdGF0aW9ucywgcmVzdWx0X3N1bW1hcnksIHJldHJ5X3N1bW1hcnksIHRlcwog
ICAgICAgICAgICAgICAgIGlmIHJlc3VsdF90eXBlICE9IHJldHJ5X3Jlc3VsdF90eXBlOgogICAg
ICAgICAgICAgICAgICAgICBhY3R1YWwuYXBwZW5kKGtleXdvcmRzW3JldHJ5X3Jlc3VsdF90eXBl
XSkKICAgICAgICAgICAgICAgICAgICAgbnVtX2ZsYWt5ICs9IDEKKyAgICAgICAgICAgICAgICAj
IEZJWE1FOiBicmVhayBNSVNTSU5HIHJlc3VsdHMgaW50byBhIGRpZmZlcmVudCBjYXRlZ29yeQor
ICAgICAgICAgICAgICAgIGVsaWYgJ01JU1NJTkcnIGluIGFjdHVhbDoKKyAgICAgICAgICAgICAg
ICAgICAgbnVtX2ZsYWt5ICs9IDEKICAgICAgICAgICAgICAgICBlbHNlOgogICAgICAgICAgICAg
ICAgICAgICBudW1fcmVncmVzc2lvbnMgKz0gMQogCg==
</data>

          </attachment>
          <attachment
              isobsolete="1"
              ispatch="0"
              isprivate="0"
          >
            <attachid>107837</attachid>
            <date>2011-09-19 05:40:15 -0700</date>
            <delta_ts>2011-09-19 05:41:04 -0700</delta_ts>
            <desc>mark missing results as flakey</desc>
            <filename>16afixed.patch</filename>
            <type>text/plain</type>
            <size>2229</size>
            <attacher name="Kristóf Kosztyó">kkristof</attacher>
            
              <data encoding="base64">ZGlmZiAtLWdpdCBhL1Rvb2xzL0NoYW5nZUxvZyBiL1Rvb2xzL0NoYW5nZUxvZwppbmRleCA4OWNj
YWU1Li4xZTgwOTQ4IDEwMDY0NAotLS0gYS9Ub29scy9DaGFuZ2VMb2cKKysrIGIvVG9vbHMvQ2hh
bmdlTG9nCkBAIC0xLDMgKzEsMTMgQEAKKzIwMTEtMDktMTkgIEtyaXN0w7NmIEtvc3p0ecOzICA8
a2tyaXN0b2ZAaW5mLnUtc3plZ2VkLmh1PgorCisgICAgICAgIEJ1aWxkYm90IG1hcmtzIGEgbnJ3
dCBib3QgcmVkIHdoZW4gdGVzdHMgYXJlIG1pc3NpbmcgcmVzdWx0cworICAgICAgICBodHRwczov
L2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9NjQ4MTIKKworICAgICAgICBSZXZpZXdl
ZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICAqIFNjcmlwdHMvd2Via2l0cHkvbGF5b3V0
X3Rlc3RzL2NvbnRyb2xsZXJzL21hbmFnZXIucHk6CisgICAgICAgICogU2NyaXB0cy93ZWJraXRw
eS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0c19pbnRlZ3JhdGlvbnRlc3QucHk6CisKIDIw
MTEtMDktMTYgIEVsbGlvdCBQb2dlciAgPGVwb2dlckBnb29nbGUuY29tPgogCiAgICAgICAgIGFk
ZCBub24tQ0cgV2Via2l0LU1hYyBidWlsZHMgdG8gZmxha2luZXNzIGRhc2hib2FyZApkaWZmIC0t
Z2l0IGEvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvY29udHJvbGxlcnMvbWFu
YWdlci5weSBiL1Rvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL2NvbnRyb2xsZXJz
L21hbmFnZXIucHkKaW5kZXggYjQwMmM0My4uMjNlMDQ5MSAxMDA2NDQKLS0tIGEvVG9vbHMvU2Ny
aXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvY29udHJvbGxlcnMvbWFuYWdlci5weQorKysgYi9U
b29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9jb250cm9sbGVycy9tYW5hZ2VyLnB5
CkBAIC0xNDcsNiArMTQ3LDkgQEAgZGVmIHN1bW1hcml6ZV9yZXN1bHRzKHBvcnRfb2JqLCBleHBl
Y3RhdGlvbnMsIHJlc3VsdF9zdW1tYXJ5LCByZXRyeV9zdW1tYXJ5LCB0ZXMKICAgICAgICAgICAg
ICAgICBpZiByZXN1bHRfdHlwZSAhPSByZXRyeV9yZXN1bHRfdHlwZToKICAgICAgICAgICAgICAg
ICAgICAgYWN0dWFsLmFwcGVuZChrZXl3b3Jkc1tyZXRyeV9yZXN1bHRfdHlwZV0pCiAgICAgICAg
ICAgICAgICAgICAgIG51bV9mbGFreSArPSAxCisgICAgICAgICAgICAgICAgIyBGSVhNRTogYnJl
YWsgTUlTU0lORyByZXN1bHRzIGludG8gYSBkaWZmZXJlbnQgY2F0ZWdvcnkKKyAgICAgICAgICAg
ICAgICBlbGlmICdNSVNTSU5HJyBpbiBhY3R1YWw6CisgICAgICAgICAgICAgICAgICBudW1fZmxh
a3kgKz0gMQogICAgICAgICAgICAgICAgIGVsc2U6CiAgICAgICAgICAgICAgICAgICAgIG51bV9y
ZWdyZXNzaW9ucyArPSAxCiAKZGlmZiAtLWdpdCBhL1Rvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5
b3V0X3Rlc3RzL3J1bl93ZWJraXRfdGVzdHNfaW50ZWdyYXRpb250ZXN0LnB5IGIvVG9vbHMvU2Ny
aXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0c19pbnRlZ3JhdGlvbnRl
c3QucHkKaW5kZXggZGNjNGE2My4uNjkwMjQ5ZSAxMDA3NTUKLS0tIGEvVG9vbHMvU2NyaXB0cy93
ZWJraXRweS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0c19pbnRlZ3JhdGlvbnRlc3QucHkK
KysrIGIvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0
c19pbnRlZ3JhdGlvbnRlc3QucHkKQEAgLTcxNSw3ICs3MTUsNyBAQCBjbGFzcyBSZWJhc2VsaW5l
VGVzdCh1bml0dGVzdC5UZXN0Q2FzZSk6CiAgICAgICAgICAgICAgICAgICAgICB0ZXN0c19pbmNs
dWRlZD1UcnVlLCBmaWxlc3lzdGVtPWZzLCBuZXdfcmVzdWx0cz1UcnVlKQogICAgICAgICBmaWxl
X2xpc3QgPSBmcy53cml0dGVuX2ZpbGVzLmtleXMoKQogICAgICAgICBmaWxlX2xpc3QucmVtb3Zl
KCcvdG1wL2xheW91dC10ZXN0LXJlc3VsdHMvdGVzdHNfcnVuMC50eHQnKQotICAgICAgICBzZWxm
LmFzc2VydEVxdWFscyhyZXMsIDIpCisgICAgICAgIHNlbGYuYXNzZXJ0RXF1YWxzKHJlcywgMCkK
ICAgICAgICAgc2VsZi5hc3NlcnRGYWxzZShvdXQuZW1wdHkoKSkKICAgICAgICAgc2VsZi5hc3Nl
cnRFcXVhbChsZW4oZmlsZV9saXN0KSwgNCkKICAgICAgICAgc2VsZi5hc3NlcnRCYXNlbGluZXMo
ZmlsZV9saXN0LCAiL2ZhaWx1cmVzL3VuZXhwZWN0ZWQvbWlzc2luZ190ZXh0IiwgWyIudHh0Il0s
IGVycikK
</data>

          </attachment>
          <attachment
              isobsolete="0"
              ispatch="1"
              isprivate="0"
          >
            <attachid>107838</attachid>
            <date>2011-09-19 05:42:38 -0700</date>
            <delta_ts>2011-09-19 11:02:12 -0700</delta_ts>
            <desc>mark missing results as flakey</desc>
            <filename>16afixed.patch</filename>
            <type>text/plain</type>
            <size>2231</size>
            <attacher name="Kristóf Kosztyó">kkristof</attacher>
            
              <data encoding="base64">ZGlmZiAtLWdpdCBhL1Rvb2xzL0NoYW5nZUxvZyBiL1Rvb2xzL0NoYW5nZUxvZwppbmRleCA4OWNj
YWU1Li4xZTgwOTQ4IDEwMDY0NAotLS0gYS9Ub29scy9DaGFuZ2VMb2cKKysrIGIvVG9vbHMvQ2hh
bmdlTG9nCkBAIC0xLDMgKzEsMTMgQEAKKzIwMTEtMDktMTkgIEtyaXN0w7NmIEtvc3p0ecOzICA8
a2tyaXN0b2ZAaW5mLnUtc3plZ2VkLmh1PgorCisgICAgICAgIEJ1aWxkYm90IG1hcmtzIGEgbnJ3
dCBib3QgcmVkIHdoZW4gdGVzdHMgYXJlIG1pc3NpbmcgcmVzdWx0cworICAgICAgICBodHRwczov
L2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5jZ2k/aWQ9NjQ4MTIKKworICAgICAgICBSZXZpZXdl
ZCBieSBOT0JPRFkgKE9PUFMhKS4KKworICAgICAgICAqIFNjcmlwdHMvd2Via2l0cHkvbGF5b3V0
X3Rlc3RzL2NvbnRyb2xsZXJzL21hbmFnZXIucHk6CisgICAgICAgICogU2NyaXB0cy93ZWJraXRw
eS9sYXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0c19pbnRlZ3JhdGlvbnRlc3QucHk6CisKIDIw
MTEtMDktMTYgIEVsbGlvdCBQb2dlciAgPGVwb2dlckBnb29nbGUuY29tPgogCiAgICAgICAgIGFk
ZCBub24tQ0cgV2Via2l0LU1hYyBidWlsZHMgdG8gZmxha2luZXNzIGRhc2hib2FyZApkaWZmIC0t
Z2l0IGEvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvY29udHJvbGxlcnMvbWFu
YWdlci5weSBiL1Rvb2xzL1NjcmlwdHMvd2Via2l0cHkvbGF5b3V0X3Rlc3RzL2NvbnRyb2xsZXJz
L21hbmFnZXIucHkKaW5kZXggYjQwMmM0My4uZjhiNzAzOSAxMDA2NDQKLS0tIGEvVG9vbHMvU2Ny
aXB0cy93ZWJraXRweS9sYXlvdXRfdGVzdHMvY29udHJvbGxlcnMvbWFuYWdlci5weQorKysgYi9U
b29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9jb250cm9sbGVycy9tYW5hZ2VyLnB5
CkBAIC0xNDcsNiArMTQ3LDkgQEAgZGVmIHN1bW1hcml6ZV9yZXN1bHRzKHBvcnRfb2JqLCBleHBl
Y3RhdGlvbnMsIHJlc3VsdF9zdW1tYXJ5LCByZXRyeV9zdW1tYXJ5LCB0ZXMKICAgICAgICAgICAg
ICAgICBpZiByZXN1bHRfdHlwZSAhPSByZXRyeV9yZXN1bHRfdHlwZToKICAgICAgICAgICAgICAg
ICAgICAgYWN0dWFsLmFwcGVuZChrZXl3b3Jkc1tyZXRyeV9yZXN1bHRfdHlwZV0pCiAgICAgICAg
ICAgICAgICAgICAgIG51bV9mbGFreSArPSAxCisgICAgICAgICAgICAgICAgIyBGSVhNRTogYnJl
YWsgTUlTU0lORyByZXN1bHRzIGludG8gYSBkaWZmZXJlbnQgY2F0ZWdvcnkKKyAgICAgICAgICAg
ICAgICBlbGlmICdNSVNTSU5HJyBpbiBhY3R1YWw6CisgICAgICAgICAgICAgICAgICAgIG51bV9m
bGFreSArPSAxCiAgICAgICAgICAgICAgICAgZWxzZToKICAgICAgICAgICAgICAgICAgICAgbnVt
X3JlZ3Jlc3Npb25zICs9IDEKIApkaWZmIC0tZ2l0IGEvVG9vbHMvU2NyaXB0cy93ZWJraXRweS9s
YXlvdXRfdGVzdHMvcnVuX3dlYmtpdF90ZXN0c19pbnRlZ3JhdGlvbnRlc3QucHkgYi9Ub29scy9T
Y3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9ydW5fd2Via2l0X3Rlc3RzX2ludGVncmF0aW9u
dGVzdC5weQppbmRleCBkY2M0YTYzLi42OTAyNDllIDEwMDc1NQotLS0gYS9Ub29scy9TY3JpcHRz
L3dlYmtpdHB5L2xheW91dF90ZXN0cy9ydW5fd2Via2l0X3Rlc3RzX2ludGVncmF0aW9udGVzdC5w
eQorKysgYi9Ub29scy9TY3JpcHRzL3dlYmtpdHB5L2xheW91dF90ZXN0cy9ydW5fd2Via2l0X3Rl
c3RzX2ludGVncmF0aW9udGVzdC5weQpAQCAtNzE1LDcgKzcxNSw3IEBAIGNsYXNzIFJlYmFzZWxp
bmVUZXN0KHVuaXR0ZXN0LlRlc3RDYXNlKToKICAgICAgICAgICAgICAgICAgICAgIHRlc3RzX2lu
Y2x1ZGVkPVRydWUsIGZpbGVzeXN0ZW09ZnMsIG5ld19yZXN1bHRzPVRydWUpCiAgICAgICAgIGZp
bGVfbGlzdCA9IGZzLndyaXR0ZW5fZmlsZXMua2V5cygpCiAgICAgICAgIGZpbGVfbGlzdC5yZW1v
dmUoJy90bXAvbGF5b3V0LXRlc3QtcmVzdWx0cy90ZXN0c19ydW4wLnR4dCcpCi0gICAgICAgIHNl
bGYuYXNzZXJ0RXF1YWxzKHJlcywgMikKKyAgICAgICAgc2VsZi5hc3NlcnRFcXVhbHMocmVzLCAw
KQogICAgICAgICBzZWxmLmFzc2VydEZhbHNlKG91dC5lbXB0eSgpKQogICAgICAgICBzZWxmLmFz
c2VydEVxdWFsKGxlbihmaWxlX2xpc3QpLCA0KQogICAgICAgICBzZWxmLmFzc2VydEJhc2VsaW5l
cyhmaWxlX2xpc3QsICIvZmFpbHVyZXMvdW5leHBlY3RlZC9taXNzaW5nX3RleHQiLCBbIi50eHQi
XSwgZXJyKQo=
</data>

          </attachment>
      

    </bug>

</bugzilla>