Jump to content

Parsoid/Parser Unification/Pixel Diff Testing Stats

From mediawiki.org

In order to compare rendering fidelity between Parsoid and core parser, we are going to be doing pixel diff testing on a subset of pages from various wikis and monitor progress. Initially, we are starting small (~25K pages across ~20 wikis) and eventually we will expand the test set. In these initial stages, we are likely going to get a number of false positives as we iron out wrinkles in the testing infrastructure.

[edit]
  • Test timeouts: If there differences between core parser rendering and Parsoid rendering on a page is large, the diffing algorithm (uprightdiff) might take too long or too much memory in which case the test run on that page will not complete since the tests are given a fixed time to complete (~5 mins). That is the reason you see < 100% test completion rate. As we fix sources of diffs, this test completion rate should naturally improve since there are fewer diffs and the diffing algorithm is likely to run to completion.
  • Unstyled Parsoid output: Parsoid's output is unstyled. The testing infrastructure loads the vector skin styles and applies it to the output. While this is now mostly working, there may still be areas where the right styles may not apply because of HTML structure differences between Parsoid and legacy HTML. For example, this is the case with HTML output for media. Legacy parser will soon be updated to emit Parsoid-compatible HTML structures for media and this will eliminate some of these CSS diffs we currently see in these visualdiff test runs.
  • Known Cite CSS diffs: Parsoid generates identical HTML for refs and references across all wikis and relies on CSS to generate varied styling across wikis. On the core parser side, the core Cite extension actually generates varied output for different wikis and is not CSS-based. Parsoid's approach is better suited for editing clients, but we haven't yet done the work of identifying the precise CSS needed to emulate the output on all wikis. This work is captured on Phabricator. Pixel-diff testing will let us isolate these differences and fix up the CSS.
  • Known missing JS modules in Parsoid output: The testing infrastructure attempts to expand all collapsed content on pages before comparing output. Parsoid's output is currently uncollapsed by default (because of missing JS modules in Parsoid's output) and while some JS scripts attempt to expand collapsed sections, this is error-prone currently and doesn't capture all collapsed content and so we get large false positive differences when the collapsed state is different in the two screenshots.
  • Other workarounds / issues:
    • span wrappers around various pieces of content (entities, display-space for frwiki, nowiki, template content text nodes for about-id continuity) cause minor pixel-level discrepancies in rendering which human readers won't notice but which introduce a lot of noise in visualdiffing. This seems to be something new that has been showing up since Sep 2021 after some library upgrades on the server.
    • <section> wrappers need to be removed from Parsoid output for some CSS query selectors to apply.
    • Cite errors are handled different in Parsoid & core
    • jsconfig vars added by extensions are added all at once in legacy parser and one tag at a time in Parsoid and this leads to the last tag-instance overwriting everything else in Parsoid.
    • enwiki:World Flags has a number of {{compact TOC|..}} uses which generates a HTML structure identical to auto-generated table of contents and so in visual diff testing, when we suppress TOCs, all of these get suppressed causing visual diffs.
    • On enwiki:Podgorica, there is an extra space before [citation needed] in Parsoid HTML but not in legacy HTML. Parsoid's output matches what is seen in source (to many noteworthy events. {{Citation needed|date=March 2017}} -- see the space after the period there). So, not sure why this is being stripped in legacy parser output.
    • Support for Special:Prefixindex is missing in Parsoid
    • sol state in extensions. Parsoid treats content in extensions as having SOL state. But, legacy parser doesn't. It transfers document sol state to extensions affects how <ref>* x</ref> and <ref>\n*x</ref> is parsed. Former is not a list in legacy, but latter is. Both are lists in Parsoid.

As we resolve these and other issues in the coming months, we will remove them from this list.

Aggregate results for the entire test set across all wikis

[edit]
Date Test Id % completed % vertical-shift-only-or-no-diffs % pixel-perfect

rendering

Notes
Jan 6, 2022 1.38.0-wmf.16 99.85 88.78 42.15 arwiki results have taken a dip - needs investigation
Dec 16, 2021 1.38.0-wmf.13 99.86 89.22 41.91 Regression from previous train fixed
Dec 10, 2021 1.38.0-wmf.12 99.82 86.56 36.81 Regression from CSS related work in core. Fixed in https://gerrit.wikimedia.org/r/c/mediawiki/core/+/745916 which has rolled out in wmf.13 and will improve results in the next test run.
Nov 18, 2021 1.38.0-wmf.9 99.85 89.17 41.76
Nov 4, 2021 1.38.0-wmf.7 99.86 89.15 41.34
Oct 28, 2021 1.38.0-wmf.6 99.85 88.96 40.96
Oct 21, 2021 1.38.0-wmf.5 99.85 88.97 40.97
Oct 14, 2021 1.38.0-wmf.4 99.86 88.95 40.82
Oct 8, 2021 1.38.0-wmf.3 99.84 88.69 40.26
Oct 1, 2021 1.38.0-wmf.2 99.84 88.91 39.22 This test run also includes a few Cite CSS tweaks for dewiki & kowiki. The tests ran on a new server with better performance. That is the reason for the reduction in crashing pages.
Sep 28, 2021 diffscoring-tweak 99.58 88.64 39.11 Tweak the scoring algorithm to treat any diffs that are 99.99% or more identical as pixel perfect since they tend to imperceptible to the humans. This just builds on the previous span stripping tweaks to hide noise introduce since Sep 10th.

Also includes a fix to eliminate a regression on arwiki due to div.catlinks moving outside div.mw-body-content (got rid of a hack-fix introduced about 6 weeks back to have an arwiki JS modeule apply to Parsoid HTML).

Sep 26, 2021 more-span-stripping 99.62 88.69 28.55 Strip additional spans around nowikis, displayspace (impacts frwiki significant), and placeholder content
Sep 18, 2021 1.38.0-wmf.1 99.58 88.37 24.79 This included a Parsoid fix to mark more effectively-empty paragraphs with mw-empty-elt class that lets them be hidden in rendering. This also reduces visualdiffs with core parser output. The visualdiff improvements will likely reflect in later weeks as the caches slowly purge.
Sep 11, 2021 strip-entity-spans 99.55 88.33 24.65 Strip spans around entities and template content to mitigate the rendering impact and noise.
Sep 10,2021 1.37.0-wmf.23 99.46 85.34 12.93 Something (uninvestigated) broke on the test server which caused us to reinstall several libraries needed by Chrome. This in turn seems to have made the rendering sensitive to span wrappers that Parsoid adds in several places. The impacts aren't visible to the human eye but add a lot of minor noise in testing and cause a number of tests results with 0 score to now report a score of 1, but which causes them all to drop out of the pixel-perfect-rendering category. The drop from ~36% to ~13% here is pretty significant.
Sep 3, 2021 puppeteer-bump 99.53 88.43 35.46 Bump puppeteer version from 5.x to 9.x. This upgrades the version of Chrome from 88.x to 91.x
Sep 3, 2021 1.37.0-wmf.21 99.6 88.68 34.97 Several Cite CSS fixes + some minor bug fixes in Parsoid.
Aug 26, 2021 1.37.0-wmf.20 99.53 89.02 28.15 T288715 is probably the most significant fix to Parsoid HTML which lead the noticeable test result improvements.
Aug 18, 2021 more_rl_and_css_fixes 99.60 88.74 27.02 Additional fixes:
  • Remove <section> wrappers from Parsoid ouput - enables JS & CSS to apply better (because of query selectors that have specific assumptions about HTML structure)
  • Add additional resourceloader state/config to Parsoid output based on available info in <head>
  • Add a #catlinks dummy div to end of Parsoid output to let arwiki's site JS module to apply
  • Fix a minor CSS issue with hewiki ref output
  • Add additional Cite CSS style for svwiki
Aug 14, 2021 rl_and_css_fixes 99.55 86.67 25.45 Several fixes to ensure (a) the right style modules are loaded and in the proper order (b) the right js modules are loaded and take effect on Parsoid page (c) turn off ext.gadget.* modules in legacy parser output since those aren't accessible to Parsoid's rendering yet.


Notably, this run gets rid of the hack introduced in the 'rl_modules_hack_2' test run by leveraging Parsoid's new output where applicable resource modules are exposed in Parsoid's output in the <head>.

Jan 8, 2021 1.36.0-wmf.25 99.61 82.92 17.73 The regressions are mostly testing noise. No significant code or infrastructure changes since last run.
Dec 31, 2020 parsoid_workarounds 99.60 83.01 17.83 Three workarounds for Parsoid gaps / bugs that are yet to be fixed:
  • Missing self-links in Parsoid output
  • Parsoid's gallery output doesn't p-wrap captions
  • Kartographer maps suppressed to eliminate noisy diffs from JS modules not applying correctly on Parsoid output. Kartographer extensions needs to retargeted for Parsoid so some of this is known.
Dec 26, 2020 vd_and_css_tweaks 99.61 80.63 16.55 Several CSS and visual diff infrastructure fixes. Improved results on arwiki, itwiki, svwiki, and frwiki.
Dec 18, 2020 rl_modules_hack_2 99.55 79.00 15.54 Replace the <head> element in Parsoid output with the <head> element from core parser output to mimic the effect of having Parsoid get the right resource modules. It needed a few additional tweaks. Overall, the difference between the 1.36.0-wmf.18 run and this test run represents the expected rendering improvements from fixing ResourceModule gaps in Parsoid.
Dec 17, 2020 1.36.0-wmf.22 99.55 75.96 14.75
Dec 16, 2020 vd_tweaks 99.55 76.08 14.73 Tweaks to the visual diff infrastructure to improve behavior of rl_modules hacks. This test run also purges results / pages from the database which have been deleted from the wikis.
Dec 10, 2020 1.36.0-wmf.21 99.55 75.86 14.59 zhwiki regressions fixed. But, enwiki saw a bunch of regressions
Dec 7, 2020 1.36.0-wmf.20 99.55 75.78 14.62 Notable regression on zhwiki because of this patch - this will be fixed in wmf.21.
Nov 29, 2020 rl_modules_hack 99.51 75.88 14.62 Two changes:
  1. Parsoid doesn't add JS modules to the HTML. In this test run, the visual diff infrastructure is hacked to add some basic defaults.
  2. Fix some post-processing that ensures ruwiki content has colllapsible content expanded in both Parsoid & core content.
Nov 24, 2020 1.36.0-wmf.18 99.39 71.76 14.71
Nov 10, 2020 1.36.0-wmf.16 99.39 71.62 14.51
Oct 22, 2020 1.36.0-wmf.14 99.43 71.82 14.81
Oct 15, 2020 1.36.0-wmf.13 99.44 71.75 14.97
Oct 13, 2020 cite_css_fixes 99.45 71.79 15.02 Visualdiff Cite CSS fixes ( Commit )
Sep 29, 2020 body post-processing fix 99.41 70.60 15.11 Visualdiff code fixes to ensure no content is dropped from core output ( Commit + followups )
Sep 26, 2020 1.36.0-wmf.10 + CSS fixes 99.41 70.07 15.08 Visualdiff code fixes to ensure stylesheets apply in the right order + some CSS fixes ( Commit ).
Sep 24, 2020 1.36.0-wmf.10 98.95 69.22 14.55 nlwiki continued to see a big improvement (now at ~92% vertical-shift-only diffs) because of an edit to an nl infobox (see below).
Sep 17, 2020 1.36.0-wmf.9 98.94 67.41 14.07 nlwiki saw a huge improvement (see per-wiki stats below).

Caused by an edit to a nlwiki infobox. This edit happened partway through this test run.

Sep 10, 2020 1.36.0-wmf.8 98.95 65.67 13.66 T178927 fixed
Aug 27, 2020 1.36.0-wmf.6 98.98 65.55 13.59
Aug 20, 2020 1.36.0-wmf.5 98.98 65.14 13.32
Aug 13, 2020 1.36.0-wmf.4 98.97 65.14 13.06
Aug 6 & 7, 2020 1.36.0-wmf.3 99.04 64.69 12.46 This had a Parsoid fix to ensure RTL styles are loaded for RTL wikis. After the run completed (on Aug 6), arwiki & hewiki results were reset, a visualdiff config fix was added (to purge cache before we loaded pages to ensure latest Parsoid output was used), and tests rerun on arwiki & hewiki pages (Aug 7).
Aug 5, 2020 1.36.0-wmf.2 + vector-useskinversion-1 99.05 64.51 12.45 This fixes the issue with the previous run by ensuring we always fetch legacy vector CSS.

So, this is effectively the 1.36.0-wmf2 run.

Aug 3, 2020 1.36.0-wmf.2 99.07 64.31 12.48 There have been a number of regressions on hewiki pages. It turns out this is because of Desktop Refresh! hewiki pages are being loaded with new CSS whereas Parsoid content is being styled with legacy vector CSS. Need to figure out how to match up skin CSS.
July 24, 2020 init_with_css_fixes 99.02 64.37 12.30 Based on the previous run, this includes a number of Cite CSS fixes and enables all Cite output. So, this is just like the init run but with additional CSS fixes.

Relative to 'init' run, the overall diff score improved by 16% across the test set.

This can effectively be considered the new baseline metric.

July 24, 2020 no_refs 99.17 67.26 18.40 Suppress all Cite extension output (but images and galleries are enabled again).

Relative to 'init' run, the overall diff score improved by 27% across the test set.

Looking at aggregate stats across wikis in the test set, looks like jawiki, eswiki, frwiki, plwiki, svwiki improved a lot. This just indicates that Cite CSS styles for these wikis are probably out of date and need a refresh.

July 23, 2020 no_img_or_gallery 98.91 63.36 12.19 Suppress all images and galleries.

This is to isolate differences arising out of different media output between Parsoid & core parser and associated CSS.

The overall diff score improved by by 12% across the test set.

Looking at aggregate stats across wikis in the test set, looks like enwikivoyage pages improved the most.

July 23, 2020 init 98.81 60.45 11.09 Initial baseline run

More detailed per-wiki & per-category stats across test runs

[edit]

Stats for arwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.30 53.83 4.18 428 232 18
1.38.0-wmf.7 99.30 53.83 4.41 428 232 19
1.38.0-wmf.6 99.30 45.94 2.78 428 198 12
1.38.0-wmf.5 99.30 45.94 2.78 428 198 12
1.38.0-wmf.4 99.30 45.94 2.78 428 198 12
1.38.0-wmf.3 99.30 45.48 2.78 428 196 12
1.38.0-wmf.2 99.30 43.39 2.78 428 187 12
diffscoring-tweak 99.30 37.35 2.78 428 161 12
more-span-stripping 99.07 41.53 2.09 427 179 9
1.38.0-wmf.1 99.07 40.14 2.09 427 173 9
strip-entity-spans 99.07 42.00 2.09 427 181 9
1.37.0-wmf.23 97.45 41.76 0.93 420 180 4
puppeteer-bump 99.07 38.75 1.86 427 167 8
1.37.0-wmf.21 98.38 38.98 1.86 424 168 8
1.37.0-wmf.20 98.84 38.05 1.86 426 164 8
more_rl_and_css_fixes 99.07 38.28 1.86 427 165 8
rl_and_css_fixes 99.07 25.52 1.39 427 110 6
survey_and_other_css_tweaks 95.36 23.67 2.09 411 102 9
1.36.0-wmf.27 94.43 22.51 2.09 407 97 9
1.36.0-wmf.26 96.06 23.20 1.86 414 100 8
1.36.0-wmf.25 96.29 26.45 1.86 415 114 8
parsoid_workarounds 96.52 26.45 1.86 416 114 8
vd_and_css_tweaks 96.52 23.43 1.86 416 101 8
rl_modules_hack_2 96.29 20.65 1.86 415 89 8
1.36.0-wmf.22 96.29 20.65 1.86 415 89 8
vd_tweaks 96.29 20.65 1.86 415 89 8
1.36.0-wmf.21 96.29 20.65 1.86 415 89 8
1.36.0-wmf.20 96.29 20.65 1.86 415 89 8
rl_modules_hack 96.29 21.11 1.86 415 91 8
1.36.0-wmf.18 96.29 20.42 1.86 415 88 8
1.36.0-wmf.16 96.29 20.42 1.86 415 88 8
1.36.0-wmf.14 96.52 21.11 1.86 416 91 8
1.36.0-wmf.13 96.52 20.88 1.86 416 90 8
cite_css_fixes 96.75 20.88 1.86 417 90 8
body_postprocessing_fix 96.52 21.58 2.09 416 93 9
1.36.0-wmf.10_and_CSS_fixes 96.06 1.86 1.62 414 8 7
1.36.0-wmf.10 71.46 0.70 0.00 308 3 0
1.36.0-wmf.9 71.93 0.70 0.00 310 3 0
1.36.0-wmf.8 72.16 0.70 0.00 311 3 0
1.36.0-wmf.6 72.62 0.70 0.00 313 3 0
1.36.0-wmf.5 72.16 0.70 0.00 311 3 0
1.36.0-wmf.4 72.16 0.70 0.00 311 3 0
1.36.0-wmf.3 74.25 0.70 0.00 320 3 0
vector-useskinversion-1 75.64 0.70 0.00 326 3 0
1.36.0-wmf.2 75.87 0.70 0.00 327 3 0
init_with_css_fixes 75.87 0.70 0.00 327 3 0
no_refs 74.25 0.70 0.00 320 3 0
no_img_or_gallery 73.78 0.70 0.00 318 3 0
init 75.87 0.70 0.00 327 3 0

Stats for dewiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.94 93.67 60.19 1642 1539 989
1.38.0-wmf.7 99.94 93.61 59.77 1642 1538 982
1.38.0-wmf.6 99.94 93.37 58.37 1642 1534 959
1.38.0-wmf.5 99.94 93.37 58.31 1642 1534 958
1.38.0-wmf.4 99.94 93.37 58.25 1642 1534 957
1.38.0-wmf.3 99.94 93.55 58.00 1642 1537 953
1.38.0-wmf.2 99.94 93.49 57.76 1642 1536 949
diffscoring-tweak 99.88 93.18 57.52 1641 1531 945
more-span-stripping 99.88 93.06 42.06 1641 1529 691
1.38.0-wmf.1 99.76 93.00 39.38 1639 1528 647
strip-entity-spans 99.76 93.18 39.38 1639 1531 647
1.37.0-wmf.23 99.88 84.54 11.87 1641 1389 195
puppeteer-bump 99.76 93.06 24.16 1639 1529 397
1.37.0-wmf.21 99.70 93.37 24.28 1638 1534 399
1.37.0-wmf.20 99.88 95.01 24.95 1641 1561 410
more_rl_and_css_fixes 99.76 95.01 24.95 1639 1561 410
rl_and_css_fixes 99.51 94.34 25.20 1635 1550 414
survey_and_other_css_tweaks 99.57 86.00 23.37 1636 1413 384
1.36.0-wmf.27 99.63 85.94 23.13 1637 1412 380
1.36.0-wmf.26 99.57 85.58 23.31 1636 1406 383
1.36.0-wmf.25 99.63 85.58 23.37 1637 1406 384
parsoid_workarounds 99.70 85.70 23.37 1638 1408 384
vd_and_css_tweaks 99.70 81.86 21.36 1638 1345 351
rl_modules_hack_2 99.63 81.56 21.36 1637 1340 351
1.36.0-wmf.22 99.63 80.04 19.29 1637 1315 317
vd_tweaks 99.63 79.98 19.23 1637 1314 316
1.36.0-wmf.21 99.63 79.98 19.29 1637 1314 317
1.36.0-wmf.20 99.70 80.22 19.29 1638 1318 317
rl_modules_hack 99.63 80.40 19.35 1637 1321 318
1.36.0-wmf.18 99.33 78.09 19.35 1632 1283 318
1.36.0-wmf.16 99.39 78.09 19.42 1633 1283 319
1.36.0-wmf.14 99.33 78.15 19.35 1632 1284 318
1.36.0-wmf.13 99.33 77.91 19.35 1632 1280 318
cite_css_fixes 99.33 77.97 19.35 1632 1281 318
body_postprocessing_fix 99.33 77.78 19.29 1632 1278 317
1.36.0-wmf.10_and_CSS_fixes 99.33 77.48 19.29 1632 1273 317
1.36.0-wmf.10 99.33 77.18 19.23 1632 1268 316
1.36.0-wmf.9 99.33 77.36 19.17 1632 1271 315
1.36.0-wmf.8 99.33 77.24 19.05 1632 1269 313
1.36.0-wmf.6 99.33 77.12 18.93 1632 1267 311
1.36.0-wmf.5 99.33 76.63 18.81 1632 1259 309
1.36.0-wmf.4 99.33 76.08 18.44 1632 1250 303
1.36.0-wmf.3 99.39 75.59 18.08 1633 1242 297
vector-useskinversion-1 99.39 74.92 17.83 1633 1231 293
1.36.0-wmf.2 99.39 75.53 18.02 1633 1241 296
init_with_css_fixes 99.27 74.32 17.59 1631 1221 289
no_refs 99.33 74.62 42.85 1632 1226 704
no_img_or_gallery 99.57 80.34 18.14 1636 1320 298
init 99.39 74.25 17.59 1633 1220 289

Stats for enwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.82 91.98 31.19 7094 6537 2217
1.38.0-wmf.7 99.83 92.04 31.31 7095 6541 2225
1.38.0-wmf.6 99.82 92.04 30.98 7094 6541 2202
1.38.0-wmf.5 99.82 91.98 31.10 7094 6537 2210
1.38.0-wmf.4 99.80 91.92 30.80 7093 6533 2189
1.38.0-wmf.3 99.80 91.60 29.52 7093 6510 2098
1.38.0-wmf.2 99.80 91.88 29.62 7093 6530 2105
diffscoring-tweak 99.39 91.54 29.25 7064 6506 2079
more-span-stripping 99.42 91.42 20.06 7066 6497 1426
1.38.0-wmf.1 99.41 91.30 19.25 7065 6489 1368
strip-entity-spans 99.32 91.16 19.05 7059 6479 1354
1.37.0-wmf.23 99.31 88.97 12.34 7058 6323 877
puppeteer-bump 99.25 91.61 41.30 7054 6511 2935
1.37.0-wmf.21 99.54 92.06 40.57 7074 6543 2883
1.37.0-wmf.20 99.30 93.06 38.46 7057 6614 2733
more_rl_and_css_fixes 99.55 92.06 37.16 7075 6543 2641
rl_and_css_fixes 99.41 92.85 34.98 7065 6599 2486
survey_and_other_css_tweaks 99.68 90.05 18.59 7084 6400 1321
1.36.0-wmf.27 99.69 90.02 18.60 7085 6398 1322
1.36.0-wmf.26 99.69 90.39 18.64 7085 6424 1325
1.36.0-wmf.25 99.70 90.43 18.46 7086 6427 1312
parsoid_workarounds 99.68 90.71 18.78 7084 6447 1335
vd_and_css_tweaks 99.70 88.77 18.53 7086 6309 1317
rl_modules_hack_2 99.70 88.79 18.46 7086 6310 1312
1.36.0-wmf.22 99.70 86.01 18.35 7086 6113 1304
vd_tweaks 99.70 86.08 18.32 7086 6118 1302
1.36.0-wmf.21 99.70 85.75 18.28 7086 6094 1299
1.36.0-wmf.20 99.70 86.44 18.49 7086 6143 1314
rl_modules_hack 99.68 86.18 18.49 7084 6125 1314
1.36.0-wmf.18 99.48 80.84 19.18 7070 5745 1363
1.36.0-wmf.16 99.47 80.89 18.78 7069 5749 1335
1.36.0-wmf.14 99.49 81.15 19.50 7071 5767 1386
1.36.0-wmf.13 99.51 81.07 19.98 7072 5762 1420
cite_css_fixes 99.49 81.23 20.08 7071 5773 1427
body_postprocessing_fix 99.41 81.31 20.44 7065 5779 1453
1.36.0-wmf.10_and_CSS_fixes 99.47 81.17 20.51 7069 5769 1458
1.36.0-wmf.10 99.45 81.09 20.47 7068 5763 1455
1.36.0-wmf.9 99.42 81.27 20.46 7066 5776 1454
1.36.0-wmf.8 99.44 81.19 20.42 7067 5770 1451
1.36.0-wmf.6 99.48 81.10 20.35 7070 5764 1446
1.36.0-wmf.5 99.48 80.61 20.29 7070 5729 1442
1.36.0-wmf.4 99.52 81.22 20.32 7073 5772 1444
1.36.0-wmf.3 99.54 81.10 20.15 7074 5764 1432
vector-useskinversion-1 99.54 81.10 20.22 7074 5764 1437
1.36.0-wmf.2 99.52 81.02 20.28 7073 5758 1441
init_with_css_fixes 99.52 81.07 20.32 7073 5762 1444
no_refs 99.68 80.70 26.68 7084 5735 1896
no_img_or_gallery 99.56 82.30 23.08 7076 5849 1640
init 99.54 80.79 20.37 7074 5742 1448

Stats for enwikisource

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 88.89 51.85 108 96 56
1.38.0-wmf.7 100.00 87.96 51.85 108 95 56
1.38.0-wmf.6 100.00 88.89 51.85 108 96 56
1.38.0-wmf.5 100.00 88.89 51.85 108 96 56
1.38.0-wmf.4 100.00 88.89 51.85 108 96 56
1.38.0-wmf.3 100.00 87.96 51.85 108 95 56
1.38.0-wmf.2 100.00 88.89 51.85 108 96 56
diffscoring-tweak 100.00 88.89 51.85 108 96 56
more-span-stripping 100.00 87.96 51.85 108 95 56
1.38.0-wmf.1 100.00 87.96 51.85 108 95 56
strip-entity-spans 100.00 88.89 51.85 108 96 56
1.37.0-wmf.23 100.00 88.89 43.52 108 96 47
puppeteer-bump 100.00 87.04 34.26 108 94 37
1.37.0-wmf.21 100.00 86.11 28.70 108 93 31
1.37.0-wmf.20 100.00 87.04 25.00 108 94 27
more_rl_and_css_fixes 99.07 87.96 22.22 107 95 24
rl_and_css_fixes 100.00 88.89 23.15 108 96 25
survey_and_other_css_tweaks 100.00 25.93 0.00 108 28 0
1.36.0-wmf.27 100.00 28.70 0.00 108 31 0
1.36.0-wmf.26 100.00 22.22 0.00 108 24 0
1.36.0-wmf.25 100.00 22.22 0.00 108 24 0
parsoid_workarounds 100.00 21.30 0.00 108 23 0
vd_and_css_tweaks 100.00 21.30 0.00 108 23 0
rl_modules_hack_2 100.00 21.30 0.00 108 23 0
1.36.0-wmf.22 98.15 14.81 0.00 106 16 0
vd_tweaks 97.22 14.81 0.00 105 16 0
1.36.0-wmf.21 98.15 28.70 2.78 106 31 3
1.36.0-wmf.20 98.15 28.70 2.78 106 31 3
rl_modules_hack 98.15 28.70 2.78 106 31 3
1.36.0-wmf.18 98.15 26.85 1.85 106 29 2
1.36.0-wmf.16 98.15 26.85 1.85 106 29 2
1.36.0-wmf.14 99.07 26.85 1.85 107 29 2
1.36.0-wmf.13 98.15 26.85 1.85 106 29 2
cite_css_fixes 98.15 26.85 1.85 106 29 2
body_postprocessing_fix 98.15 26.85 1.85 106 29 2
1.36.0-wmf.10_and_CSS_fixes 98.15 9.26 0.93 106 10 1
1.36.0-wmf.10 98.15 9.26 0.93 106 10 1
1.36.0-wmf.9 98.15 9.26 0.93 106 10 1
1.36.0-wmf.8 98.15 9.26 0.93 106 10 1
1.36.0-wmf.6 98.15 9.26 0.93 106 10 1
1.36.0-wmf.5 98.15 9.26 0.93 106 10 1
1.36.0-wmf.4 98.15 9.26 0.93 106 10 1
1.36.0-wmf.3 98.15 9.26 0.93 106 10 1
vector-useskinversion-1 98.15 22.22 0.93 106 24 1
1.36.0-wmf.2 98.15 22.22 0.93 106 24 1
init_with_css_fixes 98.15 22.22 0.93 106 24 1
no_refs 98.15 22.22 0.93 106 24 1
no_img_or_gallery 98.15 23.15 0.93 106 25 1
init 98.15 22.22 0.93 106 24 1

Stats for enwikivoyage

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 47.75 18.02 111 53 20
1.38.0-wmf.7 100.00 47.75 18.02 111 53 20
1.38.0-wmf.6 100.00 46.85 14.41 111 52 16
1.38.0-wmf.5 100.00 47.75 14.41 111 53 16
1.38.0-wmf.4 100.00 47.75 13.51 111 53 15
1.38.0-wmf.3 100.00 47.75 13.51 111 53 15
1.38.0-wmf.2 100.00 48.65 13.51 111 54 15
diffscoring-tweak 100.00 48.65 13.51 111 54 15
more-span-stripping 100.00 48.65 11.71 111 54 13
1.38.0-wmf.1 100.00 48.65 11.71 111 54 13
strip-entity-spans 100.00 47.75 11.71 111 53 13
1.37.0-wmf.23 100.00 40.54 2.70 111 45 3
puppeteer-bump 97.30 49.55 12.61 108 55 14
1.37.0-wmf.21 100.00 49.55 12.61 111 55 14
1.37.0-wmf.20 100.00 49.55 11.71 111 55 13
more_rl_and_css_fixes 100.00 49.55 11.71 111 55 13
rl_and_css_fixes 100.00 48.65 11.71 111 54 13
survey_and_other_css_tweaks 100.00 46.85 13.51 111 52 15
1.36.0-wmf.27 100.00 45.95 13.51 111 51 15
1.36.0-wmf.26 100.00 45.95 13.51 111 51 15
1.36.0-wmf.25 100.00 45.95 13.51 111 51 15
parsoid_workarounds 100.00 45.95 13.51 111 51 15
vd_and_css_tweaks 100.00 24.32 11.71 111 27 13
rl_modules_hack_2 99.10 24.32 11.71 110 27 13
1.36.0-wmf.22 99.10 24.32 6.31 110 27 7
vd_tweaks 99.10 24.32 6.31 110 27 7
1.36.0-wmf.21 99.10 24.32 6.31 110 27 7
1.36.0-wmf.20 99.10 24.32 6.31 110 27 7
rl_modules_hack 99.10 24.32 6.31 110 27 7
1.36.0-wmf.18 100.00 24.32 6.31 111 27 7
1.36.0-wmf.16 100.00 23.42 6.31 111 26 7
1.36.0-wmf.14 100.00 23.42 6.31 111 26 7
1.36.0-wmf.13 100.00 23.42 6.31 111 26 7
cite_css_fixes 100.00 23.42 6.31 111 26 7
body_postprocessing_fix 100.00 22.52 6.31 111 25 7
1.36.0-wmf.10_and_CSS_fixes 100.00 21.62 6.31 111 24 7
1.36.0-wmf.10 99.10 21.62 6.31 110 24 7
1.36.0-wmf.9 100.00 20.72 6.31 111 23 7
1.36.0-wmf.8 100.00 18.92 4.50 111 21 5
1.36.0-wmf.6 100.00 23.42 6.31 111 26 7
1.36.0-wmf.5 100.00 23.42 6.31 111 26 7
1.36.0-wmf.4 100.00 23.42 6.31 111 26 7
1.36.0-wmf.3 100.00 23.42 6.31 111 26 7
vector-useskinversion-1 100.00 23.42 6.31 111 26 7
1.36.0-wmf.2 100.00 23.42 6.31 111 26 7
init_with_css_fixes 100.00 23.42 6.31 111 26 7
no_refs 100.00 23.42 6.31 111 26 7
no_img_or_gallery 100.00 41.44 8.11 111 46 9
init 100.00 23.42 6.31 111 26 7

Stats for enwiktionary

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 87.27 72.73 110 96 80
1.38.0-wmf.7 100.00 87.27 73.64 110 96 81
1.38.0-wmf.6 100.00 87.27 73.64 110 96 81
1.38.0-wmf.5 100.00 87.27 73.64 110 96 81
1.38.0-wmf.4 100.00 87.27 73.64 110 96 81
1.38.0-wmf.3 100.00 87.27 73.64 110 96 81
1.38.0-wmf.2 100.00 88.18 74.55 110 97 82
diffscoring-tweak 100.00 88.18 74.55 110 97 82
more-span-stripping 100.00 88.18 73.64 110 97 81
1.38.0-wmf.1 100.00 88.18 73.64 110 97 81
strip-entity-spans 100.00 88.18 73.64 110 97 81
1.37.0-wmf.23 100.00 88.18 50.91 110 97 56
puppeteer-bump 100.00 89.09 60.91 110 98 67
1.37.0-wmf.21 100.00 89.09 60.91 110 98 67
1.37.0-wmf.20 100.00 88.18 57.27 110 97 63
more_rl_and_css_fixes 100.00 88.18 57.27 110 97 63
rl_and_css_fixes 100.00 88.18 57.27 110 97 63
survey_and_other_css_tweaks 100.00 88.18 58.18 110 97 64
1.36.0-wmf.27 100.00 88.18 58.18 110 97 64
1.36.0-wmf.26 100.00 88.18 58.18 110 97 64
1.36.0-wmf.25 100.00 88.18 58.18 110 97 64
parsoid_workarounds 100.00 88.18 58.18 110 97 64
vd_and_css_tweaks 100.00 88.18 57.27 110 97 63
rl_modules_hack_2 100.00 88.18 58.18 110 97 64
1.36.0-wmf.22 100.00 86.36 58.18 110 95 64
vd_tweaks 100.00 86.36 58.18 110 95 64
1.36.0-wmf.21 100.00 86.36 58.18 110 95 64
1.36.0-wmf.20 100.00 86.36 58.18 110 95 64
rl_modules_hack 100.00 86.36 58.18 110 95 64
1.36.0-wmf.18 100.00 87.27 58.18 110 96 64
1.36.0-wmf.16 100.00 87.27 58.18 110 96 64
1.36.0-wmf.14 100.00 87.27 58.18 110 96 64
1.36.0-wmf.13 100.00 87.27 60.91 110 96 67
cite_css_fixes 100.00 87.27 60.91 110 96 67
body_postprocessing_fix 100.00 87.27 60.00 110 96 66
1.36.0-wmf.10_and_CSS_fixes 100.00 87.27 60.00 110 96 66
1.36.0-wmf.10 100.00 87.27 58.18 110 96 64
1.36.0-wmf.9 100.00 86.36 49.09 110 95 54
1.36.0-wmf.8 100.00 82.73 46.36 110 91 51
1.36.0-wmf.6 100.00 88.18 50.00 110 97 55
1.36.0-wmf.5 100.00 87.27 43.64 110 96 48
1.36.0-wmf.4 100.00 88.18 36.36 110 97 40
1.36.0-wmf.3 100.00 87.27 20.91 110 96 23
vector-useskinversion-1 100.00 87.27 20.91 110 96 23
1.36.0-wmf.2 100.00 87.27 20.91 110 96 23
init_with_css_fixes 100.00 86.36 20.91 110 95 23
no_refs 100.00 86.36 20.91 110 95 23
no_img_or_gallery 100.00 87.27 20.91 110 96 23
init 100.00 86.36 20.91 110 95 23

Stats for eswiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 91.92 50.11 2179 2003 1092
1.38.0-wmf.7 99.95 92.06 50.30 2178 2006 1096
1.38.0-wmf.6 99.95 92.01 49.93 2178 2005 1088
1.38.0-wmf.5 99.95 91.74 49.75 2178 1999 1084
1.38.0-wmf.4 99.95 92.06 49.98 2178 2006 1089
1.38.0-wmf.3 99.95 90.45 48.55 2178 1971 1058
1.38.0-wmf.2 99.95 92.38 39.74 2178 2013 866
diffscoring-tweak 99.72 91.97 35.15 2173 2004 766
more-span-stripping 99.91 92.20 25.33 2177 2009 552
1.38.0-wmf.1 99.86 92.20 22.90 2176 2009 499
strip-entity-spans 99.86 91.97 22.85 2176 2004 498
1.37.0-wmf.23 99.63 91.65 13.58 2171 1997 296
puppeteer-bump 99.91 90.78 22.44 2177 1978 489
1.37.0-wmf.21 99.82 91.14 22.21 2175 1986 484
1.37.0-wmf.20 99.86 91.05 4.18 2176 1984 91
more_rl_and_css_fixes 99.72 90.50 2.75 2173 1972 60
rl_and_css_fixes 99.72 90.64 2.75 2173 1975 60
survey_and_other_css_tweaks 99.72 79.12 2.85 2173 1724 62
1.36.0-wmf.27 99.68 78.89 2.85 2172 1719 62
1.36.0-wmf.26 99.68 79.07 2.80 2172 1723 61
1.36.0-wmf.25 99.63 78.57 2.80 2171 1712 61
parsoid_workarounds 99.68 78.89 2.80 2172 1719 61
vd_and_css_tweaks 99.77 78.38 2.80 2174 1708 61
rl_modules_hack_2 99.77 77.93 2.80 2174 1698 61
1.36.0-wmf.22 99.72 77.42 2.11 2173 1687 46
vd_tweaks 99.72 78.16 2.16 2173 1703 47
1.36.0-wmf.21 99.86 77.79 2.25 2176 1695 49
1.36.0-wmf.20 99.77 77.51 2.25 2174 1689 49
rl_modules_hack 99.72 77.01 2.34 2173 1678 51
1.36.0-wmf.18 99.72 74.16 2.25 2173 1616 49
1.36.0-wmf.16 99.72 73.66 2.20 2173 1605 48
1.36.0-wmf.14 99.72 73.61 2.34 2173 1604 51
1.36.0-wmf.13 99.77 73.70 2.43 2174 1606 53
cite_css_fixes 99.82 73.66 2.48 2175 1605 54
body_postprocessing_fix 99.63 60.26 2.11 2171 1313 46
1.36.0-wmf.10_and_CSS_fixes 99.63 60.21 2.07 2171 1312 45
1.36.0-wmf.10 99.63 58.19 2.07 2171 1268 45
1.36.0-wmf.9 99.45 58.01 2.02 2167 1264 44
1.36.0-wmf.8 99.63 58.05 1.97 2171 1265 43
1.36.0-wmf.6 99.54 58.05 1.70 2169 1265 37
1.36.0-wmf.5 99.50 57.82 1.47 2168 1260 32
1.36.0-wmf.4 99.45 57.69 1.33 2167 1257 29
1.36.0-wmf.3 99.45 57.60 1.01 2167 1255 22
vector-useskinversion-1 99.45 57.55 1.01 2167 1254 22
1.36.0-wmf.2 99.54 57.69 1.01 2169 1257 22
init_with_css_fixes 99.36 57.64 1.01 2165 1256 22
no_refs 99.86 69.85 1.24 2176 1522 27
no_img_or_gallery 98.76 63.74 0.92 2152 1389 20
init 98.35 54.80 1.01 2143 1194 22

Stats for frwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.82 88.06 47.37 2166 1911 1028
1.38.0-wmf.7 99.86 88.11 47.56 2167 1912 1032
1.38.0-wmf.6 99.82 88.06 47.19 2166 1911 1024
1.38.0-wmf.5 99.82 88.06 47.74 2166 1911 1036
1.38.0-wmf.4 99.86 88.11 47.79 2167 1912 1037
1.38.0-wmf.3 99.82 88.02 48.02 2166 1910 1042
1.38.0-wmf.2 99.82 88.06 47.00 2166 1911 1020
diffscoring-tweak 99.54 88.06 50.88 2160 1911 1104
more-span-stripping 99.59 88.11 35.53 2161 1912 771
1.38.0-wmf.1 99.49 85.67 7.93 2159 1859 172
strip-entity-spans 99.45 85.67 7.00 2158 1859 152
1.37.0-wmf.23 99.54 85.02 3.69 2160 1845 80
puppeteer-bump 99.59 86.73 35.39 2161 1882 768
1.37.0-wmf.21 99.49 86.96 37.65 2159 1887 817
1.37.0-wmf.20 99.35 86.59 24.06 2156 1879 522
more_rl_and_css_fixes 99.63 87.00 21.52 2162 1888 467
rl_and_css_fixes 99.59 75.25 14.52 2161 1633 315
survey_and_other_css_tweaks 99.54 65.67 11.01 2160 1425 239
1.36.0-wmf.27 99.59 65.67 11.06 2161 1425 240
1.36.0-wmf.26 99.63 65.81 11.06 2162 1428 240
1.36.0-wmf.25 99.63 66.27 11.20 2162 1438 243
parsoid_workarounds 99.59 66.36 11.11 2161 1440 241
vd_and_css_tweaks 99.59 63.55 10.78 2161 1379 234
rl_modules_hack_2 99.35 47.70 2.49 2156 1035 54
1.36.0-wmf.22 99.35 47.60 2.53 2156 1033 55
vd_tweaks 99.31 47.65 2.49 2155 1034 54
1.36.0-wmf.21 99.40 47.60 2.53 2157 1033 55
1.36.0-wmf.20 99.35 47.51 2.53 2156 1031 55
rl_modules_hack 99.35 47.74 2.53 2156 1036 55
1.36.0-wmf.18 99.22 46.08 2.44 2153 1000 53
1.36.0-wmf.16 99.22 45.99 2.49 2153 998 54
1.36.0-wmf.14 99.22 46.04 2.49 2153 999 54
1.36.0-wmf.13 99.22 45.90 2.49 2153 996 54
cite_css_fixes 99.22 45.99 2.49 2153 998 54
body_postprocessing_fix 99.22 46.18 2.44 2153 1002 53
1.36.0-wmf.10_and_CSS_fixes 99.22 46.04 2.40 2153 999 52
1.36.0-wmf.10 99.17 44.70 1.38 2152 970 30
1.36.0-wmf.9 99.12 44.52 1.34 2151 966 29
1.36.0-wmf.8 99.17 44.65 1.38 2152 969 30
1.36.0-wmf.6 99.12 44.88 1.43 2151 974 31
1.36.0-wmf.5 99.12 44.84 1.43 2151 973 31
1.36.0-wmf.4 99.12 45.07 1.38 2151 978 30
1.36.0-wmf.3 99.22 45.16 1.38 2153 980 30
vector-useskinversion-1 99.17 45.07 1.38 2152 978 30
1.36.0-wmf.2 99.17 45.12 1.34 2152 979 29
init_with_css_fixes 99.17 44.93 1.38 2152 975 30
no_refs 99.31 51.94 2.81 2155 1127 61
no_img_or_gallery 98.43 46.91 1.38 2136 1018 30
init 98.16 41.94 1.34 2130 910 29

Stats for hewiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 77.32 45.80 441 341 202
1.38.0-wmf.7 100.00 78.00 46.94 441 344 207
1.38.0-wmf.6 100.00 78.46 46.94 441 346 207
1.38.0-wmf.5 100.00 78.23 46.71 441 345 206
1.38.0-wmf.4 100.00 78.68 46.94 441 347 207
1.38.0-wmf.3 100.00 78.00 43.54 441 344 192
1.38.0-wmf.2 100.00 78.46 45.80 441 346 202
diffscoring-tweak 99.77 78.46 46.26 440 346 204
more-span-stripping 99.77 78.46 40.36 440 346 178
1.38.0-wmf.1 99.77 78.23 39.46 440 345 174
strip-entity-spans 100.00 78.68 39.91 441 347 176
1.37.0-wmf.23 99.77 78.91 22.90 440 348 101
puppeteer-bump 99.77 78.46 39.91 440 346 176
1.37.0-wmf.21 100.00 77.78 40.59 441 343 179
1.37.0-wmf.20 99.77 82.77 29.93 440 365 132
more_rl_and_css_fixes 99.77 82.99 22.90 440 366 101
rl_and_css_fixes 99.77 62.36 10.66 440 275 47
survey_and_other_css_tweaks 99.77 64.63 9.07 440 285 40
1.36.0-wmf.27 99.77 63.95 9.75 440 282 43
1.36.0-wmf.26 99.55 63.72 9.75 439 281 43
1.36.0-wmf.25 99.55 63.95 9.75 439 282 43
parsoid_workarounds 99.77 63.95 9.75 440 282 43
vd_and_css_tweaks 99.77 61.68 9.07 440 272 40
rl_modules_hack_2 99.77 61.68 7.94 440 272 35
1.36.0-wmf.22 99.77 43.99 3.63 440 194 16
vd_tweaks 99.77 43.99 3.63 440 194 16
1.36.0-wmf.21 99.55 43.99 3.63 439 194 16
1.36.0-wmf.20 99.55 44.44 3.63 439 196 16
rl_modules_hack 99.77 44.44 3.85 440 196 17
1.36.0-wmf.18 99.55 44.44 3.85 439 196 17
1.36.0-wmf.16 99.55 44.67 3.85 439 197 17
1.36.0-wmf.14 99.77 45.80 4.08 440 202 18
1.36.0-wmf.13 99.77 45.80 3.85 440 202 17
cite_css_fixes 99.77 45.80 3.85 440 202 17
body_postprocessing_fix 99.77 46.71 4.31 440 206 19
1.36.0-wmf.10_and_CSS_fixes 99.77 46.49 4.31 440 205 19
1.36.0-wmf.10 99.55 27.21 0.68 439 120 3
1.36.0-wmf.9 99.55 27.44 0.68 439 121 3
1.36.0-wmf.8 99.55 27.66 0.68 439 122 3
1.36.0-wmf.6 99.55 27.21 0.68 439 120 3
1.36.0-wmf.5 99.32 25.62 0.68 438 113 3
1.36.0-wmf.4 99.09 25.40 0.68 437 112 3
1.36.0-wmf.3 99.32 22.00 0.45 438 97 2
vector-useskinversion-1 98.64 15.42 0.45 435 68 2
1.36.0-wmf.2 100.00 0.00 0.00 441 0 0
init_with_css_fixes 98.41 15.19 0.68 434 67 3
no_refs 98.64 23.36 1.13 435 103 5
no_img_or_gallery 99.55 18.59 0.91 439 82 4
init 98.64 15.19 0.68 435 67 3

Stats for hiwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 82.78 45.93 209 173 96
1.38.0-wmf.7 100.00 82.30 45.45 209 172 95
1.38.0-wmf.6 100.00 82.30 44.98 209 172 94
1.38.0-wmf.5 100.00 82.30 44.50 209 172 93
1.38.0-wmf.4 100.00 81.82 44.50 209 171 93
1.38.0-wmf.3 100.00 82.30 45.45 209 172 95
1.38.0-wmf.2 100.00 81.34 44.50 209 170 93
diffscoring-tweak 100.00 81.34 44.98 209 170 94
more-span-stripping 100.00 81.34 37.80 209 170 79
1.38.0-wmf.1 100.00 81.82 33.97 209 171 71
strip-entity-spans 100.00 80.86 33.01 209 169 69
1.37.0-wmf.23 100.00 80.38 26.79 209 168 56
puppeteer-bump 100.00 82.30 42.11 209 172 88
1.37.0-wmf.21 100.00 82.78 41.15 209 173 86
1.37.0-wmf.20 99.52 83.73 44.02 208 175 92
more_rl_and_css_fixes 100.00 83.25 44.50 209 174 93
rl_and_css_fixes 100.00 82.78 44.50 209 173 93
survey_and_other_css_tweaks 100.00 83.25 37.80 209 174 79
1.36.0-wmf.27 100.00 83.73 37.80 209 175 79
1.36.0-wmf.26 100.00 82.78 37.80 209 173 79
1.36.0-wmf.25 100.00 83.25 38.28 209 174 80
parsoid_workarounds 100.00 83.25 38.28 209 174 80
vd_and_css_tweaks 100.00 82.30 32.54 209 172 68
rl_modules_hack_2 100.00 81.82 31.10 209 171 65
1.36.0-wmf.22 100.00 81.34 30.14 209 170 63
vd_tweaks 100.00 81.34 30.14 209 170 63
1.36.0-wmf.21 100.00 81.34 30.14 209 170 63
1.36.0-wmf.20 100.00 81.82 30.14 209 171 63
rl_modules_hack 100.00 81.34 30.14 209 170 63
1.36.0-wmf.18 100.00 80.38 32.06 209 168 67
1.36.0-wmf.16 100.00 79.90 32.54 209 167 68
1.36.0-wmf.14 100.00 80.86 32.54 209 169 68
1.36.0-wmf.13 100.00 81.34 32.54 209 170 68
cite_css_fixes 100.00 80.86 32.54 209 169 68
body_postprocessing_fix 100.00 80.38 32.54 209 168 68
1.36.0-wmf.10_and_CSS_fixes 100.00 80.86 32.06 209 169 67
1.36.0-wmf.10 100.00 81.34 16.27 209 170 34
1.36.0-wmf.9 100.00 80.86 16.27 209 169 34
1.36.0-wmf.8 100.00 80.38 15.79 209 168 33
1.36.0-wmf.6 100.00 79.43 15.31 209 166 32
1.36.0-wmf.5 100.00 79.43 14.35 209 166 30
1.36.0-wmf.4 100.00 80.38 13.88 209 168 29
1.36.0-wmf.3 100.00 77.51 5.74 209 162 12
vector-useskinversion-1 100.00 77.03 5.74 209 161 12
1.36.0-wmf.2 100.00 76.08 5.74 209 159 12
init_with_css_fixes 100.00 76.08 5.74 209 159 12
no_refs 100.00 78.95 26.79 209 165 56
no_img_or_gallery 100.00 82.30 6.70 209 172 14
init 100.00 77.03 5.74 209 161 12

Stats for iswiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 87.27 54.55 110 96 60
1.38.0-wmf.7 100.00 87.27 53.64 110 96 59
1.38.0-wmf.6 100.00 87.27 53.64 110 96 59
1.38.0-wmf.5 100.00 87.27 44.55 110 96 49
1.38.0-wmf.4 100.00 87.27 44.55 110 96 49
1.38.0-wmf.3 100.00 87.27 44.55 110 96 49
1.38.0-wmf.2 100.00 87.27 46.36 110 96 51
diffscoring-tweak 100.00 87.27 44.55 110 96 49
more-span-stripping 100.00 87.27 38.18 110 96 42
1.38.0-wmf.1 100.00 87.27 38.18 110 96 42
strip-entity-spans 100.00 87.27 39.09 110 96 43
1.37.0-wmf.23 100.00 85.45 32.73 110 94 36
puppeteer-bump 100.00 86.36 43.64 110 95 48
1.37.0-wmf.21 100.00 85.45 42.73 110 94 47
1.37.0-wmf.20 100.00 85.45 48.18 110 94 53
more_rl_and_css_fixes 100.00 85.45 48.18 110 94 53
rl_and_css_fixes 100.00 85.45 49.09 110 94 54
survey_and_other_css_tweaks 100.00 94.55 46.36 110 104 51
1.36.0-wmf.27 100.00 94.55 46.36 110 104 51
1.36.0-wmf.26 100.00 94.55 46.36 110 104 51
1.36.0-wmf.25 100.00 94.55 49.09 110 104 54
parsoid_workarounds 100.00 94.55 49.09 110 104 54
vd_and_css_tweaks 100.00 91.82 47.27 110 101 52
rl_modules_hack_2 100.00 91.82 47.27 110 101 52
1.36.0-wmf.22 100.00 83.64 40.91 110 92 45
vd_tweaks 100.00 83.64 40.91 110 92 45
1.36.0-wmf.21 100.00 83.64 40.91 110 92 45
1.36.0-wmf.20 100.00 83.64 40.91 110 92 45
rl_modules_hack 100.00 83.64 40.91 110 92 45
1.36.0-wmf.18 100.00 81.82 41.82 110 90 46
1.36.0-wmf.16 100.00 81.82 40.91 110 90 45
1.36.0-wmf.14 100.00 81.82 40.91 110 90 45
1.36.0-wmf.13 100.00 81.82 40.91 110 90 45
cite_css_fixes 100.00 81.82 40.91 110 90 45
body_postprocessing_fix 100.00 77.27 40.00 110 85 44
1.36.0-wmf.10_and_CSS_fixes 100.00 76.36 39.09 110 84 43
1.36.0-wmf.10 100.00 75.45 39.09 110 83 43
1.36.0-wmf.9 100.00 74.55 38.18 110 82 42
1.36.0-wmf.8 100.00 72.73 37.27 110 80 41
1.36.0-wmf.6 100.00 71.82 34.55 110 79 38
1.36.0-wmf.5 100.00 65.45 29.09 110 72 32
1.36.0-wmf.4 100.00 60.91 26.36 110 67 29
1.36.0-wmf.3 100.00 55.45 20.91 110 61 23
vector-useskinversion-1 100.00 55.45 20.91 110 61 23
1.36.0-wmf.2 100.00 55.45 20.91 110 61 23
init_with_css_fixes 100.00 54.55 20.91 110 60 23
no_refs 100.00 56.36 23.64 110 62 26
no_img_or_gallery 100.00 56.36 20.00 110 62 22
init 100.00 54.55 20.91 110 60 23

Stats for itwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.94 91.09 54.09 1637 1492 886
1.38.0-wmf.7 99.94 91.15 53.97 1637 1493 884
1.38.0-wmf.6 99.94 91.33 53.85 1637 1496 882
1.38.0-wmf.5 99.94 91.21 53.36 1637 1494 874
1.38.0-wmf.4 99.94 91.21 53.36 1637 1494 874
1.38.0-wmf.3 99.88 91.21 53.91 1636 1494 883
1.38.0-wmf.2 99.88 91.21 53.91 1636 1494 883
diffscoring-tweak 99.88 91.03 53.91 1636 1491 883
more-span-stripping 99.82 91.09 46.03 1635 1492 754
1.38.0-wmf.1 99.82 91.15 44.26 1635 1493 725
strip-entity-spans 99.82 90.96 43.89 1635 1490 719
1.37.0-wmf.23 99.82 90.35 11.66 1635 1480 191
puppeteer-bump 99.76 93.53 50.06 1634 1532 820
1.37.0-wmf.21 99.82 93.65 49.51 1635 1534 811
1.37.0-wmf.20 99.82 92.98 31.44 1635 1523 515
more_rl_and_css_fixes 99.63 93.10 30.40 1632 1525 498
rl_and_css_fixes 99.69 92.92 30.59 1633 1522 501
survey_and_other_css_tweaks 99.82 83.33 18.93 1635 1365 310
1.36.0-wmf.27 99.82 83.21 18.99 1635 1363 311
1.36.0-wmf.26 99.76 83.39 18.99 1634 1366 311
1.36.0-wmf.25 99.82 83.27 18.99 1635 1364 311
parsoid_workarounds 99.82 83.09 18.74 1635 1361 307
vd_and_css_tweaks 99.76 78.69 18.56 1634 1289 304
rl_modules_hack_2 99.82 76.92 15.69 1635 1260 257
1.36.0-wmf.22 99.82 77.17 15.69 1635 1264 257
vd_tweaks 99.82 76.98 15.69 1635 1261 257
1.36.0-wmf.21 99.82 76.98 15.69 1635 1261 257
1.36.0-wmf.20 99.82 76.92 15.69 1635 1260 257
rl_modules_hack 99.82 76.86 15.69 1635 1259 257
1.36.0-wmf.18 99.69 78.57 15.87 1633 1287 260
1.36.0-wmf.16 99.69 78.69 14.96 1633 1289 245
1.36.0-wmf.14 99.76 78.45 15.87 1634 1285 260
1.36.0-wmf.13 99.76 78.57 15.93 1634 1287 261
cite_css_fixes 99.76 78.39 15.93 1634 1284 261
body_postprocessing_fix 99.76 78.39 16.00 1634 1284 262
1.36.0-wmf.10_and_CSS_fixes 99.76 78.39 16.00 1634 1284 262
1.36.0-wmf.10 99.76 78.27 16.00 1634 1282 262
1.36.0-wmf.9 99.76 78.57 16.00 1634 1287 262
1.36.0-wmf.8 99.76 78.27 15.81 1634 1282 259
1.36.0-wmf.6 99.76 78.33 15.81 1634 1283 259
1.36.0-wmf.5 99.76 78.27 15.69 1634 1282 257
1.36.0-wmf.4 99.76 78.27 15.57 1634 1282 255
1.36.0-wmf.3 99.76 78.21 15.45 1634 1281 253
vector-useskinversion-1 99.76 78.21 15.51 1634 1281 254
1.36.0-wmf.2 99.76 78.21 15.38 1634 1281 252
init_with_css_fixes 99.76 77.90 13.49 1634 1276 221
no_refs 99.82 78.88 17.89 1635 1292 293
no_img_or_gallery 99.94 79.00 16.12 1637 1294 264
init 99.76 77.66 13.00 1634 1272 213

Stats for jawiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.79 93.66 55.21 929 872 514
1.38.0-wmf.7 99.79 91.84 47.58 929 855 443
1.38.0-wmf.6 99.79 91.51 47.37 929 852 441
1.38.0-wmf.5 99.79 91.62 46.94 929 853 437
1.38.0-wmf.4 99.79 91.62 46.94 929 853 437
1.38.0-wmf.3 99.79 91.73 47.26 929 854 440
1.38.0-wmf.2 99.79 91.62 46.62 929 853 434
diffscoring-tweak 99.25 91.51 46.94 924 852 437
more-span-stripping 99.36 91.84 27.18 925 855 253
1.38.0-wmf.1 99.36 91.73 26.64 925 854 248
strip-entity-spans 99.36 91.51 26.64 925 852 248
1.37.0-wmf.23 99.25 60.90 12.78 924 567 119
puppeteer-bump 99.36 91.84 17.51 925 855 163
1.37.0-wmf.21 99.57 91.84 17.94 927 855 167
1.37.0-wmf.20 99.57 94.09 18.58 927 876 173
more_rl_and_css_fixes 99.57 94.09 18.05 927 876 168
rl_and_css_fixes 99.03 93.13 18.05 922 867 168
survey_and_other_css_tweaks 99.68 94.09 16.97 928 876 158
1.36.0-wmf.27 99.68 94.20 17.08 928 877 159
1.36.0-wmf.26 99.68 94.31 17.40 928 878 162
1.36.0-wmf.25 99.68 94.31 17.51 928 878 163
parsoid_workarounds 99.68 94.09 17.62 928 876 164
vd_and_css_tweaks 99.68 90.23 13.96 928 840 130
rl_modules_hack_2 99.68 90.12 13.96 928 839 130
1.36.0-wmf.22 99.68 87.97 13.00 928 819 121
vd_tweaks 99.68 87.97 12.89 928 819 120
1.36.0-wmf.21 99.68 88.18 12.78 928 821 119
1.36.0-wmf.20 99.68 88.18 12.57 928 821 117
rl_modules_hack 99.68 88.18 12.67 928 821 118
1.36.0-wmf.18 99.68 88.08 12.24 928 820 114
1.36.0-wmf.16 99.89 88.83 13.00 930 827 121
1.36.0-wmf.14 99.89 88.61 12.78 930 825 119
1.36.0-wmf.13 99.89 88.61 12.78 930 825 119
cite_css_fixes 99.89 88.61 13.00 930 825 121
body_postprocessing_fix 99.89 88.40 12.67 930 823 118
1.36.0-wmf.10_and_CSS_fixes 99.89 88.51 12.78 930 824 119
1.36.0-wmf.10 99.89 88.18 12.35 930 821 115
1.36.0-wmf.9 99.89 88.72 12.46 930 826 116
1.36.0-wmf.8 99.89 88.51 12.35 930 824 115
1.36.0-wmf.6 99.89 88.08 12.67 930 820 118
1.36.0-wmf.5 99.89 87.43 12.78 930 814 119
1.36.0-wmf.4 99.89 85.93 12.14 930 800 113
1.36.0-wmf.3 99.89 84.21 10.31 930 784 96
vector-useskinversion-1 99.89 84.21 10.31 930 784 96
1.36.0-wmf.2 99.89 84.10 10.31 930 783 96
init_with_css_fixes 99.89 83.57 10.10 930 778 94
no_refs 100.00 83.57 25.03 931 778 233
no_img_or_gallery 99.89 84.00 10.42 930 782 97
init 99.68 83.57 9.99 928 778 93

Stats for kaawiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 91.84 60.20 98 90 59
1.38.0-wmf.7 100.00 91.84 60.20 98 90 59
1.38.0-wmf.6 100.00 91.84 60.20 98 90 59
1.38.0-wmf.5 100.00 91.84 60.20 98 90 59
1.38.0-wmf.4 100.00 91.84 60.20 98 90 59
1.38.0-wmf.3 100.00 91.84 60.20 98 90 59
1.38.0-wmf.2 100.00 91.84 59.18 98 90 58
diffscoring-tweak 100.00 91.84 59.18 98 90 58
more-span-stripping 100.00 91.84 55.10 98 90 54
1.38.0-wmf.1 100.00 91.84 51.02 98 90 50
strip-entity-spans 100.00 91.84 51.02 98 90 50
1.37.0-wmf.23 100.00 91.84 45.92 98 90 45
puppeteer-bump 100.00 91.84 56.12 98 90 55
1.37.0-wmf.21 100.00 91.84 56.12 98 90 55
1.37.0-wmf.20 100.00 91.84 55.10 98 90 54
more_rl_and_css_fixes 100.00 91.84 55.10 98 90 54
rl_and_css_fixes 100.00 90.82 54.08 98 89 53
survey_and_other_css_tweaks 100.00 98.98 75.51 98 97 74
1.36.0-wmf.27 100.00 98.98 75.51 98 97 74
1.36.0-wmf.26 100.00 98.98 75.51 98 97 74
1.36.0-wmf.25 100.00 98.98 75.51 98 97 74
parsoid_workarounds 100.00 98.98 75.51 98 97 74
vd_and_css_tweaks 100.00 95.92 64.29 98 94 63
rl_modules_hack_2 100.00 95.92 64.29 98 94 63
1.36.0-wmf.22 100.00 91.84 55.10 98 90 54
vd_tweaks 100.00 91.84 55.10 98 90 54
1.36.0-wmf.21 100.00 91.84 55.10 98 90 54
1.36.0-wmf.20 100.00 91.84 55.10 98 90 54
rl_modules_hack 100.00 91.84 55.10 98 90 54
1.36.0-wmf.18 100.00 89.80 54.08 98 88 53
1.36.0-wmf.16 100.00 89.80 54.08 98 88 53
1.36.0-wmf.14 100.00 89.80 54.08 98 88 53
1.36.0-wmf.13 100.00 89.80 53.06 98 88 52
cite_css_fixes 100.00 89.80 53.06 98 88 52
body_postprocessing_fix 100.00 87.76 53.06 98 86 52
1.36.0-wmf.10_and_CSS_fixes 100.00 86.73 52.04 98 85 51
1.36.0-wmf.10 100.00 84.69 52.04 98 83 51
1.36.0-wmf.9 100.00 84.69 50.00 98 83 49
1.36.0-wmf.8 100.00 84.69 47.96 98 83 47
1.36.0-wmf.6 100.00 81.63 43.88 98 80 43
1.36.0-wmf.5 100.00 78.57 38.78 98 77 38
1.36.0-wmf.4 100.00 78.57 32.65 98 77 32
1.36.0-wmf.3 100.00 72.45 23.47 98 71 23
vector-useskinversion-1 100.00 72.45 23.47 98 71 23
1.36.0-wmf.2 100.00 72.45 23.47 98 71 23
init_with_css_fixes 100.00 70.41 22.45 98 69 22
no_refs 100.00 70.41 22.45 98 69 22
no_img_or_gallery 100.00 73.47 23.47 98 72 23
init 100.00 70.41 22.45 98 69 22

Stats for kowiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 92.48 63.91 133 123 85
1.38.0-wmf.7 100.00 92.48 64.66 133 123 86
1.38.0-wmf.6 100.00 92.48 64.66 133 123 86
1.38.0-wmf.5 100.00 92.48 63.16 133 123 84
1.38.0-wmf.4 100.00 92.48 61.65 133 123 82
1.38.0-wmf.3 100.00 91.73 62.41 133 122 83
1.38.0-wmf.2 100.00 91.73 57.89 133 122 77
diffscoring-tweak 100.00 91.73 55.64 133 122 74
more-span-stripping 100.00 91.73 47.37 133 122 63
1.38.0-wmf.1 100.00 90.98 40.60 133 121 54
strip-entity-spans 99.25 90.23 41.35 132 120 55
1.37.0-wmf.23 99.25 89.47 38.35 132 119 51
puppeteer-bump 100.00 90.23 54.89 133 120 73
1.37.0-wmf.21 100.00 88.72 51.13 133 118 68
1.37.0-wmf.20 99.25 88.72 50.38 132 118 67
more_rl_and_css_fixes 100.00 88.72 50.38 133 118 67
rl_and_css_fixes 100.00 88.72 52.63 133 118 70
survey_and_other_css_tweaks 99.25 90.23 28.57 132 120 38
1.36.0-wmf.27 99.25 89.47 28.57 132 119 38
1.36.0-wmf.26 99.25 90.98 29.32 132 121 39
1.36.0-wmf.25 100.00 90.98 30.08 133 121 40
parsoid_workarounds 100.00 90.98 27.82 133 121 37
vd_and_css_tweaks 100.00 90.98 27.82 133 121 37
rl_modules_hack_2 99.25 90.98 27.82 132 121 37
1.36.0-wmf.22 100.00 90.98 25.56 133 121 34
vd_tweaks 100.00 90.98 25.56 133 121 34
1.36.0-wmf.21 100.00 90.98 27.82 133 121 37
1.36.0-wmf.20 100.00 90.98 27.82 133 121 37
rl_modules_hack 100.00 90.98 27.07 133 121 36
1.36.0-wmf.18 100.00 87.22 27.07 133 116 36
1.36.0-wmf.16 100.00 87.97 27.07 133 117 36
1.36.0-wmf.14 100.00 87.22 26.32 133 116 35
1.36.0-wmf.13 100.00 87.22 26.32 133 116 35
cite_css_fixes 100.00 87.22 26.32 133 116 35
body_postprocessing_fix 100.00 86.47 26.32 133 115 35
1.36.0-wmf.10_and_CSS_fixes 100.00 87.22 26.32 133 116 35
1.36.0-wmf.10 100.00 81.95 6.77 133 109 9
1.36.0-wmf.9 100.00 80.45 6.77 133 107 9
1.36.0-wmf.8 100.00 79.70 6.77 133 106 9
1.36.0-wmf.6 100.00 80.45 6.77 133 107 9
1.36.0-wmf.5 100.00 79.70 6.77 133 106 9
1.36.0-wmf.4 100.00 79.70 6.77 133 106 9
1.36.0-wmf.3 100.00 79.70 6.77 133 106 9
vector-useskinversion-1 100.00 79.70 6.77 133 106 9
1.36.0-wmf.2 100.00 79.70 6.77 133 106 9
init_with_css_fixes 100.00 78.95 6.02 133 105 8
no_refs 100.00 81.95 6.77 133 109 9
no_img_or_gallery 100.00 77.44 6.77 133 103 9
init 100.00 78.20 6.02 133 104 8

Stats for nlwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 97.09 34.06 1098 1066 374
1.38.0-wmf.7 100.00 97.27 34.15 1098 1068 375
1.38.0-wmf.6 100.00 97.27 33.97 1098 1068 373
1.38.0-wmf.5 100.00 97.27 33.88 1098 1068 372
1.38.0-wmf.4 100.00 97.27 33.15 1098 1068 364
1.38.0-wmf.3 100.00 97.18 31.69 1098 1067 348
1.38.0-wmf.2 100.00 97.09 30.97 1098 1066 340
diffscoring-tweak 100.00 96.99 31.79 1098 1065 349
more-span-stripping 100.00 97.09 24.41 1098 1066 268
1.38.0-wmf.1 100.00 97.09 24.04 1098 1066 264
strip-entity-spans 100.00 97.09 23.86 1098 1066 262
1.37.0-wmf.23 100.00 97.09 13.66 1098 1066 150
puppeteer-bump 100.00 96.99 34.97 1098 1065 384
1.37.0-wmf.21 100.00 96.99 34.88 1098 1065 383
1.37.0-wmf.20 100.00 97.18 31.06 1098 1067 341
more_rl_and_css_fixes 100.00 97.18 30.78 1098 1067 338
rl_and_css_fixes 100.00 97.18 31.06 1098 1067 341
survey_and_other_css_tweaks 100.00 97.36 28.69 1098 1069 315
1.36.0-wmf.27 100.00 97.45 28.78 1098 1070 316
1.36.0-wmf.26 100.00 97.45 29.33 1098 1070 322
1.36.0-wmf.25 100.00 97.54 29.60 1098 1071 325
parsoid_workarounds 100.00 97.36 29.78 1098 1069 327
vd_and_css_tweaks 100.00 95.08 23.86 1098 1044 262
rl_modules_hack_2 100.00 95.17 23.86 1098 1045 262
1.36.0-wmf.22 100.00 93.17 21.86 1098 1023 240
vd_tweaks 100.00 93.35 21.86 1098 1025 240
1.36.0-wmf.21 100.00 93.44 21.86 1098 1026 240
1.36.0-wmf.20 100.00 93.44 21.86 1098 1026 240
rl_modules_hack 100.00 93.44 22.22 1098 1026 244
1.36.0-wmf.18 100.00 92.26 21.22 1098 1013 233
1.36.0-wmf.16 100.00 92.35 21.13 1098 1014 232
1.36.0-wmf.14 100.00 92.44 21.22 1098 1015 233
1.36.0-wmf.13 100.00 92.35 21.22 1098 1014 233
cite_css_fixes 100.00 92.17 21.13 1098 1012 232
body_postprocessing_fix 100.00 92.35 21.86 1098 1014 240
1.36.0-wmf.10_and_CSS_fixes 100.00 92.17 21.86 1098 1012 240
1.36.0-wmf.10 100.00 92.08 21.77 1098 1011 239
1.36.0-wmf.9 100.00 51.28 13.57 1098 563 149
1.36.0-wmf.8 100.00 15.12 7.56 1098 166 83
1.36.0-wmf.6 100.00 14.85 7.10 1098 163 78
1.36.0-wmf.5 100.00 14.12 6.10 1098 155 67
1.36.0-wmf.4 100.00 13.30 4.55 1098 146 50
1.36.0-wmf.3 100.00 12.84 4.37 1098 141 48
vector-useskinversion-1 100.00 12.75 4.37 1098 140 48
1.36.0-wmf.2 100.00 12.75 4.28 1098 140 47
init_with_css_fixes 100.00 12.75 4.28 1098 140 47
no_refs 100.00 12.84 4.92 1098 141 54
no_img_or_gallery 100.00 13.48 4.37 1098 148 48
init 100.00 12.75 4.28 1098 140 47

Stats for plwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.73 95.18 71.88 1096 1046 790
1.38.0-wmf.7 99.73 94.81 70.34 1096 1042 773
1.38.0-wmf.6 99.73 94.63 69.70 1096 1040 766
1.38.0-wmf.5 99.73 95.72 72.07 1096 1052 792
1.38.0-wmf.4 99.73 95.91 71.61 1096 1054 787
1.38.0-wmf.3 99.73 95.91 71.43 1096 1054 785
1.38.0-wmf.2 99.73 95.45 70.15 1096 1049 771
diffscoring-tweak 99.73 95.27 70.06 1096 1047 770
more-span-stripping 99.73 95.18 49.32 1096 1046 542
1.38.0-wmf.1 99.73 95.27 48.32 1096 1047 531
strip-entity-spans 99.73 95.27 48.41 1096 1047 532
1.37.0-wmf.23 99.64 94.18 18.56 1095 1035 204
puppeteer-bump 99.73 94.90 65.24 1096 1043 717
1.37.0-wmf.21 99.82 95.27 62.33 1097 1047 685
1.37.0-wmf.20 99.73 90.08 41.13 1096 990 452
more_rl_and_css_fixes 99.82 91.08 39.76 1097 1001 437
rl_and_css_fixes 99.73 82.44 36.31 1096 906 399
survey_and_other_css_tweaks 99.64 91.08 36.85 1095 1001 405
1.36.0-wmf.27 99.64 91.17 37.12 1095 1002 408
1.36.0-wmf.26 99.64 91.36 37.31 1095 1004 410
1.36.0-wmf.25 99.64 91.54 37.31 1095 1006 410
parsoid_workarounds 99.64 91.54 37.31 1095 1006 410
vd_and_css_tweaks 99.64 88.81 30.94 1095 976 340
rl_modules_hack_2 99.64 88.81 30.85 1095 976 339
1.36.0-wmf.22 99.64 73.34 26.84 1095 806 295
vd_tweaks 99.64 73.43 26.75 1095 807 294
1.36.0-wmf.21 99.64 73.34 27.30 1095 806 300
1.36.0-wmf.20 99.64 73.70 27.39 1095 810 301
rl_modules_hack 99.64 73.70 27.57 1095 810 303
1.36.0-wmf.18 99.27 68.15 26.11 1091 749 287
1.36.0-wmf.16 99.18 68.24 26.48 1090 750 291
1.36.0-wmf.14 99.45 67.97 26.21 1093 747 288
1.36.0-wmf.13 99.36 67.70 26.21 1092 744 288
cite_css_fixes 99.36 67.61 26.30 1092 743 289
body_postprocessing_fix 99.45 67.61 26.75 1093 743 294
1.36.0-wmf.10_and_CSS_fixes 99.45 67.52 26.57 1093 742 292
1.36.0-wmf.10 99.45 66.15 25.39 1093 727 279
1.36.0-wmf.9 99.45 65.97 25.11 1093 725 276
1.36.0-wmf.8 99.36 66.06 25.20 1092 726 277
1.36.0-wmf.6 99.45 66.33 25.20 1093 729 277
1.36.0-wmf.5 99.45 65.70 24.29 1093 722 267
1.36.0-wmf.4 99.36 65.70 24.29 1092 722 267
1.36.0-wmf.3 99.45 65.15 23.57 1093 716 259
vector-useskinversion-1 99.45 65.06 23.48 1093 715 258
1.36.0-wmf.2 99.45 65.06 23.38 1093 715 257
init_with_css_fixes 99.45 64.51 23.20 1093 709 255
no_refs 99.73 67.70 28.03 1096 744 308
no_img_or_gallery 99.09 43.95 12.74 1089 483 140
init 99.00 39.58 12.65 1088 435 139

Stats for ruwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.95 90.89 33.24 2183 1985 726
1.38.0-wmf.7 99.95 90.84 32.69 2183 1984 714
1.38.0-wmf.6 99.95 90.61 32.83 2183 1979 717
1.38.0-wmf.5 99.91 90.57 32.37 2182 1978 707
1.38.0-wmf.4 99.95 90.52 32.65 2183 1977 713
1.38.0-wmf.3 99.91 90.52 32.55 2182 1977 711
1.38.0-wmf.2 99.91 90.52 31.87 2182 1977 696
diffscoring-tweak 99.77 90.75 32.01 2179 1982 699
more-span-stripping 99.82 90.57 21.29 2180 1978 465
1.38.0-wmf.1 99.68 90.11 18.22 2177 1968 398
strip-entity-spans 99.68 90.29 18.54 2177 1972 405
1.37.0-wmf.23 99.63 88.83 9.11 2176 1940 199
puppeteer-bump 99.73 90.02 33.75 2178 1966 737
1.37.0-wmf.21 99.68 90.02 31.41 2177 1966 686
1.37.0-wmf.20 99.73 91.35 25.78 2178 1995 563
more_rl_and_css_fixes 99.82 91.21 25.18 2180 1992 550
rl_and_css_fixes 99.73 90.71 25.50 2178 1981 557
survey_and_other_css_tweaks 99.82 83.15 19.73 2180 1816 431
1.36.0-wmf.27 99.73 85.85 19.78 2178 1875 432
1.36.0-wmf.26 99.73 85.99 20.42 2178 1878 446
1.36.0-wmf.25 99.82 86.03 20.51 2180 1879 448
parsoid_workarounds 99.82 85.99 20.74 2180 1878 453
vd_and_css_tweaks 99.82 83.24 18.91 2180 1818 413
rl_modules_hack_2 99.77 83.20 18.64 2179 1817 407
1.36.0-wmf.22 99.77 81.46 18.50 2179 1779 404
vd_tweaks 99.77 81.73 18.41 2179 1785 402
1.36.0-wmf.21 99.77 82.97 18.45 2179 1812 403
1.36.0-wmf.20 99.77 82.10 18.54 2179 1793 405
rl_modules_hack 99.77 82.88 18.09 2179 1810 395
1.36.0-wmf.18 99.73 64.88 17.72 2178 1417 387
1.36.0-wmf.16 99.68 63.32 17.17 2177 1383 375
1.36.0-wmf.14 99.68 64.70 17.45 2177 1413 381
1.36.0-wmf.13 99.68 64.61 17.49 2177 1411 382
cite_css_fixes 99.68 64.74 17.63 2177 1414 385
body_postprocessing_fix 99.77 64.56 17.54 2179 1410 383
1.36.0-wmf.10_and_CSS_fixes 99.68 64.29 17.35 2177 1404 379
1.36.0-wmf.10 99.68 64.06 17.17 2177 1399 375
1.36.0-wmf.9 99.68 64.10 16.94 2177 1400 370
1.36.0-wmf.8 99.63 64.10 16.67 2176 1400 364
1.36.0-wmf.6 99.63 63.42 16.62 2176 1385 363
1.36.0-wmf.5 99.77 63.14 16.07 2179 1379 351
1.36.0-wmf.4 99.73 63.10 15.75 2178 1378 344
1.36.0-wmf.3 99.77 62.45 14.33 2179 1364 313
vector-useskinversion-1 99.77 61.90 14.19 2179 1352 310
1.36.0-wmf.2 99.77 62.45 14.47 2179 1364 316
init_with_css_fixes 99.73 62.13 14.15 2178 1357 309
no_refs 99.91 63.00 19.14 2182 1376 418
no_img_or_gallery 99.54 52.47 6.46 2174 1146 141
init 99.54 50.18 6.36 2174 1096 139

Stats for svwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 100.00 92.15 27.74 739 681 205
1.38.0-wmf.7 100.00 92.56 28.01 739 684 207
1.38.0-wmf.6 100.00 92.42 27.74 739 683 205
1.38.0-wmf.5 100.00 92.56 27.33 739 684 202
1.38.0-wmf.4 100.00 91.20 26.25 739 674 194
1.38.0-wmf.3 100.00 91.34 26.52 739 675 196
1.38.0-wmf.2 100.00 92.29 26.25 739 682 194
diffscoring-tweak 100.00 92.15 26.79 739 681 198
more-span-stripping 100.00 92.29 20.43 739 682 151
1.38.0-wmf.1 100.00 92.29 18.67 739 682 138
strip-entity-spans 100.00 91.75 18.67 739 678 138
1.37.0-wmf.23 100.00 89.58 6.36 739 662 47
puppeteer-bump 100.00 92.02 33.83 739 680 250
1.37.0-wmf.21 100.00 92.56 33.69 739 684 249
1.37.0-wmf.20 100.00 94.99 34.24 739 702 253
more_rl_and_css_fixes 100.00 94.72 33.83 739 700 250
rl_and_css_fixes 100.00 89.58 33.96 739 662 251
survey_and_other_css_tweaks 100.00 88.90 15.29 739 657 113
1.36.0-wmf.27 100.00 89.04 15.29 739 658 113
1.36.0-wmf.26 100.00 89.04 14.75 739 658 109
1.36.0-wmf.25 100.00 89.17 15.16 739 659 112
parsoid_workarounds 100.00 89.17 15.29 739 659 113
vd_and_css_tweaks 100.00 88.36 14.61 739 653 108
rl_modules_hack_2 100.00 87.96 12.99 739 650 96
1.36.0-wmf.22 100.00 72.26 12.04 739 534 89
vd_tweaks 99.86 72.26 11.91 738 534 88
1.36.0-wmf.21 99.59 65.09 5.68 736 481 42
1.36.0-wmf.20 99.46 65.09 5.68 735 481 42
rl_modules_hack 99.46 65.09 5.82 735 481 43
1.36.0-wmf.18 99.46 64.55 5.82 735 477 43
1.36.0-wmf.16 99.46 64.82 5.82 735 479 43
1.36.0-wmf.14 99.46 64.82 5.95 735 479 44
1.36.0-wmf.13 99.59 64.55 5.82 736 477 43
cite_css_fixes 99.59 64.68 5.82 736 478 43
body_postprocessing_fix 99.59 64.95 5.82 736 480 43
1.36.0-wmf.10_and_CSS_fixes 99.59 64.68 5.82 736 478 43
1.36.0-wmf.10 99.73 64.82 5.82 737 479 43
1.36.0-wmf.9 99.73 64.68 5.95 737 478 44
1.36.0-wmf.8 99.59 64.41 5.82 736 476 43
1.36.0-wmf.6 99.73 64.01 5.55 737 473 41
1.36.0-wmf.5 99.73 64.14 5.41 737 474 40
1.36.0-wmf.4 99.73 64.01 5.41 737 473 40
1.36.0-wmf.3 99.73 63.73 5.41 737 471 40
vector-useskinversion-1 99.73 63.73 5.41 737 471 40
1.36.0-wmf.2 99.59 63.73 5.41 736 471 40
init_with_css_fixes 99.73 63.33 5.41 737 468 40
no_refs 100.00 70.64 15.43 739 522 114
no_img_or_gallery 99.59 27.74 4.87 736 205 36
init 99.59 27.74 4.74 736 205 35

Stats for viwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 99.91 93.66 57.63 1087 1019 627
1.38.0-wmf.7 100.00 93.75 55.88 1088 1020 608
1.38.0-wmf.6 100.00 93.84 55.33 1088 1021 602
1.38.0-wmf.5 100.00 93.93 55.42 1088 1022 603
1.38.0-wmf.4 100.00 94.03 55.15 1088 1023 600
1.38.0-wmf.3 99.91 94.03 55.42 1087 1023 603
1.38.0-wmf.2 100.00 93.93 55.42 1088 1022 603
diffscoring-tweak 99.63 93.84 55.70 1084 1021 606
more-span-stripping 99.82 93.75 43.01 1086 1020 468
1.38.0-wmf.1 99.72 93.84 42.46 1085 1021 462
strip-entity-spans 99.91 93.75 42.37 1087 1020 461
1.37.0-wmf.23 99.54 90.90 34.01 1083 989 370
puppeteer-bump 99.63 93.57 34.65 1084 1018 377
1.37.0-wmf.21 99.91 94.12 33.73 1087 1024 367
1.37.0-wmf.20 99.63 91.27 25.09 1084 993 273
more_rl_and_css_fixes 99.82 90.90 24.45 1086 989 266
rl_and_css_fixes 99.82 90.99 24.36 1086 990 265
survey_and_other_css_tweaks 99.82 89.80 13.88 1086 977 151
1.36.0-wmf.27 99.72 89.06 12.59 1085 969 137
1.36.0-wmf.26 99.82 89.89 14.06 1086 978 153
1.36.0-wmf.25 99.72 89.34 13.97 1085 972 152
parsoid_workarounds 99.72 89.25 14.06 1085 971 153
vd_and_css_tweaks 99.72 87.78 13.79 1085 955 150
rl_modules_hack_2 99.82 88.51 14.25 1086 963 155
1.36.0-wmf.22 99.72 88.33 13.97 1085 961 152
vd_tweaks 99.82 88.42 14.15 1086 962 154
1.36.0-wmf.21 99.72 88.33 13.97 1085 961 152
1.36.0-wmf.20 99.72 87.96 14.06 1085 957 153
rl_modules_hack 99.82 88.42 14.06 1086 962 153
1.36.0-wmf.18 99.36 85.85 14.80 1081 934 161
1.36.0-wmf.16 99.45 85.75 14.52 1082 933 158
1.36.0-wmf.14 99.54 85.57 14.52 1083 931 158
1.36.0-wmf.13 99.63 85.39 14.43 1084 929 157
cite_css_fixes 99.63 85.29 14.52 1084 928 158
body_postprocessing_fix 99.63 84.93 14.15 1084 924 154
1.36.0-wmf.10_and_CSS_fixes 99.63 85.11 14.15 1084 926 154
1.36.0-wmf.10 99.54 85.11 14.43 1083 926 157
1.36.0-wmf.9 99.54 84.83 14.15 1083 923 154
1.36.0-wmf.8 99.54 84.65 13.24 1083 921 144
1.36.0-wmf.6 99.54 83.92 13.51 1083 913 147
1.36.0-wmf.5 99.54 83.92 13.51 1083 913 147
1.36.0-wmf.4 99.54 83.09 13.05 1083 904 142
1.36.0-wmf.3 99.54 82.26 12.22 1083 895 133
vector-useskinversion-1 99.54 82.26 12.22 1083 895 133
1.36.0-wmf.2 99.54 82.26 12.32 1083 895 134
init_with_css_fixes 99.54 82.63 12.32 1083 899 134
no_refs 99.72 88.14 18.47 1085 959 201
no_img_or_gallery 99.82 83.46 12.59 1086 908 137
init 99.54 82.54 12.41 1083 898 135

Stats for zhwiki

[edit]
Test Id % completed % vertical-shift-only-or-no-diffs % no-diffs # completed # vertical-shift-only-or-no-diffs # no-diffs
1.38.0-wmf.9 98.93 30.89 1.53 647 202 10
1.38.0-wmf.7 98.93 31.19 1.53 647 204 10
1.38.0-wmf.6 98.78 31.04 1.53 646 203 10
1.38.0-wmf.5 98.93 31.04 1.53 647 203 10
1.38.0-wmf.4 99.08 30.89 1.53 648 202 10
1.38.0-wmf.3 99.08 30.73 1.53 648 201 10
1.38.0-wmf.2 99.08 30.43 1.53 648 199 10
diffscoring-tweak 97.71 30.73 1.53 639 201 10
more-span-stripping 97.71 30.73 1.38 639 201 9
1.38.0-wmf.1 97.86 30.73 1.38 640 201 9
strip-entity-spans 97.40 30.89 1.38 637 202 9
1.37.0-wmf.23 96.48 29.97 1.38 631 196 9
puppeteer-bump 97.55 26.91 1.38 638 176 9
1.37.0-wmf.21 96.94 26.91 1.07 634 176 7
1.37.0-wmf.20 97.40 27.37 1.07 637 179 7
more_rl_and_css_fixes 96.48 27.52 1.07 631 180 7
rl_and_css_fixes 97.86 27.68 1.07 640 181 7
survey_and_other_css_tweaks 96.94 38.69 1.07 634 253 7
1.36.0-wmf.27 97.25 38.69 1.07 636 253 7
1.36.0-wmf.26 97.09 38.99 1.07 635 255 7
1.36.0-wmf.25 97.40 38.84 1.07 637 254 7
parsoid_workarounds 96.94 38.84 1.07 634 254 7
vd_and_css_tweaks 96.94 38.38 1.07 634 251 7
rl_modules_hack_2 97.09 38.07 1.07 635 249 7
1.36.0-wmf.22 96.48 30.28 1.07 631 198 7
vd_tweaks 96.48 30.43 1.07 631 199 7
1.36.0-wmf.21 96.18 29.05 1.07 629 190 7
1.36.0-wmf.20 96.79 26.45 1.07 633 173 7
rl_modules_hack 95.87 29.97 1.07 627 196 7
1.36.0-wmf.18 96.48 30.28 1.07 631 198 7
1.36.0-wmf.16 96.33 29.97 1.07 630 196 7
1.36.0-wmf.14 96.48 30.28 1.22 631 198 8
1.36.0-wmf.13 96.48 30.43 1.22 631 199 8
cite_css_fixes 96.64 30.58 1.22 632 200 8
body_postprocessing_fix 96.33 31.04 1.22 630 203 8
1.36.0-wmf.10_and_CSS_fixes 96.33 31.65 1.22 630 207 8
1.36.0-wmf.10 96.33 31.80 1.22 630 208 8
1.36.0-wmf.9 96.33 31.65 1.22 630 207 8
1.36.0-wmf.8 96.33 31.35 1.22 630 205 8
1.36.0-wmf.6 96.64 31.04 1.22 632 203 8
1.36.0-wmf.5 96.64 30.43 1.22 632 199 8
1.36.0-wmf.4 96.64 30.73 1.07 632 201 7
1.36.0-wmf.3 96.79 29.82 0.92 633 195 6
vector-useskinversion-1 96.64 29.82 0.92 632 195 6
1.36.0-wmf.2 96.64 29.82 0.92 632 195 6
init_with_css_fixes 96.64 29.36 0.92 632 192 6
no_refs 97.09 40.67 2.29 635 266 15
no_img_or_gallery 96.64 29.20 0.92 632 191 6
init 96.64 29.05 0.92 632 190 6