Sorry for the delay! We are done testing the participants' solutions, presenting preliminary results below. Why are these “preliminary”? Because we can be wrong. We hope not, but if someone can point out how our results are incorrect, there's still time to revisit them. Comments are welcome!
Final results, with participants' names instead of submission IDs, will be announced on June 20, 2016. We are also going to post a separate article that gives proper consideration to those solutions that learn, comparing them to each other.
See also the Russian version of this page.
All solutions were tested on 10,000 blocks of 100 words each, generated by the testcase generator using the official testcase sequence. Here are a few facts about the test set.
| Subset | Words | Share | Examples |
|---|---|---|---|
| Dictionary words | 500,672 | 50.07% | |
| All nonwords | 499,328 | 49.93% | |
| Nonwords, model 0 | 92,206 | 9.22% | ha'pjcnvcekpmexvsswbzfoq'k, qh'whqpmowhukjjgxwinajyk, leysazuyabs |
| Nonwords, model 1 | 69,134 | 6.91% | tcnes, husis, cobotlvindiomives |
| Nonwords, model 2 | 74,631 | 7.46% | coterfnicurly, wileberwalinteller's, grahablens |
| Nonwords, model 3 | 78,793 | 7.88% | fluiajalorium's, theral, cryophy |
| Nonwords, model 4 | 75,506 | 7.55% | anzanies, blanckian, alchorp |
| Nonwords, model 5 | 56,814 | 5.68% | ostenderstated, smuckers, kettless |
| Nonwords, model 6 | 30,604 | 3.06% | portlige, celioelectrochemical's, runlessen |
| Nonwords, model 7 | 14,427 | 1.44% | ultrapatriot's, acocantheridiida, counterforms |
| Nonwords, model 8 | 7,213 | 0.72% | gynogenetical, prepalaeolithy, oxynaphthalene |
Nonwords from high-order Markov models are significantly more rare in the test set than those from low-order models. This is due to the particular algorithm the test generator uses: if a generated nonword happens to be in the dictionary, it is discarded, and a new nonword is generated, possibly from a different model. Because the output of high-order models very closely resembles English, this happens to them much more often. We decided not to correct for this phenomenon, and have low-similarity nonwords dominate the set.
A few people asked why the dictionary was so weird, with many “words” that you wouldn't normally think of as English. Here is why. There are only so many words in English (and any other language). Dictionaries normally used in spellcheckers range between 50,000 and 165,000 words. We could have picked, say, 165,000 words, which is on the large side of what can reasonably be called “an English dictionary”. With 64 KiB size limit, it would most likely be possible to fit the entire compressed dictionary in the quota and achieve 100% correctness. This wouldn't be acceptable because then we would be unable to decide between many contestants who achieved 100%. This means that the quota would have to be reduced accordingly, to 16 KiB or even smaller. But for such small sizes, efficient minification of the code itself (and not just data compression) becomes a concern, and we didn't want this to become mainly a code minification contest. For this reason, we went for the biggest dictionary we could find: the “insane” version of the SCOWL, which includes ridiculously rare terminology, seldom-used spelling variants, and even some nonexistent words generated by stemming. Even the biggest reasonable spelling dictionary is less than a quarter of this, which means that at least 3 in 4 words in our wordlist are not what you would call an English word. Still, these are not entirely random, and still share many statistical properties with English proper. We decided to compromise on this dictionary to achieve an interesting balance.
We received 603 submissions from 312 unique participants. Only the last submission from each participant was tested.
Excluded from this table are submissions that crashed, hanged, or were too slow to complete testing.
Legend:
- Correct: correctness rate (this is what the competition is about)
- F–: rate of false negatives
- F+: rate of false positives
- F+0…F+8: rate of false positives among words generated from a particular model
- hc: submissions hors concours (off-contest)
Solutions that haven't been assigned a rank in the leftmost column of this table, were evaluated off-contest for several reasons, such as having been submitted by Hola employees or requiring a fix to run (author forgot the “gzip” checkbox when submitting).
| # | ID | Correct | F– | F+ | F+0 | F+1 | F+2 | F+3 | F+4 | F+5 | F+6 | F+7 | F+8 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 5747452a63905b3a11d97c13 | 83.67% | 6.21% | 26.47% | 1.65% | 19.33% | 25.58% | 28.52% | 33.31% | 39.93% | 48.92% | 57.62% | 63.80% |
| 2 | 5748dc6363905b3a11d97d03 | 83.11% | 8.69% | 25.10% | 4.60% | 19.26% | 23.12% | 26.03% | 30.68% | 37.58% | 45.51% | 52.22% | 56.09% |
| hc | 57581ef1bb50d92eb4000001 | 83.03% | 6.97% | 27.01% | 2.05% | 22.38% | 26.38% | 28.50% | 33.51% | 40.73% | 48.68% | 54.72% | 56.99% |
| 3 | 57483bab63905b3a11d97c5c | 83.00% | 8.83% | 25.19% | 1.26% | 16.06% | 22.57% | 26.46% | 32.15% | 39.78% | 50.83% | 60.14% | 65.23% |
| 4 | 57487e6a63905b3a11d97c73 | 82.16% | 9.74% | 25.96% | 4.66% | 19.85% | 23.56% | 25.28% | 30.11% | 40.55% | 54.00% | 57.02% | 49.36% |
| 5 | 5745fc8163905b3a11d97be3 | 82.11% | 2.36% | 33.47% | 4.58% | 29.99% | 39.08% | 40.47% | 41.37% | 43.59% | 46.77% | 49.64% | 50.02% |
| 6 | 5748dc5763905b3a11d97d02 | 81.62% | 9.52% | 27.26% | 2.95% | 18.83% | 25.14% | 28.75% | 33.79% | 41.58% | 53.00% | 62.17% | 64.54% |
| 7 | 5748a0a363905b3a11d97c96 | 81.59% | 4.25% | 32.61% | 4.53% | 19.38% | 23.86% | 29.01% | 39.71% | 59.38% | 78.15% | 79.81% | 75.21% |
| hc | 5748df1c63905b3a11d97d0f | 81.51% | 4.33% | 32.69% | 2.20% | 21.91% | 34.28% | 40.40% | 44.33% | 47.71% | 52.31% | 55.40% | 56.30% |
| hc | 5748dda963905b3a11d97d06 | 81.44% | 3.78% | 33.38% | 4.72% | 21.86% | 29.06% | 33.77% | 41.36% | 54.37% | 67.08% | 74.49% | 76.54% |
| 8 | 5748dded63905b3a11d97d0a | 81.30% | 12.35% | 25.06% | 5.88% | 21.75% | 25.45% | 27.83% | 31.56% | 35.31% | 38.03% | 38.23% | 37.53% |
| 9 | 5748c16c63905b3a11d97cd0 | 81.29% | 2.20% | 35.27% | 7.68% | 22.60% | 30.11% | 35.94% | 43.16% | 55.37% | 70.27% | 78.08% | 80.45% |
| 10 | 5747e9eb63905b3a11d97c45 | 81.25% | 5.35% | 32.19% | 1.49% | 19.70% | 30.41% | 36.27% | 41.97% | 50.10% | 60.74% | 70.71% | 76.49% |
| hc | 5747dbba63905b3a11d97c3d | 81.25% | 4.89% | 32.66% | 3.61% | 24.20% | 33.88% | 38.12% | 41.65% | 47.08% | 54.20% | 58.69% | 61.64% |
| 11 | 574893e463905b3a11d97c85 | 81.20% | 5.91% | 31.72% | 5.04% | 25.78% | 32.26% | 35.48% | 40.40% | 45.90% | 50.72% | 54.04% | 55.03% |
| 12 | 5748a0fe63905b3a11d97c99 | 81.20% | 2.65% | 34.99% | 4.40% | 27.42% | 36.90% | 41.22% | 44.66% | 49.59% | 55.06% | 59.87% | 59.74% |
| 13 | 57485c0f63905b3a11d97c65 | 81.17% | 8.54% | 29.16% | 2.45% | 15.04% | 18.55% | 24.48% | 38.76% | 59.27% | 72.12% | 70.80% | 63.51% |
| 14 | 5748dbce63905b3a11d97cfe | 80.82% | 10.07% | 28.32% | 0.92% | 20.72% | 30.24% | 33.68% | 37.08% | 42.07% | 47.19% | 50.59% | 48.75% |
| 15 | 5748c99463905b3a11d97cdb | 80.71% | 9.92% | 28.67% | 3.02% | 17.11% | 22.73% | 28.01% | 35.82% | 51.34% | 64.65% | 64.70% | 58.12% |
| 16 | 574713ca63905b3a11d97c03 | 80.70% | 4.84% | 33.80% | 3.27% | 25.98% | 35.64% | 40.06% | 43.39% | 47.61% | 53.67% | 60.87% | 64.01% |
| 17 | 5735b994a6200f187771219a | 80.41% | 3.65% | 35.58% | 5.65% | 27.86% | 34.81% | 37.91% | 42.10% | 52.38% | 67.02% | 72.11% | 67.56% |
| 18 | 5748d02163905b3a11d97ce6 | 80.28% | 5.64% | 33.84% | 5.55% | 24.97% | 33.14% | 38.27% | 43.76% | 49.18% | 56.09% | 61.41% | 65.24% |
| 19 | 5728a01893f2f29d3c9acc08 | 80.23% | 2.77% | 36.82% | 3.64% | 33.41% | 42.22% | 45.08% | 46.28% | 48.61% | 52.16% | 53.88% | 56.18% |
| 20 | 5746978e63905b3a11d97bee | 80.19% | 5.99% | 33.67% | 4.44% | 27.19% | 36.71% | 40.54% | 42.71% | 46.08% | 51.79% | 53.96% | 53.02% |
| 21 | 57484a0663905b3a11d97c62 | 80.13% | 5.50% | 34.28% | 2.50% | 27.33% | 32.52% | 35.06% | 41.46% | 53.28% | 68.38% | 73.57% | 68.42% |
| 22 | 5748a78563905b3a11d97ca3 | 80.13% | 15.59% | 24.17% | 2.50% | 17.11% | 22.79% | 27.97% | 31.78% | 35.80% | 42.17% | 46.81% | 48.30% |
| 23 | 5748d63b63905b3a11d97cef | 80.11% | 2.97% | 36.86% | 5.18% | 26.90% | 34.37% | 38.03% | 45.26% | 58.88% | 72.33% | 72.67% | 66.37% |
| 24 | 573b6d7da6200f18777121ad | 79.95% | 3.47% | 36.68% | 7.08% | 32.99% | 38.75% | 42.24% | 45.06% | 49.80% | 55.40% | 57.41% | 56.48% |
| 25 | 5748acf563905b3a11d97cac | 79.77% | 9.62% | 30.87% | 9.54% | 22.79% | 25.59% | 28.53% | 35.97% | 50.33% | 63.33% | 61.81% | 54.83% |
| 26 | 5747268263905b3a11d97c0b | 79.76% | 5.55% | 34.96% | 0.70% | 19.71% | 30.07% | 35.35% | 45.21% | 63.17% | 78.78% | 76.38% | 67.27% |
| 27 | 57461bcb63905b3a11d97be7 | 79.50% | 3.05% | 37.99% | 6.16% | 32.12% | 40.83% | 45.01% | 46.85% | 50.11% | 57.14% | 65.07% | 71.52% |
| 28 | 57487fb663905b3a11d97c75 | 79.47% | 3.93% | 37.17% | 2.96% | 34.26% | 42.85% | 45.69% | 47.09% | 49.52% | 52.92% | 53.01% | 50.94% |
| 29 | 5747140263905b3a11d97c04 | 79.33% | 2.92% | 38.46% | 8.62% | 29.45% | 37.62% | 40.42% | 44.49% | 55.93% | 71.82% | 77.58% | 73.24% |
| 30 | 5748d0bb63905b3a11d97ce7 | 79.14% | 6.29% | 35.48% | 4.01% | 32.63% | 41.65% | 43.77% | 45.57% | 46.92% | 47.20% | 46.11% | 43.95% |
| hc | 57487c4363905b3a11d97c72 | 78.95% | 0.11% | 42.04% | 4.25% | 22.97% | 32.61% | 41.91% | 57.82% | 79.50% | 86.39% | 82.34% | 78.15% |
| 31 | 5748c56663905b3a11d97cd7 | 78.94% | 8.67% | 33.49% | 2.79% | 28.11% | 34.81% | 37.13% | 40.90% | 50.18% | 60.42% | 59.65% | 48.44% |
| 32 | 5748b2be63905b3a11d97cbb | 78.89% | 3.45% | 38.82% | 4.95% | 25.99% | 38.88% | 45.91% | 50.67% | 56.40% | 64.91% | 72.59% | 75.96% |
| 33 | 5747455863905b3a11d97c14 | 78.74% | 3.01% | 39.55% | 4.79% | 36.04% | 46.13% | 48.73% | 50.34% | 52.00% | 53.27% | 53.91% | 51.39% |
| 34 | 574439eaa6200f1877712212 | 78.70% | 6.25% | 36.39% | 7.83% | 31.34% | 36.99% | 41.84% | 46.90% | 50.89% | 53.46% | 53.83% | 52.49% |
| 35 | 5748b60e63905b3a11d97cc1 | 78.68% | 1.99% | 40.71% | 11.19% | 34.89% | 41.62% | 46.24% | 49.45% | 53.81% | 61.00% | 66.63% | 71.58% |
| 36 | 57441849a6200f1877712210 | 78.12% | 4.43% | 39.38% | 10.25% | 29.66% | 33.69% | 37.58% | 46.50% | 64.15% | 79.53% | 76.93% | 68.18% |
| 37 | 573f6c0da6200f18777121c7 | 77.99% | 6.57% | 37.50% | 11.86% | 18.69% | 24.35% | 33.55% | 50.17% | 74.60% | 79.82% | 69.39% | 56.51% |
| 38 | 5748662163905b3a11d97c69 | 77.79% | 8.59% | 35.88% | 1.72% | 29.52% | 41.41% | 44.99% | 47.56% | 50.37% | 50.81% | 50.50% | 47.73% |
| 39 | 5748487163905b3a11d97c60 | 77.72% | 11.19% | 33.40% | 3.84% | 26.93% | 33.92% | 39.16% | 44.14% | 49.32% | 52.19% | 52.84% | 48.51% |
| 40 | 574832fc63905b3a11d97c58 | 77.67% | 5.62% | 39.08% | 22.39% | 34.27% | 39.19% | 42.35% | 45.50% | 48.63% | 51.72% | 49.81% | 44.10% |
| 41 | 5748dbf563905b3a11d97cff | 77.64% | 11.83% | 32.93% | 2.13% | 12.85% | 20.86% | 30.24% | 47.51% | 70.77% | 76.85% | 70.29% | 61.53% |
| 42 | 57437474a6200f1877712208 | 77.40% | 6.55% | 38.71% | 23.33% | 33.14% | 38.38% | 41.38% | 43.88% | 48.03% | 52.14% | 52.91% | 49.79% |
| 43 | 5746309f63905b3a11d97bea | 77.34% | 11.50% | 33.86% | 2.10% | 17.04% | 24.55% | 33.29% | 48.09% | 69.71% | 73.03% | 61.95% | 49.81% |
| 44 | 57435693a6200f1877712202 | 77.23% | 8.20% | 37.38% | 24.91% | 33.97% | 36.04% | 38.62% | 42.73% | 46.23% | 47.93% | 46.22% | 41.44% |
| 45 | 57435058a6200f18777121fe | 77.14% | 8.18% | 37.58% | 25.04% | 33.99% | 36.24% | 39.08% | 42.99% | 46.28% | 48.23% | 46.44% | 41.43% |
| 46 | 5748b26063905b3a11d97cb8 | 77.05% | 9.59% | 36.35% | 7.64% | 20.91% | 27.90% | 35.62% | 50.30% | 70.30% | 71.49% | 57.39% | 41.92% |
| 47 | 57489cb763905b3a11d97c91 | 77.02% | 1.24% | 44.77% | 2.03% | 29.21% | 40.89% | 47.30% | 56.92% | 74.24% | 90.94% | 95.81% | 95.48% |
| 48 | 5742f826a6200f18777121f7 | 76.98% | 7.94% | 38.15% | 1.59% | 25.45% | 38.75% | 44.83% | 50.32% | 60.12% | 69.75% | 66.07% | 57.37% |
| 49 | 5746f88063905b3a11d97c01 | 76.84% | 18.42% | 27.92% | 0.45% | 10.86% | 25.00% | 33.30% | 43.28% | 50.06% | 51.43% | 47.57% | 39.84% |
| 50 | 572e27c893f2f29d3c9acc15 | 76.76% | 0.02% | 46.51% | 5.30% | 40.34% | 47.05% | 50.79% | 54.92% | 64.23% | 81.48% | 99.24% | 99.00% |
| 51 | 57488bcf63905b3a11d97c7f | 76.65% | 6.29% | 40.46% | 10.57% | 37.43% | 46.01% | 49.09% | 51.40% | 52.11% | 50.35% | 46.15% | 40.50% |
| 52 | 57489b8263905b3a11d97c8d | 76.62% | 0.06% | 46.76% | 25.13% | 38.30% | 46.78% | 48.71% | 51.79% | 58.62% | 69.44% | 76.16% | 81.88% |
| 53 | 5748cffe63905b3a11d97ce5 | 76.53% | 11.84% | 35.13% | 8.15% | 28.54% | 36.62% | 41.05% | 45.00% | 48.20% | 50.97% | 53.55% | 52.85% |
| 54 | 5747fc2863905b3a11d97c4a | 76.52% | 5.90% | 41.10% | 4.75% | 26.77% | 33.49% | 41.45% | 56.37% | 76.65% | 79.99% | 69.36% | 56.59% |
| 55 | 5746d73a63905b3a11d97bfc | 76.21% | 18.50% | 29.09% | 4.96% | 24.84% | 35.52% | 38.20% | 39.01% | 38.78% | 34.44% | 25.65% | 16.43% |
| 56 | 57404ce9a6200f18777121ce | 76.19% | 10.92% | 36.73% | 3.81% | 21.49% | 27.00% | 33.92% | 44.13% | 65.24% | 90.76% | 92.20% | 93.00% |
| 57 | 57421a7ca6200f18777121eb | 76.17% | 0.00% | 47.72% | 5.20% | 29.47% | 40.99% | 53.61% | 70.27% | 80.09% | 80.23% | 79.64% | 78.80% |
| 58 | 5748bd6b63905b3a11d97ccc | 76.10% | 9.88% | 37.96% | 12.69% | 26.54% | 32.04% | 39.77% | 49.92% | 64.38% | 64.63% | 51.83% | 37.52% |
| 59 | 5748c9be63905b3a11d97cdd | 75.95% | 11.45% | 36.68% | 8.09% | 24.56% | 31.80% | 36.55% | 44.64% | 60.80% | 74.44% | 72.69% | 64.30% |
| 60 | 5747b6ff63905b3a11d97c39 | 75.90% | 0.63% | 47.64% | 3.48% | 22.64% | 36.93% | 52.70% | 75.28% | 88.29% | 85.75% | 79.37% | 72.24% |
| 61 | 5741ef07a6200f18777121e3 | 75.68% | 8.54% | 40.14% | 4.64% | 37.80% | 47.77% | 50.75% | 53.12% | 53.59% | 49.61% | 42.54% | 34.63% |
| 62 | 5748db6863905b3a11d97cfd | 75.58% | 5.84% | 43.05% | 0.16% | 12.42% | 28.40% | 45.38% | 72.22% | 88.16% | 87.62% | 84.11% | 79.04% |
| 63 | 5747528563905b3a11d97c17 | 75.55% | 4.10% | 44.86% | 2.03% | 26.93% | 40.12% | 46.30% | 61.68% | 80.14% | 88.05% | 85.20% | 79.27% |
| 64 | 5747e76263905b3a11d97c44 | 75.39% | 15.54% | 33.70% | 3.95% | 23.39% | 32.93% | 40.27% | 48.83% | 53.92% | 51.42% | 43.90% | 35.59% |
| 65 | 574880a963905b3a11d97c76 | 75.20% | 0.00% | 49.66% | 0.42% | 20.37% | 42.33% | 61.72% | 77.07% | 85.09% | 88.84% | 90.16% | 90.70% |
| 66 | 5748af4663905b3a11d97caf | 75.08% | 4.59% | 45.31% | 4.74% | 43.28% | 53.75% | 57.00% | 59.38% | 60.29% | 57.10% | 50.45% | 43.01% |
| 67 | 5748ac3b63905b3a11d97cab | 74.68% | 0.15% | 50.57% | 1.39% | 33.35% | 54.47% | 65.36% | 72.19% | 74.39% | 75.22% | 75.23% | 74.39% |
| 68 | 5748bee563905b3a11d97cce | 74.53% | 2.73% | 48.27% | 16.25% | 41.31% | 50.50% | 56.48% | 61.27% | 63.46% | 63.51% | 62.79% | 61.87% |
| 69 | 57481d9763905b3a11d97c51 | 74.39% | 6.16% | 45.12% | 5.96% | 43.29% | 53.37% | 56.46% | 58.92% | 59.30% | 56.75% | 49.19% | 40.00% |
| 70 | 5740551ba6200f18777121cf | 74.25% | 3.06% | 48.51% | 4.38% | 46.28% | 57.15% | 60.50% | 62.82% | 64.19% | 63.13% | 60.03% | 55.07% |
| 71 | 57452d57a6200f1877712226 | 74.24% | 1.26% | 50.32% | 2.61% | 27.50% | 46.87% | 61.61% | 74.21% | 81.43% | 84.63% | 84.16% | 83.00% |
| 72 | 5736d5cea6200f18777121a0 | 74.23% | 3.19% | 48.42% | 41.97% | 44.95% | 47.26% | 48.21% | 49.00% | 51.50% | 57.98% | 65.90% | 72.20% |
| 73 | 5746cfcf63905b3a11d97bfb | 74.02% | 16.49% | 35.49% | 8.31% | 32.88% | 39.05% | 43.60% | 47.31% | 48.08% | 43.76% | 34.91% | 25.94% |
| 74 | 5744c3eaa6200f187771221c | 73.95% | 0.01% | 52.17% | 0.35% | 24.53% | 47.77% | 66.89% | 79.47% | 84.93% | 88.55% | 89.74% | 90.52% |
| 75 | 57488d9763905b3a11d97c80 | 73.86% | 24.68% | 27.61% | 3.45% | 21.68% | 28.74% | 34.36% | 37.08% | 38.18% | 39.28% | 42.12% | 46.67% |
| 76 | 57473f9863905b3a11d97c10 | 73.70% | 7.80% | 44.85% | 0.21% | 14.56% | 29.81% | 47.79% | 75.15% | 90.78% | 89.35% | 85.44% | 80.31% |
| 77 | 5741df98a6200f18777121e1 | 73.57% | 25.50% | 27.36% | 0.58% | 19.42% | 29.54% | 33.34% | 38.32% | 42.49% | 42.87% | 38.71% | 35.73% |
| 78 | 5748d3f663905b3a11d97ceb | 73.42% | 5.57% | 47.64% | 0.66% | 25.12% | 43.89% | 55.00% | 66.90% | 82.48% | 87.85% | 90.15% | 90.45% |
| hc | 5748d4c263905b3a11d97cec | 73.33% | 7.48% | 45.92% | 1.41% | 26.83% | 45.65% | 59.48% | 69.80% | 71.89% | 70.53% | 63.93% | 57.42% |
| 79 | 5748949a63905b3a11d97c86 | 73.19% | 8.06% | 45.62% | 21.16% | 27.92% | 33.41% | 42.85% | 61.82% | 73.74% | 77.07% | 82.14% | 86.91% |
| 80 | 573f2165a6200f18777121c2 | 73.10% | 7.45% | 46.41% | 0.14% | 17.90% | 38.58% | 58.41% | 73.07% | 80.34% | 83.37% | 83.70% | 83.21% |
| 81 | 57404259a6200f18777121cd | 73.04% | 5.62% | 48.35% | 33.58% | 46.29% | 49.88% | 53.25% | 55.58% | 56.15% | 52.72% | 45.64% | 37.46% |
| 82 | 574855af63905b3a11d97c63 | 72.83% | 13.89% | 40.49% | 2.89% | 37.21% | 48.44% | 51.02% | 52.98% | 53.67% | 52.98% | 51.04% | 46.92% |
| 83 | 5748845563905b3a11d97c7b | 72.65% | 1.74% | 53.03% | 11.43% | 32.96% | 43.51% | 57.36% | 72.24% | 86.07% | 94.62% | 98.48% | 99.68% |
| 84 | 573f687ca6200f18777121c5 | 72.18% | 7.79% | 47.90% | 8.77% | 39.93% | 49.16% | 58.08% | 65.39% | 68.21% | 66.25% | 60.21% | 54.67% |
| 85 | 573f263aa6200f18777121c3 | 71.83% | 1.44% | 54.97% | 2.88% | 32.01% | 53.01% | 67.37% | 81.03% | 87.54% | 88.68% | 88.19% | 87.16% |
| 86 | 5748df0863905b3a11d97d0d | 71.81% | 4.66% | 51.78% | 0.98% | 42.17% | 59.31% | 66.04% | 71.91% | 74.76% | 71.97% | 64.69% | 56.51% |
| 87 | 5748b98463905b3a11d97cc9 | 71.78% | 5.62% | 50.88% | 9.49% | 30.74% | 49.64% | 64.74% | 73.64% | 77.61% | 74.83% | 65.84% | 54.00% |
| 88 | 5745b92d63905b3a11d97bdc | 71.70% | 19.08% | 37.56% | 2.74% | 16.56% | 26.99% | 40.25% | 61.69% | 74.04% | 69.61% | 58.81% | 45.28% |
| 89 | 5748cd6463905b3a11d97ce2 | 71.65% | 23.67% | 33.04% | 28.72% | 29.06% | 29.55% | 31.65% | 34.48% | 37.83% | 42.74% | 48.69% | 52.53% |
| 90 | 5747ac3f63905b3a11d97c34 | 71.61% | 14.50% | 42.32% | 1.71% | 27.34% | 37.37% | 48.84% | 62.16% | 70.50% | 72.91% | 71.10% | 68.33% |
| 91 | 5747c9f463905b3a11d97c3a | 71.51% | 8.31% | 48.72% | 0.27% | 21.96% | 44.66% | 63.73% | 75.61% | 79.67% | 82.02% | 79.52% | 74.75% |
| 92 | 57485e3663905b3a11d97c66 | 71.49% | 0.00% | 57.10% | 1.45% | 32.17% | 54.65% | 72.93% | 85.70% | 89.40% | 91.37% | 91.70% | 91.36% |
| 93 | 57403baea6200f18777121cb | 71.33% | 0.66% | 56.76% | 4.81% | 49.63% | 64.58% | 71.01% | 74.47% | 76.00% | 77.42% | 79.32% | 82.91% |
| 94 | 5748ddce63905b3a11d97d09 | 71.31% | 15.36% | 42.04% | 2.10% | 29.25% | 44.84% | 53.57% | 60.99% | 63.76% | 60.71% | 54.13% | 47.54% |
| 95 | 5748a6dd63905b3a11d97c9f | 71.28% | 9.47% | 48.02% | 0.72% | 20.73% | 40.32% | 59.94% | 74.73% | 81.71% | 84.93% | 86.11% | 86.16% |
| 96 | 5748bc2b63905b3a11d97cca | 71.20% | 15.05% | 42.58% | 2.94% | 28.59% | 41.42% | 49.46% | 60.63% | 68.63% | 69.77% | 67.17% | 61.43% |
| hc | 5748ab4963905b3a11d97caa | 71.17% | 1.76% | 55.97% | 1.85% | 49.38% | 64.62% | 71.27% | 75.77% | 77.87% | 75.85% | 69.80% | 62.21% |
| 97 | 57489ba563905b3a11d97c8e | 71.06% | 5.65% | 52.29% | 0.32% | 26.27% | 51.74% | 69.03% | 82.86% | 85.21% | 80.16% | 69.53% | 56.81% |
| 98 | 57488f6563905b3a11d97c82 | 70.95% | 0.00% | 58.17% | 28.58% | 47.89% | 52.06% | 57.62% | 64.67% | 80.39% | 100.00% | 100.00% | 100.00% |
| 99 | 5730c3b693f2f29d3c9acc21 | 70.95% | 2.38% | 55.79% | 1.35% | 30.98% | 53.02% | 71.21% | 84.00% | 87.69% | 89.94% | 90.11% | 89.56% |
| 100 | 5748d0d663905b3a11d97ce8 | 70.87% | 0.00% | 58.33% | 8.25% | 60.95% | 66.79% | 71.66% | 75.55% | 76.36% | 71.45% | 63.03% | 52.67% |
| 101 | 5736410ba6200f187771219e | 70.83% | 0.46% | 57.96% | 37.83% | 53.94% | 60.57% | 64.55% | 66.44% | 66.29% | 64.65% | 62.92% | 62.22% |
| 102 | 5748d90363905b3a11d97cf5 | 70.83% | 10.39% | 48.01% | 2.79% | 28.67% | 42.46% | 59.76% | 77.59% | 77.90% | 73.48% | 64.75% | 53.79% |
| 103 | 5746e15663905b3a11d97bfe | 70.76% | 0.00% | 58.57% | 47.05% | 60.47% | 61.23% | 60.68% | 60.77% | 61.46% | 62.22% | 63.68% | 65.38% |
| 104 | 5748d2fc63905b3a11d97cea | 70.55% | 0.00% | 58.99% | 55.19% | 55.73% | 56.55% | 58.19% | 59.44% | 62.12% | 67.59% | 72.97% | 78.91% |
| 105 | 5748725763905b3a11d97c71 | 70.45% | 10.48% | 48.67% | 0.44% | 27.44% | 49.40% | 65.90% | 70.34% | 73.42% | 75.26% | 77.14% | 81.02% |
| 106 | 57452f18a6200f1877712228 | 70.36% | 11.57% | 47.76% | 1.24% | 28.72% | 48.08% | 61.79% | 72.43% | 73.76% | 71.34% | 67.10% | 66.28% |
| 107 | 57421e57a6200f18777121ed | 70.29% | 2.81% | 56.67% | 18.66% | 49.93% | 62.97% | 68.85% | 73.89% | 74.26% | 67.39% | 55.86% | 46.26% |
| 108 | 5747e33263905b3a11d97c40 | 70.17% | 0.00% | 59.74% | 4.33% | 46.36% | 62.81% | 74.65% | 81.59% | 85.98% | 87.94% | 88.51% | 89.12% |
| 109 | 5748c08963905b3a11d97ccf | 70.13% | 8.71% | 51.08% | 2.04% | 37.67% | 55.41% | 65.03% | 72.48% | 76.31% | 73.76% | 66.75% | 58.91% |
| 110 | 574871ea63905b3a11d97c70 | 69.89% | 1.53% | 58.77% | 13.24% | 54.14% | 62.88% | 69.36% | 74.07% | 77.44% | 79.53% | 82.48% | 84.50% |
| 111 | 5748d6a363905b3a11d97cf0 | 69.66% | 10.49% | 50.25% | 21.67% | 48.45% | 54.08% | 58.86% | 61.51% | 61.26% | 58.67% | 54.59% | 50.24% |
| 112 | 574868fe63905b3a11d97c6a | 69.58% | 0.03% | 60.89% | 0.89% | 35.70% | 64.75% | 79.41% | 87.84% | 92.05% | 93.68% | 94.07% | 93.68% |
| 113 | 574825f663905b3a11d97c53 | 69.23% | 18.28% | 43.29% | 3.00% | 29.68% | 41.38% | 52.31% | 63.54% | 69.38% | 67.72% | 60.84% | 53.60% |
| 114 | 57374840a6200f18777121a4 | 69.06% | 0.00% | 61.96% | 32.81% | 59.06% | 66.30% | 69.83% | 72.00% | 73.59% | 73.33% | 70.76% | 69.14% |
| 115 | 5748a97463905b3a11d97ca6 | 68.44% | 24.18% | 38.97% | 2.20% | 26.24% | 42.10% | 50.21% | 56.12% | 59.16% | 56.31% | 49.05% | 43.32% |
| 116 | 57471ac263905b3a11d97c06 | 68.13% | 23.96% | 39.80% | 39.63% | 39.63% | 39.92% | 39.86% | 39.79% | 39.66% | 40.46% | 40.50% | 38.46% |
| 117 | 57481b7a63905b3a11d97c50 | 68.07% | 11.97% | 51.95% | 1.16% | 42.83% | 60.08% | 68.09% | 73.35% | 74.41% | 68.50% | 57.57% | 45.97% |
| 118 | 5748d1fa63905b3a11d97ce9 | 68.00% | 19.45% | 44.59% | 35.29% | 47.45% | 49.30% | 48.57% | 46.41% | 43.77% | 42.66% | 42.42% | 43.81% |
| 119 | 57473cf963905b3a11d97c0e | 67.90% | 0.00% | 64.29% | 3.49% | 50.37% | 71.75% | 80.88% | 87.17% | 91.11% | 92.37% | 92.11% | 90.89% |
| 120 | 57444c74a6200f1877712214 | 67.87% | 4.14% | 60.19% | 12.63% | 52.24% | 65.35% | 72.84% | 79.71% | 82.67% | 79.54% | 72.66% | 64.31% |
| 121 | 5748df4d63905b3a11d97d11 | 67.85% | 2.20% | 62.17% | 10.95% | 59.29% | 69.30% | 74.60% | 79.16% | 81.89% | 82.00% | 80.83% | 80.40% |
| 122 | 5748ddb963905b3a11d97d08 | 67.71% | 1.75% | 62.91% | 8.98% | 58.94% | 75.04% | 78.91% | 81.82% | 82.66% | 78.50% | 69.16% | 58.21% |
| 123 | 5748dc1c63905b3a11d97d00 | 67.62% | 21.25% | 43.54% | 2.08% | 37.58% | 49.83% | 57.96% | 63.12% | 63.27% | 53.26% | 36.38% | 20.82% |
| 124 | 5741653da6200f18777121dc | 67.51% | 10.02% | 55.03% | 5.59% | 49.22% | 60.09% | 68.46% | 76.07% | 78.64% | 72.95% | 61.24% | 48.68% |
| 125 | 5748460963905b3a11d97c5f | 67.47% | 6.07% | 59.06% | 1.02% | 38.10% | 63.07% | 77.15% | 87.45% | 88.92% | 86.59% | 79.82% | 72.51% |
| 126 | 5744a316a6200f187771221b | 67.45% | 0.00% | 65.19% | 3.71% | 35.58% | 66.00% | 91.72% | 93.73% | 95.69% | 97.12% | 97.59% | 97.64% |
| 127 | 573d721fa6200f18777121bc | 67.35% | 0.02% | 65.36% | 59.35% | 62.14% | 65.20% | 66.84% | 68.21% | 68.88% | 69.48% | 70.98% | 71.97% |
| 128 | 57473fe263905b3a11d97c12 | 67.08% | 6.89% | 59.02% | 5.39% | 48.12% | 62.76% | 72.91% | 81.12% | 84.98% | 83.76% | 80.00% | 75.97% |
| 129 | 5748af7163905b3a11d97cb1 | 66.97% | 0.15% | 66.00% | 4.33% | 58.92% | 74.60% | 80.79% | 85.85% | 90.43% | 93.61% | 95.17% | 95.56% |
| 130 | 5736853ca6200f187771219f | 66.85% | 10.16% | 56.20% | 15.16% | 48.79% | 60.28% | 69.62% | 74.87% | 75.16% | 70.11% | 60.57% | 50.58% |
| 131 | 5748b42363905b3a11d97cc0 | 66.51% | 9.80% | 57.25% | 0.40% | 38.18% | 67.39% | 77.45% | 81.95% | 83.65% | 79.47% | 69.22% | 56.47% |
| 132 | 5748b76963905b3a11d97cc3 | 66.17% | 0.00% | 67.74% | 5.43% | 58.55% | 77.60% | 83.98% | 89.24% | 92.70% | 93.60% | 92.71% | 91.88% |
| 133 | 5748d7ee63905b3a11d97cf2 | 66.16% | 0.00% | 67.77% | 67.68% | 67.80% | 67.55% | 67.75% | 67.77% | 68.04% | 68.19% | 67.60% | 67.67% |
| 134 | 5747fbc163905b3a11d97c49 | 65.54% | 10.19% | 58.79% | 2.99% | 56.02% | 70.94% | 76.94% | 79.69% | 79.28% | 71.66% | 57.66% | 42.22% |
| 135 | 5732158493f2f29d3c9acc29 | 65.53% | 57.09% | 11.79% | 0.13% | 3.36% | 9.62% | 14.22% | 15.18% | 17.83% | 25.78% | 36.75% | 45.43% |
| 136 | 57477b6b63905b3a11d97c29 | 65.40% | 21.35% | 47.90% | 9.99% | 40.20% | 50.62% | 57.21% | 64.53% | 68.28% | 65.29% | 57.66% | 48.23% |
| 137 | 5748af2d63905b3a11d97cae | 65.35% | 0.10% | 69.29% | 10.20% | 59.93% | 79.35% | 85.06% | 89.74% | 92.53% | 93.52% | 92.45% | 91.75% |
| 138 | 572f463e93f2f29d3c9acc19 | 65.34% | 0.00% | 69.41% | 67.10% | 71.25% | 71.19% | 70.59% | 69.28% | 68.24% | 68.37% | 67.72% | 68.60% |
| 138 | 5739c378a6200f18777121aa | 65.34% | 4.06% | 65.34% | 1.91% | 47.35% | 76.70% | 82.63% | 87.85% | 92.46% | 95.97% | 97.76% | 98.42% |
| 139 | 5748ccf663905b3a11d97ce1 | 65.30% | 19.41% | 50.02% | 0.16% | 28.42% | 61.04% | 67.50% | 73.39% | 75.98% | 70.02% | 56.85% | 41.70% |
| 140 | 5748ca0563905b3a11d97cde | 65.19% | 0.00% | 69.72% | 2.92% | 48.82% | 78.11% | 90.26% | 97.45% | 99.56% | 99.72% | 99.79% | 99.78% |
| 141 | 5747798863905b3a11d97c28 | 65.16% | 5.82% | 63.92% | 1.54% | 52.80% | 77.69% | 82.51% | 86.55% | 88.52% | 85.90% | 78.37% | 69.75% |
| 142 | 573898aca6200f18777121a5 | 65.01% | 0.00% | 70.08% | 69.88% | 70.11% | 70.30% | 70.26% | 70.17% | 70.05% | 69.67% | 69.97% | 69.08% |
| 143 | 5748a34f63905b3a11d97c9b | 64.99% | 3.89% | 66.21% | 10.81% | 59.91% | 77.87% | 82.53% | 85.84% | 87.20% | 84.18% | 76.62% | 68.21% |
| 144 | 5748a75963905b3a11d97ca1 | 64.95% | 4.97% | 65.20% | 5.34% | 59.85% | 75.09% | 81.03% | 86.00% | 88.53% | 87.16% | 82.48% | 77.57% |
| 145 | 5748b34263905b3a11d97cbd | 64.88% | 4.96% | 65.36% | 15.12% | 60.41% | 74.34% | 80.01% | 83.59% | 84.98% | 81.83% | 75.05% | 67.57% |
| 146 | 57370b75a6200f18777121a1 | 64.84% | 10.46% | 59.93% | 38.72% | 60.58% | 65.09% | 68.02% | 68.13% | 66.67% | 61.58% | 53.71% | 49.31% |
| 147 | 573cd43ea6200f18777121b9 | 64.75% | 14.77% | 55.78% | 0.81% | 42.23% | 62.43% | 70.05% | 78.97% | 84.05% | 80.88% | 71.28% | 61.04% |
| 148 | 5744d8e0a6200f1877712220 | 64.72% | 0.96% | 69.69% | 14.72% | 62.23% | 74.14% | 82.81% | 89.77% | 93.75% | 95.29% | 95.25% | 95.11% |
| 149 | 5741d1d3a6200f18777121e0 | 64.70% | 0.00% | 70.70% | 63.60% | 67.06% | 69.59% | 71.74% | 72.74% | 75.10% | 78.33% | 82.08% | 85.07% |
| 150 | 5745b59863905b3a11d97bdb | 64.69% | 2.09% | 68.61% | 1.57% | 55.89% | 82.28% | 87.54% | 92.14% | 94.64% | 94.72% | 92.58% | 89.32% |
| 151 | 57476abd63905b3a11d97c22 | 64.63% | 0.00% | 70.84% | 6.15% | 61.33% | 82.78% | 88.07% | 92.46% | 95.57% | 96.49% | 96.40% | 96.01% |
| 152 | 5725021193f2f29d3c9acbf7 | 64.62% | 0.00% | 70.87% | 70.85% | 71.08% | 70.85% | 70.64% | 70.96% | 70.84% | 70.89% | 70.90% | 70.72% |
| 153 | 5748a8d663905b3a11d97ca5 | 64.50% | 0.00% | 71.09% | 3.03% | 57.32% | 80.52% | 92.28% | 95.53% | 98.01% | 99.30% | 99.49% | 99.81% |
| 154 | 5745a80763905b3a11d97bd8 | 64.36% | 0.00% | 71.38% | 49.99% | 74.38% | 76.59% | 76.76% | 76.53% | 76.69% | 76.30% | 76.11% | 77.12% |
| 155 | 5748c83d63905b3a11d97cd9 | 64.30% | 10.68% | 60.78% | 6.05% | 51.59% | 66.81% | 73.72% | 81.67% | 86.18% | 85.31% | 82.37% | 78.51% |
| 156 | 5748dd3363905b3a11d97d04 | 64.28% | 29.38% | 42.07% | 0.19% | 23.15% | 42.73% | 52.67% | 61.37% | 68.09% | 69.65% | 66.94% | 62.71% |
| 157 | 5748a3a263905b3a11d97c9c | 64.25% | 17.75% | 53.81% | 2.48% | 39.82% | 61.83% | 69.42% | 75.47% | 78.38% | 75.16% | 66.18% | 54.62% |
| 158 | 5748b96e63905b3a11d97cc8 | 63.96% | 0.19% | 71.98% | 3.26% | 57.19% | 83.38% | 92.30% | 97.52% | 99.17% | 99.44% | 99.42% | 99.28% |
| 159 | 572b4c6093f2f29d3c9acc11 | 63.89% | 11.44% | 60.85% | 12.50% | 61.95% | 71.60% | 76.10% | 78.55% | 77.94% | 70.13% | 56.17% | 40.83% |
| 160 | 5748ca4963905b3a11d97cdf | 63.83% | 22.10% | 50.28% | 5.56% | 38.84% | 59.16% | 64.24% | 67.86% | 69.32% | 66.89% | 62.40% | 58.42% |
| 161 | 574209bea6200f18777121e5 | 63.79% | 15.18% | 57.29% | 7.17% | 50.90% | 63.88% | 70.68% | 76.44% | 78.88% | 76.47% | 70.94% | 65.23% |
| 162 | 5748dee563905b3a11d97d0c | 63.59% | 14.53% | 58.34% | 16.10% | 52.15% | 64.33% | 70.15% | 75.09% | 76.90% | 74.09% | 67.38% | 60.53% |
| hc | 57466eb863905b3a11d97bed | 63.49% | 4.24% | 68.86% | 4.78% | 55.09% | 74.78% | 90.83% | 92.89% | 94.76% | 95.55% | 95.95% | 96.05% |
| 163 | 5731af1993f2f29d3c9acc27 | 63.37% | 0.06% | 73.31% | 46.44% | 66.43% | 81.10% | 81.38% | 82.33% | 82.72% | 83.28% | 82.94% | 83.95% |
| 164 | 5748ddab63905b3a11d97d07 | 63.20% | 10.98% | 62.68% | 20.47% | 63.29% | 71.37% | 76.16% | 78.78% | 78.23% | 70.72% | 57.63% | 43.98% |
| 165 | 57296f4b93f2f29d3c9acc09 | 63.20% | 24.90% | 48.74% | 31.81% | 36.84% | 42.92% | 50.03% | 60.30% | 69.00% | 68.75% | 57.48% | 42.31% |
| 166 | 5730b6db93f2f29d3c9acc20 | 63.10% | 0.00% | 73.89% | 17.37% | 73.61% | 80.95% | 87.18% | 91.88% | 94.80% | 95.60% | 94.74% | 94.16% |
| 167 | 57407f40a6200f18777121d1 | 63.06% | 68.30% | 5.49% | 1.12% | 5.04% | 8.46% | 8.82% | 6.34% | 4.51% | 4.24% | 4.53% | 4.58% |
| 168 | 5748dad563905b3a11d97cfb | 63.00% | 0.00% | 74.10% | 57.77% | 68.22% | 73.27% | 77.20% | 80.85% | 83.46% | 86.48% | 88.29% | 88.76% |
| 169 | 57223fbd93f2f29d3c9acbd8 | 62.96% | 28.34% | 45.77% | 1.18% | 52.95% | 54.34% | 55.42% | 56.41% | 58.25% | 59.33% | 59.42% | 58.27% |
| hc | 5721ed3d93f2f29d3c9acbd1 | 62.61% | 5.06% | 69.81% | 66.98% | 69.46% | 70.06% | 70.65% | 70.36% | 70.61% | 71.45% | 72.37% | 73.74% |
| 170 | 57489a6c63905b3a11d97c8c | 62.60% | 0.03% | 74.86% | 5.32% | 73.62% | 87.94% | 92.42% | 95.91% | 98.02% | 98.58% | 98.56% | 98.07% |
| 171 | 5748b09963905b3a11d97cb4 | 62.45% | 7.33% | 67.85% | 8.33% | 58.97% | 81.87% | 86.23% | 88.12% | 88.70% | 87.31% | 82.89% | 79.18% |
| 172 | 5748c99a63905b3a11d97cdc | 62.17% | 8.32% | 67.41% | 19.93% | 70.79% | 75.57% | 79.94% | 82.84% | 83.55% | 80.08% | 73.10% | 66.78% |
| 173 | 5746a6ad63905b3a11d97bf3 | 61.98% | 4.59% | 71.55% | 36.02% | 65.10% | 78.13% | 82.77% | 86.31% | 87.33% | 83.39% | 73.96% | 62.90% |
| 174 | 5748a77c63905b3a11d97ca2 | 61.93% | 23.21% | 52.97% | 7.78% | 50.33% | 61.27% | 66.14% | 70.13% | 70.87% | 66.06% | 55.68% | 44.64% |
| 175 | 5744eb61a6200f1877712223 | 61.79% | 9.07% | 67.43% | 0.91% | 44.28% | 87.29% | 88.87% | 90.43% | 92.52% | 93.94% | 94.75% | 94.52% |
| 176 | 57481a1d63905b3a11d97c4f | 61.78% | 64.42% | 11.95% | 0.13% | 7.65% | 13.65% | 16.10% | 14.70% | 14.67% | 18.89% | 25.94% | 33.97% |
| 177 | 5747e38963905b3a11d97c41 | 61.74% | 17.15% | 59.44% | 35.65% | 50.64% | 58.05% | 65.86% | 74.20% | 77.96% | 71.84% | 57.82% | 42.31% |
| 178 | 5730af2093f2f29d3c9acc1f | 61.70% | 7.51% | 69.17% | 3.71% | 65.32% | 79.95% | 84.18% | 90.24% | 93.39% | 94.27% | 95.55% | 96.56% |
| 179 | 5748244663905b3a11d97c52 | 61.58% | 27.37% | 49.50% | 12.88% | 45.09% | 55.13% | 60.26% | 64.79% | 66.34% | 61.06% | 51.12% | 39.14% |
| 180 | 572685d493f2f29d3c9acc02 | 61.58% | 0.06% | 76.89% | 2.75% | 68.41% | 96.52% | 99.01% | 99.51% | 99.82% | 99.91% | 99.95% | 99.99% |
| 181 | 5748b1c063905b3a11d97cb6 | 61.55% | 0.00% | 77.01% | 16.61% | 80.00% | 86.06% | 91.02% | 94.82% | 97.24% | 97.95% | 97.87% | 97.39% |
| 182 | 572129ed93f2f29d3c9acbb6 | 61.49% | 15.57% | 61.51% | 8.33% | 54.01% | 70.80% | 75.05% | 78.40% | 82.51% | 84.31% | 84.65% | 83.77% |
| 183 | 5747e4c763905b3a11d97c42 | 61.27% | 31.51% | 45.96% | 1.34% | 28.62% | 46.29% | 56.98% | 64.23% | 69.77% | 75.76% | 80.49% | 84.21% |
| 184 | 5748dd4e63905b3a11d97d05 | 61.14% | 20.36% | 57.41% | 27.58% | 59.70% | 65.81% | 69.46% | 70.36% | 67.09% | 56.14% | 40.45% | 26.05% |
| 185 | 57225ba193f2f29d3c9acbdd | 61.00% | 0.00% | 78.10% | 18.40% | 79.27% | 87.51% | 92.28% | 96.18% | 98.34% | 98.90% | 98.97% | 98.82% |
| 186 | 572175b393f2f29d3c9acbbd | 60.99% | 16.23% | 61.84% | 61.92% | 61.81% | 61.48% | 61.71% | 61.88% | 62.07% | 62.46% | 61.75% | 61.71% |
| 187 | 5721c5bc93f2f29d3c9acbc6 | 60.95% | 6.43% | 71.76% | 7.62% | 62.47% | 82.47% | 90.28% | 92.86% | 95.40% | 97.44% | 98.38% | 98.34% |
| 188 | 572619e893f2f29d3c9acbfe | 60.63% | 31.26% | 47.50% | 9.15% | 46.90% | 54.41% | 58.77% | 62.15% | 61.69% | 57.38% | 48.49% | 39.96% |
| 189 | 572786a293f2f29d3c9acc06 | 60.39% | 5.62% | 73.69% | 51.06% | 70.58% | 76.51% | 81.20% | 84.58% | 85.24% | 80.20% | 69.55% | 56.86% |
| 190 | 5748b33863905b3a11d97cbc | 60.31% | 10.04% | 69.42% | 55.36% | 69.90% | 72.25% | 72.47% | 73.06% | 73.35% | 74.95% | 75.49% | 77.04% |
| 191 | 5748da2863905b3a11d97cf9 | 60.25% | 60.03% | 19.43% | 19.43% | 19.59% | 19.36% | 19.38% | 19.36% | 19.46% | 19.54% | 19.28% | 19.34% |
| 192 | 5747f27e63905b3a11d97c46 | 60.09% | 30.27% | 49.57% | 4.76% | 38.05% | 53.63% | 60.31% | 67.65% | 72.55% | 73.61% | 68.86% | 62.40% |
| 193 | 5721354793f2f29d3c9acbb9 | 59.92% | 0.00% | 80.27% | 7.43% | 81.15% | 99.95% | 99.96% | 99.96% | 99.97% | 99.99% | 99.99% | 99.99% |
| 194 | 5748b81a63905b3a11d97cc5 | 59.89% | 41.09% | 39.12% | 9.87% | 35.78% | 45.22% | 48.15% | 51.52% | 51.42% | 45.98% | 38.38% | 29.02% |
| 195 | 5746c78163905b3a11d97bf9 | 59.56% | 0.28% | 80.72% | 6.90% | 85.60% | 99.77% | 99.77% | 99.92% | 99.92% | 99.96% | 99.97% | 99.94% |
| 196 | 574868ff63905b3a11d97c6b | 59.54% | 12.30% | 68.69% | 3.49% | 63.88% | 87.09% | 87.12% | 88.11% | 88.23% | 87.07% | 86.32% | 85.85% |
| 197 | 5745ac9d63905b3a11d97bd9 | 59.50% | 0.00% | 81.12% | 26.82% | 86.46% | 89.96% | 93.28% | 96.22% | 98.15% | 98.63% | 98.60% | 98.11% |
| 198 | 572ae7bc93f2f29d3c9acc0f | 59.31% | 7.25% | 74.21% | 11.05% | 73.66% | 91.10% | 91.84% | 92.33% | 91.97% | 90.89% | 89.51% | 88.77% |
| 199 | 5747600163905b3a11d97c1c | 59.19% | 2.74% | 78.98% | 11.39% | 78.11% | 96.27% | 97.51% | 97.76% | 98.07% | 98.67% | 99.00% | 99.36% |
| 200 | 57212f5993f2f29d3c9acbb8 | 59.13% | 9.70% | 72.13% | 14.93% | 72.00% | 87.76% | 88.17% | 88.71% | 88.52% | 86.34% | 83.56% | 81.87% |
| 201 | 573b808da6200f18777121ae | 58.97% | 19.00% | 63.11% | 33.85% | 59.53% | 67.78% | 73.26% | 77.04% | 77.26% | 68.67% | 56.44% | 44.91% |
| 202 | 5742af7ca6200f18777121f3 | 58.87% | 9.93% | 72.42% | 19.20% | 66.25% | 81.45% | 86.02% | 89.87% | 92.25% | 93.86% | 94.93% | 94.94% |
| 203 | 5746a2c663905b3a11d97bf2 | 58.66% | 22.71% | 60.02% | 0.04% | 30.81% | 67.13% | 83.14% | 82.85% | 87.98% | 94.83% | 97.50% | 98.60% |
| 204 | 5723774f93f2f29d3c9acbe4 | 58.38% | 9.72% | 73.61% | 0.67% | 65.03% | 94.05% | 93.31% | 94.22% | 97.20% | 99.17% | 99.56% | 99.76% |
| 205 | 572f8c8d93f2f29d3c9acc1d | 58.22% | 80.47% | 2.99% | 0.00% | 0.42% | 1.23% | 2.74% | 5.22% | 7.19% | 7.60% | 6.17% | 4.31% |
| 206 | 5748d96f63905b3a11d97cf8 | 57.97% | 38.38% | 45.69% | 1.13% | 44.38% | 53.71% | 56.90% | 59.57% | 61.57% | 60.57% | 60.52% | 59.27% |
| 207 | 57486d7a63905b3a11d97c6e | 57.53% | 82.69% | 2.14% | 0.73% | 2.43% | 4.01% | 3.14% | 2.20% | 1.53% | 0.92% | 0.36% | 0.15% |
| 208 | 5721512b93f2f29d3c9acbbc | 57.33% | 18.07% | 67.33% | 13.02% | 67.61% | 79.14% | 81.67% | 82.25% | 82.85% | 84.51% | 87.27% | 89.20% |
| 209 | 573c8409a6200f18777121b6 | 57.19% | 42.47% | 43.15% | 1.07% | 25.02% | 51.48% | 58.26% | 59.55% | 59.97% | 63.08% | 66.39% | 68.70% |
| 210 | 57489fd063905b3a11d97c95 | 57.01% | 52.42% | 33.54% | 10.02% | 33.91% | 36.46% | 39.64% | 43.27% | 44.81% | 39.41% | 31.15% | 23.21% |
| 211 | 5722057493f2f29d3c9acbd2 | 56.76% | 45.68% | 40.79% | 14.14% | 37.09% | 50.95% | 52.12% | 51.83% | 48.39% | 41.79% | 31.86% | 26.66% |
| 212 | 5748819463905b3a11d97c77 | 56.32% | 23.37% | 64.04% | 12.92% | 76.21% | 76.79% | 75.03% | 75.52% | 76.22% | 74.64% | 72.22% | 71.30% |
| 213 | 5730e4cd93f2f29d3c9acc22 | 56.15% | 0.00% | 87.81% | 54.83% | 80.59% | 95.69% | 97.83% | 99.19% | 99.70% | 99.85% | 99.88% | 99.79% |
| 214 | 57483b9063905b3a11d97c5b | 55.48% | 19.36% | 69.76% | 46.74% | 70.10% | 71.65% | 74.40% | 78.01% | 80.93% | 79.02% | 73.73% | 68.63% |
| 215 | 5721cfea93f2f29d3c9acbca | 54.10% | 30.71% | 61.14% | 11.28% | 56.75% | 69.54% | 72.60% | 75.38% | 78.62% | 83.37% | 88.78% | 92.00% |
| 216 | 5748c24f63905b3a11d97cd1 | 53.91% | 0.69% | 91.61% | 72.68% | 90.78% | 94.56% | 96.37% | 97.77% | 98.24% | 98.56% | 98.82% | 98.74% |
| 217 | 57486cb163905b3a11d97c6c | 52.79% | 83.83% | 10.49% | 3.02% | 11.51% | 13.80% | 14.18% | 13.43% | 11.77% | 8.44% | 4.44% | 1.91% |
| 218 | 5738c2a8a6200f18777121a7 | 51.01% | 97.26% | 0.59% | 0.14% | 0.13% | 0.15% | 0.46% | 2.09% | 0.93% | 0.35% | 0.24% | 0.06% |
| 219 | 5748c3c863905b3a11d97cd5 | 50.85% | 98.16% | 0.01% | 0.00% | 0.00% | 0.00% | 0.00% | 0.01% | 0.01% | 0.03% | 0.10% | 0.06% |
| 220 | 5748b29e63905b3a11d97cba | 50.69% | 89.37% | 9.14% | 4.28% | 9.49% | 10.63% | 10.64% | 10.00% | 10.03% | 10.59% | 10.27% | 11.42% |
| 221 | 57212e1293f2f29d3c9acbb7 | 50.63% | 83.59% | 15.06% | 15.12% | 15.05% | 15.07% | 15.06% | 15.03% | 15.15% | 15.05% | 14.94% | 14.58% |
| 222 | 574602c563905b3a11d97be4 | 50.10% | 49.92% | 49.89% | 49.78% | 49.87% | 49.98% | 49.95% | 49.66% | 49.77% | 50.09% | 50.52% | 50.92% |
| 223 | 5721c5d893f2f29d3c9acbc7 | 50.09% | 49.96% | 49.86% | 50.03% | 49.72% | 49.53% | 49.75% | 49.96% | 50.22% | 50.28% | 48.98% | 49.72% |
| 224 | 5720eba193f2f29d3c9acbad | 50.07% | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% |
| 224 | 5724564f93f2f29d3c9acbef | 50.07% | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% |
| 224 | 573732caa6200f18777121a2 | 50.07% | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% |
| 224 | 5744e451a6200f1877712221 | 50.07% | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% |
| 224 | 5748b36263905b3a11d97cbf | 50.07% | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% |
| hc | 5720ebb893f2f29d3c9acbae | 50.07% | 0.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% | 100.00% |
| 225 | 5721c3ad93f2f29d3c9acbc5 | 50.04% | 49.95% | 49.96% | 50.08% | 50.23% | 49.95% | 49.85% | 49.95% | 49.71% | 49.61% | 50.48% | 49.97% |
| 226 | 5721eb1593f2f29d3c9acbcf | 50.04% | 49.92% | 50.01% | 50.19% | 49.97% | 49.85% | 49.84% | 49.83% | 50.16% | 50.49% | 50.04% | 50.17% |
| 227 | 5742f682a6200f18777121f6 | 50.02% | 49.99% | 49.97% | 50.27% | 49.97% | 49.94% | 49.90% | 49.96% | 49.95% | 49.74% | 49.41% | 49.33% |
| 228 | 5724496e93f2f29d3c9acbed | 50.01% | 49.96% | 50.02% | 49.99% | 50.17% | 49.97% | 49.86% | 50.01% | 50.28% | 49.75% | 49.92% | 50.99% |
| 229 | 5722091793f2f29d3c9acbd3 | 50.00% | 49.95% | 50.05% | 49.80% | 49.96% | 50.13% | 49.95% | 50.44% | 50.30% | 50.08% | 48.94% | 50.44% |
| 230 | 5721e97493f2f29d3c9acbce | 49.99% | 49.94% | 50.08% | 50.06% | 50.38% | 49.72% | 50.19% | 50.24% | 49.83% | 49.98% | 50.08% | 50.80% |
| hc | 5720ed5393f2f29d3c9acbb0 | 49.97% | 50.00% | 50.06% | 50.05% | 50.29% | 50.06% | 50.17% | 50.14% | 49.65% | 49.73% | 50.24% | 49.91% |
| 231 | 57406418a6200f18777121d0 | 49.95% | 50.03% | 50.08% | 49.97% | 50.19% | 50.17% | 50.18% | 50.02% | 49.88% | 50.10% | 50.29% | 50.24% |
| 232 | 5748df0c63905b3a11d97d0e | 49.94% | 99.80% | 0.18% | 0.79% | 0.16% | 0.07% | 0.01% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 233 | 5723e06893f2f29d3c9acbeb | 49.93% | 90.03% | 9.99% | 9.98% | 10.09% | 10.05% | 10.00% | 9.79% | 10.07% | 9.88% | 10.29% | 9.75% |
| 234 | 5748a99163905b3a11d97ca7 | 49.93% | 100.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 235 | 5748a44863905b3a11d97c9d | 49.93% | 30.74% | 69.45% | 69.58% | 69.63% | 69.53% | 69.16% | 69.37% | 69.45% | 69.25% | 69.09% | 70.53% |
| 235 | 5722269493f2f29d3c9acbd7 | 49.93% | 100.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 235 | 5725cb9893f2f29d3c9acbfd | 49.93% | 100.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 235 | 573623fda6200f187771219d | 49.93% | 100.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 235 | 5745592a63905b3a11d97bd4 | 49.93% | 100.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| hc | 5720ebd293f2f29d3c9acbaf | 49.93% | 100.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 236 | 5748d91b63905b3a11d97cf7 | 49.92% | 99.99% | 0.03% | 0.14% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% |
| 237 | 57217ac893f2f29d3c9acbbe | 48.03% | 99.27% | 4.54% | 3.05% | 7.57% | 7.33% | 4.84% | 3.07% | 2.22% | 2.54% | 4.08% | 5.64% |
| 238 | 5732127f93f2f29d3c9acc28 | 36.12% | 95.58% | 32.09% | 87.60% | 35.75% | 21.22% | 16.63% | 12.98% | 11.32% | 14.04% | 21.53% | 30.29% |
Three solutions were too slow to be tested with 10,000 blocks in reasonable time. They have been tested on fewer blocks, so their results are approximate, and they could not be ranked precisely with the others. As of this writing, they are still running on one of our servers. If it doesn't need to reboot before the testing completes, these solutions will eventually be moved to the main table above.
| ID | Correct | TC completed | Seconds per word |
|---|---|---|---|
| 5748d60763905b3a11d97cee | 74.82% | 27% | 1.58 |
| 5745740063905b3a11d97bd5 | 54.05% | 36% | 0.99 |
| 57469a9263905b3a11d97bf0 | 53.69% | 4% | 8.95 |
The remaining solutions failed in one way or another. With the exception of the two solutions that hang on a certain input, all crashes happened on initialization or first word classification attempt, and could have been prevented with the help of the test program we published during the contest.
| ID | Failure |
|---|---|
| 5720b107aac57f9a2c003901 | Error: data supplied but no init function |
| 5720fbf993f2f29d3c9acbb2 | TypeError: module.exports.test is not a function |
| 5721417f93f2f29d3c9acbba | TypeError: Cannot read property 'toString' of undefined |
| 57219da793f2f29d3c9acbc0 | TypeError: module.exports.test is not a function |
| 5721ac2f93f2f29d3c9acbc2 | TypeError: module.exports.test is not a function |
| 5721cf9d93f2f29d3c9acbc9 | TypeError: module.exports.test is not a function |
| 5721eb2c93f2f29d3c9acbd0 | TypeError: data.split is not a function |
| 57221f0a93f2f29d3c9acbd6 | SyntaxError: Unexpected token { |
| 572246fb93f2f29d3c9acbda | Error: incorrect header check |
| 572346b693f2f29d3c9acbe3 | TypeError: module.exports.test is not a function |
| 572389df93f2f29d3c9acbe8 | TypeError: module.exports.test is not a function |
| 57245a1f93f2f29d3c9acbf0 | TypeError: Cannot read property 'split' of undefined |
| 5724617f93f2f29d3c9acbf2 | SyntaxError: Unexpected token export |
| 572469b793f2f29d3c9acbf3 | SyntaxError: Unexpected token true |
| 572572e193f2f29d3c9acbfc | TypeError: module.exports.test is not a function |
| 57274d4b93f2f29d3c9acc03 | TypeError: Cannot read property 'forEach' of null |
| 5727706493f2f29d3c9acc05 | Error: incorrect header check |
| 5727ac2593f2f29d3c9acc07 | ReferenceError: process is not defined |
| 5729d32b93f2f29d3c9acc0b | ReferenceError: require is not defined |
| 5731411f93f2f29d3c9acc25 | ReferenceError: require is not defined |
| 573314a093f2f29d3c9acc2c | TypeError: Cannot read property 'end' of undefined |
| 57335b62a6200f1877712191 | TypeError: Cannot read property 'getIsFirst' of null |
| 573c53cfa6200f18777121b2 | SyntaxError: Unexpected token export |
| 573f6b79a6200f18777121c6 | Error: incorrect header check |
| 5740bedea6200f18777121d6 | TypeError: data.split is not a function |
| 57436456a6200f1877712204 | TypeError: w2_data.split is not a function |
| 5744cff0a6200f187771221e | Error: data supplied but no init function |
| 57452dbea6200f1877712227 | ReferenceError: fs is not defined |
| 57473d2b63905b3a11d97c0f | SyntaxError: Unexpected identifier |
| 574761e163905b3a11d97c1d | TypeError: module.exports.test is not a function |
| 5747927363905b3a11d97c30 | Error: incorrect header check |
| 5747da8d63905b3a11d97c3c | SyntaxError: Unexpected token export |
| 5747f65963905b3a11d97c47 | Error: incorrect header check |
| 5747f68063905b3a11d97c48 | test("'s") hangs |
| 574829f263905b3a11d97c55 | ReferenceError: require is not defined |
| 5748354d63905b3a11d97c59 | test("d") hangs |
| 574835bb63905b3a11d97c5a | TypeError: Cannot read property 'length' of null |
| 57486d5663905b3a11d97c6d | TypeError: module.exports.test is not a function |
| 5748828c63905b3a11d97c79 | TypeError: Cannot read property 'a' of undefined |
| 5748840663905b3a11d97c7a | ReferenceError: require is not defined |
| 57489d8d63905b3a11d97c92 | TypeError: Cannot read property 'readInt32LE' of undefined |
| 5748aef563905b3a11d97cad | TypeError: Cannot read property 'endWord' of undefined |
| 5748b18563905b3a11d97cb5 | TypeError: module.exports.test is not a function |
| 5748b35d63905b3a11d97cbe | TypeError: Cannot read property '11' of undefined |
| 5748b89263905b3a11d97cc6 | TypeError: r.split is not a function |
| 5748c3aa63905b3a11d97cd4 | ReferenceError: window is not defined |
| 5748dabd63905b3a11d97cfa | ReferenceError: GLOBAL is not defined |
| 5748dc4e63905b3a11d97d01 | TypeError: word is not a function |
| 5748de7e63905b3a11d97d0b | ReferenceError: word is not defined |
| 5748df4b63905b3a11d97d10 | Error: data supplied but no init function |
The tables above have been generated from the raw results produced by the production test system we published earlier. We are also publishing the raw results for each of the solutions, except for the slow programs that still haven't completed. The files contain a lot more data than we could show in these tables. We encourage you to perform your own analysis of the raw data, and publish your findings.