W3C home > Mailing lists > Public > www-archive@w3.org > April 2012

Duplicate code points in indexes

From: Anne van Kesteren <annevk@opera.com>
Date: Wed, 25 Apr 2012 22:07:40 +0200
To: www-archive@w3.org
Message-ID: <op.wdb7i2wp64w2qv@annevk-macbookpro.local>
For https://www.w3.org/Bugs/Public/show_bug.cgi?id=16839 I wanted to  
figure out which indexes have the same code point at distinct pointers. So  
I ran the attached Python script on  
http://dvcs.w3.org/hg/encoding/raw-file/tip/indexes.json from the Encoding  
Standard. It seems the jis0208 and big5 indexes are more broadly affected  
and gbk has a single code point with two pointers. The result of running  
the script:

INDEX: jis0208

U+222A [125, 1219]
U+2229 [126, 1218]
U+FFE2 [137, 8644, 10736]
U+2220 [153, 1214]
U+22A5 [154, 1213]
U+2261 [158, 1208]
U+2252 [159, 1207]
U+221A [162, 1212]
U+2235 [165, 1217, 10743]
U+222B [166, 1209]
U+2160 [1148, 10726]
U+2161 [1149, 10727]
U+2162 [1150, 10728]
U+2163 [1151, 10729]
U+2164 [1152, 10730]
U+2165 [1153, 10731]
U+2166 [1154, 10732]
U+2167 [1155, 10733]
U+2168 [1156, 10734]
U+2169 [1157, 10735]
U+2116 [1193, 10741]
U+2121 [1195, 10742]
U+3231 [1201, 10740]
U+7E8A [8272, 10744]
U+891C [8273, 10745]
U+9348 [8274, 10746]
U+9288 [8275, 10747]
U+84DC [8276, 10748]
U+4FC9 [8277, 10749]
U+70BB [8278, 10750]
U+6631 [8279, 10751]
U+68C8 [8280, 10752]
U+92F9 [8281, 10753]
U+66FB [8282, 10754]
U+5F45 [8283, 10755]
U+4E28 [8284, 10756]
U+4EE1 [8285, 10757]
U+4EFC [8286, 10758]
U+4F00 [8287, 10759]
U+4F03 [8288, 10760]
U+4F39 [8289, 10761]
U+4F56 [8290, 10762]
U+4F92 [8291, 10763]
U+4F8A [8292, 10764]
U+4F9A [8293, 10765]
U+4F94 [8294, 10766]
U+4FCD [8295, 10767]
U+5040 [8296, 10768]
U+5022 [8297, 10769]
U+4FFF [8298, 10770]
U+501E [8299, 10771]
U+5046 [8300, 10772]
U+5070 [8301, 10773]
U+5042 [8302, 10774]
U+5094 [8303, 10775]
U+50F4 [8304, 10776]
U+50D8 [8305, 10777]
U+514A [8306, 10778]
U+5164 [8307, 10779]
U+519D [8308, 10780]
U+51BE [8309, 10781]
U+51EC [8310, 10782]
U+5215 [8311, 10783]
U+529C [8312, 10784]
U+52A6 [8313, 10785]
U+52C0 [8314, 10786]
U+52DB [8315, 10787]
U+5300 [8316, 10788]
U+5307 [8317, 10789]
U+5324 [8318, 10790]
U+5372 [8319, 10791]
U+5393 [8320, 10792]
U+53B2 [8321, 10793]
U+53DD [8322, 10794]
U+FA0E [8323, 10795]
U+549C [8324, 10796]
U+548A [8325, 10797]
U+54A9 [8326, 10798]
U+54FF [8327, 10799]
U+5586 [8328, 10800]
U+5759 [8329, 10801]
U+5765 [8330, 10802]
U+57AC [8331, 10803]
U+57C8 [8332, 10804]
U+57C7 [8333, 10805]
U+FA0F [8334, 10806]
U+FA10 [8335, 10807]
U+589E [8336, 10808]
U+58B2 [8337, 10809]
U+590B [8338, 10810]
U+5953 [8339, 10811]
U+595B [8340, 10812]
U+595D [8341, 10813]
U+5963 [8342, 10814]
U+59A4 [8343, 10815]
U+59BA [8344, 10816]
U+5B56 [8345, 10817]
U+5BC0 [8346, 10818]
U+752F [8347, 10819]
U+5BD8 [8348, 10820]
U+5BEC [8349, 10821]
U+5C1E [8350, 10822]
U+5CA6 [8351, 10823]
U+5CBA [8352, 10824]
U+5CF5 [8353, 10825]
U+5D27 [8354, 10826]
U+5D53 [8355, 10827]
U+FA11 [8356, 10828]
U+5D42 [8357, 10829]
U+5D6D [8358, 10830]
U+5DB8 [8359, 10831]
U+5DB9 [8360, 10832]
U+5DD0 [8361, 10833]
U+5F21 [8362, 10834]
U+5F34 [8363, 10835]
U+5F67 [8364, 10836]
U+5FB7 [8365, 10837]
U+5FDE [8366, 10838]
U+605D [8367, 10839]
U+6085 [8368, 10840]
U+608A [8369, 10841]
U+60DE [8370, 10842]
U+60D5 [8371, 10843]
U+6120 [8372, 10844]
U+60F2 [8373, 10845]
U+6111 [8374, 10846]
U+6137 [8375, 10847]
U+6130 [8376, 10848]
U+6198 [8377, 10849]
U+6213 [8378, 10850]
U+62A6 [8379, 10851]
U+63F5 [8380, 10852]
U+6460 [8381, 10853]
U+649D [8382, 10854]
U+64CE [8383, 10855]
U+654E [8384, 10856]
U+6600 [8385, 10857]
U+6615 [8386, 10858]
U+663B [8387, 10859]
U+6609 [8388, 10860]
U+662E [8389, 10861]
U+661E [8390, 10862]
U+6624 [8391, 10863]
U+6665 [8392, 10864]
U+6657 [8393, 10865]
U+6659 [8394, 10866]
U+FA12 [8395, 10867]
U+6673 [8396, 10868]
U+6699 [8397, 10869]
U+66A0 [8398, 10870]
U+66B2 [8399, 10871]
U+66BF [8400, 10872]
U+66FA [8401, 10873]
U+670E [8402, 10874]
U+F929 [8403, 10875]
U+6766 [8404, 10876]
U+67BB [8405, 10877]
U+6852 [8406, 10878]
U+67C0 [8407, 10879]
U+6801 [8408, 10880]
U+6844 [8409, 10881]
U+68CF [8410, 10882]
U+FA13 [8411, 10883]
U+6968 [8412, 10884]
U+FA14 [8413, 10885]
U+6998 [8414, 10886]
U+69E2 [8415, 10887]
U+6A30 [8416, 10888]
U+6A6B [8417, 10889]
U+6A46 [8418, 10890]
U+6A73 [8419, 10891]
U+6A7E [8420, 10892]
U+6AE2 [8421, 10893]
U+6AE4 [8422, 10894]
U+6BD6 [8423, 10895]
U+6C3F [8424, 10896]
U+6C5C [8425, 10897]
U+6C86 [8426, 10898]
U+6C6F [8427, 10899]
U+6CDA [8428, 10900]
U+6D04 [8429, 10901]
U+6D87 [8430, 10902]
U+6D6F [8431, 10903]
U+6D96 [8432, 10904]
U+6DAC [8433, 10905]
U+6DCF [8434, 10906]
U+6DF8 [8435, 10907]
U+6DF2 [8436, 10908]
U+6DFC [8437, 10909]
U+6E39 [8438, 10910]
U+6E5C [8439, 10911]
U+6E27 [8440, 10912]
U+6E3C [8441, 10913]
U+6EBF [8442, 10914]
U+6F88 [8443, 10915]
U+6FB5 [8444, 10916]
U+6FF5 [8445, 10917]
U+7005 [8446, 10918]
U+7007 [8447, 10919]
U+7028 [8448, 10920]
U+7085 [8449, 10921]
U+70AB [8450, 10922]
U+710F [8451, 10923]
U+7104 [8452, 10924]
U+715C [8453, 10925]
U+7146 [8454, 10926]
U+7147 [8455, 10927]
U+FA15 [8456, 10928]
U+71C1 [8457, 10929]
U+71FE [8458, 10930]
U+72B1 [8459, 10931]
U+72BE [8460, 10932]
U+7324 [8461, 10933]
U+FA16 [8462, 10934]
U+7377 [8463, 10935]
U+73BD [8464, 10936]
U+73C9 [8465, 10937]
U+73D6 [8466, 10938]
U+73E3 [8467, 10939]
U+73D2 [8468, 10940]
U+7407 [8469, 10941]
U+73F5 [8470, 10942]
U+7426 [8471, 10943]
U+742A [8472, 10944]
U+7429 [8473, 10945]
U+742E [8474, 10946]
U+7462 [8475, 10947]
U+7489 [8476, 10948]
U+749F [8477, 10949]
U+7501 [8478, 10950]
U+756F [8479, 10951]
U+7682 [8480, 10952]
U+769C [8481, 10953]
U+769E [8482, 10954]
U+769B [8483, 10955]
U+76A6 [8484, 10956]
U+FA17 [8485, 10957]
U+7746 [8486, 10958]
U+52AF [8487, 10959]
U+7821 [8488, 10960]
U+784E [8489, 10961]
U+7864 [8490, 10962]
U+787A [8491, 10963]
U+7930 [8492, 10964]
U+FA18 [8493, 10965]
U+FA19 [8494, 10966]
U+FA1A [8495, 10967]
U+7994 [8496, 10968]
U+FA1B [8497, 10969]
U+799B [8498, 10970]
U+7AD1 [8499, 10971]
U+7AE7 [8500, 10972]
U+FA1C [8501, 10973]
U+7AEB [8502, 10974]
U+7B9E [8503, 10975]
U+FA1D [8504, 10976]
U+7D48 [8505, 10977]
U+7D5C [8506, 10978]
U+7DB7 [8507, 10979]
U+7DA0 [8508, 10980]
U+7DD6 [8509, 10981]
U+7E52 [8510, 10982]
U+7F47 [8511, 10983]
U+7FA1 [8512, 10984]
U+FA1E [8513, 10985]
U+8301 [8514, 10986]
U+8362 [8515, 10987]
U+837F [8516, 10988]
U+83C7 [8517, 10989]
U+83F6 [8518, 10990]
U+8448 [8519, 10991]
U+84B4 [8520, 10992]
U+8553 [8521, 10993]
U+8559 [8522, 10994]
U+856B [8523, 10995]
U+FA1F [8524, 10996]
U+85B0 [8525, 10997]
U+FA20 [8526, 10998]
U+FA21 [8527, 10999]
U+8807 [8528, 11000]
U+88F5 [8529, 11001]
U+8A12 [8530, 11002]
U+8A37 [8531, 11003]
U+8A79 [8532, 11004]
U+8AA7 [8533, 11005]
U+8ABE [8534, 11006]
U+8ADF [8535, 11007]
U+FA22 [8536, 11008]
U+8AF6 [8537, 11009]
U+8B53 [8538, 11010]
U+8B7F [8539, 11011]
U+8CF0 [8540, 11012]
U+8CF4 [8541, 11013]
U+8D12 [8542, 11014]
U+8D76 [8543, 11015]
U+FA23 [8544, 11016]
U+8ECF [8545, 11017]
U+FA24 [8546, 11018]
U+FA25 [8547, 11019]
U+9067 [8548, 11020]
U+90DE [8549, 11021]
U+FA26 [8550, 11022]
U+9115 [8551, 11023]
U+9127 [8552, 11024]
U+91DA [8553, 11025]
U+91D7 [8554, 11026]
U+91DE [8555, 11027]
U+91ED [8556, 11028]
U+91EE [8557, 11029]
U+91E4 [8558, 11030]
U+91E5 [8559, 11031]
U+9206 [8560, 11032]
U+9210 [8561, 11033]
U+920A [8562, 11034]
U+923A [8563, 11035]
U+9240 [8564, 11036]
U+923C [8565, 11037]
U+924E [8566, 11038]
U+9259 [8567, 11039]
U+9251 [8568, 11040]
U+9239 [8569, 11041]
U+9267 [8570, 11042]
U+92A7 [8571, 11043]
U+9277 [8572, 11044]
U+9278 [8573, 11045]
U+92E7 [8574, 11046]
U+92D7 [8575, 11047]
U+92D9 [8576, 11048]
U+92D0 [8577, 11049]
U+FA27 [8578, 11050]
U+92D5 [8579, 11051]
U+92E0 [8580, 11052]
U+92D3 [8581, 11053]
U+9325 [8582, 11054]
U+9321 [8583, 11055]
U+92FB [8584, 11056]
U+FA28 [8585, 11057]
U+931E [8586, 11058]
U+92FF [8587, 11059]
U+931D [8588, 11060]
U+9302 [8589, 11061]
U+9370 [8590, 11062]
U+9357 [8591, 11063]
U+93A4 [8592, 11064]
U+93C6 [8593, 11065]
U+93DE [8594, 11066]
U+93F8 [8595, 11067]
U+9431 [8596, 11068]
U+9445 [8597, 11069]
U+9448 [8598, 11070]
U+9592 [8599, 11071]
U+F9DC [8600, 11072]
U+FA29 [8601, 11073]
U+969D [8602, 11074]
U+96AF [8603, 11075]
U+9733 [8604, 11076]
U+973B [8605, 11077]
U+9743 [8606, 11078]
U+974D [8607, 11079]
U+974F [8608, 11080]
U+9751 [8609, 11081]
U+9755 [8610, 11082]
U+9857 [8611, 11083]
U+9865 [8612, 11084]
U+FA2A [8613, 11085]
U+FA2B [8614, 11086]
U+9927 [8615, 11087]
U+FA2C [8616, 11088]
U+999E [8617, 11089]
U+9A4E [8618, 11090]
U+9AD9 [8619, 11091]
U+9ADC [8620, 11092]
U+9B75 [8621, 11093]
U+9B72 [8622, 11094]
U+9B8F [8623, 11095]
U+9BB1 [8624, 11096]
U+9BBB [8625, 11097]
U+9C00 [8626, 11098]
U+9D70 [8627, 11099]
U+9D6B [8628, 11100]
U+FA2D [8629, 11101]
U+9E19 [8630, 11102]
U+9ED1 [8631, 11103]
U+2170 [8634, 10716]
U+2171 [8635, 10717]
U+2172 [8636, 10718]
U+2173 [8637, 10719]
U+2174 [8638, 10720]
U+2175 [8639, 10721]
U+2176 [8640, 10722]
U+2177 [8641, 10723]
U+2178 [8642, 10724]
U+2179 [8643, 10725]
U+FFE4 [8645, 10737]
U+FF07 [8646, 10738]
U+FF02 [8647, 10739]


INDEX: gbk

U+3000 [6176, 6555]


INDEX: big5

U+7BB8 [2082, 9081]
U+7C06 [2088, 17060]
U+7CCE [2103, 5214]
U+7DD2 [2114, 9103]
U+7E1D [2123, 9802]
U+8005 [2148, 6543]
U+8028 [2151, 9810]
U+83C1 [2221, 8281]
U+84A8 [2239, 15488]
U+840F [2244, 14187]
U+880F [2282, 4902]
U+89A6 [2303, 9840]
U+89A9 [2304, 4981]
U+8D77 [2354, 7410]
U+90FD [2400, 7915]
U+92B9 [2413, 18957]
U+96B6 [2453, 10950]
U+975C [2477, 9909]
U+97FF [2498, 10696]
U+9F17 [2604, 4748]
U+9F16 [2605, 17713]
U+8503 [2671, 2673]
U+5159 [2746, 5206]
U+515B [2747, 5207]
U+515D [2748, 5209]
U+515E [2749, 5208]
U+936E [2771, 4898]
U+7479 [2780, 15930]
U+5F0C [2859, 4828]
U+6D67 [2990, 12739]
U+7250 [3004, 4997]
U+7468 [3041, 4982]
U+799B [3087, 15967]
U+9097 [3259, 11479]
U+975D [3301, 4369]
U+701E [3436, 3437]
U+5B28 [3451, 16353]
U+732A [3821, 19643]
U+7201 [4136, 17421]
U+77D7 [4138, 10825]
U+7E87 [4141, 18346]
U+99D6 [4182, 16278]
U+91D4 [4206, 12497]
U+60DE [4220, 19504]
U+6FB6 [4230, 9741]
U+8F36 [4241, 16745]
U+4FBB [4258, 12065]
U+71DF [4273, 10024]
U+9104 [4279, 14305]
U+9DF0 [4282, 18728]
U+83CF [4294, 14159]
U+5C10 [4329, 11332]
U+79E3 [4330, 7300]
U+5A67 [4349, 13142]
U+8F0B [4419, 14975]
U+7B51 [4422, 8240]
U+62D0 [4494, 6410]
U+5605 [4537, 19162]
U+5ED0 [4549, 19305]
U+6062 [4624, 6732]
U+75F9 [4694, 14708]
U+6C4A [4708, 11458]
U+9B2E [4742, 18938]
U+50ED [4815, 8870]
U+62CE [4922, 6422]
U+60A4 [4989, 19355]
U+7162 [4992, 14651]
U+3003 [5104, 10957]
U+74E9 [5213, 19697]
U+256D [5243, 18992]
U+256E [5244, 18993]
U+2570 [5245, 18994]
U+256F [5246, 18995]
U+2550 [5247, 18991]
U+255E [5248, 18975]
U+256A [5249, 18976]
U+2561 [5250, 18977]
U+5341 [5287, 5512]
U+5344 [5288, 19096]
U+5345 [5289, 5599]
U+5305 [5681, 19088]
U+675E [6119, 19454]
U+5029 [7007, 19028]
U+537F [7045, 19112]
U+507D [7457, 19035]
U+5A77 [8007, 19240]
U+6674 [8093, 19439]
U+6E2F [8137, 19557]
U+6E1D [8161, 19554]
U+716E [8178, 19611]
U+745C [8616, 19672]
U+6490 [9346, 19398]
U+5EF4 [10942, 19309]
U+65E0 [10946, 19424]
U+7676 [10948, 19720]
U+4EDD [10958, 11345]
U+5E75 [11425, 19299]
U+6C9C [11642, 19553]
U+7809 [12389, 19748]
U+5F58 [13805, 19326]


-- 
Anne van Kesteren
http://annevankesteren.nl/


Received on Wednesday, 25 April 2012 20:08:13 UTC

This archive was generated by hypermail 2.3.1 : Wednesday, 7 January 2015 14:44:03 UTC