Friday, 8 June 2007
Back in November 2005 I asked What's new in Unicode 5.0 ? in anticipation of its release in July of the following year. Now that Unicode 5.0 has been out for nearly a year I thought it would be good time to look ahead to what is in store for Unicode 5.1. Just to be clear, Unicode 5.1 won't be released until the spring or summer of 2008, but the character repertoire is already basically fixed, and there are unlikely to be any major changes (but if there are I will update this post). Well in the end there was one major change -- see addendum at bottom of the page [2007-10-19]. See bottom of post for a list of fonts with Unicode 5.1 coverage.
The additions to Unicode 5.1 will correspond to Amendments 3 and 4 of ISO/IEC 10646:2003. A total of 1,102 new characters are added in Amd.3, although four (U+097B, U+097C, U+097E and U+097F) are already in Unicode 5.0, and a total of 636 526 new characters are expected to be added to Amd.4, so that Unicode 5.1 will have 1,734 1,624 additional characters compared with Unicode 5.0, making a grand total of 100,823 100,713 encoded characters (graphic, format and control characters) in Unicode, breaking the 100K mark for the first time (and for all those who are worried that 17 planes are just not enough, that still leaves room for another 873,707 873,817 characters).
The additions for 5.1 are not as controversial as those for 5.0, and maybe not be as exciting as 5.2 promises to be, but it will include twelve eleven new scripts [Lanna now postponed to Amd.5], which equals nearly equals 3.0 as being the largest number of scripts added in a single version of Unicode. From 5.1 Unicode will cover 76 75 scripts (including Braille which is classified as a script in Unicode), as shown in the table below. Regular readers of my blog will realise that there are still many more historic and less comon scripts waiting to be encoded.
| Script Name | ISO 15924 | Characters* | Version Introduced into Unicode | |
|---|---|---|---|---|
| 5.0 | 5.1 | |||
| Arabic | Arab | 966 | 999 | 1.0 |
| Armenian | Armn | 90 | 90 | 1.0 |
| Balinese | Bali | 121 | 121 | 5.0 |
| Bengali | Beng | 91 | 91 | 1.0 |
| Bopomofo | Bopo | 64 | 65 | 1.0 |
| Braille | Brai | 256 | 256 | 3.0 |
| Buginese | Bugi | 30 | 30 | 4.1 |
| Buhid | Buhd | 20 | 20 | 3.2 |
| Canadian Aboriginal | Cans | 630 | 630 | 3.0 |
| Carian | Cari | 0 | 49 | 5.1 |
| Cham | Cham | 0 | 83 | 5.1 |
| Cherokee | Cher | 85 | 85 | 3.0 |
| Coptic | Copt | 128 | 128 | 1.0 (disunified from Greek in 4.1) |
| Cuneiform | Xsux | 982 | 982 | 5.0 |
| Cypriot | Cprt | 55 | 55 | 4.0 |
| Cyrillic | Cyrl | 277 | 404 | 1.0 |
| Deseret | Dsrt | 80 | 80 | 3.1 |
| Devanagari | Deva | 107 | 107 | 1.0 |
| Ethiopic | Ethi | 461 | 461 | 3.0 |
| Georgian | Geor | 120 | 120 | 1.0 |
| Glagolitic | Glag | 94 | 94 | 4.1 |
| Gothic | Goth | 27 | 27 | 3.1 |
| Greek | Grek | 506 | 511 | 1.0 |
| Gujarati | Gujr | 83 | 83 | 1.0 |
| Gurmukhi | Guru | 77 | 79 | 1.0 |
| Han | Hani | 71,570 | 71,578 | 1.0 |
| Hangul | Hang | 11,620 | 11,620 | 1.0 (relocated in 2.0) |
| Hanunoo | Hano | 21 | 21 | 3.2 |
| Hebrew | Hebr | 133 | 133 | 1.0 |
| Hiragana | Hira | 89 | 89 | 1.0 |
| Kannada | Knda | 86 | 84 | 1.0 |
| Katakana | Kana | 164 | 299 | 1.0 |
| Kayah Li | Kali | 0 | 48 | 5.1 |
| Kharoshthi | Khar | 65 | 65 | 4.1 |
| Khmer | Khmr | 146 | 146 | 3.0 |
| Lana | 0 | |||
| Lao | Laoo | 65 | 65 | 1.0 |
| Latin | Latn | 1,070 | 1,241 | 1.0 |
| Lepcha | Lepc | 0 | 74 | 5.1 |
| Limbu | Limb | 66 | 66 | 4.0 |
| Linear B | Linb | 211 | 211 | 4.0 |
| Lycian | Lyci | 0 | 29 | 5.1 |
| Lydian | Lydi | 0 | 27 | 5.1 |
| Malayalam | Mlym | 78 | 95 | 1.0 |
| Mongolian | Mong | 152 | 153 | 3.0 |
| Myanmar | Mymr | 78 | 3.0 | |
| N’Ko | Nkoo | 59 | 59 | 5.0 |
| New Tai Lue | Talu | 80 | 80 | 4.1 |
| Ogham | Ogam | 29 | 29 | 3.0 |
| Ol Chiki | Olck | 0 | 48 | 5.1 |
| Old Italic | Ital | 35 | 35 | 3.1 |
| Old Persian | Xpeo | 50 | 50 | 4.1 |
| Oriya | Orya | 81 | 84 | 1.0 |
| Osmanya | Osma | 40 | 40 | 4.0 |
| Phags-pa | Phag | 56 | 56 | 5.0 |
| Phoenician | Phnx | 27 | 27 | 5.0 |
| Rejang | Rjng | 0 | 37 | 5.1 |
| Runic | Runr | 78 | 78 | 3.0 |
| Saurashtra | Saur | 0 | 81 | 5.1 |
| Shavian | Shaw | 48 | 48 | 4.0 |
| Sinhala | Sinh | 80 | 80 | 3.0 |
| Sundanese | Sund | 0 | 55 | 5.1 |
| Syloti Nagri | Sylo | 44 | 44 | 4.1 |
| Syriac | Syrc | 77 | 77 | 3.0 |
| Tagalog | Tglg | 20 | 20 | 3.2 |
| Tagbanwa | Tagb | 18 | 18 | 3.2 |
| Tai Le | Tale | 35 | 35 | 4.0 |
| Tamil | Taml | 71 | 72 | 1.0 |
| Telugu | Telu | 80 | 93 | 1.0 |
| Thaana | Thaa | 50 | 50 | 3.0 |
| Thai | Thai | 86 | 86 | 1.0 |
| Tibetan | Tibt | 195 | 201 | 1.0 (removed in 1.1 and reintroduced in 2.0) |
| Tifinagh | Tfng | 55 | 55 | 4.1 |
| Ugaritic | Ugar | 31 | 31 | 4.0 |
| Vai | Vaii | 0 | 300 | 5.1 |
| Yi | Yiii | 1,220 | 1,220 | 3.0 |
* Numbers of characters do not necessarily represent the total number of encoded characters used for the script (and are not necessarily the same as the number of characters in the same-named block), but are the number of characters that are uniquely assigned to that script by Unicode (i.e. excluding characters that have the Unicode script property of "common" or "inherited"). Some differences in the figures for particular scripts (e.g. Katakana and Latin) reflect changes in script assignment in Unicode 5.1.
For me, the highlights of Unicode 5.1 are the encoding of the symbols on the enigmatic Phaistos Disc (first proposed for encoding ten years ago, but delayed because of some opposition to encoding undeciphered symbols found on a unique artefact), and the encoding of a wide range of letters used in medieval manuscripts and early printed books, so that finally texts such as The Calixtus Bull can be represented exactly as they are written. The script that has had the biggest makeover for 5.1 is Myanmar, with changes to the encoding model to finally make it useable, as well as additions to support minority languages such as Mon, S'gaw Karen, Western Pwo Karen, Eastern Pwo Karen, Geba Karen, Kayah, Shan and Rumai Palaung (see Andrew Cunningham's The Myanmar script and Unicode for a useful overview of support for the Myanmar script) And then there are a handful of Tibetan (U+0FCE, U+0FD2..U+0FD4), Mongolian (U+18AA) and CJK (U+9FC3) characters that I am responsible for, which I am of course pleased to see make it into the standard.
Amendment 3 is now at the FDAM stage of the ISO ballot process, and its repertoire is fixed, so the code points given below can be relied on. The ISO 15924 code for new scripts is given in square brackets, and the number of new characters is given in curly braces.
Amendment 4 is now at the FPDAM stage of the ISO ballot process, and its repertoire is unlikely to change significantly, but there may be changes, and the code point allocations could possibly change. The ISO 15924 code for new scripts is given in square brackets, and the number of new characters is given in curly braces.
Egyptian Hieroglyphs (an initial set of 1,063 characters corresponding to Gardiner's Sign List) are not in 5.1, but are in Amd.5 which is currently undergoing its first ballot, and should correspond to Unicode 5.2 (there will probably be several minor versions before Unicode 6.0 is published). Other scripts that are in Amd.5 are Meitei Mayek, Bamum (removed for further study), Tai Viet and Avestan. Amd.5 also includes two new blocks for a set of controversial Old Hangul Jamo.
Not yet ready for inclusion in Unicode 5.2 is Tangut. A first proposal has now been submitted to the UTC, but has not yet reached WG2. Because of the complexity of the Tangut repertoire and probable issues about "ownership" of the script, it may take some time to reach an agreement on encoding Tangut, and so may not be in Unicode for a few more versions yet. [Well, I was wrong about that—it has made it into Amd.6 which means that it is scheduled for inclusion in Unicode 5.2]
However, the big and unexpected hole in 5.1 (Amd.4) is CJK-C, which is the first installment of the tens of thousands of additional Han characters submitted for encoding by members of the Ideographic characters Rapporteur Group (IRG). This set of 4,219 CJKV ideographs was included in PDAM4, but was moved from Amd.4 to Amd.5 at the last WG2 meeting (in Frankfurt at the end of April). I will look at CJK-C in more detail in my next post.
At the WG2 meeting in Hangzhou last month (which I had hoped to attend if it was in Ürümqi as originally planned) two important changes to the Amd.4 repertoire were made.
Firstly, 17 additional Myanmar characters (including 10 Shan digits) were added in order to complete the extensions to the Myanmar script required to support the Shan language.
Secondly, the agreement on encoding the Lanna script achieved at the Frankfurt WG2 meeting in the Spring fell apart, with China demanding significant changes to the proposal. The end result was that Lanna was removed from Amd.4, and put back to Amd.5 (this will mean that it will miss the train for Unicode 5.1 next year). In addition, the script name is to be changed to TAI THAM due to objections to the name "Lanna" by China. (There have been a lot of disputes over script names recently, with user communities objecting to traditional English script names such as Pollard and Fraser.)
So now the repertoire of Amds. 3 and 4 have been finalised, and consequently the contents of Unicode 5.1 are now fixed, and will be going beta in the Spring. However, I think that Amd.5 is going to be the interesting one, as it includes both CJK-C and Egyptian hieroglyphs (but with Bamum removed by request of the user community, and Meitei Mayek removed due to fierce differences of opinion on danda disunification within WG2).
Now that Unicode 5.1 has been released (April 2008) a lot of people want to be able to make use of all the new scripts and characters, but obviously can't if they don't have any fonts that support the new Unicode 5.1 characters. So here is a list of some freeware and shareware fonts that do have Unicode 5.1 coverage (Unicode 5.1 coverage in brackets):
And finally, if you are interested in what will be in the next version of Unicode after 5.1, take a look at What's new in Unicode 5.2 ?.
Index of BabelStone Blog Posts