The Unicode Standard Version 10.0 Core Specification

Transcription

1 The Unicode Standard Version 10.0 Core Specification To learn about the latest version of the Unicode Standard, see Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals. Unicode and the Unicode Logo are registered trademarks of Unicode, Inc., in the United States and other countries. The authors and publisher have taken care in the preparation of this specification, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. The Unicode Character Database and other files are provided as-is by Unicode, Inc. No claims are made as to fitness for any particular purpose. No warranties of any kind are expressed or implied. The recipient agrees to determine applicability of information provided Unicode, Inc. All rights reserved. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction. For information regarding permissions, inquire at For information about the Unicode terms of use, please see The Unicode Standard / the Unicode Consortium; edited by the Unicode Consortium. Version Includes bibliographical references and index. ISBN ( 1. Unicode (Computer character set) I. Unicode Consortium. QA268.U ISBN Published in Mountain View, CA June 2017

2 987 I Index The index covers the contents of this core specification. To find topics in the Unicode Standard Annexes, Unicode Technical Standards, and Unicode Technical Reports, use the search feature on the Unicode website. For definitions of terms used, see the glossary on the Unicode website. To find the code points for specific characters or the code ranges for particular scripts, use the Character Index on the Unicode website. (See Section B.3, Other Unicode Online Resources.) A abbreviation, Coptic abjads , 363 abstract character sequences definition abstract characters definition abugidas , 262, 445, 615 accent marks see diacritics accented characters encoding Latin normalization accounting numbers, ideographic acrophonic numerals , 311 Adlam reference materials Aegean numbers Africa scripts of Afrikaans Ahom reference materials Ainu Aiton Alchemical Symbols reference materials Algonquian Ali Gali aliases character name , 183 informative normative property property value allocation areas allocation of encoded characters Alphabetic (informative property) alphabets European mathematical alternate format characters (deprecated). 194, Americas scripts of Amharic Anatolian hieroglyphs reference materials Ancient Symbols angle brackets (U+2329 and U+232A) deprecated for technical publication Annexes, Unicode Standard (UAX) xxxiii, 901 as components of Unicode Standard conformance list of annotation characters use in plain text discouraged ANSI/ISO C wchar_t and Unicode apostrophe (U+0027) Arabic digits Arabic-Indic digits signs used with ArabicShaping.txt , 384, 399 Aramaic , 445, 528, 555, 560 areas of the Unicode Standard ARIB Armenian arrows ASCII characters with multiple semantics transparency of UTF Unicode modeled on zero extension , 913 Assamese assigned code points , 30 Athapascan

3 Index 988 atomic character boundaries Avestan reference materials B Balinese reference materials Bamum reference materials Bangla base characters definition multiple ordered before combining marks , 330 Basic Multilingual Plane (BMP) , 44 allocation areas representation in UTF Basque Bassa Vah reference materials Batak reference materials benefits of Unicode Bengali Bhaiksuki reference materials Bidi Class (normative property) Bidi Mirrored (normative property) Bidi Mirroring Glyph (informative property) BidiMirroring.txt Bidirectional Algorithm, Unicode , 84 bidirectional ordering controls bidirectional text , 84 Middle Eastern scripts nonspacing marks in punctuation in big-endian definition Bihari binary comparison and sort order caution for UTF UTF differences , 235 UTF block , 90, 259, 875 headers BMP see Basic Multilingual Plane BNF (Backus-Naur Form) BOCU-1 see UTN #6, BOCU-1 MIME-Compatible Unicode Compression Bodhi Bodo BOM (U+FEFF) , 67, , Bopomofo boundaries, text , 191, , 230 see also UAX #14, Unicode Line Breaking Algorithm see also UAX #29, Unicode Text Segmentation boustrophedon , 353 box drawing symbols Brahmi , 555, , 560, 617 reference materials Braille Breton Buginese Buhid Bulgarian bullets numeric Burmese see Myanmar Byelorussian byte order mark (BOM) (U+FEFF). 40, 67, , byte ordering changing conformance byte serialization , 67 Byzantine Musical Symbols C C language wchar_t and Unicode C0 and C1 control codes , 189, 840 Cambodian see Khmer Canadian Aboriginal Syllabics reference materials candrabindu , 590 canonical composite characters see canonical decomposable characters canonical composition algorithm canonical decomposable characters definition canonical decomposition definition mappings canonical equivalence definition nonspacing marks canonical equivalent character sequences conformance canonical mappings see canonical decomposition mappings canonical ordering algorithm canonical precomposed characters see canonical decomposable characters Cantonese

4 Index 989 capital letters , 238, 291 Carian reference materials carriage return (U+000D) (CR) , 841 carriage return and line feed (CRLF) case and text processes beyond ASCII camelcase case folding case operations (conformance) , case operations and normalization case operations, reversibility cased (definition) case-insensitive comparison , 233, 242 casing context (definition) conversion detection European alphabets exceptional Latin pairs , 299 Georgian lowercase , 238, 291 mapping tables mappings , 168, mappings noted in code charts titlecase , 238 Turkish I , 295 uppercase , 238, 291 see also default case Case (normative property) , 238 CaseFolding.txt , 242 caseless letters Catalan Caucasian Albanian reference materials cedilla CEF see character encoding forms CES see character encoding schemes Chakma reference materials Cham reference materials character encoding forms (CEF) , 913 see also Unicode encoding forms character encoding model , 42 see also UTR #17, Unicode Character Encoding Model character encoding schemes (CES) see also Unicode encoding schemes character encoding standards coverage by Unicode Character Index character literals, Unicode code point notation U character names , , 917 aliases , 183 conventions for CJK ideographs for control codes , 189 in code charts matching character properties see properties see also individual properties, e.g. Combining Class character semantics , 80, 87 88, 918 as Unicode design principle ASCII definition character sequences abstract see abstract character sequences canonical equivalent see canonical equivalent character sequences compatibility equivalent see compatibility equivalent character sequences conformance named character sequences, combining character shaping selectors (deprecated) character tabulation (U+0009) characters abstract see abstract characters arrangement in Unicode assigned , 30 boundaries canonical decomposable see canonical decomposable characters classes code charts , 902 coded see encoded characters combining see combining characters compatibility decomposable see compatibility decomposable characters composite see decomposable characters concept of , 60 conformance definitions confusable conversion decomposable see decomposable characters deprecated see deprecated characters encoded see encoded characters encoding forms see encoding forms encoding schemes see encoding schemes end-user perceived format control , 68, 267, glyphs, relationship to graphic identity (definition) ignored in processing

5 Index 990 interpretation layout control , modification names list names see character names not encoded in Unicode number encoded in Version precomposed see decomposable characters properties see properties semantics see character semantics special , supplementary see supplementary characters transcoding unsupported characters, not glyphs in spoofing Unicode principle charsets IANA registered names charts, character code see code charts Cherokee reference materials Chinese Cantonese Hakka Mandarin Minnan (Hokkien/Fujian, incl. Taiwanese). 706 simplified and traditional Chu hán Chu Nôm citations for properties Unicode algorithms Unicode Standard CJK ideographs , accounting numbers CJK Compatibility Ideographs CJK Compatibility Supplement CJK Strokes , 931 CJK Unified Ideographs CJK Unified Ideographs Extension A CJK Unified Ideographs Extension B CJK Unified Ideographs Extension C CJK Unified Ideographs Extension D CJK Unified Ideographs Extension E CJK Unified Ideographs Extension F code charts compatibility ideographs in Plane component structure encoding blocks ideographic description sequences ideographic variation mark (U+303E) KangXi radicals , names numbers numeric values , 207 order of encoding radicals source standards unknown or unavailable Vietnamese CJK Miscellaneous Area CJK punctuation and symbols compatibility forms overscores and underscores quotation marks sesame dots vertical forms CJK-JRG (Chinese/Japanese/Korean Joint Research Group) CJKV Ideographs Area CLDR (Unicode Common Locale Data Repository). 903 cluster boundaries code charts , 902 representative glyphs code point sequences notation code points , 29 assigned , 30 assignment categories default ignorable , 254 definition designated notation number in Unicode Standard private-use see private-use code points reserved see reserved code points semantics surrogate see surrogates unassigned see unassigned code points undesignated code positions see code points code set independence code unit sequences definition ill-formed (definition) notation well-formed (definition) code units definition isolated code values see code units coded character representations see coded character sequences coded character sequences definition coded characters see encoded characters

6 Index 991 codespace see Unicode codespace coeng , 634 Collation Algorithm, Unicode (UCA) collation see sorting collation tables combining character sequences , 106 defective definition Latin line breaking matching order of base character and marks , 330 rendering selection truncation combining characters , , blocking reordering canonical ordering , 138, 170 combining marks definition dependence display order keyboard input ligatures multiple multiple base characters normalization of ordering conventions rendering of marks reordrant script-specific split strikethrough subjoined typographical interaction , 170 vertical stacking see also diacritics Combining Class (normative property) combining classes , 170, class zero characters definition combining grapheme joiner (U+034F) combining half marks , 338 combining marks see combining characters comma below Compatibility and Specials Area , 50 compatibility characters compatibility composite characters see compatibility decomposable characters compatibility decomposable characters definition compatibility decomposition definition compatibility decomposition mappings compatibility equivalence definition compatibility equivalent character sequences conformance compatibility mappings see compatibility decomposition mappings compatibility precomposed characters see compatibility decomposable characters compatibility variants mapping composite characters see decomposable characters Composition Exclusion (normative property) compression see also UTS #6, A Standard Compression Scheme for Unicode (SCSU) conferences conformance definitions examples ISO/IEC implementations requirements confusables conjunct consonants Indic , 451 Myanmar selection of clusters contextual shaping apostrophe Arabic not used for Hebrew final forms quotation marks Syriac contour tones control codes , 68, 840 graphics for names properties semantics , 841 specified in Unicode control sequences conversion of characters , , 256 convertibility as Unicode design principle Coptic , reference materials Coptic Epact numbers corporate use subarea corrigenda CR (U+000D carriage return) , 841 CRLF (carriage return and line feed) Croatian digraphs culturally expected sorting , 232

7 Index 992 Cuneiform Old Persian Sumero-Akkadian Ugaritic Cuneiform and Hieroglyphic Area Cuneiform and Hieroglyphs currency symbols block currency symbols encoded in other blocks currency symbols, other dollar sign, form and usage euro sign lari sign lira sign, compatibility usage lira sign, Turkish peso signs, usage ruble sign rupee signs, Indian, usage yen and yuan signs, usage cursive joining Arabic control characters for , , 531, 844 Mandaic Mongolian N Ko Phags-pa Syriac transparency cursive scripts Cypriot reference materials see also Linear B Cyrillic Czech D danda, in Devanagari block Danish dashes Database, Unicode Character see Unicode Character Database (UCD) dead consonants, Indic dead keys decomposable characters definition normalization of decomposition , canonical see canonical decomposition compatibility see compatibility decomposition definition in normalization mapping, definition mappings noted in code charts default case algorithms , conversion detection folding default caseless matching default grapheme clusters see also UAX #29, Unicode Text Segmentation Default Ignorable Code Point (property) default ignorable code points , 254 default property values definition defective combining character sequences definition dependent vowel signs Indic Khmer Philippine scripts deprecated characters , 879 alternate format , definition Derived Age (property) derived properties definition DerivedCoreProperties.txt , 166, 254 DerivedNormalizationProps.txt Deseret reference materials design goals of Unicode design principles of Unicode designated code points Devanagari Dhivehi diacritics , 330 alternative glyphs , 330 Czech display in isolation , 269, 331 double , 192, 332 German dialectology Greek , 310 Latin Latvian mathematical on i and j rendering Slovak spacing clones of , 332 symbol , 337 see also combining characters dictionary symbols digit form names digits Arabic Arabic-Indic

8 Index 993 compatibility decimal glyph variants hexadecimal Myanmar national shapes Shan superscript and subscript Tai Laing Tai Tham digraphs , 301, 303 dingbats directionality , 53 East Asian scripts Middle Eastern scripts Mongolian musical symbols normative property Ogham Old Italic Philippine scripts Runic discussion list for Unicode Dogri Domino Tiles dotless i , 295 dotted circle in code charts , 331 in fallback rendering to indicate diacritic to indicate vowel sign placement double diacritics , 192, 332 Duployan reference materials Dutch , 298 dynamic composition as Unicode design principle Dzongkha E East Asian scripts writing direction see also CJK ideographs Eastern Arabic-Indic digits EBCDIC newline function editing, text boundaries for efficiency as Unicode design principle Egyptian hieroglyphs reference materials Elbasan reference materials ellipsis discussion list for Unicode emoji , 902 animal symbols charts cultural symbols zodiacal symbols emoji modifiers emoticons Enclosed Alphanumerics enclosing marks definition encoded characters , 29 allocation definition encoding form conversion definition encoding forms ISO/IEC definitions encoding forms, Unicode see Unicode encoding forms encoding model for Unicode characters , 42 see also UTR #17, Unicode Character Encoding Model encoding schemes encoding schemes, Unicode see Unicode encoding schemes endian ordering see byte order mark (BOM) (U+FEFF) end-user subarea English equivalent sequences as Unicode design principle case-insensitivity , 242 combining characters in matching conformance Hangul syllables in sorting and searching language-specific security implications see also canonical equivalence see also compatibility equivalence see also encoding forms, encoding schemes errata xxxvi, 76, 903 escape sequences not used in Unicode , 4 Esperanto Estonian Ethiopic reference materials Etruscan European scripts ancient eyelash-ra

9 Index 994 F fallback rendering of nonspacing marks FAQ (Frequently Asked Questions) Faroese Farsi , 374 featural syllabaries FF (U+000C form feed) , 841 file separator (U+001C) Finnish Finno-Ugric Transcription (FUT) see Uralic Phonetic Alphabet (UPA) fixed-width Unicode encoding form (UTF-32)... 35, 124 flat tables Flemish fleurons fonts and Unicode characters for mathematical alphabets style variation for symbols form feed (U+000C) (FF) , 841 format control characters , 68, 267, deprecated prefixed , 334 stateful fraction characters fraction slash (U+2044) , 801 French Frisian FTP site, Unicode Consortium fullwidth forms in East Asian encodings futhark G Garshuni Ge ez General Category (normative property) list of values general punctuation General Scripts Area geometrical symbols Georgian German geta mark (U+3013) Glagolitic reference materials Glossary glyph selection tables glyphs , 15 characters, relationship to diacritics alternative , 330 Greek alternative Latin alternative mathematical alternative missing representative in code charts standardized variants symbols alternative golden numbers Gothic reference materials Grantha reference materials grapheme base definition grapheme clusters , see also UAX #29, Unicode Text Segmentation default definition grapheme extender definition grapheme joiner, combining (U+034F) graphic characters Greek acrophonic numerals , 311 alternative glyphs ancient musical notation editorial marks letters as symbols , 808 see also Cypriot, Linear B Greek editorial marks reference materials Greenlandic group separator (U+001D) guillemets Gujarati Gurmukhi H Hakka halant see also virama half marks, combining , 338 half-consonants, Indic halfwidth forms in East Asian encodings Han ideographs see CJK ideographs Han unification and language tags history language usage source separation rule , 690 source standards hand symbols Hangul Area

10 Index 995 Hangul syllables , and combining marks as grapheme clusters canonical decomposition collation composition conjoining jamo equivalent sequences Hangul Compatibility Jamo Hangul Jamo Hangul Syllables block Johab set name generation normalization standard Hangzhou numerals Hanja see CJK ideographs Hanunóo Hanzi see CJK ideographs harakat hasant hash tables Hatran reference materials Hebrew hentaigana hieroglyphs Anatolian Egyptian Meroitic high surrogate definition high-surrogate code points , 862 high-surrogate code units higher-level protocols definition Hindi Hiragana horizontal tab (U+0009) HTML newline function Hungarian hyphenation as a text process hyphens , 844 I I Ching symbols IANA charset names Icelandic identifiers see also UAX #31, Unicode Identifier and Pattern Syntax Ideographic (informative property) ideographic description sequences Ideographic Rapporteur Group (IRG) ideographs see also CJK ideographs IICore , 928 ill-formed definition Imperial Aramaic reference materials implementation guidelines in a Unicode encoding form definition in-band mechanisms India Official scripts Indian rupee signs, usage Indic scripts principles, in terms of Devanagari relation to ISCII standard Indonesia and Oceania scripts of Indonesian industry character sets covered in Unicode information separators (U+001C..U+001F) informative properties definition Inscriptional Pahlavi Inscriptional Parthian inside-out rule interchange restrictions International Phonetic Alphabet (IPA) 260, reference materials Spacing Modifier Letters see also phonetic alphabets internationalization Internationalization & Unicode Conference Internet protocols UTF-8 as preferred encoding Inuktitut invisible operators iota subscript IPA see International Phonetic Alphabet IRG (Ideographic Rapporteur Group) Irish , 360 ISCII standard and Unicode ISO/IEC conformance of Unicode implementations..918 encoding forms synchrony with Unicode Standard timeline compared to Unicode versions Italian ITC Zapf Dingbats IUC see Internationalization & Unicode Conference

11 Index 996 J jamos see Hangul syllables Japanese Javanese reference materials Jawi jihvamuliya , 590 Johab joiners combining grapheme joiner (U+034F) word joiner (U+2060) zero width joiner (U+200D) , 846 justification K Kaithi reference materials Kana (Hiragana and Katakana) Kanbun KangXi radicals , Kanji see CJK ideographs Kannada Kashmiri Katakana Kawi , 667 Kayah Li reference materials KC (normalization form) see Normalization Form KC KD (normalization form) see Normalization Form KD keytop labels Khamti Shan Kharoshthi reference materials Khmer characters not recommended syllable components, order of Khojki reference materials Khudawadi reference materials killer Batak Brahmi Meetei Mayek Myanmar (asat) see also virama Konkani Korean Hangul see Hangul Kurdish L Ladino language tags , and Han unification use strongly discouraged , 873 Lanna Lao last-resort glyphs Latin alternative glyphs Basic Latin encoding blocks IPA Extensions Latin Extended Additional Latin Extended-A Latin Extended-B Latin Extended-C Latin Extended-D Latin Extended-E Latin Ligatures Latin-1 Supplement Phonetic Extensions Latvian , 305 cedilla layout control characters , leading surrogates see high-surrogate code units legibility criterion for plain text Lepcha reference materials letter spacing letterlike symbols LF (U+000A line feed) , 841 ligatures Arabic combining characters on control characters for for nonspacing marks Latin selection Syriac Limbu reference materials line breaking , control characters in South Asian scripts , 627, 641 recommendations see also UAX #14, Unicode Line Breaking Algorithm line feed (U+000A) (LF) , 841 line separator (U+2028) (LS) , 845 line tabulation (U+000B) (VT)

12 Index 997 Linear A reference materials Linear B reference materials see also Cypriot linear boundaries Lisu reference materials Lithuanian little-endian definition logical order as Unicode design principle exceptions to logograph logosyllabaries low surrogate definition low-surrogate code points , 862 low-surrogate code units lowercase , 238, 291 LS (U+2028 line separator) , 845 Lycian reference materials Lydian reference materials M MacOS newline function Mahajani reference materials Mahjong Tiles mail discussion list for Unicode Maithili major version Malay Malay, Patani Malayalam Suriyani , 502 Maltese Manchu Mandaic reference materials Mandarin Manden Manichaean reference materials map symbols mapping tables see tables of character data Marathi , 456, 463 Marchen reference materials markup languages and Unicode conformance line breaking Masaram Gondi reference materials Mathematical (informative property) mathematical expression format characters see also UTR #25, Unicode Support for Mathematics mathematical symbols alphabets alphanumeric fonts format characters fragments for typesetting invisible operators operators reference materials standardized variants MathML matras , 449 Meetei Mayek reference materials Mende Kikakui reference materials Meroitic cursive hieroglyphs reference materials Miao reference materials Middle Eastern scripts ancient Min Minnan (Hokkien/Fujian, incl. Taiwanese) minor version minus sign commercial (U+2052) mirrored property see Bidi Mirrored (normative property) mirroring of paired punctuation Miscellaneous Symbols missing glyphs Modi reference materials modifier letters Modifier Letters, Spacing Mongolian , 568 writing direction Mro reference materials , 965 Multani reference materials