The Unicode Standard. Version 3.0. The Unicode Consortium ADDISON-WESLEY. An Imprint of Addison Wesley Longman, Inc.

Transcription

1 The Unicode Standard Version 3.0 The Unicode Consortium ADDISON-WESLEY An Imprint of Addison Wesley Longman, Inc. Reading, Massachusetts Harlow, England Menlo Park, California Berkeley, California Don Mills, Ontario Sydney Bonn Amsterdam Tokyo Mexico City

2 Acknowledgments iii Unicode Consortium Menibers and Directors viii Füll Members viii Current Associate Members viii Current Liaison Menibers Current Specialist Members Current Individual Members Current Members of the Board of Directors Former Members of the Board of Directors Contents xi Figures x Tables xxi Preface xxv 0.1 About the Unicode Standard xxv Concepts, Architecture, Conformance, and Guidelines xxv Character Block Descriptions xxvi Charts and Index xxvi Appendices and Tables xxvii The Unicode Character Database and Technical Reports xxvii On the CD-ROM xxvii 0.2 Notational Conventions xxviii Extended BNF xxviii Operators xx 0.3 Resources xxx Unicode Web Site xxx Unicode Anonymous FTP Site xxx Unicode Public Mailing List xxx How to Contact the Unicode Consortium xxx Introduction Coverage 2 Standards Coverage 3 New Characters Design Basis Text Handling 4 Interpreting Characters 5 Text Elements The Unicode Standard and ISO/IEC The Unicode Consortium 6 The Unicode Technical Committee 6 General Structure Architectural Context 9 Basic Text Processes 9 Text Elements, Code Values, and Text Processes 10 xi

3 Text Processes and Encoding 1 ] 2.2 Unicode Design Principles 12 Steen-Bit Character Codes 12 Efficiency 13 Characters, Not Glyphs 13 Semantics 15 Piain Text 15 Logical Order 16 Unification 17 Dynamic Composition 18 Equivalent Sequence 18 Convertibility Encoding Forms 19 UTF UTF-8 20 Character Encoding Schemes Unicode Allocation 21 Allocation Areas 21 Codespace Assignment for Graphic Characters 23 Nongraphic Characters, Reserved and Unassigned Codes Writing Direction Combining Characters 24 Sequence of Base Characters and Diacritics 25 Multiple Combining Characters 25 Multiple Base Characters 27 Spacing Clones of European Diacritical Marks Special Character and Noncharacter Values 28 Byte Order Mark (BOM) 28 Special Noncharacter Values 28 Separators 29 Layout and Format Control Characters 29 The Replacement Character Controls and Control Sequences 29 Control Characters 29 Representing Control Sequences Conforming to the Unicode Standard 30 Characters Not Used in a Subset Referencing Versions of the Unicode Standard 32 3 Conformance Conformance Requirements 37 Byte Ordering 37 Invalid Code Values 3g Interpretation 38 Modification 39 Transformations 39 Bidirectional Text 39 Unicode Technical Reports Semantics Characters and Coded Representations Simple Properties Combination 43 " TheUn kode Standard 3.0

4 3.6 Decomposition 44 CompatibiHty Decomposition 44 Canonical Decomposition Surrogates Transformations Special Character Properties Canonical Ordering Behavior 50 Combining Classes 51 Canonical Ordering 51 Use with Collation Conjoining Jarno Behavior 52 Syllable Boundaries 53 Standard Syllables 53 Hangul Syllable Composition 54 Hangul Syllable Decomposition 55 Hangul Syllable Names Bidirectional Behavior 55 Directional Formatting Codes 56 Basic Display Algorithm 57 Definitions 58 Resolving Embedding Levels 61 Reordering Resolved Levels 65 Bidirectional Conformance 67 Implementation Notes 68 4 Character Properties Case Normative Combining Classes Normative Directionality Normative Jamo Short Names Normative General Category Normative in Part Numeric Value Normative Mirrored Normative Unicode 1.0 Names Mathematical Property Letters and Other Useful Properties Implementation Guidelines Transcoding to Other Standards 105 Issues 105 Multistage Tables Bit or 8-Bit Transmission 107 Mapping Table Resources ANSI/ISO C wchar_t Unknown and Missing Characters 108 Unassigned and Private Use Character Codes 108 Interpretable but Unrenderable Characters 108 Reassigned Characters Handimg Surrogate Pairs Handling Numbers HO 5.6 Handling Properties 111 Xln

5 xiv 5.7 Normalization 5.8 Compression Line Handling Regulär Expressions H Language Information in Piain Text! U Requirements for Language Tagging Working with Language Tags..'. U4 Language Tags and Han Unification Editing and Selection! 15 Consistent Text Elements U Strategies for Handling Nonspacing Marks! J? Keyboard Input Truncation J Rendering Nonspacing Marks U9 Positioning Methods Locating Text Element Boundaries \f A Boundary Specification Example Specifications.'.'.'.'.'.'.'.' 124 Grapheme Boundaries 126 Word Boundaries 126 Line Boundaries 127 Sentence Boundaries '' " _' 129 Random Access ^ Identifiers Syntactic Rule SortingandSearching 134 Culturally Expected Sorüng.'' 135 Unicode Character Equivalence..." 135 Similar Characters 136 Levels of Comparison.'."'.' 136 Ignorable Characters ' 137 Multiple Mappings.'..'.'.'. 13S Collating Out-of-Scope Characters..'.' 138 Unmapped Characters 139 Parameterization 139 Optimizations 140 Searching! Sublinear Searching..." Case Mappings I41 Punctuation 6.1 General Punctuation 147 Punctuation: U+0020-U+OOBF.'.'.' 148 General Punctuation: U+200O-U+206F.'.'.' 148 CJK Symbols and Punctuation: U+3000-U+303F 149 CJK Compatibility Forms: U+FE30-U+FE4F. 155 I56 Small Form Variants: U+FE50-U+FE6F 156 European Alphabetic Scripts Latin "_" Letters of Basic Latin: U+0041-U+007A Letters of the Latin-1 Supplement: U+OOCO-uVoOFF J5? Latin Extended-A: U+01CKMJ+017F

6 Latin Extended-B: U+0180-U+024F 163 IPA Extensions: U+0250-U+02AF 164 Latin Extended Additional: U+1E00-U+1EFF 165 Latin Ligatures: FB00-FBO Greek 167 Greek: U+037O-U+03FF 167 Greek Extended: U+1F0O-U+1FFF Cyrillic 171 Cyrillic: U+0400-U+04FF Armenian 172 Armenian: U+0530-U+058F Georgian 173 Georgian: U+10A(MJ+10FF Runic 174 Runic: U+16A0-U+16FO Ogham 176 Ogham: U+1680-U+169F Modifier Letters 177 Spacing Modifier Letters: U+02BO-U+02FF Combining Marks 179 Combining Diacritical Marks: U+0300-U+036F 179 Combining Marks for Symbols: U+20D0-U+20FF 180 Combining Half Marks: U+FE20-U+FE2F Middle Eastern Scripts Hebrew 186 Hebrew: U+0590-U+05FF 186 Alphabetic Presentation Forms: U+FB1D-U+FB4F Arabic 189 Arabic: U+0600-U+06FF 189 Cursive Joining 192 Ligatures 194 Arabic Presentation Forms-A: U+FB50-U+FDFF 197 Arabic Presentation Forms-B: U+FE70-U+FEFF Syriac 199 Syriac: U+0700-U+074F 199 Syriac Shaping 203 Syriac Cursive Joining 203 Ligatures Thaana 206 Thaana: U+0780-U+07BF South and Southeast Asian Scripts Devanagari 211 Devanagari: U+0900-U+097F Bengali 224 Bengali: U+0980-U+09FF Gurmukhi 225 Gurmukhi: U+OA0O-U+0A7F Gujarati 226 Gujarati: U+0A80-U+0AFF Oriya 227 Oriya: U+0B00-U+0B7F 227 xv

7 9.6 Tamil 228 Tamil: U+0B80-U+0BFF ' Telugu 233 Telugu: U+0COO-U+0C7F Kannada 234 Kannada: U+0C80-U+0CFF Malayalam 235 Malayalam: U+ODO0-U+OD7F Sinhala 236 Sinhala: U+0D80-U+0DFF Thai '.'.'.'.'.'''.'.'.'.'.'.'.'''.'.'.217 Thai: U+OEOO-U+0E7F Lao 239 Lao: U+0E80-U+0EFF Tibetan 240 Tibetan: U+0F00-U+0FBF!!'.' Myanmar 249 Myanmar: U+1000-U+109F Khmer "'' \ \\\' " '' \\' " 251 Khmer: U+1780-U+17FF East Asian Scripts Han 258 CJK Unified Ideographs 258 CJK Compatibility Ideographs: U+F900-U+FAFF 267 Kanbun: U+3190-U+319F " 267 CJK and KangXi Radicals: U+2E8Ö-U+2FD5 267 Ideographie Description: (J+2FF0-U+2FFB Hiragana 272 Hiragana: U+3040-U+309F Katakana 273 Katakana: U+30A0-U+30FF 273 Halfwidth and Fullwidth Forms: U+FFOO-U+FFEF Hangul 275 HangulJamo:U+1100-U+llFF 275 Hangul Compatibility Jarno: U+3130-U+318F 275 Hangul Syllables: U+AC00-U+D7A Bopomofo 27g Bopomofo: U+3100-U+312F io -6 Yi.'";;;;::.".".".":.'.":::.':".';28o Yi: U+AO0O-U+A4CF Additional Scripts Ethiopic 284 Ethiopic: U+1200-U+137F Cherokee 287 Cherokee: U+13A0-U+13FF ^ Canadian Aboriginal Syllabics 288 Canadian Aboriginal Syllabics: U+1400-U+167F Mongolian 289 Mongolian: U+180O-U+18AF Symbols 295 xvi

8 12.1 Currency Symbols 297 Currency Symbols: U+20A0-U+20CF Letterlike Symbols 298 Letterlike Symbols: U+2100-U+214F Number Forms 299 Number Forms: U+2150-U+218F 299 Superscripts and Subscripts: U+2070-U+209F Mathematical Operators 300 Mathematical Operators: U+2200-U+22FF 300 Arrows: U+2190-U+21FF Technical Symbols 302 Control Pictures: U+2400-U+243F 302 Miscellaneous Technical: U+2300-U+23FF 302 Optical Character Recognition: U+2440-U+245F Geometrical Symbols 304 Box Drawing: U+2500-U+257F 304 Block Elements: U+2580-U+259F 304 Geometrie Shapes: U+25A0^U+25FF Miscellaneous Symbols and Dingbats 305 Miscellaneous Symbols: U+2600-U+26FF 305 Dingbats: U+2700-U+27BF Enclosed and Square 307 Enclosed Alphanumerics: U+2460-U+24FF 307 Enclosed CJK Letters and Months: U+3200-U+32FF 307 CJK Compatibility: U+3300-U+33FF Braille 308 Braille: U+2800-U+28FF Special Areas and Format Characters Control Codes 314 CO Control Codes: U+0000-U+001F 314 Cl Control Codes: U+0080-U+009F Layout Controls 315 Layout Controls Deprecated Format Characters 320 Deprecated Format Characters: U+206A-U+206F Surrogates Area 322 Surrogates Area: U+D800-U+DFFF Private Use Area 323 Private Use Area: U+EO0O^U+F8FF Specials 324 Specials: U+FEFF, U+FFF0-U+FFFF, Code Charts Character Names List 331 Images in the Code Charts and Character Lists 332 Cross References 333 Case Form Mappings 333 Decompositions 333 Information About Languages 334 Reserved Characters CJK Unified Ideographs 335 xvii

9 14.3 Hangul Syllables Han Indices Han Radical-Stroke Index Shift-JIS Index 923 A Han Unification History 96i B Submitting New Characters 963 B.l Proposal Guidelines 963 B.2 Requirements of Proposal Form and Process 964 Interim Solutions 965 Sending Proposals, 965 C Relationship to ISO/IEC C.1 History 967 Unicode Unicode Unicode C.2 Encoding Forms in ISO/IEC Zero Extending 970 C.3 UCS Transformation Formats 970 UTF UTF C.4 Synchronization of the Standards 971 C.5 Identification of Features for the Unicode Standard 971 C.6 Character Names 972 C.7 Character Functional Specifications 972 D Changes from Unicode Version D.l Versions of the Unicode Standard 973 D.2 Changes from Unicode Version 2.0 to Version New Characters Added 974 Character Semantics Changes 974 Changes Affecting Conformance 974 D.3 Changes from Unicode Version 2.1 to Version New Characters Added 975 Character Semantics Changes 978 Changes Affecting Conformance 979 Unicode Technical Reports 980 G Glossary 983 R References 999 R.l Source Standards 999 R.2 Source Dictionaries for Han Unification 1002 R.3 Other Sources for the Unicode Standard 1003 R.4 Selected Resources 1003 I Indices 1011 LI Unicode Names Index 1011 L2 General Index 1037 xvm