Character encoding
lastmod 2022-12-08created 2019-01-212 edits
Character encoding, or simply encoding, refers to a method of encoding a set of characters or symbols for storage on a computer or for use in communication. A code that is produced through character encoding and that, when decoded, stands for the original character or symbol is called a character code. Typical examples of character encoding include Morse code, which represents the Latin alphabet by pressing a telegraph key for long or short durations, and ASCII, a method of representing the Latin alphabet, digits, special characters, and so on as integers and their corresponding 7-bit binary numbers.
In the early days of computing, character sets such as ASCII (1963) and EBCDIC (1964) became established as standards. The limitations of these character sets were obvious, and numerous ad hoc methods were developed. Support for multiple scripts (languages), including East Asian CJK scripts, was urgently needed.
Libraries
Table of Character encodings
| Early telecommunications | ASCII, ISO/IEC 646, ISO/IEC 6937, T.61, BCD (6-bit), Baudot code, Morse code, Chinese telegraph code |
| ISO/IEC 8859 | -1, -2, -3, -4, -5, -6, -7, -8, -9, -10, -11, -12, -13, -14, -15, -16 |
| Bibliographic use | ANSEL, ISO 5426 / 5426-2 / 5427 / 5428 / 6438 / 6861 / 6862 / 10585 / 10586 / 10754 / 11822, MARC-8 |
| National standards | ArmSCII, CNS 11643, GOST 10859, GB 2312, HKSCS, ISCII, JIS X 0201, JIS X 0208, JIS X 0212, JIS X 0213, KPS 9566, KS X 1001, PASCII, TIS-620, TSCII, VISCII, YUSCII |
| EUC | CN, JP, KR, TW |
| ISO/IEC 2022 | CN, JP, KR, CCCII |
| MacOS codepages ("scripts") | Arabic, CentralEurRoman, ChineseSimp / EUC-CN, ChineseTrad / Big5, Croatian, Cyrillic, Devanagari, Dingbats, Farsi, Greek, Gujarati, Gurmukhi, Hebrew, Icelandic, Japanese / ShiftJIS, Korean / EUC-KR, Roman, Romanian, Symbol, Thai / TIS-620, Turkish, Ukrainian |
| DOS codepages | 437, 720, 737, 775, 850, 852, 855, 857, 858, 860, 861, 862, 863, 864, 865, 866, 869, Kamenicky, Mazovia, MIK, Iran System |
| Windows codepages | 874 / TIS-620, 932 / Shift JIS, 936 / GBK, 949/ EUC-KR, 950 / Big5, 1250, 1251, 1252 (ANSI), 1253, 1254, 1255, 1256, 1257, 1258, 54936 / GB18030 |
| EBCDIC codepages | 37/1140, 273/1141, 277/1142, 278/1143, 280/1144, 284/1145, 285/1146, 297/1147, 420/16804, 424/12712, 500/1148, 838/1160, 871/1149, 875/9067, 930/1390, 933/1364, 937/1371, 935/1388, 939/1399, 1025/1154, 1026/1155, 1047/924, 1112/1156, 1122/1157, 1123/1158, 1130/1164, JEF, KEIS |
| Platform specific | ATASCII, CDC display code, DEC-MCS, DEC Radix-50, Fieldata, GSM 03.38, HP roman8, PETSCII, TI calculator character sets, WISCII, ZX Spectrum character set |
| Unicode / ISO/IEC 10646 | UTF-8, UTF-16/UCS-2, UTF-32/UCS-4, UTF-7, UTF-1, UTF-EBCDIC, GB 18030, SCSU, BOCU-1 |
| Miscellaneous codepages | APL, Cork, HZ, IBM code page 1133, KOI8, TRON |
| Related topics | control character (C0 C1), CCSID, Character encodings in HTML, charset detection, Han unification, ISO 6429/IEC 6429/ANSI X3.64, mojibake |
Favorite site
- Wikipedia (en) article on character encoding
- Encodings and character sets
- Understanding Korean encoding, part 1: The history of Korean encoding and Unicode 1
- Understanding Korean encoding, part 2: Korean text processing with Unicode and Java 2