UTF-EBCDIC

UTF-EBCDIC is a character encoding used to represent Unicode characters. It is meant to be EBCDIC-friendly, so that legacy EBCDIC applications on mainframes may process the characters without much difficulty. Its advantages for existing EBCDIC-based systems are similar to UTF-8's advantages for existing ASCII-based systems. Details on UTF-EBCDIC are defined in Unicode Technical Report #16.

To produce the UTF-EBCDIC encoded version of a series of Unicode code points, an encoding based on UTF-8 (known in the specification as UTF-8-Mod) is applied first. The main difference between this encoding and UTF-8 is that it allows Unicode code points U+0080 through U+009F (the C1 control codes) to be represented as a single byte and therefore later mapped to corresponding EBCDIC control codes. In order to achieve this, UTF-8-Mod uses 101XXXXX instead of 10XXXXXX as the format for trailing bytes in a multi-byte sequence. As this can only hold 5 bits rather than 6, the UTF-8-Mod encoding of codepoints above U+009F is generally larger than the UTF-8 encoding.

The UTF-8-Mod transformation leaves the data in an ASCII-based format (for example, U+0041 "A" is still encoded as 01000001), so each byte is fed through a reversible (one-to-one) lookup table to produce the final UTF-EBCDIC encoding. For example, 01000001 in this table maps to 11000001; thus the UTF-EBCDIC encoding of U+0041 (Unicode's "A") is 0xC1 (EBCDIC's "A").

This encoding form is rarely used, even on the EBCDIC-based mainframes for which it was designed. IBM EBCDIC-based mainframe operating systems, such as z/OS, usually use UTF-16 for complete Unicode support. For example, DB2 UDB, COBOL, PL/I, Java and the IBM XML toolkit support UTF-16 on IBM mainframes.

Codepage layout

There are 160 characters with single-byte encodings in UTF-EBCDIC (compared to 128 in UTF-8). As can be seen, the single-byte portion is similar to IBM-1047 instead of IBM-37 due to the location of the square brackets. CCSID 37 has [] at hex BA and BB instead of at hex AD and BD respectively.

UTF-EBCDIC
	_0	_1	_2	_3	_4	_5	_6	_7	_8	_9	_A	_B	_C	_D	_E	_F
0_	NUL 0000 0	SOH 0001 1	STX 0002 2	ETX 0003 3	ST 009C 4	HT 0009 5	SSA 0086 6	DEL 007F 7	EPA 0097 8	RI 008D 9	SS2 008E 10	VT 000B 11	FF 000C 12	CR 000D 13	SO 000E 14	SI 000F 15
1_	DLE 0010 16	DC1 0011 17	DC2 0012 18	DC3 0013 19	OSC 009D 20	LF 000A 21	BS 0008 22	ESA 0087 23	CAN 0018 24	EM 0019 25	PU2 0092 26	SS3 008F 27	FS 001C 28	GS 001D 29	RS 001E 30	US 001F 31
2_	PAD 0080 32	HOP 0081 33	BPH 0082 34	NBH 0083 35	IND 0084 36	NEL 0085 37	ETB 0017 38	ESC 001B 39	HTS 0088 40	HTJ 0089 41	VTS 008A 42	PLD 008B 43	PLU 008C 44	ENQ 0005 45	ACK 0006 46	BEL 0007 47
3_	DCS 0090 48	PU1 0091 49	SYN 0016 50	STS 0093 51	CCH 0094 52	MW 0095 53	SPA 0096 54	EOT 0004 55	SOS 0098 56	SGCI 0099 57	SCI 009A 58	CSI 009B 59	DC4 0014 60	NAK 0015 61	PM 009E 62	SUB 001A 63
4_	SP 0020 64	• +00 65	• +01 66	• +02 67	• +03 68	• +04 69	• +05 70	• +06 71	• +07 72	• +08 73	• +09 74	. 002E 75	< 003C 76	( 0028 77	+ 002B 78	\| 007C 79
5_	& 0026 80	• +0A 81	• +0B 82	• +0C 83	• +0D 84	• +0E 85	• +0F 86	• +10 87	• +11 88	• +12 89	! 0021 90	$ 0024 91	* 002A 92	) 0029 93	; 003B 94	^ 005E 95
6_	- 002D 96	/ 002F 97	• +13 98	• +14 99	• +15 100	• +16 101	• +17 102	• +18 103	• +19 104	• +1A 105	• +1B 106	, 002C 107	% 0025 108	_ 005F 109	> 003E 110	? 003F 111
7_	• +1C 112	• +1D 113	• +1E 114	• +1F 115	2 0000 116	2 0020 117	2 0040 118	2 0060 119	2 0080 120	` 0060 121	: 003A 122	# 0023 123	@ 0040 124	' 0027 125	= 003D 126	" 0022 127
8_	2 00A0 128	a 0061 129	b 0062 130	c 0063 131	d 0064 132	e 0065 133	f 0066 134	g 0067 135	h 0068 136	i 0069 137	2 00C0 138	2 00E0 139	2 0100 140	2 0120 141	2 0140 142	2 0160 143
9_	2 0180 144	j 006A 145	k 006B 146	l 006C 147	m 006D 148	n 006E 149	o 006F 150	p 0070 151	q 0071 152	r 0072 153	2 01A0 154	2 01C0 155	2 01E0 156	2 0200 157	2 0220 158	2 0240 159
A_	2 0260 160	~ 007E 161	s 0073 162	t 0074 163	u 0075 164	v 0076 165	w 0077 166	x 0078 167	y 0079 168	z 007A 169	2 0280 170	2 02A0 171	2 02C0 172	[ 005B 173	2 02E0 174	2 0300 175
B_	2 0320 176	2 0340 177	2 0360 178	2 0380 179	2 03A0 180	2 03C0 181	2 03E0 182	3 0000 183	3 0400 184	3 0800 185	3 0C00 186	3 1000 187	3 1400 188	] 005D 189	3 1800 190	3 1C00 191
C_	{ 007B 192	A 0041 193	B 0042 194	C 0043 195	D 0044 196	E 0045 197	F 0046 198	G 0047 199	H 0048 200	I 0049 201	3 2000 202	3 2400 203	3 2800 204	3 2C00 205	3 3000 206	3 3400 207
D_	} 007D 208	J 004A 209	K 004B 210	L 004C 211	M 004D 212	N 004E 213	O 004F 214	P 0050 215	Q 0051 216	R 0052 217	3 3800 218	3 3C00 219	4 4000 220	4 8000 221	4 10000 222	4 18000 223
E_	\ 005C 224	4 20000 225	S 0053 226	T 0054 227	U 0055 228	V 0056 229	W 0057 230	X 0058 231	Y 0059 232	Z 005A 233	4 28000 234	4 30000 235	4 38000 236	5 40000 237	5 100000 238	239
F_	0 0030 240	1 0031 241	2 0032 242	3 0033 243	4 0034 244	5 0035 245	6 0036 246	7 0037 247	8 0038 248	9 0039 249	250	251	252	253	254	APC 009F 255
	_0	_1	_2	_3	_4	_5	_6	_7	_8	_9	_A	_B	_C	_D	_E	_F

White cells containing a large single-digit number are the start bytes for a sequence of that many bytes. The unbolded hexadecimal code point number shown in the cell is the lowest character value encoded using that start byte. This value can be greater than the value which would be obtained by following the start byte with continuation bytes which are all 65 (hex 0x41), if this would result in an invalid overlong form.

Orange cells with one dot are continuation bytes. The hexadecimal number shown after a "+" plus sign is the value of the 5 bits they add.

Red cells indicate start bytes (for a sequence of that many bytes) which can never appear in properly encoded UTF-EBCDIC text, because any possible continuation would result in an invalid overlong form. For example, 0x76 is marked in red because even 0x76 0x73 (which maps to the UTF-8-Mod sequence 0xC2 0xBF) would merely be an overlong encoding of U+005F (properly encoded as UTF-8-Mod 0x5F, UTF-EBCDIC 0x6D).

External links

V.S. Umamaheswaran, Unicode Technical Report #16: the definition of UTF-EBCDIC (2002-04-16)

Unicode

Code points

Characters

Special purpose	BOM Combining Grapheme Joiner Left-to-right mark / Right-to-left mark Soft hyphen Word joiner Zero-width joiner Zero-width non-joiner Zero-width space

Lists	Characters CJK Unified Ideographs Combining character Duplicate characters Numerals Scripts Spaces Symbols Halfwidth and fullwidth

Processing

Algorithms	Bi-directional text Collation ISO 14651 Equivalence Variation sequences

Comparison	BOCU-1 CESU-8 Punycode SCSU UTF-1 UTF-7 UTF-8 UTF-9/UTF-18 UTF-16/UCS-2 UTF-32/UCS-4 UTF-EBCDIC

On pairs of
code points

Usage

Related standards

Related topics

Scripts and symbols in Unicode

Common and inherited scripts	Combining marks Diacritics Punctuation Space

Modern scripts	Adlam Arabic diacritics Armenian Balinese Bamum Batak Bengali Bopomofo Braille Buhid Burmese Canadian Aboriginal Chakma Cham Cherokee CJK Unified Ideographs (Han) Cyrillic Deseret Devanagari Ge'ez Georgian Greek Gujarati Gurmukhī Hangul Hanja Hanunó'o Hebrew diacritics Hiragana Javanese Kanji Kannada Katakana Kayah Li Khmer Khudawadi Lao Latin Lepcha Limbu Lisu (Fraser) Lontara Malayalam Mandaic Meetei Mayek Mende Kikakui Miao (Pollard) Mongolian Mro N'Ko New Tai Lue Newa Ol Chiki Oriya Osage Osmanya Pahawh Hmong Pau Cin Hau Rejang Samaritan Śāradā Saurashtra Shavian Sinhala Sorang Sompeng Sundanese Sylheti Nagari Syriac Tagalog (Baybayin) Tagbanwa Tai Le Tai Tham Tai Viet Takri Tamil Telugu Thaana Thai Tibetan Tifinagh Tirhuta Vai Varang Kshiti Yi

Ancient and historic scripts	Ahom Anatolian hieroglyphs Ancient North Arabian Avestan Bassa Vah Bhaiksuki Brāhmī Carian Caucasian Albanian Coptic Cuneiform Cypriot Egyptian hieroglyphs Elbasan Glagolitic Gothic Grantha Hatran Imperial Aramaic Inscriptional Pahlavi Inscriptional Parthian Kaithi Kharosthi Khojki Linear A Linear B Lycian Lydian Mahajani Manichaean Marchen Meroitic Modi Multani Nabataean Ogham Old Hungarian Old Italic Old Permic Old Persian cuneiform Old Turkic Palmyrene 'Phags-pa Phoenician Psalter Pahlavi Runic Siddham Tangut South Arabian Ugaritic

Notational scripts	Duployan SignWriting

Symbols	Cultural, political, and religious symbols Currency Mathematical operators and symbols Phonetic symbols (including IPA) Emoji

Character encodings

Character sets

Early telecommunications	ASCII ISO/IEC 646 ISO/IEC 6937 T.61 BCDIC Baudot code Morse code (Telegraph code Wabun code) Special telegraphy codes: Non-Latin, Chinese, Cyrillic

ISO/IEC 8859	-1 -2 -3 -4 -5 -6 -7 -8 -9 -10 -11 -12 -13 -14 -15 -16

Bibliographic use	ANSEL ISO 5426 / 5426-2 / 5427 / 5428 / 6438 / 6861 / 6862 / 10585 / 10586 / 10754 / 11822 MARC-8

National standards	ArmSCII CNS 11643 GOST 10859 GB 18030 HKSCS ISCII JIS X 0201 JIS X 0208 JIS X 0212 JIS X 0213 KOI-7 KPS 9566 KS X 1001 PASCII SI 960 TIS-620 TSCII VISCII YUSCII

EUC	CN JP KR TW

ISO/IEC 2022	CN JP KR CCCII

MacOS code pages ("scripts")	Arabic Mac OS Celtic CentEuro ChineseSimp / EUC-CN ChineseTrad / Big5 Croatian Cyrillic Devanagari Dingbats Farsi Gaelic Greek Gujarati Gurmukhi Hebrew Iceland Japanese / ShiftJIS Korean / EUC-KR Roman Romanian Symbol Thai / TIS-620 Turkish Ukrainian

DOS code pages	100 111 112 113 151 161 162 163 164 165 220 300 301 437 449 620 667 668 708 709 710 711 720 737 770 771 772 773 774 775 776 777 778 790 808 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 872 874 876 877 878 881 882 883 884 885 891 895 897 898 899 900 903 904 906 907 909 910 911 925 926 927 928 929 932 934 936 938 941 942 943 944 946 947 948 949 950/1370 951 966 991 1004 1034 1039 1040 1041 1042 1043 1044 1046 1086 1088 1090 1092 1093 1098 1108 1109 1114 1115 1116 1117 1118 1119 1125 1126 1127 1131 1139 1161 1162 1167 1168 1351 1361 1362 1363 1372 1373 1374 1375 1380 1381 1385 1386 1391 1392 1393 1394 17248 Kamenický Mazovia CWI-2 KOI8 MIK Iran System

IBM AIX code pages	367 371 806 813 819 895 896 901 902 912 913 914 915 916 919 920 921 922 923 952 953 954 955 956 957 958 959 960 961 962 963 964 965 970 971 1006 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1029 1036 1089 1111 1124 1129 1133 1163 1350 1382 1383

IBM Apple MacIntosh Emulations	1275 1280 1281 1282 1283 1284 1285 1286

IBM Adobe Emulations	1038 1276 1277

IBM DEC Emulations	1021 1023 1100 1101 1102 1103 1104 1105 1106 1107 1287 1288

IBM HP Emulations	1050 1051 1052 1053 1054 1055 1056 1057 1058

Windows code pages	874/1162 (TIS-620) 932/943 (Shift JIS) 936/1386 (GBK) 950/1370 (Big5) 949/1363 (EUC-KR) 1169 1174 1200 (UTF-16LE) 1201 (UTF-16BE) 1250 1251 1252 1253 1254 1255 1256 1257 1258 1261 1270 54936 (GB18030)

EBCDIC code pages	1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 29 30 31 32 33 34 35 36 37/1140 38 39 40 251 252 254 256 257 258 259 260 264 273/1141 274 275 276 277/1142 278/1143 279 280/1144 281 282 283 284/1145 285/1146 286 287 288 289 290 293 297/1147 298 310 320 321 322 330 351 352 353 355 357 358 359 360 361 363 382 383 384 385 386 387 388 389 390 391 392 393 394 395 410 420/16804 421 423 424/12712 425 435 500/1148 803 829 833 834 835 836 837 838/1160 839 870/1153 871/1149 875/9067 880 881 882 883 884 885 886 887 888 889 890 892 893 905 918 924 930/1390 931 933/1364 935/1388 937/1371 939/1399 1001 1002 1003 1005 1007 1024 1025/1154 1026/1155 1027 1028 1030 1031 1032 1033 1037 1047 1068 1069 1070 1071 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1087 1091 1097 1110 1112/1156 1113 1122/1157 1123/1158 1130/1164 1132 1136 1137 1150 1151 1152 1159 1165 1166 1278 1303 1364 1376 1377 JEF KEIS

Platform specific	ATASCII Atari ST BICS CDC CPC DEC Radix-50 DMCS/NRCS ELWRO-Junior FIELDATA GEM GEOS GSM 03.38 HP Roman Extension HP Roman-8 HP Roman-9 HP calculators LICS LMBCS NEC APC NeXT PETSCII TI calculators WISCII XCCS ZX80 ZX81 ZX Spectrum

Unicode / ISO/IEC 10646	UTF-1 UTF-7 UTF-8 UTF-16 (UTF-16LE/UTF-16BE) / UCS-2 UTF-32 (UTF-32LE/UTF-32BE) / UCS-4 UTF-EBCDIC GB 18030 BOCU-1 CESU-8 SCSU

Miscellaneous code pages	ABICOMP APL Cork HZ JOHAB TRON UTF-5 UTF-6 WTF-8

Related topics	Control character (C0 C1) CCSID Character encodings in HTML Charset detection Han unification Hardware ISO 6429/IEC 6429/ANSI X3.64 Mojibake

This article is issued from Wikipedia - version of the 4/10/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.

UTF-EBCDIC

Codepage layout

See also

External links