计算机编码与转化1.docVIP

计算机编码和转化1 计算机编码和转化12011-03-10 10：38这是一个高手写的 UTF-8和UTF-16之间的转换函数 Excel 2003导出的XML表格会出现乱码，这是由于其编码采用了UTF8，而其文件开头却没有BOM(Byte Order Mark)EF BB BF，造成文本编辑程序将它误认为Ansi文本文件造成的。要想看清楚内容，可以用UltraEdit打开，在开头加入那个BOM即可。 下面是我提供的进行UTF-16和UTF-8之间的转换的4个函数： //UTF8_16.h typedef unsigned char byte； typedef unsigned int uint； //cbUtf8Text--byte count of utf8Text //ccUtf16Text--character count of utf16Text void UTF8toUTF16(/*in*/const byte*utf8Text,/*in*/uint cbUtf8Text,/*out*/wchar_t*utf16Text,/*in,out*/uintccUtf16Text)； uint UTF8toUTF16CharCount(/*in*/const byte*utf8Text,/*in*/uint cbUtf8Text)；//return ccUtf16Text void UTF16toUTF8(/*in*/const wchar_t*utf16Text,/*in*/uint ccUtf16Text,/*out*/byte*utf8Text,/*in,out*/uintcbUtf8Text)； uint UTF16toUTF8ByteCount(/*in*/const wchar_t*utf16Text,/*in*/uint ccUtf16Text)；//return cbUtf8Text //UTF8_16.cpp #includestdafx.h #includeUTF8_16.h #include crtdbg.h #ifndef TRUE #define TRUE 1 #endif //The table below summarizes the format of these different octet types. //The letter xindicates bits available for encoding bits of the //character number. // //Char.number range|UTF-8 octet sequence //(hexadecimal)|(binary) //--+--- //0000 0000-0000 007F|0xxxxxxx //0000 0080-0000 07FF|110xxxxx 10xxxxxx //0000 0800-0000 FFFF|1110xxxx 10xxxxxx 10xxxxxx //0001 0000-0010 FFFF|11110xxx 10xxxxxx 10xxxxxx 10xxxxxx // //Encoding acharacter to UTF-8 proceeds as follows： // //1.Determine the number of octets required from the character number //and the first column of the table above.It is important to note //that the rows of the table are mutually exclusive,i.e.,there is //only one valid way to encode agiven character. // //2.Prepare the high-order bits of the octets as per the second //column of the table. // //3.Fill in the bits marked xf rom the bits of the character number, //expressed in binary.Start by putting the lowest-order bit of //the character number in the lowest-order position of the last //octet of the sequence,then put the next higher-order bit of the //char