This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 64%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
The project is MFC/Unicode (Use Unicode Character Set). Here is a little code that get strings from an address:
CString sOutput;
CInternetSession session{};
char buffer[256];
CStdioFile file = session.OpenURL(address, 1, INTERNET_FLAG_TRANSFER_ASCII);
while (UINT nRead = file->Read(buffer, sizeof(buffer - 1)))
{
buffer[nRead] = '\0';
sOutput += buffer;
}
The problem is that I got non-unicode string, even if CString is UNICODE (CStringW). Example:
înțelege
which is non UNICODE. If I change char to wchar_t, I got even worst:
㼼浸敶쳌쳌쳌쳌獲潩㵮
How can adapt the code to read UNICODE?
Maybe the character encoding of the internet string is utf-8?
Are you refer to address?
I'm referring to the data on the internet. Maybe its not ASCII text?
If you look at the data that is read into the buffer variable is it ASCII text?
What does the buffer look like if you use INTERNET_FLAG_TRANSFER_BINARY?
The string from internet is something like:
înțelege
which is unicode and correct ... I hope I understood your request. And if I look in VS code, in break window:
înțelege
which is not correct. P.S. I have tried with INTERNET_FLAG_TRANSFER_BINARY too, same outcome.
When you say that the internet data is unicode do you mean that it is utf-16le or utf-8?
Try converting the buffer to unicode (UTF-16LE) using MultiByteToWideChar with CP_UTF8.
When you say that the internet data is unicode do you mean that it is utf-16le or utf-8?
utf-8
Have you tried converting the buffer with MultiByteToWideChar?
"Try converting the buffer to unicode (UTF-16LE) using MultiByteToWideChar with CP_UTF8."
You mean chunk by chunk, at this point?
sOutput += buffer;
I don't know if there is a reason to working with 255 byte chunks of data.
I would recommend obtaining a buffer containing all the internet data and converting that at one time. Since a utf-8 character can take more than 1 byte its possible that an arbitrary 255 byte chunk may not contain completely valid utf-8 encoded characters.
And how can I know whole internet data at once, to read it all? See original code.
Try using https://learn.microsoft.com/en-us/cpp/mfc/reference/cfile-class?view=msvc-170#getlength
Or maybe you can append chunks to a CStringA until the entire file is read and then convert the entire buffer encapsulated by the CStringA object.
"I mean that you convert the entire buffer to utf-16le BEFORE that statement. Once you have obtained a utf-16le encoded string you should be able to work with that and CString without problems."
Yes, I applied what you said, and it worked. Thank you.
Yes, I applied what you said, and it worked. Thank you.
You're welcome. I converted an earlier comment to an Answer that can be accepted to close the question.
You mean byte by byte, at this point?
sOutput += buffer;
I mean that you convert the entire buffer to utf-16le BEFORE that statement. Once you have obtained a utf-16le encoded string you should be able to work with that and CString without problems.