how to read txt file which has char or unicode ?

Question

mc 5,511

I can not use std::fstream right?

If I set locale I can not read normal char If I do not set it I can not read unicode bytes.

RLWA32 49,636 Reputation points

2024-10-25T14:17:21.0366667+00:00

The character encoding doesn't matter if you read the file as a binary file. Windows has the IsTextUnicode function to help you determine the encoding of the data you read from a file. Additonally, you can check the buffer into which you read the data to see if it contains a BOM.
mc 5,511 Reputation points

2024-10-26T01:50:56.2266667+00:00

but what if both unicode or not char?
RLWA32 49,636 Reputation points

2024-10-26T10:51:23.86+00:00
Maybe I wasn't clear about what I meant. You can test some data from the file to determine if it is or is not unicode.

For example,

if(FileIsUnicode()) { // code for a unicode text file } else { // code for other than unicode }

You would write the FileIsUnicode function that can call the Windows API IsTextUnicode function as well as check the test data for the presence of BOMs.

Your answer

RLWA32 49,636 Reputation points

2024-10-25T14:17:21.0366667+00:00

The character encoding doesn't matter if you read the file as a binary file. Windows has the IsTextUnicode function to help you determine the encoding of the data you read from a file. Additonally, you can check the buffer into which you read the data to see if it contains a BOM.
mc 5,511 Reputation points

2024-10-26T01:50:56.2266667+00:00

but what if both unicode or not char?
RLWA32 49,636 Reputation points

2024-10-26T10:51:23.86+00:00

Maybe I wasn't clear about what I meant. You can test some data from the file to determine if it is or is not unicode.

For example,

if(FileIsUnicode()) { // code for a unicode text file } else { // code for other than unicode }

You would write the FileIsUnicode function that can call the Windows API IsTextUnicode function as well as check the test data for the presence of BOMs.