Store cyrillic text alongwith ASCII from csv into SQL

Question

Store cyrillic text alongwith ASCII from csv into SQL

PV 21

I have an issue I m trying to address where there are strings which have Cyrillic characters and when loaded from csv into SQL it gets loaded as some weird characters .
As per many posts online,I tried to deal with flat file connection manager changing code page to 650001 ,output columns changed to DT WSTR and converted the SQL metadata of all columns to nvarchar.This works well but the real trouble is the table I use is being consumed by many other views which I can’t touch and these views are performing very slowly compared to what it used to.
I changed the metadata back to varchar and checked views for performance and they were faster.So the problem is with my changing to nvarchar and it’s doing implicit conversions in all those views .Problem is I can’t change those views to help solve 1 problem.
What is the other way by which I can deal with this issue?

Erland Sommarskog 121.4K Reputation points MVP Volunteer Moderator

2021-06-19T08:57:36.327+00:00

To be able to help you, we need to get some more information.

First, which is the encoding of the CSV file? If you are unfamiliar with character encodings, you can upload a file, so we can look at it. That could also help to answer another question that I have: is it only Cyrillic and pure ASCII, or are there other Latin characters beyond ASCII in the data?

Next, we need to know the definition of you table. You talk about varchar, but which collation do you have? Script the table and post the script here.

1 answer

Your answer

Erland Sommarskog 121.4K Reputation points MVP Volunteer Moderator

2021-06-19T08:57:36.327+00:00

To be able to help you, we need to get some more information.

First, which is the encoding of the CSV file? If you are unfamiliar with character encodings, you can upload a file, so we can look at it. That could also help to answer another question that I have: is it only Cyrillic and pure ASCII, or are there other Latin characters beyond ASCII in the data?

Next, we need to know the definition of you table. You talk about varchar, but which collation do you have? Script the table and post the script here.

Answer 1

ZoeHui-MSFT 41,491

Hi

As ErlandSommarskog said, more details could help us to do more analysis.

You may share the simple data with us so that we could test locally.

Regards，

Zoe

If the answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
Hot issues October

Share via

Store cyrillic text alongwith ASCII from csv into SQL

1 answer

Your answer