5,380 questions
Efficient way to read large csv file in c#
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 91%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERN%3C/text%3E%3C/svg%3E)
RAgib Noor
16
Reputation points
In xamarin ios application When i am trying to read a large csv file applications crash. the code works fine for smaller csv file .
What will be the most efficient way to read csv file and store into datatable
Developer technologies .NET Xamarin
{count} votes
-
Sam of Simple Samples 5,546 Reputation points2021-07-29T20:30:54.41+00:00 Are you sure this is a Xamarin question? It is probably a C# question.
Regardless, you will need to be more specific than crash. What is the error code and/or error message? If you can post the relevant code then that will help.
-
RAgib Noor 16 Reputation points
2021-07-30T06:41:38.44+00:00 DataTable dataTable = new DataTable();
using (var csv = new DelimitedRecordReader(new StreamReader(filePath, Encoding.UTF8),20))
{
csv.ReadColumnHeaders();
dataTable .Load(csv); // application crash here . app close automatically
}II am using https://github.com/slorion/nlight this library to read the csv file. The above code works fine for large csv file in .net application on mac/windows but in ios device its not working for large csv (I guess its due to limited resources of mobile device) .
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 3%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWZ%3C/text%3E%3C/svg%3E)
Wenyan Zhang (Shanghai Wicresoft Co,.Ltd.) 36,436 Reputation points Microsoft External Staff2021-07-30T08:50:24.833+00:00 There is a link about reading csv file, it got a list finally. You could store the list into database by using SQLite. I am afraid your app crash is not caused by the large size of file. The SQLite .NET library that Xamarin recommends is a basic ORM that lets you store and retrieve objects in the local SQLite database on an iOS device
In addition, may I ask what the size of your file is? Would you mind sharing crash logs? -
RAgib Noor 16 Reputation points
2021-07-30T09:23:19.2+00:00 csv file size is around 230Mb and there is 1500000 rows in it .
could you please enlighten me how can i get the crash log for the application -
Wenyan Zhang (Shanghai Wicresoft Co,.Ltd.) 36,436 Reputation points Microsoft External Staff
2021-08-04T07:28:03.637+00:00 Do you install the app in your own iPhone? Or install the app in Simulator? You can get the logs by the following steps if you install the app in your own iPhone.
- Connect the device with XCode
- Open XCode, click "Window", select"Devices and Simulators"
- Click "View Device Logs"
If you use the Simulator, you can get the logs from output view, you can also make a break point to check.
-
RAgib Noor 16 Reputation points
2021-08-04T12:21:33.467+00:00 120478-xamarinappios-8-4-21-5-55-pm.txt
sharing the crash log here
can you help me to find out what causes the application crash -
Wenyan Zhang (Shanghai Wicresoft Co,.Ltd.) 36,436 Reputation points Microsoft External Staff
2021-08-05T09:04:36.163+00:00 The log shows that the main thread is blocked. You can have a try to use sqlite to store data in iOS. The max size of SQLite database is limited by free disk space on the user‘s device.
Sign in to comment
Sign in to answer