1,931 questions
When my data is more than 10000 rows, the speed becomes very very slow.
Use Virtual DGV :
10000 rows is nothing for a database (I used Virtual (ListView) and could display millions of rows very fast)
How to filter a table on multiple columns without slowing down? For DataTable
Mansour_Dalir
2,036
Reputation points
When my data is more than 10000 rows, the speed becomes very very slow.
What class should be used to filter the table. Thankful
Show me some links to solve this problem. Thanks again
Tags: vs2019- vb.net- DataGridView
Developer technologies Windows Forms
Developer technologies VB
2,892 questions
{count} votes
-
Viorel 122.5K Reputation points2023-05-14T19:04:39.1166667+00:00 What filter are you using? Maybe you can use some dictionaries.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 87%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EME%3C/text%3E%3C/svg%3E)
Michell Easmus 0 Reputation points2023-05-16T18:19:19.0266667+00:00 Filtering a table on multiple columns can be resource-intensive, but there are a few strategies you can employ to optimize performance and prevent slowdowns when working with DataTables. Here are some suggestions:
Use server-side processing: Server-side processing involves performing the filtering and pagination operations on the server instead of the client-side. This approach reduces the amount of data transferred to the client and can significantly improve performance. DataTables provides options for server-side processing, and you can configure it to send filter criteria to your server, where the filtering is performed using server-side resources.
Implement indexing: If your DataTable is working with a large dataset, consider adding indexes to the columns that you frequently use for filtering. Indexing can speed up the filtering process by allowing the database or data source to quickly locate matching rows based on the indexed columns.
Optimize your queries: When performing filtering operations, ensure that your database queries or data retrieval operations are properly optimized. This includes using appropriate indexes, optimizing your query logic, and minimizing unnecessary data retrieval. Efficient queries can significantly improve performance.
Limit the initial dataset: If you're working with a large dataset, consider loading only a portion of the data initially, such as the visible rows or a small subset of the entire dataset. Then, as the user filters the table, you can fetch additional data dynamically from the server and update the DataTable accordingly. This approach reduces the initial load time and allows for smoother filtering.
Utilize debouncing or throttling: Implement techniques such as debouncing or throttling to control the frequency of filter operations triggered by user input. Debouncing adds a delay before performing the filter operation, while throttling limits the rate at which the filter operation is executed. These techniques can prevent excessive and unnecessary filtering calls and help optimize performance.
Employ efficient client-side filtering algorithms: If you need to perform filtering on the client-side, consider using efficient filtering algorithms. For example, you can implement algorithms like binary search or hash-based filtering to quickly identify matching rows based on multiple columns.
Consider using pagination: If it's applicable to your use case, consider implementing pagination to display the data in smaller chunks instead of loading the entire dataset at once. Pagination reduces the amount of data rendered and can help maintain optimal performance during filtering operations.
By combining these strategies, you can optimize the performance of filtering operations on multiple columns in DataTables and prevent slowdowns, even with large datasets. However, the effectiveness of these optimizations can vary depending on your specific implementation, dataset size, and data source. It's recommended to measure and test the performance impact of each strategy to identify the most suitable approach for your use case.
-
Mansour_Dalir 2,036 Reputation points
2023-05-20T03:18:55.9066667+00:00 Hello, according to your words, I changed the filtering technique. Imagine I have a table with 30 columns and 10,000 rows. I created a unique column named ID. According to the user's choice, the filtering operation is performed only on the ID column. Now this filter is added layer by layer from other columns, but I don't know how to make an algorithm that will be successful. I need a good algorithm to perform the operation correctly. Algorithm operations, when should the layer be made, when, and, and
Sign in to comment
1 answer
Sort by: Most helpful
-
Castorix31 90,521 Reputation points2023-05-17T01:46:36.1166667+00:00 -
Mansour_Dalir 2,036 Reputation points
2023-05-18T10:18:32.3633333+00:00 Hello, I did not succeed. I do not know what to do. Whatever I do, the speed is slow.
I use another way. I don't know if it will work or not
-
Castorix31 90,521 Reputation points
2023-05-18T11:27:21.05+00:00 If you use a Cache like in the second MSDN sample, it cannot be slow, as it only displays rows from the cache (it is like displaying 30 rows for example)
-
Mansour_Dalir 2,036 Reputation points
2023-05-18T19:49:44.2566667+00:00 Can you show me an example of what you said? I have a datatable with 10000 rows. What is the best way to filter some columns. with high speed.
Sign in to comment -