Large Data Set Handling

[joe_hugan1]

[ FlexSim 17.1.2 ]

I have a large global table - 660000 rows and 22 columns that I have using bundled data. Trying to update this table with new data (it is an order file) is very time consuming and some times Flexsim will hang when trying to paste in a new data set. What is the preferred method for handling data sets of this size?

[matt_long]

Are you doing a copy paste or an excel import?

[joe_hugan1]

Matt,

The excel import too way too long. I ended up killing the process. I was able to get a paste to work when I started the project but updating it does not work with the paste. Keeps hanging.

[matt_long · Accepted solution]

Looks like when we did an overhaul to our tabling system code was changed such that it's creating an undo record for each cell that is pasted (as opposed to a single undo record for the entire paste operation). I'll add this to the dev list so we can get it fixed.

[joe_hugan1]

Does that mean if I delete the table and recreate it, it should work faster? I need to get a solution for how to update this table until issue is corrected by dev.

[matt_long]

No, the issue is in the table interface. Have you tried using the Excel Import with the Data Distinction set to Values Only (very fast)? I imported 600,000 rows and 22 columns in under 20 seconds. In fact it took longer for Excel to open (about 14 seconds) than it did to do the actual import (3 or 4 seconds).

[joe_hugan1]

That worked great! Thanks!