Is it possible to import csv files with many rows?

Question

question

Yokota T asked Jan 10, '23 Jason Lightfoot edited Jan 10, '23

Is it possible to import csv files with many rows?

Hello all,

I'm trying to import a csv file with about 700,000 rows into a table. I've tried to use importtable(), but FlexSim is not responding, probably because there are too many rows.

Is there another way to import the csv file ?

Software Version:

FlexSim 22.0.11

csv files

· 1

Joerg Vogel commented · Jan 10, 2023 at 10:21 AM

Please think about a different approach:

setup a database and read only values of interest
split file into smaller parts and read them after one another
filter relevant data externally and provide an optimized version to import

0 ·

Answer 1 · 2023-01-10T13:45:18Z

Jason Lightfoot answered Jan 10, '23 Jason Lightfoot edited Jan 10, '23

Try setting your table to use bundle data (and adding an index if you will be querying it with filters) - if it's a one time process then just wait until it's done and save your model. If it's a regular process then consider putting the data into a database and have FlexSim import from that for speed - either performing the full import or partial imports on demand.

Also consider if you need all the 'raw' data or if you can store processed/summary data in a more condensed format.

question