Large Data Set Handling

Question

question

Joe Hugan asked May 14 2017 at 8:35 PM Joe Hugan commented Jul 11 2017 at 9:25 PM

Large Data Set Handling

I have a large global table - 660000 rows and 22 columns that I have using bundled data. Trying to update this table with new data (it is an order file) is very time consuming and some times Flexsim will hang when trying to paste in a new data set. What is the preferred method for handling data sets of this size?

Software Version:

FlexSim 17.1.2

global tables

· 2

______

Cookie preferences

Your privacy is important to us and so is an optimal experience. To help us customize information and build applications, we collect data about your use of this site.

May we collect and use your data?

Learn more about the Third Party Services we use and our Privacy Statement.

Strictly necessary – required for our site to work and to provide services to you

These cookies allow us to record your preferences or login information, respond to your requests or fulfill items in your shopping cart.

YES

Improve your experience – allows us to show you what is relevant to you

These cookies enable us to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we use to deliver information and experiences tailored to you. If you do not allow these cookies, some or all of these services may not be available for you.

YES

NO

Customize your advertising – permits us to offer targeted advertising to you

These cookies collect data about you based on your activities and interests in order to show you relevant ads and to track effectiveness. By collecting this data, the ads you see will be more tailored to your interests. If you do not allow these cookies, you will experience less targeted advertising.

YES

NO

Are you sure you want a less customized experience?

We can access your data only if you select "yes" for the categories on the previous screen. This lets us tailor our marketing so that it's more relevant for you. You can change your settings at any time by visiting our privacy statement

Your experience. Your choice.

We care about your privacy. The data we collect helps us understand how you use our products, what information you might be interested in, and what we can improve to make your engagement with Autodesk more rewarding.

May we collect and use your data to tailor your experience?

Explore the benefits of a customized experience by managing your privacy settings for this site or visit our Privacy Statement to learn more about your options.

Answer 1 · 2017-05-15T14:37:48Z

Matt Long answered May 15 2017 at 2:37 PM Joe Hugan commented Jul 11 2017 at 9:25 PM

Looks like when we did an overhaul to our tabling system code was changed such that it's creating an undo record for each cell that is pasted (as opposed to a single undo record for the entire paste operation). I'll add this to the dev list so we can get it fixed.

· 3

Joe Hugan commented · May 15 2017 at 3:21 PM

Does that mean if I delete the table and recreate it, it should work faster? I need to get a solution for how to update this table until issue is corrected by dev.

0 ·

Matt Long Joe Hugan commented · May 15 2017 at 3:33 PM

No, the issue is in the table interface. Have you tried using the Excel Import with the Data Distinction set to Values Only (very fast)? I imported 600,000 rows and 22 columns in under 20 seconds. In fact it took longer for Excel to open (about 14 seconds) than it did to do the actual import (3 or 4 seconds).

1 ·

Joe Hugan commented · May 15 2017 at 3:44 PM

That worked great! Thanks!

0 ·

question