Exporting and Importing csv with object and Array Columns.

Question

question

Jouky D asked Jul 08 2024 at 3:17 PM Felix Möhlmann commented Jul 09 2024 at 7:41 AM

Exporting and Importing csv with object and Array Columns.

Hello everyone,

I tried to export to a csv file a table with different column types: strings, integers, doubles, OBJECTS, ARRAYS of arrays, etc. All the columns are exported fine except the objects and the arrays of arrays.

I want to re-import that table into FlexSim again to avoid calculate the table again after the reset. But the values are imported as string, e.g.

array: Array[8]: {Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}, Array[2]: {1.000000, 4.000000}}

Is there a way to export and import correctly? If not, maybe I could save the table on a specific moment to reset the table on that values?

Thank you:)

Software Version:

FlexSim 23.2.1

excel import tables array

· 8

Jouky D commented · Jul 08 2024 at 3:18 PM

And no, I cannot do the table in a separate script because I want to create it during the simulation and depending on some characteristics of the simulation.

0 ·

Joerg Vogel Jouky D commented · Jul 08 2024 at 3:47 PM

Let me assume that there are some restrictions in csv file data: strings and numbers. Maybe you can create a string that looks like an array of arrays, that an input interpreter can resolve into an array of arrays.

My fault: There seems to be a more sophistic problem with excel data in a structure of arrays in arrays. Perhaps you think about a different export variant like saving a treenode structure in xml data to your disk.

0 ·

Jouky D Joerg Vogel commented · Jul 09 2024 at 6:00 AM

It's interesting what you propose about exporting the node in xml. Do you know a way to export it and import it using FlexScript? I know there are cmdsavetree and cmdloadtree functions. However, when I export and import using those codes it builds the following treenode:

However, when I import using right click of the mouse (Save Node As and Load Into Node) it builds an Object node:

0 ·

1720506933549.png (731 B)

1720507031202.png (3.1 KiB)

Show more comments

Jeanette F ♦♦ commented · Jul 08 2024 at 3:40 PM

Hi @Jouky D,

Thank you for contributing to our community! We couldn't identify a maintained license or subscription linked to your account.

You may need to update your profile information to identify yourself as a license owner or their associate. Check out our article for how to ensure you receive timely support. If you update your profile comment back to let us know - we'll adjust the priority of your post accordingly.

If your current license is expired, please contact your local distributor to renew.

0 ·

Felix Möhlmann commented · Jul 09 2024 at 6:22 AM

Can you give some more information about what you want to do with the data? Will it be imported into a different model or the same one? Because if it's the same one you could just clone it to a separate table (global table or even some custom node in the model tree if it should not be visible in the toolbox).

https://docs.flexsim.com/en/24.0/Reference/CodingInFlexSim/FlexScriptAPIReference/Data/Table.html#Method-cloneTo

0 ·

Jouky D Felix Möhlmann commented · Jul 09 2024 at 6:53 AM

Hello Felix!

It is the same model. I want to not build the same table every time I run the simulation because it takes 5 min to build it. This table has 800.000 cells including arrays of arrays, so for model speed and not collapse RAM, I guess is better to export and import the node or the table instead of having a 800.000 useless values during the simulations. What do you think?

Maybe I am wrong, but I thing the better way is to export and import treenode or resetting the table values at the time I need to save that table. But we cannot put "Reset Values" on a table, we need another table as you propose. I am trying to do cmdload and cmdsave treenodes it seems it works.

0 ·

______

Cookie preferences

Your privacy is important to us and so is an optimal experience. To help us customize information and build applications, we collect data about your use of this site.

May we collect and use your data?

Learn more about the Third Party Services we use and our Privacy Statement.

Strictly necessary – required for our site to work and to provide services to you

These cookies allow us to record your preferences or login information, respond to your requests or fulfill items in your shopping cart.

YES

Improve your experience – allows us to show you what is relevant to you

These cookies enable us to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we use to deliver information and experiences tailored to you. If you do not allow these cookies, some or all of these services may not be available for you.

YES

NO

Customize your advertising – permits us to offer targeted advertising to you

These cookies collect data about you based on your activities and interests in order to show you relevant ads and to track effectiveness. By collecting this data, the ads you see will be more tailored to your interests. If you do not allow these cookies, you will experience less targeted advertising.

YES

NO

Are you sure you want a less customized experience?

We can access your data only if you select "yes" for the categories on the previous screen. This lets us tailor our marketing so that it's more relevant for you. You can change your settings at any time by visiting our privacy statement

Your experience. Your choice.

We care about your privacy. The data we collect helps us understand how you use our products, what information you might be interested in, and what we can improve to make your engagement with Autodesk more rewarding.

May we collect and use your data to tailor your experience?

Explore the benefits of a customized experience by managing your privacy settings for this site or visit our Privacy Statement to learn more about your options.

Answer 1 · 2024-07-09T07:14:30Z

Jouky D answered Jul 09 2024 at 7:14 AM Felix Möhlmann commented Jul 09 2024 at 7:41 AM

@Felix Möhlmann and @Joerg Vogel solved it! Thank you! (I don't know why, I can't accept your responses). I used:

- Exporting the Table:

string filename = modeldir().replace("/","\\",1) + "SlotsNode.fsx";

treenode node = Table("Slots");

cmdsavetree(node, filename);

- Importing the Table:

cmdloadtree(node, filename);

It is useful if you table is large. Importing a treenode takes around 6-7 seconds. So if your time computing the table is larger than that, it is useful to apply it. If not, don't waste your time or try another way.

· 3

Felix Möhlmann commented · Jul 09 2024 at 7:23 AM

Our posts up to this point have been comments under the question, not answers, since we were only discussing possibilities or asking for clarification. "Answers" should present a complete solution. So it would be good if you edit yours to include the steps you took to solve the issue so other users can learn from it. Then accept your own answer.

Regarding your latest comment. I tested restoring a table with 800.000 cells (about 2MB of data, yours is probably larger) using both approaches, saving and loading with a separate file and creating a copy directly in the model. Speed wise I didn't notice much of a difference. The downside to having a duplicate table in the model is that the file size would be larger and saving/loading the model will take a bit longer.

0 ·

Jouky D Felix Möhlmann commented · Jul 09 2024 at 7:36 AM

Done!

However, I use Table("Slots") and it may cause the problem of taking the data node and not all the node, I don't know how to export it correctly. It works to me now, because I use the old node, but maybe someone wants to import it into a new node.

Thank you! (I still cannot accept my own answer I don't know why)

0 ·

Felix Möhlmann Jouky D commented · Jul 09 2024 at 7:41 AM

Hm, weird that you can't accept the answer. Hi @Jeanette F, could you please accept Jouky's answer?

0 ·

question