Reinforcement learning

Question

question

Damini C asked May 23 2022 at 7:42 AM Damini C commented May 31 2022 at 6:47 AM

Reinforcement learning

Hi

I am trying to simulate model with AI using reinforcement learning. I am following your tutorial of flexsim 2022 (https://docs.flexsim.com/en/22.1/ModelLogic/ReinforcementLearning/Training/Training.html) . But I am facing issue in python It cant able to fetch observation data. It did not update further value.

please help me to solve this problem

Software Version:

FlexSim 22.1.1

reinforcement learning python

whatsapp-image-2022-05-23-at-10950-pm.jpeg (95.4 KiB)

· 1

______

Cookie preferences

Your privacy is important to us and so is an optimal experience. To help us customize information and build applications, we collect data about your use of this site.

May we collect and use your data?

Learn more about the Third Party Services we use and our Privacy Statement.

Strictly necessary – required for our site to work and to provide services to you

These cookies allow us to record your preferences or login information, respond to your requests or fulfill items in your shopping cart.

YES

Improve your experience – allows us to show you what is relevant to you

These cookies enable us to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we use to deliver information and experiences tailored to you. If you do not allow these cookies, some or all of these services may not be available for you.

YES

NO

Customize your advertising – permits us to offer targeted advertising to you

These cookies collect data about you based on your activities and interests in order to show you relevant ads and to track effectiveness. By collecting this data, the ads you see will be more tailored to your interests. If you do not allow these cookies, you will experience less targeted advertising.

YES

NO

Are you sure you want a less customized experience?

We can access your data only if you select "yes" for the categories on the previous screen. This lets us tailor our marketing so that it's more relevant for you. You can change your settings at any time by visiting our privacy statement

Your experience. Your choice.

We care about your privacy. The data we collect helps us understand how you use our products, what information you might be interested in, and what we can improve to make your engagement with Autodesk more rewarding.

May we collect and use your data to tailor your experience?

Explore the benefits of a customized experience by managing your privacy settings for this site or visit our Privacy Statement to learn more about your options.

Answer 1 · 2022-05-24T14:24:07Z

Phil BoBo answered May 24 2022 at 2:24 PM Damini C commented May 31 2022 at 6:47 AM

Please post your ChangeovertimesRL.fsm file. We cannot tell what is wrong from just a screenshot of the python output.

Without more information, my best guess for what is wrong is that (1) you skipped step 2.16 where you check the Pull box, (2) you skipped step 3.26 where you configure a decision event, or (3) you have a stop time that is causing your model to not run. But we can't tell you for sure what is wrong without seeing the model.

If the model doesn't get to a decision event to send another observation and request another action, then the python script will be stuck waiting for that to happen.

· 3

Damini C commented · May 25 2022 at 6:37 AM

thank you Phil bobo for giving some time to answer.

sorry i didn't give proper information

ChangeoverTimesRL.fsm this is fsm file which i am using for reinforcement learning. .

the above picture when flexsim_env python script run and simulation module start running

I check flexsim module again at step 2.16 and 3.26 possibility of where i can skip step. i did this step . But i didn't understand about stop Time which you said where should i check this stop

Actually my laptop run slowly. is that reason python script will stuck to get observation message?

please help me to solve this problem

0 ·

chaingeovertimesrl.png (296.2 KiB)

Felix Möhlmann Damini C commented · May 25 2022 at 9:45 AM

In the reward function, you mistyped 'sink1' instead of 'Sink1' (which is causing the error message you are seeing in the system console).

As FlexSim can't calculate/fetch the reward value, this likely means nothing is returned to the python script.

2 ·

1653471833189.png (18.7 KiB)

Damini C Felix Möhlmann commented · May 31 2022 at 6:47 AM

thank you felix Mohlmann!!!

It solved the issue

0 ·

question