Hi
I am trying to simulate model with AI using reinforcement learning. I am following your tutorial of flexsim 2022 (https://docs.flexsim.com/en/22.1/ModelLogic/ReinforcementLearning/Training/Training.html) . But I am facing issue in python It cant able to fetch observation data. It did not update further value.
please help me to solve this problem
Hi @Damini C, was Phil BoBo's answer helpful? If so, please click the "Accept" button at the bottom of their answer. Or if you still have questions, add a comment and we'll continue the conversation.
If we haven't heard back from you within 3 business days we'll auto-accept an answer, but you can always unaccept and comment back to reopen your question.
Please post your ChangeovertimesRL.fsm file. We cannot tell what is wrong from just a screenshot of the python output.
Without more information, my best guess for what is wrong is that (1) you skipped step 2.16 where you check the Pull box, (2) you skipped step 3.26 where you configure a decision event, or (3) you have a stop time that is causing your model to not run. But we can't tell you for sure what is wrong without seeing the model.
If the model doesn't get to a decision event to send another observation and request another action, then the python script will be stuck waiting for that to happen.
thank you Phil bobo for giving some time to answer.
sorry i didn't give proper information
ChangeoverTimesRL.fsm this is fsm file which i am using for reinforcement learning. . 
the above picture when flexsim_env python script run and simulation module start running
I check flexsim module again at step 2.16 and 3.26 possibility of where i can skip step. i did this step . But i didn't understand about stop Time which you said where should i check this stop
Actually my laptop run slowly. is that reason python script will stuck to get observation message?
please help me to solve this problem
In the reward function, you mistyped 'sink1' instead of 'Sink1' (which is causing the error message you are seeing in the system console).
As FlexSim can't calculate/fetch the reward value, this likely means nothing is returned to the python script.
17 People are following this question.
FlexSim can help you understand and improve any system or process. Transform your existing data into accurate predictions.
FlexSim is a fully 3D simulation software environment. FlexSim can be used to simulate any process in any industry.
FlexSim®, FlexSim Healthcare™, Problem Solved.®, the FlexSim logo, the FlexSim X-mark, and the FlexSim Healthcare logo with stylized Caduceus mark are trademarks of FlexSim Software Products, Inc. All rights reserved.
