Reinforcement learning python observation expected

Question

question

Keter asked Jul 04 2024 at 8:55 AM Keter commented Jul 05 2024 at 10:16 AM

Reinforcement learning python observation expected

Hello,

I encountered some problems while initiating flexsim_training.py. I read the article that has similar problem. I know the issue is about the version of package and python. I already changed my python version to 3.7.8, stable-baselines3 to 2.0.0, and gymnasium to 0.28.0. However, I still get the same error. Hope I can get some advice, thanks!

The observation returned.PNG

Software Version:

FlexSim 23.1.4

reinforcement learning python stable-baselines3 gym

the-observation-returned.png (37.8 KiB)

piplist.png (31.9 KiB)

flexsim-env.py (7.5 KiB)

flexsim-training.py (1.6 KiB)

rl-first.fsm (28.8 KiB)

______

Cookie preferences

Your privacy is important to us and so is an optimal experience. To help us customize information and build applications, we collect data about your use of this site.

May we collect and use your data?

Learn more about the Third Party Services we use and our Privacy Statement.

Strictly necessary – required for our site to work and to provide services to you

These cookies allow us to record your preferences or login information, respond to your requests or fulfill items in your shopping cart.

YES

Improve your experience – allows us to show you what is relevant to you

These cookies enable us to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we use to deliver information and experiences tailored to you. If you do not allow these cookies, some or all of these services may not be available for you.

YES

NO

Customize your advertising – permits us to offer targeted advertising to you

These cookies collect data about you based on your activities and interests in order to show you relevant ads and to track effectiveness. By collecting this data, the ads you see will be more tailored to your interests. If you do not allow these cookies, you will experience less targeted advertising.

YES

NO

Are you sure you want a less customized experience?

We can access your data only if you select "yes" for the categories on the previous screen. This lets us tailor our marketing so that it's more relevant for you. You can change your settings at any time by visiting our privacy statement

Your experience. Your choice.

We care about your privacy. The data we collect helps us understand how you use our products, what information you might be interested in, and what we can improve to make your engagement with Autodesk more rewarding.

May we collect and use your data to tailor your experience?

Explore the benefits of a customized experience by managing your privacy settings for this site or visit our Privacy Statement to learn more about your options.

Answer 1 · 2024-07-05T05:55:05Z

Felix Möhlmann answered Jul 05 2024 at 5:55 AM Keter commented Jul 05 2024 at 10:16 AM

Did the presented solution of specifying the dtype not work?

See also these two more recent posts:
https://answers.flexsim.com/questions/167193/reinforcement-learning-error-by-more-decision-even.html

https://answers.flexsim.com/questions/167263/reinforcement-learning-problem-by-test-runs.html

· 7

Keter commented · Jul 05 2024 at 6:56 AM

Hi Mr. Möhlmann,

Can you provide your package version list to me? Cause I'm using gymnasium instead of gym.

0 ·

Felix Möhlmann Keter commented · Jul 05 2024 at 7:15 AM

I can but it won't help much. I haven't really worked with the RL since that post and still have the old "gym" package.

pip-list.png

The user in the other two posts I linked does use gymnasium though and got it work by setting the dtype. So that's why I asked if you had tried this.

0 ·

pip-list.png (34.9 KiB)

Keter Felix Möhlmann commented · Jul 05 2024 at 8:09 AM

Yes, I tried set the dtype in the env.pydtype.PNG

0 ·

dtype.png (166.4 KiB)

Show more comments

question