Reinforcement Learning tutorial training Problem

Question

question

Enoch asked Dec 20, '23 Enoch commented Dec 20, '23

Reinforcement Learning tutorial training Problem

I followed the reinforcement learning tutorial. i don't understand why is there an error and how to solve this. I'm using python3.10.4.

Software Version:

FlexSim 24.0.0

reinforcement learning python

2023-12-20.png (71.4 KiB)

Answer 1 · 2023-12-20T08:09:07Z

Guldberg answered Dec 20, '23 Enoch commented Dec 20, '23

The Gym API changed and requires more parameters now. I think that was the issue when I ran it. The python have to be updated to account for this. If you are not super into python, dump the code and the error message into chatGPT and it will help you resolve it.

At some point Flexsim should probably update the tutorial code.

· 6

Enoch commented · Dec 20, 2023 at 09:01 AM

do you mean i need to update python3.10.4, or i need to fix the code?

0 ·

Guldberg Enoch commented · Dec 20, 2023 at 09:05 AM

Fix the code. Its the Gym lib that is causing the issue, not the python version.

You can try with the attached version. Just remember to change the paths (as stated in the tutorial)

flexsimRL.zip

0 ·

flexsimrl.zip (143.2 KiB)

Enoch Guldberg commented · Dec 20, 2023 at 09:54 AM

i add a variable called truncated to avoid the error below. Is it ok if i fix like this? the code works fine but I'm concerned.

0 ·

2023-12-20-174611.png (87.0 KiB)

Show more comments

Answer 2 · 2023-12-20T10:05:18Z

Guldberg answered Dec 20, '23

That should be fixed in the code I sent. Anyway chatGPT is your friend here, it will tell you what to change based on any error codes you give it. This is more related to python programming than Flexsim.

question