question

katerina-fratczak avatar image
0 Likes"
katerina-fratczak asked katerina-fratczak commented

Sequence in reinforcement learning

Hello,

in Parameters Table is the possibility to choose a sequence. But in RL Tools - Observation/ Action Space it is not possible to choose such a parameter. How can I link the sequence into there please?1727860458793.png

FlexSim 23.0.15
reinforcement learning
1727860458793.png (54.3 KiB)
· 4
5 |100000

Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.

Sam Stubbs avatar image Sam Stubbs ♦ commented ·

Hey Katerina, that's a good question. Unfortunately when it comes to scheduling and sequencing in the RL environment we don't really have an answer for that. You MIGHT be able to use a multidiscrete option there, but I just can't confirm that it will give you what you're looking for.


I'll point you to this forum post earlier about it. You might find better success reaching out to other Reinforcement Learning forums how to approach this, where they might have more experience on this.


https://answers.flexsim.com/questions/137714/examples-of-reinforcement-learning-with-scheduling.html

0 Likes 0 ·
katerina-fratczak avatar image katerina-fratczak Sam Stubbs ♦ commented ·

Hello, thank you for the answer, but the Parameters with a Sequence are not shown by any of the options (Box, Discrete, Multidiscrete...) in RL Tools. The link did not help also unfortunately. Thank you, Katerina

1732784304241.png

0 Likes 0 ·
1732784304241.png (45.1 KiB)
Felix Möhlmann avatar image Felix Möhlmann commented ·

If the sequence is not very long (~10 elements or fewer), you could try to use a number parameter which is then used to construct the sequence. The linked answer contains an example algorithm for this.

Though I do no know how well the RL algorithm is going to work with this.

https://answers.flexsim.com/questions/168270/how-to-create-parameters-for-this-schedule.html

0 Likes 0 ·
Logan Gold avatar image Logan Gold ♦♦ commented ·

Hi @katerina-fratczak,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

0 Likes 0 ·

0 Answers