question

mark zhen avatar image
0 Likes"
mark zhen asked Kavika F commented

The problem with model repetition

I don't understand why the time of my model running repeatedly is not the same. It should not have any randomness.rltest-2-1.fsm

FlexSim 22.0.0
time
rltest-2-1.fsm (287.4 KiB)
· 9
5 |100000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.

Felix Möhlmann avatar image Felix Möhlmann commented ·

I'm not sure what you mean. When I run your model it always takes 25582s to complete.

Have you checked that "Repeat Random Streams" is active?

1670228216629.png

0 Likes 0 ·
1670228216629.png (4.5 KiB)
mark zhen avatar image mark zhen Felix Möhlmann commented ·

This is what my connection proxy looks like.
1670312937670.png

but when i disconnect the proxy my model becomes like this

1670313012422.png

I can't understand what's going wrong

0 Likes 0 ·
Jeanette F avatar image Jeanette F ♦♦ commented ·

Hi @mark zhen ,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

0 Likes 0 ·
mark zhen avatar image mark zhen Jeanette F ♦♦ commented ·

But when I cut off the proxy, the time will be different

0 Likes 0 ·
Felix Möhlmann avatar image Felix Möhlmann mark zhen commented ·
When you run the model without querying for new values for the actions parameters they will stay the same and the result will naturally differ from the run with changed parameters.
0 Likes 0 ·
Show more comments
Kavika F avatar image Kavika F ♦ commented ·

Hi @mark zhen , was Felix Möhlmann's answer helpful? If so, please click the "Accept" button at the bottom of their answer. Or if you still have questions, add a comment and we'll continue the conversation.

If we haven't heard back from you within 3 business days we'll auto-accept an answer, but you can always unaccept and comment back to reopen your question.

0 Likes 0 ·

1 Answer

Felix Möhlmann avatar image
0 Likes"
Felix Möhlmann answered mark zhen commented

After you disconnect the RL agent, the action parameters will still be set to whatever the agent set them to last.

This will likely differ from what they were set to previously and thus lead to another run time. I used the experimenter to run all possible action combinations. The resulting times are listed below. They might differ slighty from your numbers, because the experimenter might use a different random number stream to assign the type labels than what your model is currently using.

1670665222354.png

rltest-allCombos.fsm


1670665222354.png (11.5 KiB)
rltest-allcombos.fsm (389.8 KiB)
· 13
5 |100000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.

mark zhen avatar image mark zhen commented ·

so how do i get him back to 28518

0 Likes 0 ·
Felix Möhlmann avatar image Felix Möhlmann mark zhen commented ·
You'd have to manually change the parameters back to what they were before. Maybe you still have a save from before you ran the RL algorithm and can look up what values you had entered there?
0 Likes 0 ·
mark zhen avatar image mark zhen Felix Möhlmann commented ·

I used the experimenter to run all possible action combinations.

how do i use this

0 Likes 0 ·
Show more comments
mark zhen avatar image mark zhen commented ·

I want to ask what action will be taken for my model if I am [1,1,1].

0 Likes 0 ·