The problem with model repetition

Question

question

mark zhen asked Dec 05 2022 at 7:35 AM Kavika F commented Jan 04 2023 at 5:56 PM

The problem with model repetition

I don't understand why the time of my model running repeatedly is not the same. It should not have any randomness.rltest-2-1.fsm

Software Version:

FlexSim 22.0.0

time

rltest-2-1.fsm (287.4 KiB)

· 9

Felix Möhlmann commented · Dec 05 2022 at 8:17 AM

I'm not sure what you mean. When I run your model it always takes 25582s to complete.

Have you checked that "Repeat Random Streams" is active?

0 ·

1670228216629.png (4.5 KiB)

mark zhen Felix Möhlmann commented · Dec 16 2022 at 5:13 AM

This is what my connection proxy looks like.

but when i disconnect the proxy my model becomes like this

I can't understand what's going wrong

0 ·

Jeanette F ♦♦ commented · Dec 08 2022 at 6:20 PM

Hi @mark zhen ,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

0 ·

mark zhen Jeanette F ♦♦ commented · Dec 10 2022 at 7:48 AM

But when I cut off the proxy, the time will be different

0 ·

Felix Möhlmann mark zhen commented · Dec 10 2022 at 9:00 AM

When you run the model without querying for new values for the actions parameters they will stay the same and the result will naturally differ from the run with changed parameters.

0 ·

Show more comments

Kavika F ♦ commented · Jan 04 2023 at 5:56 PM

Hi @mark zhen , was Felix Möhlmann's answer helpful? If so, please click the "Accept" button at the bottom of their answer. Or if you still have questions, add a comment and we'll continue the conversation.

If we haven't heard back from you within 3 business days we'll auto-accept an answer, but you can always unaccept and comment back to reopen your question.

0 ·

______

Cookie preferences

Your privacy is important to us and so is an optimal experience. To help us customize information and build applications, we collect data about your use of this site.

May we collect and use your data?

Learn more about the Third Party Services we use and our Privacy Statement.

Strictly necessary – required for our site to work and to provide services to you

These cookies allow us to record your preferences or login information, respond to your requests or fulfill items in your shopping cart.

YES

Improve your experience – allows us to show you what is relevant to you

These cookies enable us to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we use to deliver information and experiences tailored to you. If you do not allow these cookies, some or all of these services may not be available for you.

YES

NO

Customize your advertising – permits us to offer targeted advertising to you

These cookies collect data about you based on your activities and interests in order to show you relevant ads and to track effectiveness. By collecting this data, the ads you see will be more tailored to your interests. If you do not allow these cookies, you will experience less targeted advertising.

YES

NO

Are you sure you want a less customized experience?

We can access your data only if you select "yes" for the categories on the previous screen. This lets us tailor our marketing so that it's more relevant for you. You can change your settings at any time by visiting our privacy statement

Your experience. Your choice.

We care about your privacy. The data we collect helps us understand how you use our products, what information you might be interested in, and what we can improve to make your engagement with Autodesk more rewarding.

May we collect and use your data to tailor your experience?

Explore the benefits of a customized experience by managing your privacy settings for this site or visit our Privacy Statement to learn more about your options.

Answer 1 · 2022-12-10T09:42:13Z

Felix Möhlmann answered Dec 10 2022 at 9:42 AM mark zhen commented Dec 17 2022 at 2:24 PM

After you disconnect the RL agent, the action parameters will still be set to whatever the agent set them to last.

This will likely differ from what they were set to previously and thus lead to another run time. I used the experimenter to run all possible action combinations. The resulting times are listed below. They might differ slighty from your numbers, because the experimenter might use a different random number stream to assign the type labels than what your model is currently using.

rltest-allCombos.fsm

1670665222354.png (11.5 KiB)

rltest-allcombos.fsm (389.8 KiB)

· 13

mark zhen commented · Dec 10 2022 at 9:48 AM

so how do i get him back to 28518

0 ·

Felix Möhlmann mark zhen commented · Dec 10 2022 at 10:10 AM

You'd have to manually change the parameters back to what they were before. Maybe you still have a save from before you ran the RL algorithm and can look up what values you had entered there?

0 ·

mark zhen Felix Möhlmann commented · Dec 10 2022 at 1:17 PM

I used the experimenter to run all possible action combinations.

how do i use this

0 ·

Show more comments

mark zhen commented · Dec 17 2022 at 2:24 PM

I want to ask what action will be taken for my model if I am [1,1,1].

0 ·

question