Experimenter replications

Question

question

Sebastien asked Nov 6, '20 Ben Wilson commented Nov 11, '20

Experimenter replications

Hi,

In our model we used random numbers and distributions. When using the experimenter we obtain a wide range of results between replications, from very bad to very good.

Does the experimenter only change the random number and distributions during a replication or does it do something more ?

We could not find any relevant information on the subject in the manual.

Best regards,

Software Version:

FlexSim 20.1.2

experimenter flexsim 20.1.2 replications

· 1

Ben Wilson ♦♦ commented · Nov 11, 2020 at 04:22 PM

Hi @Sebastian, was jason.lightfoot's or Ralf Gruber's answer helpful? If so, please click the red "Accept" button on one of their answers. Or if you still have questions, add a comment and we'll continue the conversation.

If we haven't heard back from you within 3 business days we'll auto-accept an answer, but you can always unaccept and comment back to reopen your question.

0 ·

Answer 1 · 2020-11-06T14:10:10Z

Jason Lightfoot answered Nov 6, '20 Jason Lightfoot edited Nov 6, '20

I'm sure you've looked at this tutorial which explains scenarios and replications of an experiment. Basically replications should only change random number stream start seed while scenarios can change variables defined in the experimenter. (Note the format of this will change in 21.0 to model parameters - a Toolbox table)

If you think a replication has a strange result then you can run that interactively by going to the experimenter advanced tab and setting the value of "Repeat Streams of Replication" and see what's going on.

You can change the scenario in the experimenter's scenario tab using the dropdown for "Choose default reset scenario:"

Or in 21.0 beta by selecting the scenario column and pressing "Set model to selected scenario":

1604671642146.png (4.3 KiB)

1604671699796.png (15.0 KiB)

1604671774165.png (11.3 KiB)

1604671874732.png (15.0 KiB)

1604671886000.png (11.3 KiB)

1604671903164.png (4.3 KiB)

Answer 2 · 2020-11-06T14:06:40Z

Ralf Gruber answered Nov 6, '20

Hello Sebastian,

the Experimenter does only change the random numbers, not the distributions itself. They remain the same with the same parameters for every replication.

Can you post the model, if you do not want it public do it in a private post, please. Otherwise it is tough to guess, what causes the wide spread of replication results...

Best wishes

question