Algorithm in Experimenter

Hello Guys, I'm currently trying to implement functionality similar to the algorithm in Experimenter, and I have two questions.

Since in Experimenter, the number of replications for each scenario is user-defined and fixed, is it possible to allocate the number of replications based on the performance results? For example, if the performance results for the first stage of scenarios are ranked as 1>3>5>4>2, can I allocate replications accordingly, such as running 5 replications for scenario 1, 4 replications for scenario 3, and so on in a loop? Is this method currently achievable?
If not ,can Experimenter interact with external Python scripts or the other way to implement, because I have seen other related comments on the forum, and it seems that OptQuset is not supported.?

Thanks for your help and advise

Software Version:

FlexSim 23.0.0

· 4

5 |100000

Attachments: Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.

Joerg Vogel commented · Oct 28, 2023 at 06:44 AM

There is significant error in your approach. Executing of experiments is not linear. It is more a chaotic execution of scenarios and replications. You can run an experiment (all scenarios and replications), then you can evaluate the results and change parameters.

Knowing this I would run experiments with small variants more often to distinguish whether the change of parameter values brings better results.

0 ·

Willie Chung Joerg Vogel commented · Oct 28, 2023 at 01:02 PM

I apologize for the error in my previous description. The performance results for the first stage of scenarios are ranked as 1>3>5>4>2. What I want to do is to replicate the best scenario(1) 5 times, the second best scenario (3) 4 times, and not replicate scenario (2) 4 times, which might cause a misunderstanding.

So, it's not about distributing replication counts linearly but based on the performance ranking of the previous stage.

0 ·

Willie Chung Joerg Vogel commented · Oct 28, 2023 at 01:12 PM

But I understand what you mean. It seems that my approach cannot be directly implemented in Experimenter. I will try other methods and thank you for your advice.

0 ·

Jason Lightfoot ♦♦ commented · Nov 03, 2023 at 11:09 AM

Hi @Willie Chung,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

0 ·

question