topic Algorithm in Experimenter in FlexSim Forum

Algorithm in Experimenter

willie1 — Sat, 28 Oct 2023 03:39:02 GMT

[ FlexSim 23.0.0 ]

Hello Guys, I'm currently trying to implement functionality similar to the algorithm in Experimenter, and I have two questions.

Since in Experimenter, the number of replications for each scenario is user-defined and fixed, is it possible to allocate the number of replications based on the performance results? For example, if the performance results for the first stage of scenarios are ranked as 1>3>5>4>2, can I allocate replications accordingly, such as running 5 replications for scenario 1, 4 replications for scenario 3, and so on in a loop? Is this method currently achievable?
If not ,can Experimenter interact with external Python scripts or the other way to implement, because I have seen other related comments on the forum, and it seems that OptQuset is not supported.?

Thanks for your help and advise

Re: Algorithm in Experimenter

joerg_vogel_HsH — Sat, 28 Oct 2023 06:44:45 GMT

There is significant error in your approach. Executing of experiments is not linear. It is more a chaotic execution of scenarios and replications. You can run an experiment (all scenarios and replications), then you can evaluate the results and change parameters.

Knowing this I would run experiments with small variants more often to distinguish whether the change of parameter values brings better results.

Re: Algorithm in Experimenter

willie1 — Sat, 28 Oct 2023 13:02:12 GMT

I apologize for the error in my previous description. The performance results for the first stage of scenarios are ranked as 1>3>5>4>2. What I want to do is to replicate the best scenario(1) 5 times, the second best scenario (3) 4 times, and not replicate scenario (2) 4 times, which might cause a misunderstanding.

So, it's not about distributing replication counts linearly but based on the performance ranking of the previous stage.

Re: Algorithm in Experimenter

willie1 — Sat, 28 Oct 2023 13:12:35 GMT

But I understand what you mean. It seems that my approach cannot be directly implemented in Experimenter. I will try other methods and thank you for your advice.

Re: Algorithm in Experimenter

jason_lightfoot_adsk — Fri, 03 Nov 2023 11:09:53 GMT

Hi @Willie Chung,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.