Sequence in reinforcement learning

[katerina_fratczak]

[ FlexSim 23.0.15 ]

Hello,

in Parameters Table is the possibility to choose a sequence. But in RL Tools - Observation/ Action Space it is not possible to choose such a parameter. How can I link the sequence into there please?

[sam_stubbsYXX86]

Hey Katerina, that's a good question. Unfortunately when it comes to scheduling and sequencing in the RL environment we don't really have an answer for that. You MIGHT be able to use a multidiscrete option there, but I just can't confirm that it will give you what you're looking for.

I'll point you to this forum post earlier about it. You might find better success reaching out to other Reinforcement Learning forums how to approach this, where they might have more experience on this.

https://answers.flexsim.com/questions/137714/examples-of-reinforcement-learning-with-scheduling.html

[moehlmann_fe]

If the sequence is not very long (~10 elements or fewer), you could try to use a number parameter which is then used to construct the sequence. The linked answer contains an example algorithm for this.

Though I do no know how well the RL algorithm is going to work with this.

https://answers.flexsim.com/questions/168270/how-to-create-parameters-for-this-schedule.html

[logan_gold]

Hi @katerina-fratczak,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

[katerina_fratczak]

Hello, thank you for the answer, but the Parameters with a Sequence are not shown by any of the options (Box, Discrete, Multidiscrete...) in RL Tools. The link did not help also unfortunately. Thank you, Katerina