question

baraam avatar image
0 Likes"
baraam asked baraam commented

save current simulation status to custom parameter

Hello,

I'm trying to create RL agent and I need to send a lot of information to it via custom parameter.

It's about a job shop scheduling optimization so I have multiple jobs (objects) each of them have multiple operations (processors).
I think I need a Map since the information that I need to send will look like that :
obs[TokenId?] = [current step id, next destination, time to finish the current step, time to finish the whole job ,... ]

I thought about tokenId but not sure if this is a unique identifier for each job/token.

I can have x simultaneous jobs/tokens so I need to send all these information to my RL ( maybe I'll have another question about custom observation space later on)

so the idea is that my RL agent should know all about current processing, left time for each processor , occupied processors , .... )
I need your help to figure out how to do that :) hoping that my question is clear enough!

Regards!

FlexSim 23.0.3
reinforcement learningobservation spacecustom parameter
· 3
5 |100000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.

Kavika F avatar image Kavika F ♦ commented ·
Hey @BaraaM, do you have a model you have that you could post that demonstrates the basic processes you're trying to model? It would help us a lot if you gave us some concrete information to work with such as a input material rates, how many different processes there are and what they entail, are there operators involved, if so how many, etc. Thanks!
0 Likes 0 ·
baraam avatar image baraam Kavika F ♦ commented ·

Hey @Kavika F thank you very much for your answer, I saw the notification for your comment yesterday. For the moment I used "attrs.uniqueid.value" to get the id and I was able to get the information from my jobs using custom user commands. I'm still having some problems about communicating all of that with my RL model but I think I'll put another question about this problem.

Thanks!

0 Likes 0 ·
Jeanette F avatar image Jeanette F ♦♦ commented ·

Hi @baraam,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

0 Likes 0 ·

0 Answers