Define the state of reinforcement learning

Question

question

mark zhen asked Sep 4, '23 mark zhen commented Sep 14, '23

Define the state of reinforcement learning

I think I'm almost done, the state of my model now,

I want to define it as the number of deferred order but I'm a bit confused on how to do it?

And I define my actions I take six different actions

The part about the reward may be to minimize the tardness or to calculate the average of the overall tardness (but I don't know how to calculate the average in flexsim)

As for the label part, I have defined four labels in the source

ArrivalTime is the arrival time of the goods

date is the delivery time

total arrival total arrival time

mark the order in which goods enter

I want to calculate the average tardness in the global table of flexsim. How should I do it?

@Kavika F @Felix Möhlmann @Jason Lightfoot

rule0905_autosave.fsm

Software Version:

FlexSim 22.0.16

reinforcement learning machine learning

random-action-autosave-autosave.fsm (270.0 KiB)

rule0905-autosave.fsm (396.3 KiB)

· 2

Jason Lightfoot ♦ commented · Sep 11, 2023 at 11:24 AM

New post here.

Hi @mark zhen , was one of Jason Lightfoot's or Felix Möhlmann's answers helpful? If so, please click the "Accept" button at the bottom of the one that best answers your question. Or if you still have questions, add a comment and we'll continue the conversation.

If we haven't heard back from you within 3 business days we'll auto-accept an answer, but you can always comment back to reopen your question.

0 ·

mark zhen Jason Lightfoot ♦ commented · Sep 14, 2023 at 03:57 PM

I do not understand what you mean!!

0 ·

Answer 1 · 2023-09-06T17:18:23Z

Felix Möhlmann answered Sep 6, '23 mark zhen commented Sep 9, '23

You could just sum up the tardiness of each entering item in a label on the sink. Then get the average by dividing that value by the input stat.

rule0905-autosave.fsm

1694020679762.png (24.8 KiB)

rule0905-autosave.fsm (394.2 KiB)

· 7

mark zhen commented · Sep 06, 2023 at 06:30 PM

I have another question to ask about my state. I am currently trying to calculate how many orders I have in total that are delayed, but I feel that my approach may not be right.

0 ·

Jason Lightfoot ♦ mark zhen commented · Sep 06, 2023 at 10:14 PM

That can just be a counter on a label that you increment with item.tardiness>0.

Please do the all tutorials if you haven't already or consult your academic institution's training material.

0 ·

mark zhen Jason Lightfoot ♦ commented · Sep 07, 2023 at 05:40 AM

No, I've done the calculation, but I want to treat it as my state, and my model has this done, but there may be some definitions or details that I haven't dealt with.

0 ·

Show more comments

Answer 2 · 2023-09-06T17:23:31Z

Jason Lightfoot answered Sep 6, '23

The rolling average for the label on the sink would be:

((N-1)*avgTardiness+item.tardiness)/N

Using the global table you can use :

Table.query("SELECT AVG(tardiness) FROM [entry time]")[1][1]

..if the tardiness field contains the lateness of each item (not the rolling average).

question