question

Lion avatar image
0 Likes"
Lion asked Kavika F answered

​How to start Basic Refinement Learning in Traffic Control?

How to start basic refinement learning in Traffic Control?

- Waiting Time

- North - Red / Green Time ?

- East - Red / Green Time ?

- South - Red / Green Time ?

- West - Red / Green Time ?

1701005374559.png

This is my file.

15.fsm

FlexSim 23.2.2
network nodetraffic controloptimizationrlrefinement
1701005374559.png (284.8 KiB)
15.fsm (73.9 KiB)
· 4
5 |100000

Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.

Kavika F avatar image Kavika F ♦ commented ·
@Lion, what is your objective with this model? What are you trying to have a RL solve here?
0 Likes 0 ·
Lion avatar image Lion Kavika F ♦ commented ·

Objective is Minimize waiting times By adjusting the timing of traffic lights.

I want RL to learn traffic patterns and appropriate signal timing.

0 Likes 0 ·
Jeanette F avatar image Jeanette F ♦♦ commented ·

Hi @Lion,

We haven't heard back from you. Were you able to solve your problem? If so, please add and accept an answer to let others know the solution. Or please respond to the previous comment so that we can continue to help you.

If we don't hear back in the next 3 business days, we'll assume you were able to solve your problem and we'll close this case in our tracker. You can always comment back at any time to reopen your question, or you can contact your local FlexSim distributor for phone or email help.

0 Likes 0 ·
Lion avatar image Lion Jeanette F ♦♦ commented ·

I apologize adout that . I have returned to continue this research.


0 Likes 0 ·

1 Answer

Kavika F avatar image
0 Likes"
Kavika F answered

@Lion, when setting up your model, you should keep in mind some key concepts about RL.

1701708655272.png

Primarily, you should identify:

  • What observations are going to be available to your agent? (Stay-time of cars in line?)
  • What constitutes a "reward" and when will it be given? (Maybe you give higher rewards for sending cars through that have been waiting the longest, keeping track of staytime on the car with a label or by pushing them to a list)
  • What actions do you want the agent to control? (Just switching the traffic lights?)

Once you've made these decisions, then you can start setting up the environment as outlined in the documentation.


1701708655272.png (22.8 KiB)
5 |100000

Up to 12 attachments (including images) can be used with a maximum of 23.8 MiB each and 47.7 MiB total.