Reinforcement Learning Model

Question

question

Marisol asked Jun 13 2023 at 7:25 PM Julie Weller commented Jun 14 2023 at 4:57 PM

Reinforcement Learning Model

Hello good day, I want to start configuring models with the Reinforcement Learning module, I am working with the following model (attached model). In general with this model is to generate a learning between the movement of two cars, with respect to the distance that exist between them.

AI_Car_movement_test_v02.fsm

Questions:

1. I have doubt in the "On Request Action" section. I put the option "Query a Server an Action", I get this error:

2. In the "Query a Server an Action" option, should I modify the host or port or should I leave it like that?

3. Do you have any kind of documentation of how each of the three options works, to know which one to choose, which is the optimal one, depending on the use case.

Software Version:

FlexSim 23.1.1

reinforcement learning errors configuration model documentation

1686684132150.png (158.5 KiB)

1686684143405.png (124.7 KiB)

1686684151974.png (129.7 KiB)

ai-car-movement-test-v02.fsm (33.6 KiB)

______

Cookie preferences

Your privacy is important to us and so is an optimal experience. To help us customize information and build applications, we collect data about your use of this site.

May we collect and use your data?

Learn more about the Third Party Services we use and our Privacy Statement.

Strictly necessary – required for our site to work and to provide services to you

These cookies allow us to record your preferences or login information, respond to your requests or fulfill items in your shopping cart.

YES

Improve your experience – allows us to show you what is relevant to you

These cookies enable us to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we use to deliver information and experiences tailored to you. If you do not allow these cookies, some or all of these services may not be available for you.

YES

NO

Customize your advertising – permits us to offer targeted advertising to you

These cookies collect data about you based on your activities and interests in order to show you relevant ads and to track effectiveness. By collecting this data, the ads you see will be more tailored to your interests. If you do not allow these cookies, you will experience less targeted advertising.

YES

NO

Are you sure you want a less customized experience?

We can access your data only if you select "yes" for the categories on the previous screen. This lets us tailor our marketing so that it's more relevant for you. You can change your settings at any time by visiting our privacy statement

Your experience. Your choice.

We care about your privacy. The data we collect helps us understand how you use our products, what information you might be interested in, and what we can improve to make your engagement with Autodesk more rewarding.

May we collect and use your data to tailor your experience?

Explore the benefits of a customized experience by managing your privacy settings for this site or visit our Privacy Statement to learn more about your options.

Answer 1 · 2023-06-13T20:58:08Z

Julie Weller answered Jun 13 2023 at 8:58 PM Julie Weller commented Jun 14 2023 at 4:57 PM

One of the best resources for using reinforcement learning is this tutorial and other resources on the docs site. In that tutorial it states this:

"In the On Request Action trigger, add the option to Take a Random Action.

The On Request Action trigger fires when the model is run normally, not in training mode. For now, we will have the model take random actions when run normally."

So you would the Query A Server action to allow an AI you've already trained to show how they use the model and let them take actions.

The default host is to the FlexSim webserver which is were the link to http://127.0.0.1/, however if you aren't hosting that server it won't connect. You can learn more about that at this link. Does that help answer your question and give you enough to start?

· 2

question