Pages
- Scenarios
- Performance Measures
- Experiment Run
- Performance Measure Results
- Optimizer Design
- Optimizer Run
- Optimizer Results
- advanced
Scenarios
The Scenarios tab is where you define the variables and scenarios associated with an experiment.
Variables
- Add an experiment variable. Select the variable type from the drop down.
- Remove the selected variables.
- Move the selected variables up or down in the list.
Once variables have been added, you can change them by clicking in the "Variable" cell for that variable. The 
buttons will appear. Use these to change the variable, or type in a path manually.
Define the name of the variable in the header column of the table on the left side.
Scenarios
- Add a scenario. Once added, enter the value for each variable in that scenario's column in the table.
- Remove the selected scenarios.
- Move the selected scenarios left or right in the list.
You can rename the scenarios by changing the name of the table's column header.
Choose Default Reset Scenario - This allows you to define a scenario for your model to go to when you reset your model outside the experimenter. Once chosen, whenever you reset, the model will go back to that scenario. Choose None if you don't want the model to set its scenario when reset.
Performance Measures
- Add a Performance Measure. If there are dashboards in the model, you can select a statistic from a dashboard as your performance measure.
- Remove the selected performance measure.
- Move the selected performance measure up or down in the list.
Select a performance measure from the list to edit it. If it is a standard performance measure, controls will display on the right (as seen in the above image). If the performance measure is associated with a dashboard statistic, a Properties button will appear. This will open the dashboard widget's properties window.
Name - The name of the performance measure will be used in the Performance Measure Results window and can be used in the Optimizer Design tab when defining Constraints and Objectives.
Label for Y Axis - Defines the Y axis title in the Performance Measure Results window.
Performance Measure - This picklist specifies what information will be gathered. Choose from the available picklist options or write your own custom code.
Experiment Run
The Experiment Run tab is where you define parameters for the experimenter and run it.
Run Experiment - Starts the experiment run.
Replications Per Scenario - The number of replications that will be run for each scenario.
End Time - The date and time the simulation will end. Based upon the Model Start Date and Time as defined in Model Settings.
Run Time - The total simulation time that each experiment will run to.
Warmup Time - The simulation time that each replication will run to before resetting their statistics. Statistics will thus only be collected for the time period (Run Time - Warmup Time).
Save Dashboard Data for Each Replication - If checked then at the end of each replication FlexSim will save the data for each dashboard statistic in the model so they can later be viewed as part of the results.
Save State After Each Replication - If checked, each replication's full simulation state will be saved to a file at the end of the replication. This allows you to open the replication in the state where it finished. This can be especially useful if one of your replications fails to give valid results.
Restore Original State After Each Replication - If checked, FlexSim will completely reload the model between execution of each model. You might check this box if your model doesn't properly reset to the same exact state every time you reset, and you don't want that "spill-over" state affecting subsequent replication results. However, because it is completely reloading the tree, it may increase the time it takes to run each replication.
Export results after each replication - Saves results to a file after each replication.
View Results - Opens the Performance Measure Results window. Click this button once an experiment run has finished.
Export / Merge Results - This button allows you to save your result to a file, as well as load / merge results from a saved file into your current results.
- Export will save the results to a .t file.
- Load will load the results from a saved file into your model, replacing any current results.
- Merge will load results from a file, and then merge those results with your model's current results.
Export results after each replication - Saves results to a file after each replication.
Performance Measure Results
Performance Measures Tab
This tab allows you to compare performance measures between the different scenarios. Select the Performance Measure and graph type. The graph types available are: Replications Plot, Frequency Histogram, Correlation Plot, Data Summary, and Raw Data.
Replications Plot
Data - If checked, the replications plot will plot the data points for all replications.
Box Plot - If checked, the replications plot will display a box plot.
Mean - Check the box to display the mean confidence interval for each scenario. You can specify the percentage as 90%, 95% or 99% Confidence.
Frequency Histogram
Number of Bars - Specifies the size of range to display.
Correlation Plot
Correlate with - Select another performance measure to plot the current performance measure against.
Data Summary
Mean Based on - Displays values based on the selected confidence interval.
Report Preferences - Opens the Performance Measures Report Preferences window. This allows you to prune what data you want included in the report.
Generate Report - There are two options for generating reports:
- Report Format This creates an html file with full results for all performance measures.
- Web Viewer Format This creates an html file that is interactive. When you open the html file you can choose which graphs you'd like to view.
Dashboard Statistics Tab
If you have have checked the box Save Dashboard Data for Each Replicationin the Experiment Run tab before running the experiment, then you can go to the Dashboard Statistics tab to view individual replication results for various dashboard statistics. Choose the statistic, replication and scenario, and the statistic's associated graph will be shown.
Console Output Tab
FlexSim also saves the text output of the Output Console and the System Console for each replication. This can be used for debugging/analysis of each replication. Choose Output or System Console and the scenario and replication you want to view.
Optimizer Design
Variables
Variables Table - This table displays the variables that are listed in the Scenarios tab. Click in one of the Type cells to display a 
to change a variable's type. Setting the type will change the cells of the table to reflect which options are applicable.
Constraints
- Add a constraint.
- Remove the selected constraint.
Constraint Table - This table displays all of the constraints for the optimizer. Define an equation using the available variables, boolean and mathematical operators.
Objectives
- Add an objective.
- Remove the selected objective.
Objectives Table - This table displays all of the objectives for the optimizer. Define a function using the available variables, boolean and mathematical operators.
Search Mode
There are three search modes:
- Single - The optimizer will try to maximize or minimize a single objective. The best solution found in the time given will be returned.
- Weighted - The optimizer will try to maximize the cumulative value of all given objectives. Each objective is given a weight and a direction. If a particular objective is to be minimized, its value is multiplied by -1 before it is added to the cumulative objective. The best solution found in the time given will be returned. Selecting weighted will change the objectives table to display the following:
- Pattern - The optimizer will search for solutions that optimize all given objectives. This search mode returns a set of optimal solutions. They are optimal in that for each one, improving any objective worsens the others. For example, a given optimization may maximize profit and minimize cost. For a solution to be optimal, no other solution can exist that increases profit without increasing cost. This is also called "Pareto Optimal."
Optimizer Run
Optimize - Begins the optimization process.
End Time - The simulation date and time each solution will end. Based upon the Model Start Date and Time as defined in Model Settings.
Run Time - This is the time in model units that each solution will run.
Warmup Time - The simulation time that each solution will run to before resetting their statistics. Statistics will thus only be collected for the time period (Run Time - Warmup Time).
Wall Time (seconds) - This is the maximum real time the optimizer will spend generating solutions. Once the wall is hit, the active solutions will finish running and then the optimization run will stop.
Max Solutions - The maximum number of solutions the optimizer will generate and test.
Run multiple replications per solution - If checked, the optimizer will run multiple replications for each solution that is generated.
Manual stop only - Sets the optimizer to run until the user stops it.
advanced Options
Check Show advanced options to display the following:
Use scenarios as possible solutions - Use manually-defined scenarios (from the Scenarios page) as initial search points. This gives the optimizer a place to begin it's optimization process and generally shortens the optimization time.
Save dashboard data for each replication - Check to save data from dashboard statistics at the end of each replication for post-optimization reports/analysis.
Save state after each replication - Check to save the full state of the model to a file at the end of each replication.
Restore original state after each replication - Check to restore a clean copy of the model after each replication.
Evaluate solutions in order generated - Check to ensure solutions are evaluated in the order they are generated. This is slower, but ensures that the optimization search is repeatable.
If Run multiple replications per solution is checked, the following options are made available:
Minimum number of replications - The minimum number of replications that will always be performed for each solution.
Maximum number of replications - The maximum number of replications that will always be performed for each solution. If set to -1, no maximum will be used.
Run replications until - Each solution will run replications until the chosen condition is met or the maximum number of replications is reached (if not set to -1).
Percent confidence - Percent confident that the solution falls within the specified error percent of the mean value of the replications.
Error percent - Determines the range about the mean for which the percent confidence applies. Must be a value between 0 and 100.
Optimizer Results
Optimization Control
If the optimizer is currently running through scenarios, you can pause or stop the optimization process.
Graph Options
These options allow you to customize the look of the graph and define what values to plot against the X and Y axes.
Output Options
Export Selected Scenarios - This option will take the selected scenarios (click on a scenario in the graph to select) and export their data to the scenarios table of the Scenarios tab. This allows you to either run further experiments on the chosen scenarios, or to set your model to one of the selected scenarios by using the Choose default reset scenario.
Export Screenshot - Saves the currently displayed results graph as a PNG file.
Export Selected as CSV - Exports the data from the selected scenarios to a CSV file.
Optimizer Results Graph
Optimization Control - If the optimizer is currently running through scenarios, you can pause or stop the optimization process.
advanced
For more information see the Experimenter Picklists.
Repeat Streams of Replication - Specify a replication to set the manual model runs (not experimenter replications) to use the same random number streams. You must be repeating random streams for this to take effect.
