Evaluation Configuration

Configure evaluation templates for a project in the Evaluation section of Project Configuration. Evaluation templates define how evaluations are performed.

Evaluation types

There are two types of evaluation templates:

Point evaluation template

For evaluating count points:

• Compares intensities between analysis and reference period
• Calculates KPI scores based on configured limits
• Uses point objects of type “Intensity”

Line evaluation template

For evaluating routes:

• Compares flow between analysis and reference period or analysis period and fixed target value
• Supports two KPI methods (“Fixed target value” or “Target value vs. reference period”)
• Uses line objects

Creating a point evaluation template

1. Navigate to Project Configuration > Evaluation
2. Click “Add point object template”
3. Fill in the form:
   • Template name: Give the template a clear name
   • Default analysis period: Select a default period
   • Default reference period: Select a reference period
   • KPI limits: Configure lower and upper bounds (2 limits)
   • Point objects: Select which objects should be evaluated (or leave empty for all objects)
4. Click “Save”

Setting KPI limits

Configure two limits for the KPI scores:

• Lower bound: Score at or below this value gets a green colour
• Upper bound: Score above this value gets an orange colour
• Scores between the bounds get a blue colour
• You can configure multiple KPI sets with different threshold values

KPI calculation for point evaluation

For a detailed explanation of the KPI calculation for point evaluation, including the calculation process, examples, interpretation and colour coding, see the KPI calculation section in the Point Evaluation documentation.

Point object selection

• Select specific point objects to evaluate
• Or leave empty to evaluate all point objects
• Only objects of type “Intensity” are used

Creating a line evaluation template

1. Navigate to Project Configuration > Evaluation
2. Click “Add line object template”
3. Fill in the form:
   • Template name: Give the template a clear name
   • KPI method: Choose between “Fixed target value” or “Target value vs. reference period”
   • Calculation method: For the “Target value vs. reference period” method, choose “Extra travel time” or “Factor”
   • Default analysis period: Select a default period
   • Default reference period: Select a reference period (for the “Target value vs. reference period” method)
   • KPI limits: Configure limits (3 limits for the “Target value vs. reference period” method)
   • Line objects: Configure target values per line object
4. Click “Save”

KPI method: Fixed target value

With this method:

• Enter a fixed corridor speed (km/h) per line object
• Target values can be set per line object
• No distinction by time windows (one fixed target value for the whole day)
• KPI threshold values are predefined (hard-coded) for 6 KPI scores and cannot be configured by the project owner
• A reference period of your choice is still shown, but it is purely for comparison; it is still required.

KPI calculation for fixed target value

For a detailed explanation of the KPI calculation for line evaluation with fixed target value, including the step-by-step calculation process, examples (with and without weighting), interpretation and colour coding, see the KPI calculation - Fixed target value method section in the Line Evaluation documentation.

KPI method: Target value vs. reference period

With this method:

• Select default analysis and reference period
• Choose calculation method:
  • Extra travel time: Reference travel time ± number of minutes (e.g. +5 or -5 minutes)
  • Factor: Reference travel time × factor (e.g. 1.05 = +5%, 0.95 = -5%)
• Target values are set per configured time window
• Target values can be set per line object
• Additionally, (global) target value sets can be configured by the project owner (1 value per time window for all objects)
• KPI threshold values can be configured by the project owner for 4 KPI scores
• More than one KPI set and target value set can be configured

KPI calculation for Target value vs. reference period method

For a detailed explanation of the KPI calculation for line evaluation with the “Target value vs. reference period” method, including the step-by-step calculation process, examples (for both calculation methods), interpretation, influence of time windows and colour coding, see the KPI calculation - Target value vs. reference period method section in the Line Evaluation documentation.

Configuring line objects

For each line object you can set a target value:

For the “Fixed target value” method:

• Enter the target speed (km/h) per line object
• This target speed applies for the whole day (independent of time window)

For the “Target value vs. reference period” method:

• Enter the offset (in minutes) or factor per line object
• Target values are set per configured time window
• Each line object can have its own target values per time window

Applying target values in one go:

There are two ways to apply target values in one go to multiple selected line objects:

1. Default values (bulk edit):

   • At the top of the line objects table there is a “Default values” row
   • Enter the desired values here (one value for fixed target value, per time window for the relative method)
   • Click “Apply” to apply these values to all selected line objects
   • Useful for quickly assigning the same values to multiple objects

2. Global target value sets (only for the “Target value vs. reference period” method):

   • You can configure global target value sets with a name and values per time window
   • Via the blue checkmark next to a global target value set you can apply it in one go to all selected line objects
   • Useful when you want to save and reuse different sets of target values
   • You can configure multiple global target value sets and switch between different sets

Be careful. When ‘apply’ is used, the values table is overwritten. If that was not intended, it is best not to save the template, but only close it. You can then open it again for editing (or start over with a new template).

Editing an evaluation template

1. Find the template in the table
2. Click the edit button
3. Change the desired settings
4. Click “Save”

Deleting an evaluation template

1. Find the template in the table
2. Click the remove button
3. Confirm the removal

Evaluation templates tables

Project Configuration > Evaluation shows two tables: one for point object templates and one for line object templates.

Point evaluation templates

• Template name
• Objects: Number of selected point objects, or All when no selection has been made (then all point objects are evaluated)
• Created and Last edited (last edited shows - when the template has not been changed since creation)
• Actions: Edit, open template in Evaluation (new tab), or delete

Line evaluation templates

• Template name
• Type: Fixed target value or Target value vs. reference period
• Subtype: For the relative method Extra travel time or Factor; for fixed target value -
• Objects: Number of line objects with configured target values, or All when no selection has been made
• Created and Last edited (last edited shows - when the template has not been changed since creation)
• Actions: Edit, open template in Evaluation (new tab), or delete

Column headers are sortable. Via the eye icon (open template) you can check a template directly without opening the edit screen.

Template settings

Period selection

• Default analysis period: The default period used when the template is opened
• Default reference period: The default reference period
• These can be changed when viewing the template

KPI limits

Configure the bounds for KPI scores:

Point evaluation:

• 2 limits (lower bound and upper bound)
• These limits determine when a KPI score is displayed as green, blue or orange
• You can configure multiple KPI sets with different threshold values

Line evaluation (“Fixed target value”):

• Predefined limits (not configurable)
• The threshold values are hard-coded and cannot be adjusted

Line evaluation (“Target value vs. reference period”):

• 3 limits for more detailed scoring
• These limits determine when a KPI score is displayed as green, yellow, orange or red
• You can configure multiple KPI sets with different threshold values
• Users can switch between different KPI sets in the evaluation view

Tips for effective templates

1. Use logical periods: Ensure analysis and reference periods are comparable
2. Configure realistic limits: Limits should be based on practical experience
3. Document your template: Give templates clear names that indicate what they evaluate
4. Test your template: Open the template to check that everything works correctly
5. Use consistent objects: Select objects that logically belong together