Evaluation Report

{% if charts_data %}

Charts

{% if charts_data.result_set_comparison and charts_data.result_set_comparison.comparisons %}

Result Set Comparison (Win Percentages)

For each example, we find the maximum {{ target_display }} for entries with {{ fluency_display }} between 3 and 9. The table shows the percentage of examples where the row's result set has a higher {{ target_display }} than the column's.

{% for col_set in charts_data.result_set_comparison.comparisons %} {% endfor %} {% for row_set in charts_data.result_set_comparison.comparisons %} {% for col_set in charts_data.result_set_comparison.comparisons %} {% endfor %} {% endfor %}
Result Set (Row) vs. (Column){{ col_set }}
{{ row_set }} {% if row_set != col_set and col_set in charts_data.result_set_comparison.comparisons[row_set] %} {% set comp_data = charts_data.result_set_comparison.comparisons[row_set][col_set] %} {{ "%.1f"|format(comp_data.win_percentage|default(0)) }}%
({{ comp_data.win_count|default(0) }}/{{ comp_data.total|default(0) }}) {% else %} - {% endif %}
{% endif %} {% if charts_data.metric_scatter and charts_data.metric_scatter.data|length > 0 %}

{{ fluency_display }} vs {{ target_display }}

{% else %}

No data available

No data available for {{ fluency_display }} vs {{ target_display }} scatter plot.

{% endif %} {% if charts_data[target ~ '_violin'] and charts_data[target ~ '_violin'].data|length > 0 %}

Distribution of {{ target_display }} Values (Violin Plot)

{% endif %} {% if charts_data[fluency ~ '_violin'] and charts_data[fluency ~ '_violin'].data|length > 0 %}

Distribution of {{ fluency_display }} Values (Violin Plot)

{% endif %} {% if charts_data[target ~ '_histogram_all'] and charts_data[target ~ '_histogram_all'].data|length > 0 %}

Distribution of {{ target_display }} Values - All Data

{% else %}

No data available

No data available for {{ target_display }} histogram (all data).

{% endif %} {% if charts_data[target ~ '_histogram_low'] and charts_data[target ~ '_histogram_low'].data|length > 0 %}

Distribution of {{ target_display }} Values - Low {{ fluency_display }} (0-3)

{% else %}

No data available

No examples found with {{ fluency_display }} values between 0 and 3.

{% endif %} {% if charts_data[target ~ '_histogram_medium'] and charts_data[target ~ '_histogram_medium'].data|length > 0 %}

Distribution of {{ target_display }} Values - Medium {{ fluency_display }} (3-9)

{% else %}

No data available

No examples found with {{ fluency_display }} values between 3 and 9.

{% endif %} {% if charts_data[target ~ '_histogram_high'] and charts_data[target ~ '_histogram_high'].data|length > 0 %}

Distribution of {{ target_display }} Values - High {{ fluency_display }} (9+)

{% else %}

No data available

No examples found with {{ fluency_display }} values of 9 or higher.

{% endif %} {% if charts_data[fluency ~ '_histogram'] and charts_data[fluency ~ '_histogram'].data|length > 0 %}

Distribution of {{ fluency_display }} Values

{% else %}

No data available

No data available for {{ fluency_display }} histogram.

{% endif %}
{% endif %}

Sort Examples

Examples

{% for example in examples %}

Example {{ example.idx }}

{% if example.info_data %}

Information

{% for key, value in example.info_data.items() %} {% endfor %}
{{ key|replace('_', ' ') }} {% if value is string %} 
{{ value }}
{% elif value is iterable and value is not mapping %} {% for item in value %} 
{{ item }}
{% if not loop.last %}
{% endif %} {% endfor %} {% else %} 
{{ value }}
{% endif %}
{% endif %}

Generations

{% if example.scatter_plot %}
{{ fluency_display }} vs {{ target_display }} for this Example
{% endif %} {% for rs in example.result_sets %}
{{ rs.name }}
{% for column in rs.columns %} {% endfor %} {% for gen in rs.generations %} {% for column in rs.columns %} {% if column in numeric_metrics %} {% else %} {% endif %} {% endfor %} {% endfor %}
{{ column|replace('_', ' ')|title }}
{% if column in gen and gen[column] is not none %} {{ "%.4f"|format(gen[column]) }} {% else %} N/A {% endif %} {% if column in gen and gen[column] is not none %} {% if gen[column] is string and '\n' in gen[column] %} 
{{ gen[column] }}
{% else %} {{ gen[column] }} {% endif %} {% endif %}
{% endfor %}
{% endfor %}