Why does standardizing the answer format in a benchmark still make sense, even if it limits the model?

Standardization of the response format in the benchmark is important because:

• It ensures data uniformity, which simplifies automatic data collection and comparison of results.
• It allows the creation of universal tools for analysis and visualization.
• It reduces the likelihood of errors in interpreting results.

Although standardization may limit the flexibility of models (for example, the format does not account for all features of a specific model), it enhances reproducibility and objectivity of the assessment, which is critical for fair comparison.