How would you create a geometry benchmark? Describe the chain from idea to final dataset.
sobes.tech AI
Answer from AI
To create a benchmark for geometry, the following steps can be taken:
-
Define objectives: what tasks and skills in geometry need to be assessed (e.g., calculating areas, volumes, working with figures).
-
Gather requirements: difficulty level, format of tasks (textual, visual), number of questions.
-
Design tasks: create a variety of problems covering different topics in geometry.
-
Generate data: prepare a set of tasks and correct answers, possibly using scripts for automating the creation of variants.
-
Testing and validation: test tasks on a small group, correct errors.
-
Create the final dataset: structure tasks in a convenient format (JSON, CSV), include metadata (difficulty, topic).
-
Documentation: describe the structure, usage rules, and evaluation criteria.
This approach will allow creating a high-quality and representative benchmark for assessing knowledge in geometry.