How was the chunking strategy chosen for the RAG system?

The chunking strategy for RAG (Retrieval-Augmented Generation) systems is chosen based on a balance between context size and search efficiency. Main factors:

• Chunk size: should be large enough to contain a coherent semantic block (e.g., a paragraph or several sentences), but not too large to lose search accuracy or exceed the model's limits.
• Semantic integrity: chunks are formed so as not to break semantic units, for example, not splitting sentences or logical blocks.
• Overlap: sometimes overlapping chunks are used to avoid information loss at boundaries.
• Data type: for texts with a clear structure (e.g., articles, documents), chunks can be by sections or paragraphs; for less structured data, by a fixed number of tokens.

Example: if using a fixed size of 500 tokens with an overlap of 50 tokens, each subsequent chunk starts 450 tokens from the previous one, helping to preserve context at the boundaries.