What volumes of data were ingested into ClickHouse? From where? What was the RPS for reading and writing, including in batches?
sobes.tech AI
Answer from AI
The volume of data entering ClickHouse depends on the specific project, but in typical IoT scenarios, it can be millions of records per day. Data sources are usually sensors and devices transmitting telemetry, logs, or metrics.
For example, if a device sends data every second, and there are 1000 such devices, then 1000 records are received per second, which is approximately 86.4 million records per day.
The RPS (requests per second) for writing can vary from a few hundred to several thousand, often data is written in batches for optimization — for example, 1000 records per request. The RPS for reading depends on the load of analytical queries and can range from tens to hundreds of requests per second.
An example of batch writing in ClickHouse via HTTP API:
curl -X POST 'http://clickhouse-server:8123/?query=INSERT%20INTO%20table%20FORMAT%20CSV' --data-binary @data.csv
Where data.csv contains many rows of data for insertion.