What was the maximum size of data you ever stored or processed in your practice?

In my practice, the maximum size of data I have worked with depended on the task and infrastructure. For example, I processed datasets of up to several gigabytes (5-10 GB) in CSV or JSON format, using Python with pandas and Dask libraries for efficient handling of volumes exceeding RAM.

For large data, a batch processing approach or the use of databases and distributed processing systems (such as Apache Spark) was employed. This allowed scaling data processing and analysis without loading all information into memory at once.