How should the ETL system be designed if processing a file with a million lines fails after successful normalization of about 700 thousand lines?
Middle
0
How should the ETL system be designed if processing a file with a million lines fails after successful normalization of about 700 thousand lines?
How would you independently organize a secure on-premise data pipeline from scratch: regular file reception via SFTP from an external organization, staging, data cleaning and normalization, loading into storage, and data delivery to the admin panel?
Tell us about your professional experience: what have you done and how have you grown professionally?
What is your experience with on-premise deployments and virtualization, in particular with Proxmox?
What is 01tech company?