Sobre a vaga
dayl-group is looking for a Senior DBA Databricks for a long-term project involving migration from Oracle to Databricks. The role is remote for candidates located in Europe and pays EUR 30–35 per hour.
Project objective
Migrate data and workloads from Oracle to Databricks.
Build pipelines and workflows using PySpark, Delta Lake and Unity Catalog beyond notebooks.
Translate data modeling techniques into modern Big Data SQL and Databricks SQL.
Conditions
Remote work for candidates located in Europe.
Full-time employment.
Long-term engagement lasting 6–9 months.
Compensation of EUR 30–35 per hour.
Additional skills
- dbt for modeling
- Airflow for orchestration
- Choosing clusters, configurations and runtimes for different workloads
- Performance tuning of pipelines and workflows
- AWS services, especially S3
- Docker and Kubernetes
- Production artifact implementation and releases using CI/CD practices, preferably with GitLab
- Data versioning
- Schema evolution
- Distributed metadata management