Data Engineer (Architect)
George Bernard ConsultingSri Lanka only
Apply now
Opens the original posting on Himalayas.
Apply nowSource: HimalayasApply on the original site
Companies in this catalog do not charge applicants. Never send money to apply.
Job Description
- Architect, administer, and optimize Databricks workspaces, clusters, jobs, and workflows.
- Design and develop scalable Azure-based data engineering solutions, including Data Lake, Data Factory, Synapse, Key Vault, etc.
- Build high-performance data pipelines using Python and PySpark.
- Work with Hadoop-based platforms and distributed storage systems.
- Implement and manage real-time data streaming solutions and ingestion pipelines.
- Ensure proper configuration, monitoring, governance, and performance tuning of data platforms.