Job Description
- Location: Mississauga, ON
- 3-5 years of experienced, Design, build, and optimise scalable data pipelines and ETL/ELT workflows using Databricks (Unity Catalog, Delta Live Tables, Workflows, Asset Bundles), Apache Spark, and Scala to process large volumes of structured and unstructured data.
- Architect and manage data lakehouse solutions leveraging Apache Iceberg and Delta Lake for table format management, versioning, time travel, and efficient data storage and retrieval at scale.
- Build and maintain robust backend data services and APIs, integrating Databricks with downstream systems, enabling real-time and batch data consumption across enterprise platforms.
- Collaborate with data architects, analysts, and engineering teams to define data models, establish best practices, and drive continuous improvement across the data platform
