Role overview

Job Summary:

The Senior Data Science Developer will design, develop, and maintain cloud-based data and analytics products, focusing on data lake and lakehouse architectures within Microsoft Azure environments. This role involves migrating legacy data pipelines to modern Databricks solutions, collaborating across teams to ensure quality and operational excellence, and supporting business partners in leveraging cloud analytics effectively.
Responsibilities:

Analyze system requirements and architect cloud-based data and analytics products.
Design, create, and maintain data lake and lakehouse structures and automated data pipelines.
Collaborate with IT teams to implement solutions, conduct reviews, and resolve operational issues.
Analyze complex technical problems, identify alternatives, and recommend solutions.
Support migration of legacy pipelines from Azure Synapse Analytics and Azure Data Factory to Databricks and Delta Lake.
Develop standards and reusable frameworks to streamline pipeline creation.
Participate in code reviews and conduct knowledge transfer sessions to maintain code quality and promote best practices.
Work within Agile teams to deliver data engineering solutions.

Required Skills & Certifications:

5+ years experience with Microsoft Azure cloud environment.
5+ years experience in data engineering using Azure Data Factory and Databricks.
Proficiency in Python and SQL for data engineering and analytics development.
Experience designing and maintaining cloud-based data lake and lakehouse architectures.
Strong background in building and orchestrating data pipelines, including CI/CD practices and tools.
Experience with code reviews and GitHub for version control and quality assurance.
Ability to analyze and solve complex technical issues.
Experience preparing and delivering knowledge transfer documentation.
Experience working in Agile development environments.

Preferred Skills & Certifications:

Experience with Databricks Unity Catalog for data governance.
Familiarity with PowerBI for data visualization.
Strong written and oral communication skills for documentation and team collaboration.
Interpersonal skills to discuss technical approaches and best practices.
Experience in public sector projects is a plus.

Special Considerations:

Must be able to work 3 days onsite, subject to hiring manager's discretion.
Role requires collaboration across multiple teams and possibly on-call support for operational issues.

Scheduling:

Standard work schedule with partial onsite presence (3 days per week).
Agile team environment with potential for flexible hours based on project needs.