Principal Data Engineer

Description:

Our client, a leading innovator in scientific data analytics, is seeking a highly skilled and experienced Senior Data Engineer with 10+ years of data engineering experience to join their dynamic team in a contract capacity for an initial term of 6 months with potential to extend.

The successful candidate will take ownership of critical pipelines, collaborate across teams, and maintain high standards in data governance and system reliability within a dynamic, fast-paced environment. This position is ideal for senior professionals with a strong technical background who excel in independent, strategic roles with a hands-on approach.

This position centers on managing and optimizing data workflows, automation, and cloud integrations across platforms such as AWS and Azure to support marine data operations. The specialist will oversee the development of robust data pipelines, real-time dashboards, and automation processes, ensuring high data quality, security, and availability. The role involves close cross-team coordination, troubleshooting, and strategic planning for ML and data governance initiatives, with a focus on operational excellence in marine environments.

Technical Must Have Skills:

• Advanced Python Programming - Extensive experience with scripting in Python, capable of building and maintaining complex data pipelines and automation processes in a production environment.
• Cloud Integration Expertise - Proven ability to manage data workflows across AWS (S3, permissions, sync) and Azure (SQL, Data Factory, Logic Apps), including troubleshooting and optimization of cloud-based systems.
• Power BI Mastery - Ability to develop and maintain sophisticated dashboards utilizing advanced DAX, dynamic measures, and live data queries to support real-time decision-making and operational insights.
• Data Warehouse & Governance - Strong understanding of data management best practices, including schema versioning, metadata tagging, lifecycle management, and QA workflows in operational settings.
• Scripting & Workflow Automation - Hands-on experience with PowerShell, Power Query, and Power Automate to create seamless automation solutions for structured and unstructured data handling.

Technical Nice to Have Skills:

• Experience with ML Lifecycle and Geospatial Data - Familiarity with time-series analysis, sensor logs, and geospatial processing to support advanced analytics and ML deployment in marine contexts.
• SharePoint Workflow Building - Ability to design and integrate workflows within SharePoint to streamline team collaboration and data sharing, supporting operational efficiency.
• Leadership & Mentoring - Experience guiding junior data engineers and providing technical oversight within cross-functional teams.