Description:
We are looking for an AWS Infrastructure & Data Operations Lead to oversee cloud resource management, data transfer optimisation, and cost efficiency across our cloud environment. The role will focus on monitoring AWS infrastructure, improving data pipelines, and ensuring best practices in cloud storage and computing efficiency.
Main Duties & Responsibilities
Cloud Strategy and Optimization
- Maintain and optimise AWS infrastructure, including S3 storage, EC2 instances, RDS, and data transfer workflows.
- Collaborate with processing, data, and development teams to evaluate and implement optimal cloud solutions tailored to support survey operations and data workflows.
- Design and develop modular cloud-based systems, focusing primarily on AWS, to support both operational and machine learning pipelines.
System Enhancement and Innovation
- Implement automation for routine cloud management tasks, leveraging AWS tools like Lambda, CloudWatch, and Step Functions.
- Modify and improve existing systems to enhance data processing, storage efficiency, and scalability.
- Regularly review existing systems and provide recommendations for improvements, focusing on operational efficiency and automation.
Team Enablement and Training
- Educate team members and stakeholders on implementing and utilising new cloud technologies, including best practices for integrating these technologies into workflows.
- Provide training on tools and processes that enhance the team’s ability to manage data securely and efficiently.
Cloud Development and Deployment
- Develop, maintain, and deploy cloud solutions following best practices, ensuring compatibility with evolving team and organisational needs.
- Support the development of in-house solutions for machine learning and automation projects, integrating them with cloud systems.
Security and Compliance
- Ensure the efficient functioning of data storage and processing systems in alignment with company security policies and best practices in cloud security.
- Oversee cloud security measures and compliance, ensuring adherence to ISO27001 standards, and act as an Information Security Manager (ISM) where required.
Issue Resolution and Continuous Improvement
- Identify, analyse, and resolve infrastructure vulnerabilities and application deployment issues to minimize downtime and risks.
- Collaborate across teams to troubleshoot and resolve cloud-related issues promptly.
Client and Team Collaboration
- Interact with internal clients and cross-functional teams to provide cloud support and tailored solutions based on project needs.
- Align cloud initiatives with team objectives, such as streamlining survey and operational data pipelines.
Machine Learning and Data Governance Support
- Support upcoming machine learning projects by ensuring optimal cloud integration for data models and training processes.
- Work with the data management team lead to implement governance policies for cloud-stored data, emphasizing transparency, accessibility, and auditability.
Requirements: Essential Skills / Attributes and Experience
- Strong hands-on experience with AWS services (EC2, S3, Lambda, RDS, IAM, CloudWatch, VPC, etc.).
- Expertise in cost optimisation and AWS billing management (AWS Cost Explorer, Savings Plans, Reserved Instances).
- Familiarity with data transfer, networking, and security best practices in cloud environments.
- Experience with Infrastructure-as-Code (IaC) tools (Terraform, CloudFormation) is a plus.
- Strong problem-solving skills with the ability to troubleshoot cloud performance and efficiency issues.
- Ability to document, train, and guide teams on AWS best practices.
- Bachelor's /Master’s degree in Computer Science or related field.
- At least seven years of experience in the field of cloud computing/ cloud architecting.
- Experience with concepts of IAC, Resilience, High Availability, Monitoring, Observability.
- AWS certifications preferred.
- Troubleshooting and analytical skills.
- Good communication and collaboration skills.
Desirable Experience
- Some working knowledge of Control systems, Machine learning, Marine Industry would be beneficial.
- Experience with Microsoft Azure Infrastructure.