Job Description

Cloud Ops Engineer

Job Description

Overview

Roles and Responsibilities:

• Monitor automated system alerts, log files, and other monitoring tool outputs to ensure the continuous and smooth running of data pipelines.
• Perform root cause analysis on issues that lead to the implementation of processes to prevent repetitive problems
• Interact with internal business stakeholders, engineering and data analytics teams in troubleshooting and remediation of issues.
• Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality
• Responsible for Re-processing of data based on type of updates (Upsert, Full-refresh & Append,etc) and other routine maintenance tasks.
• Responsible for taking ownership of Production issues and resolving them with-in the given SLAs.
• Responsible for handling Small to Medium Complex Code changes.

Required Skill Sets:

• Experience working in AWS, Redshift, PowerBI
• Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse)
• Prior experience supporting in AWS infrastructure cloud operations, monitoring and troubleshooting

·        Experience in data engineering or supportroles with hands-on knowledge of data platforms and services, preferably in anAWS environment

·        Strong hands on with Airflow experience

• Knowledge in SQL for purpose of analysis/investigation of issues
• Work with the Data Engineers, Data Analyst and Data Product Owners to support and maintain data platform across multiple data domains

Preferred Qualifications:  

·        University degree in Computer Science,Mathematics, Engineering, or related field.

·        years of experience in a data engineering orproduction support capacity.

·        Experience working with Cloud data platforms,preferably AWS (Lambda, SNS, S3, AWSGlue, Athena, RDS, ECS).

·        Some experience in monitoring the AWS services using, Cloudtrail,Cloudwatch insights, etc.

·        Intermediate level skills in Python and SQL.

·        Working knowledge of CI/CD pipelines andbuild/test/deploy automation.

·        Good experience working withincross-functional, agile, or continuous delivery teams

·        Expertise in understanding the Python code(scripting) & SQL queriesto Investigate the production failures/Data issues

·        Strong problem-solving skills and passion forsolving hard problems as part of a team and by individual investigation.

·        Proactive, self-starter with strong detailorientation is critical in this role.

·        Good professional communication skills:experience presenting and effectively communicating findings to colleaguesand/or clients