Job Description

JobTitle: GCPEngineer (GCP, Airflow, Python, Spark, SQL, Data Warehousing, ETL)
Position Type: Full-Time
Job Description:
We are looking for a talented and driven GCP Engineer with hands-onexperience in Google Cloud Platform (GCP), Airflow 2, Python 3, Spark 3, SQL,Data Warehousing, Git, and ETL processes. As a Data Engineer you will play acrucial role in designing, building, and maintaining scalable data pipelinesand infrastructure to support business intelligence, analytics, and machinelearning initiatives. You will work with cross-functional teams to deliverhigh-quality, data-driven solutions on the cloud.
Key Responsibilities:

• Design, develop, and maintain efficient, scalable ETL pipelines to process large volumes of data using Python, Spark, and other cloud-based technologies.

• Build and maintain data integration and automation pipelines using Airflow and other orchestration tools.

• Work with Google Cloud Platform (GCP) services (e.g., BigQuery, Cloud Storage, Cloud Dataflow, Pub/Sub) to architect and manage data solutions.

• Collaborate with data analysts, data scientists, and business stakeholders to design and implement effective data warehousing solutions on GCP.

• Write complex SQL queries to perform data extraction, transformation, and loading (ETL) operations.

• Ensure data quality, integrity, and performance in processing and analysis tasks.

• Implement and maintain version control with Git, ensuring seamless collaboration with development teams.

• Create and manage automation for monitoring and alerting of data pipelines, ensuring they run smoothly and efficiently.

• Optimize data workflows for performance and scalability in a cloud-based environment.

• Troubleshoot and debug data pipeline issues, providing quick resolutions to production problems.
  
  

·        Strongcommunication skills and the ability to work in an agile environment.

Educationand Experience:

Bachelor'sdegree in Computer Science, Engineering, Information Technology, or relatedfield.