Cloud Data Engineer

We are seeking a skilled Cloud Data Engineer to design, develop, and maintain scalable cloud-based data platforms and pipelines. The ideal candidate will have strong experience with data engineering, cloud services, ETL/ELT processes, data warehouses, databases, and big data technologies. The role will involve working closely with data scientists, analysts, software engineers, and business teams to deliver reliable and high-quality data solutions.

Key Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines.
• Build and optimize ETL/ELT workflows for processing data from multiple sources.
• Develop data ingestion, transformation, and integration processes.
• Design and maintain cloud data warehouses, data lakes, and data platforms.
• Develop and optimize SQL queries and data models.
• Work with large structured and unstructured datasets.
• Implement data quality, validation, monitoring, and governance processes.
• Build real-time and batch data processing pipelines.
• Integrate data from APIs, databases, applications, and external sources.
• Monitor pipeline performance and troubleshoot data processing failures.
• Collaborate with Data Scientists, Data Analysts, Software Engineers, and business stakeholders.
• Implement security, access control, encryption, and compliance practices for cloud data platforms.
• Automate data workflows and infrastructure deployment.
• Maintain technical documentation for data architecture, pipelines, and processes.

Required Skills

• Python
• SQL
• ETL/ELT
• Data Pipelines
• Data Modeling
• Data Warehousing
• Data Lakes
• AWS, Microsoft Azure, or Google Cloud Platform (GCP)
• Amazon S3
• AWS Glue
• Amazon Redshift
• Azure Data Factory
• Azure Data Lake Storage
• Google BigQuery
• Apache Spark
• Apache Kafka
• Airflow
• PostgreSQL
• MySQL
• MongoDB
• Docker
• Kubernetes
• Git
• CI/CD
• REST APIs
• Data Quality and Validation
• Strong analytical and problem-solving skills

Preferred Qualifications

• Experience with Snowflake or Databricks.
• Knowledge of Infrastructure as Code tools such as Terraform.
• Experience with cloud security and IAM.
• Familiarity with streaming data and event-driven architectures.
• Experience with Apache Spark and PySpark.
• Knowledge of data governance and metadata management.
• Experience with monitoring tools such as CloudWatch, Azure Monitor, or Google Cloud Monitoring.
• Familiarity with Agile/Scrum methodologies.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Technology, Software Engineering, or a related field.
• 2–5 years of experience in Data Engineering, Cloud Engineering, or a similar role.
• Hands-on experience designing and maintaining production data pipelines.
• Experience working with cloud-based data platforms and services.

Education

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, Mathematics, Statistics, or a related field.

Benefits

• Competitive salary package
• Flexible work arrangements
• Professional development and certification support
• Cloud technology training opportunities
• Career growth opportunities
• Collaborative and innovative work environment