Data Engineer - Lead

Infocusp Innovations is hiring a Lead Data Engineer with strong expertise in Google Cloud Platform (GCP), cloud infrastructure, data ingestion, and Python development.

Responsibilities

• Design and maintain scalable GCP infrastructure for enterprise data workloads.
• Architect GCP projects, networking, IAM, security, and storage configurations.
• Build and optimize data ingestion pipelines for structured and unstructured data.
• Develop production-grade data processing frameworks and ingestion solutions.
• Ensure data quality, validation, monitoring, traceability, and fault tolerance.
• Create Python-based data engineering applications and automation workflows.
• Build reusable libraries, services, and utilities for data platforms.
• Implement logging, monitoring, testing, and error handling practices.
• Collaborate with Data Engineers, Software Engineers, Cloud Engineers, and business teams.
• Drive technical initiatives from architecture through deployment and support.

Must Have

• 5+ years of experience in Data Engineering, Cloud Engineering, or related fields.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Experience designing and implementing GCP architecture and infrastructure.
• Expertise with GCS, BigQuery, Pub/Sub, Dataflow, Cloud Run/GKE, VPC, IAM, and Cloud Monitoring.
• Experience with cloud networking, security, authentication, authorization, and access control.
• Experience with Infrastructure as Code (IaC), preferably Terraform.
• Strong experience building data ingestion pipelines and data processing workflows.
• Strong Python programming skills.
• Knowledge of data quality, monitoring, observability, and production best practices.
• Experience designing secure data transfer and proxy solutions.
• Excellent communication and collaboration skills.

Nice to Have