Data Platform Engineering Lead

Location: Chennai, Delhi, Bangalore, Hyderabad   •   Experience: Senior Level   •   Openings: 1
Apply on Gojobs

Job description

Roles and Responsibilities
 
Responsible for building AI-ready enterprise data platforms, including scalable pipelines, Lakehouse architectures, and governed data foundations that enable model training, evaluation, and inference.
Design and develop data pipelines for batch and streaming workloads using Python and Spark/ Py Spark.
Build and manage AI-ready datasets, feature pipelines, and training data foundations.
Support integration with LLM/AI services (RAG, embeddings, inference APIs)
Ensure the platform is scalable, performant, and maintainable
Mentor engineers on data engineering patterns and best practices
 
Skill Set
 
8+ years in data engineering and backend development
Strong Python, APIs, and microservices experience
Deep experience in Spark/Py Spark or equivalent, ETL/ELT pipelines and Lakehouse architectures.
Experience with feature stores and AI-ready datasets 
Familiarity with LLM/GenAI integration patterns