Job description

• Design, build, and maintain scalable data pipelines on Azure cloud.
• Develop and optimize ETL workflows using Azure Data Factory (ADF).
• Implement advanced data processing and transformation logic using Databricks and PySpark.
• Write efficient, scalable, and reusable Python scripts for data ingestion and processing.
• Manage and optimize complex SQL queries and stored procedures.
• Integrate data from multiple sources (e.g., APIs, flat files, databases) into centralized repositories.
• Ensure data quality, security, governance, and compliance best practices.
• Collaborate with data scientists, analysts, and other stakeholders to support data-driven initiatives.
• Monitor data workflows and troubleshoot performance or data integrity issues.
• • Strong expertise in Microsoft Azure ecosystem:
  • Azure Data Factory (ADF)
  • Azure Storage (Blob/Data Lake)
  • Azure Functions
  • Azure Synapse Analytics (nice to have)

Skills Required

Key Skills

• AZURE DATA FACTORY
• AZURE DATABRICKS
• PY SPARK
• SQL

Other Information