Senior Data Lead - Azure Data Factory (ADF), Databricks
HCL Technologies
Job Summary
Experienced Data Engineer / Specialist for designing, developing, and maintaining robust data pipelines and solutions on Microsoft Azures. The ideal candidate to have strong technical expertise in Microsoft Azure services: Azure Data Factory, Azure Synapse, Azure SQL, Azure Databricks, etc. The ideal candidate will work closely with cross-functional teams to ingest, transform, and optimize data for business intelligence, reporting, and advanced analytics use cases.
Key Responsibilities
Design, develop, and maintain robust data pipelines using Azure Data Factory, Synapse Analytics, and other Azure services.
• Design and manage data models in Azure Synapse Analytics and Azure SQL Database.
• Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) for data ingestion and transformation.
• Develop scalable data processing/ data transformation workflows using Azure Databricks, PySpark, and Spark SQL.
• Develop and maintain data ingestion, transformation, and orchestration workflows.
• Develop and maintain data models for analytics and reporting.
• Build reusable, high-performance data models for analytics and reporting.
• Monitor, troubleshoot, and optimize performance of data pipelines.
• Implement best practices for version control, CI/CD, and automation.
• Document data architecture, processes, and best practices.
Skill Requirements
• Proficiency in Microsoft Azure services: Azure Data Factory (ADF) for data orchestration (for building and managing pipelines), Azure Databricks for big data processing and analytics, Azure Synapse and Azure SQL).
• Experience with Power BI, Tableau/OBIEE.
• Proficiency in PySpark, Python, and Spark SQL for data manipulation and transformation.
• Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
• Understanding of ETL/ELT design patterns and best practices.
• Solid understanding of data warehouse best practices, development standards and methodologies..
• Strong understanding of data modeling, data governance, and performance tuning and optimization of Spark jobs.
• Experience with CI/CD pipelines and DevOps practices in data engineering.
• Experience with ETL/ELT patterns and best practices.
Other Requirements
• DevOps & CI/CD: Azure DevOps, GitHub Actions, Jenkins
• Experience in Data Lakehouse architectures and Delta Lake
• Knowledge of real-time data streaming (Event Hubs, Kafka)
Why HCLTech?
At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.
HCLTech is a global technology company, home to more than 226,300 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2025 totaled $14.5 billion.
Benefits
At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to:
Industry-benchmarked compensation
Best-in-class healthcare benefits
Personal time off
Maternity and paternity benefits
Access to skills / higher education programs/resources
Discounts on products and services via Benefit Box
Participate in CSR programs and live life with a purpose
Opportunities to grow and advance your career
Note: The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.
