Our Client is Looking for a Developer – Big Data PySpark
Job Type: Permanent
Duration: Permanent
Work Mode: Office Only
Experience Required: 5 – 7 Years
Salary Range: ₹10,00,000 – ₹11,00,000
Role Overview
We are seeking an experienced Big Data Developer with expertise in PySpark, Python, Azure Cloud, and Big Data/Hadoop ecosystems. The role involves designing and implementing large-scale data engineering solutions, building robust pipelines, and automating cloud deployments. The ideal candidate will have strong cloud experience, especially with Microsoft Azure, and proven skills in infrastructure as code (IaC), DevOps, and data engineering.
Key Responsibilities
- Lead the implementation of infrastructure via code and provide strategic recommendations for Microsoft Azure technologies.
- Integrate and automate standardized Azure deployments using Azure DevOps, Terraform, and ARM templates.
- Act as an escalation point for Azure-related issues, providing technical support, troubleshooting, and mentoring to operational teams.
- Translate business requirements into scalable data engineering solutions.
- Develop and maintain detailed design, build, and deployment documentation with proper source control.
- Work closely with support teams to ensure reliability and performance of cloud and data platforms.
- Provide leadership in security hardening and testing of Azure-based systems.
- Stay updated on cloud industry trends and contribute to continuous improvement initiatives.
Key Competencies & Skills
- 5–7 years of experience in Big Data, PySpark, and Python.
- Hands-on experience with Azure Data Factory and Azure Cloud services.
- Strong knowledge of Hadoop ecosystems and data engineering frameworks.
- Proven expertise in Infrastructure as Code (Terraform, ARM templates).
- Solid DevOps experience with Azure DevOps or similar orchestration tools.
- Demonstrated knowledge of security hardening and testing in cloud environments.
- Strong documentation skills and adherence to best practices.
- Excellent communication and collaboration abilities.
- Flexibility to work outside standard hours, including weekends, when required.