Job Description
Hi Sir, Please find the requirement below , If you find yourself comfortable with the requirement please reply with your updated resume and I will get back to you Position : Data Engineer Location : Remote Duration : 6-12 Months Interview : Phone and Skype W2 role Candidates from FAANG, Magnificent Seven, and MANGO will get priority. Followed by candidates that come from technology companies Job Description: Must haves: Azure Data Engineering Scala spark Job Description: Top 3 Must-Have Hard Skillsets • Big Data Platform Experience && Minimum 5 years Cosmos (MapReducer), Azure data stack (HDI, ADLS Gen2), Spark/Scala. 2. SQL + High-Level Programming Language && Minimum 5 years SQL queries plus experience in C#, Scala, Java, or Python (flexible, not a deal breaker). 3. CICD, Debugging && Troubleshooting — Minimum 5 years Strong debugging, monitoring, and engineering lifecycle skills. Typical Day Will work with one of the engineers and engineering manager && responsible for feature design, development, validation, CI/CD, bug fixes, troubleshooting && debugging issues Follow engineering practice and deployment rules, SAW device is needed Key Projects • Security work: fixing code security issues, updating identities/secrets, ensuring secure endpoints. • Governance: data partitioning, physical access restrictions, compliance related updates. • Feature innovation && continuous platform enhancements. • Maintaining && improving pipelines across Cosmos (MapReducer) and Azure data platforms (HDI, ADLS Gen2, Spark). Typical Task Breakdown && Operating Rhythm • 15–20% security-related fixes (code vulnerabilities, endpoint issues, secret rotation). • Governance && compliance work (data partitioning, access control). • Writing, modifying, && debugging code and services. • CICD, monitoring, && standard engineering lifecycle practices. • Mostly heads down execution work, following a task list && completing high priority deliverables quickly. • Collaborating with FTEs who && will help onboard and accelerate ramp up. • Using SAW device access for AME domain work (pre prod/prod as allowed). Ideal Background Distributed system design && implementation, BIG DATA platforms knowledge, CI/CD processes, debugging && troubleshooting skills Disqualifiers • Long ramp up timeline or lack of experience && large scale data platforms. • No experience && high reliability data engineering environments. • Inability to work independently && heavy execution demands. • Lack && any programming language + SQL exposure (manager expects at least a foundational high level language). Best vs. Average Candidate • Best: Has 5–7 yrs && large scale data engineering (Cosmos, Azure, Spark). o Strong SQL + one high level language (C#, Scala, Java, Python). o Prior Microsoft experience (S360, security expectations, internal processes). o Very fast ramp up && can immediately execute tasks independently. Thanks, Neeraj It Resource Manager Pioneer IT Systems Email: Mobile : Apply tot his job