Job Description
Note: The job is a remote job and is open to candidates in USA. VTekis Consulting LLP provides complete solutions for Staff Augmentation and Recruitment Process Outsourcing. They are seeking a Lead Data Engineer to design and optimize scalable data pipelines using Azure Databricks while integrating and processing MES data and supporting manufacturing analytics.
- Responsibilities
- Design, build, and optimize scalable data pipelines using Azure Databricks (PySpark, Spark SQL, Delta Lake)
- Integrate and process MES data, shop-floor data, IoT/sensor data, and ERP systems
- Architect modern data solutions supporting manufacturing analytics and operational reporting
- Lead data engineering best practices including performance tuning, optimization, and governance
- Work closely with manufacturing stakeholders to translate MES data requirements into scalable data models
- Ensure high data quality, reliability, and production-grade deployments
- Skills
- Strong hands-on expertise in Azure Databricks (Delta Lake, PySpark, Spark architecture)
- Proven experience in Manufacturing domain, especially working with MES systems and production data
- Experience building real-time or near-real-time data pipelines
- Strong SQL and data modeling skills
- Experience with cloud platforms (Azure preferred)
- Ability to function as both technical architect and hands-on developer
- Excellent communication skills and ability to work in PST time zone
- Experience with IoT data ingestion and streaming technologies
- Exposure to data warehousing and BI integration
- Experience leading small data engineering team
- Company Overview
- We provide Recruitment and Staffing services to many industries and domain through our innovative and customized solutions and passionate commitment to research. It was founded in 2020, and is headquartered in Alpharetta, Georgia, USA, with a workforce of 51-200 employees. Its website is https://vtekis.com.
- Company H1B Sponsorship
- VTekis Consulting LLC has a track record of offering H1B sponsorships, with 2 in 2025. Please note that this does not guarantee sponsorship for this specific role.
Apply tot his job
Apply To this Job