Job Description
Role: AWS Data Engineer
Location: Remote
Mail:
Role Summary:
The Data Engineer will build and maintain secure, scalable, and automated data pipelines to support the ingestion, transformation, and curation of data products. This role will focus on implementing CI/CD pipelines, automated testing, and monitoring solutions.
Key Responsibilities:
- Data Pipelines:
- Develop configuration-driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
- Automation:
- Implement CI/CD pipelines for automated build, test, and deployment of data products.
- Testing:
- Establish automated test frameworks for schema validation, data quality, and performance testing.
- Monitoring:
- Set up monitoring and observability dashboards for product-level metrics (CloudWatch, custom metrics).
- Collaboration:
- Work with data modelers and architects to ensure alignment with business requirements.
Required Skills:
- Programming:
- Proficiency in Python, SQL, and shell scripting.
- AWS Expertise:
- Hands-on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch).
- Automation:
- Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline).
- Data Integration:
- Strong knowledge of ETL/ELT processes and frameworks.
- Soft Skills:
- Strong problem-solving, collaboration, and communication skills.
- Qualifications:
- Bachelor s degree in computer science, Data Engineering, or related field.
- 10+ years of experience in data engineering and pipeline development.
- AWS Certified Data Analytics or AWS Certified Developer is a plus.
Apply Now
Apply Now