Job Description
Note:
The job is a remote job and is open to candidates in USA. Dice is the leading career destination for tech experts at every stage of their careers. They are seeking a Cloud Data Engineer to develop and implement data engineering solutions using AWS cloud technologies while collaborating with stakeholders to meet business requirements. Responsibilities • Collaborate with stakeholders to understand business requirements and convert them into actionable solution components aligned with Enterprise Solution architecture patterns, procedures, and policies • Design and develop scalable, resilient data service components and engineering solutions using cloud-native services and technologies • Develop data lakes and CDC services to create cohesive applications within cloud and hybrid infrastructures • Create comprehensive solution documentation detailing the design, testing, and production support processes and procedures • Set up and maintain continuous integration and continuous deployment (bolthires/CD) pipelines to automate updates and feature deployments • Design and develop cloud-native micro frontend applications and data service APIs using AWS, React, and NodeJS • Build data quality monitoring dashboards and tools to support data stewardship and policy compliance • Implement data classification and retention logic using metadata tagging, lifecycle policies, and automation • Develop secure user portals with role-based access control (RBAC), Single Sign-On (SSO), and integration with AWS Cognito • Enable workflow automation for data intake, validation, approval, and archival processes • Create and maintain solution documentation, including architecture diagrams, data flow, testing, and support procedures • Ensure solution completeness through thorough testing and quality assurance processes, ensuring compliance with security policies and best practices • Manage configuration drift and ensure consistency across different environments, using tools like AWS Code Build/Deploy and AWS CloudFormation • Apply DevOps principles to streamline the software development lifecycle (SDLC) and enhance automation • Deploy solutions to various environments, establish monitoring processes, and ensure ongoing operational stability and application resiliency through system stress testing and feature enhancements • Collaborate with cross-functional teams to understand change requirements, provide technical expertise, and ensure solutions align with business needs Skills • Intermediate, Proficient in AWS Data Engineering, works with limited or no guidance • Technical proficiency in AWS cloud development with Data engineering & full stack skills including glue, bolthires, RDS, Snowflake Integrations, ELT&ETLs, lambda, API Gateway, node js, react js, python etc • Adherence to software engineering best practices • Appreciation to data management principle and alignment with the agency's technical direction & data policies • Collaboration with stakeholders to understand business requirements and convert them into actionable solution components aligned with Enterprise Solution architecture patterns, procedures, and policies • Design and develop scalable, resilient data service components and engineering solutions using cloud-native services and technologies • Develop data lakes and CDC services to create cohesive applications within cloud and hybrid infrastructures • Create comprehensive solution documentation detailing the design, testing, and production support processes and procedures • Set up and maintain continuous integration and continuous deployment (bolthires/CD) pipelines to automate updates and feature deployments • Design and develop cloud-native micro frontend applications and data service APIs using AWS, React, and NodeJS • Build data quality monitoring dashboards and tools to support data stewardship and policy compliance • Implement data classification and retention logic using metadata tagging, lifecycle policies, and automation • Develop secure user portals with role-based access control (RBAC), Single Sign-On (SSO), and integration with AWS Cognito • Enable workflow automation for data intake, validation, approval, and archival processes • Create and maintain solution documentation, including architecture diagrams, data flow, testing, and support procedures • Ensure solution completeness through thorough testing and quality assurance processes, ensuring compliance with security policies and best practices • Manage configuration drift and ensure consistency across different environments, using tools like AWS Code Build/Deploy and AWS CloudFormation • Apply DevOps principles to streamline the software development lifecycle (SDLC) and enhance automation • Deploy solutions to various environments, establish monitoring processes, and ensure ongoing operational stability and application resiliency through system stress testing and feature enhancements • Collaborate with cross-functional teams to understand change requirements, provide technical expertise, and ensure solutions align with business needs • Expertise in developing AWS full stack applications: Translate business requirements into fully tested applications workflows by designing, implementing, and maintaining technology assets using approved tools and plugins for AWS for python • Proficiency in data services orchestration: Strong proficiency in cloud platforms, leveraging native cloud services data orchestration solution • API Development: Expertise in designing, developing, and maintaining APIs specifically tailored for cloud environments including AWS API Gateway • Cloud Networking and Security: Understanding of cloud networking concepts including VPCs, subnets, security groups and cloud security best practices, including identity and access management (IAM) • Serverless Computing: Experience with serverless computing concepts, event-driven architecture, and serverless platforms • Infrastructure as Code (IaC): Automate the provisioning and management of cloud infrastructure using tools like AWS CloudFormation and Terraform • Scripting and Automation: Ability to write scripts and automate tasks using scripting languages including NodeJS and Python • Experience with data quality frameworks, data validation, and anomaly detection • Familiarity with data classification models, metadata management, and retention policies • Monitoring and Logging: Experience in setting up alerts, dashboards, and logs for cloud infrastructure and applications • DevOps Practices: Strong understanding of DevOps practices, including developing and optimizing bolthires/CD pipelines, version control, and collaboration tools including AWS CodePipeline and Github • End-User Training and Support: Provide support and training to end-users for improved solution literacy and tool usage in a cloud ecosystem • Business Process Automation: Analyze business process life cycles to identify opportunities for automation and simplification, implementing appropriate solutions • Collaboration and Communication: Collaborate with product and business owners to deliver robust cloud-based solutions, demonstrating excellent communication skills (both written and verbal) • Compliance: Adhere to all policies and procedures of the Agency • AWS Data Engineer Associate and Solution architect
Professional Certification is desired • Familiarity with data governance frameworks such as DAMA-DMBOK or NIST Data Management Company Overview • Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.
It was founded in undefined, and is headquartered in, with a workforce of 0-1 employees. Its website is Apply tot his job