Job Description
This a Full Remote job, the offer is available from: United States
Position: Databricks Devops Engineer
Location: Remote
Duration: long term
Rate: DOE
U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time
- Requirements:
- Experience handling data engineering projects involving batch and streaming ingestion.
- Proficiency in managing both structured and unstructured data.
- Strong background in SQL development and data modeling.
- Expertise in PySpark and Python.
- Knowledge and experience with Azure Data Factory, Azure Databricks, and Azure Storage.
- Familiarity with healthcare data and the healthcare domain.
- Proficient in CI/CD, DevOps practices, and productionizing data pipelines.
- Experience with testing automation, ideally using Pytest or similar frameworks.
- Responsibilities:
- Oversee and manage data engineering projects for both batch and streaming ingestion.
- Develop, model, and manage SQL databases.
- Implement and maintain data pipelines using Azure tools and Python.
- Ensure data solutions align with healthcare standards and requirements.
- Establish and maintain CI/CD pipelines and DevOps practices for production-grade solutions.
- Automate testing processes within data pipelines.
This offer from "Georgia IT, Inc." has been enriched by Jobgether.com and got a 72% flex score.
Apply tot his job
Apply To this Job