Job Description
Databricks Platform Engineer
Remote (Candidates must reside in the Atlanta, GA area for occasional onsite meetings)
Job Summary
STAFFXPERT LLC is seeking a Databricks Platform Engineer on behalf of our client in Atlanta, GA. This role is responsible for designing, implementing, and maintaining a scalable Databricks platform within a cloud-native environment. The ideal candidate will work closely with cross-functional teams—including data engineers, data scientists, and business stakeholders—to deliver secure, reliable, and high-performing analytics and machine learning solutions.
This position focuses on optimizing Databricks workspaces, implementing governance frameworks, and enabling efficient data and ML workflows across the platform.
- Key Responsibilities
- Administer and manage Databricks accounts and workspaces, ensuring strong governance, security, and compliance.
- Design and implement automation solutions for workspace configuration and platform administration.
- Build and maintain data pipelines using Databricks tools such as Autoloader, Delta Live Tables, and Workflows.
- Implement and support MLOps practices, including model lifecycle management using MLflow, Model Registry, and serving endpoints.
- Monitor and optimize platform performance, reliability, and cost efficiency.
- Collaborate with cross-functional teams to translate business requirements into scalable data and ML solutions.
- Provide technical leadership and mentorship on Databricks best practices and platform capabilities.
- Ensure the platform supports secure, scalable, and high-performance data and machine learning workloads.
- Stay updated with emerging features and advancements in Databricks, AI/ML, and cloud technologies.
- Required Qualifications
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- 5+ years of experience with Databricks platform administration, including account and workspace management.
- Hands-on experience with Databricks data pipeline development using Autoloader, Delta Live Tables, and Workflows.
- Experience implementing MLOps frameworks using MLflow, Model Registry, and model serving endpoints.
- Experience working with large-scale distributed data environments across major cloud platforms such as Azure, AWS, or GCP.
- Familiarity with Databricks SQL tools, including queries and dashboards.
- Knowledge of enterprise data governance and security practices, including Unity Catalog architecture.
- Experience working with Azure services such as Entra ID, Data Factory, Key Vault, or similar cloud services.
- Strong communication skills with the ability to explain technical concepts to both technical and non-technical stakeholders.
- Ability to attend occasional onsite meetings in the Atlanta, GA area.
- Preferred Qualifications
- Experience with Azure networking concepts, including VNet injection.
- Relevant Databricks or cloud platform certifications.
- Microsoft Azure administration or cloud infrastructure certifications.
- Master’s degree in a related field.
Apply tot his job
Apply To this Job