Databricks Expert-Developer
US-DC-Washington, D.C.
Careers (External)
Req #: 6264
Type: Full-Time
|
|
|||||||||||
|
||||||||||||
Overview: GovCIO is currently hiring for Databricks Expert/Developer to support our client's contract needs. This position is located in the Washington, DC area and will be a hybrid remote position Responsibilities: * Demonstrate hands on experience with Databricks * Work in bid data frameworks like, Apache Spark, Delta Lake, and structured streaming * Developer ETL /ELT pipelines, data lakehouse architecture, and data modeling * Program using Python and SQL, and possibly Scala, and Java * Integrate with external data sources, Api's and on-prem databases * Demonstrate data governance, security , and performance optimization in Databricks * Mentor junior developers and foster a strong engineering culture Qualifications: Bachelor's with 6 - 8 years (or commensurate experience) Required Skills and Experience * Experience with machine learning workflows using MLflow or AutoML. * Exposure to BI tools (e.g., Oracle BI EE, Tableau) and data catalog tools (e.g., Purview, Alation). * Migration of reports from OBIEE/Tableau into Databricks * Knowledge of cost optimization and governance strategies in cloud environments. * Strong experience in Databricks (including both SQL and PySpark notebooks, Jobs, Workflows, Delta Lake, MLflow). * Proficiency in big data frameworks like Apache Spark, Delta Lake, and structured streaming. * Hands-on experience with cloud platforms - preferably Azure Databricks, but AWS or GCP is also valued. * Deep understanding of ETL/ELT pipelines, data lakehouse architecture, and data modeling. * Strong programming experience in Python, SQL, and optionally Scala or Java. * Solid understanding of DevOps/CI-CD practices for Databricks using tools like Databricks Repos, Terraform, Git, and Azure DevOps. * Experience integrating with external data sources, APIs, and on-prem databases. * Ability to design end-to-end data pipelines and lakehouse architecture using Databricks. * Strong knowledge of data governance, security, and performance optimization in Databricks. * Familiarity with Unity Catalog, RBAC, and cluster policies. * Experience in mentoring junior developers and fostering a strong engineering culture. Clearance Required: Able to acquire and maintain federal Public Trust Preferred Skills and Experience * Experience with machine learning workflows using MLflow or AutoML. * Exposure to BI tools (e.g., Oracle BI EE, Tableau) and data catalog tools (e.g., Purview, Alation). * Migration of reports from OBIEE/Tableau into Databricks * Knowledge of cost optimization and governance strategies in cloud environments.
Share this job:
