DataBricks Platform Engineer

Title: DataBricks Platform EngineerLocation: RemoteDuration: 12+ MonthsDatabricks Platform Engineer IIThe Databricks Platform Engineer II contributes to expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross‑functional teams. They will contribute to our data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects.They engage throughout the entire lifecycle of a project—from data mapping, data pipelines, data modeling, and finally data consumption. They must be self‑directed and comfortable supporting the data needs of multiple teams, systems, and products. They will learn to optimize or even re‑design our company’s data architecture to support our next generation of products and data initiatives.They can take on smaller projects from start to finish, work on problems of moderate scope where analysis of situations or data requires a review of a variety of factors, and trace issues to their source. They develop solutions to a variety of problems of moderate scope and complexity.Primary SkillsData EngineeringDevOps AutomationCI/CDDatabricksAzure DevOpsPowerShellEtc.Duties & ResponsibilitiesBuild, maintain, and support Databricks compute and storageSolve simple to moderate application errors; resolve application problems and follow up promptly with customers and IT personnelReview and contribute to QA test plans and support the QA team during test executionParticipate in developing data transformation and data pipelinesEnsure change control and change management procedures are followed within the program/projectDevelop BI datasets, reports, and dashboards to support business and IT decision‑makingInterpret requirement documents and contribute to creating functional design documents as part of the data development lifecycleDocument all phases of work including gathering requirements, joining relationship diagrams, database diagrams, report layouts, and other technical specificationsRelate information from various sources to draw logical conclusionsConduct unit testing on ELT and report developmentConduct data lineage and impact analysis as part of the change management processConduct data analysis (SQL, Excel, Data Discovery, etc.) on legacy systems and new data sourcesContribute to documenting reporting requirements through engagement with business process SMEsCreate source‑to‑target data mappings for data pipelines and integration activitiesAssist in identifying the impact of proposed application development/enhancement projectsPerform data profiling and process analysis to understand key source systemsWork with business users to design, develop, test, and implement BI solutions in the Data & Analytics PlatformImplement and maintain data governance policies and procedures to ensure data quality, security, and complianceEnsure operational stability of a 24/7/365 grocery retail environment by providing technical support, system monitoring, and issue resolution (off‑hours, weekends, holidays as needed)QualificationsBachelor’s Degree in Computer Science or related technical field; equivalent training/certifications/experience will be considered3+ years of equivalent experience in a relevant job or technology3+ years of Databricks3+ years of Terraform

Apply Now