Note: The job is a remote job and is open to candidates in USA. Booker DiMaio is seeking two Senior Databricks Data Engineers to support a federal Enterprise Data Platform modernization initiative. The role involves designing, developing, and optimizing cloud-native data solutions using Databricks and AWS services while collaborating with various stakeholders to deliver secure, production-ready solutions.

Responsibilities

• Design, develop, and maintain scalable data ingestion, transformation, and publishing pipelines utilizing Databricks and AWS services
• Implement and optimize Databricks Lakehouse capabilities including Unity Catalog, Delta Live Tables, Auto Loader, Databricks SQL, and Delta Sharing
• Build and maintain governed data products supporting operational, analytical, reporting, and machine learning workloads
• Develop and support medallion architecture data pipelines and enterprise data quality frameworks
• Implement data governance controls, metadata management, lineage tracking, and data retention policies
• Collaborate with cloud engineers, architects, cybersecurity specialists, and business stakeholders to deliver secure, production-ready solutions
• Optimize platform performance through partitioning, clustering, caching, workload tuning, and query optimization techniques
• Support analytics enablement through semantic layers, dashboards, reporting solutions, and self-service data access capabilities
• Participate in architecture reviews, operational readiness activities, platform modernization initiatives, and continuous improvement efforts
• Create and maintain technical documentation, design artifacts, operational procedures, and engineering standards

Skills

• Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related discipline
• Minimum eight (8) years of experience in cloud-based data engineering, platform development, or data architecture
• Minimum three (3) years of hands-on Databricks experience in production environments
• Experience designing, developing, and supporting large-scale ETL/ELT solutions
• Strong experience with AWS services including S3, IAM, Glue, Athena, Lambda, Redshift, and CloudWatch
• Experience implementing enterprise data governance and security controls
• Strong SQL and Python development skills
• Experience working with data lakes, data warehouses, and cloud-native analytics platforms
• Strong troubleshooting, performance tuning, and optimization experience
• Databricks Certified Data Engineer Associate or Professional certification
• AWS Data Analytics Specialty certification
• Experience supporting federal government or highly regulated environments
• Experience with real-time streaming, CDC solutions, and event-driven architectures
• Familiarity with FedRAMP, FISMA, and NIST security frameworks
• Experience supporting large-scale enterprise data platforms

Company Overview