Note: The job is a remote job and is open to candidates in USA. Agile Resources, Inc. is partnering with an industry leader in the construction supplies and equipment space to find a Sr. Data Engineer to spearhead the evolution of their global, next-generation data ecosystem. In this role, you will act as the architect behind a mission-critical platform, transforming raw datasets into powerful, secure, and production-ready intelligence that fuels executive-level decisions.

Responsibilities

• Architect and optimize high-throughput, distributed computing frameworks and modern Lakehouse structures to handle massive data velocity and volume
• Construct robust, production-grade features and pipelines that seamlessly operationalize large language models (LLMs) and predictive machine learning models
• Build automated ingestion frameworks across multi-cloud environments, utilizing both real-time streaming and scheduled batch processing
• Establish solid data quality, unified cataloging, and access controls while aggressively optimizing cluster performance and cloud infrastructure costs
• Collaborate with cross-functional leadership, finance, and operations teams to convert complex strategic goals into highly scalable technical solutions

Skills

• Applicants must be legally authorized to work in the United States on a full-time basis
• 7+ years of sophisticated data engineering experience, highlighted by mastery-level knowledge of Spark tuning, partitioning, and cloud infrastructure
• Extensive hands-on experience designing secure, ACID-compliant storage layers, ideally utilizing modern unified cataloging tools
• Expertise in Python and SQL, coupled with practical experience supporting ML lifecycle management (such as tracking, feature stores, or LLM integrations)
• A proven track record of integrating disparate, complex data sources and maintaining high-availability production environments at enterprise-scale
• Familiarity with event-driven architectures (like Kafka)
• Continuous integration/continuous deployment (CI/CD) pipelines
• Infrastructure-as-code

Benefits

• Medical
• Dental
• Vision

Company Overview