Note: The job is a remote job and is open to candidates in USA. Quanata is on a mission to help ensure a better world through context-based insurance solutions. They are seeking a Senior Data Engineer to help deliver data science services and streaming data pipelines, focusing on developing data pipelines and maintaining data quality frameworks.

Responsibilities

• Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence
• Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making
• Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries
• Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference
• Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets
• Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments
• Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems
• Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists
• Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value

Skills

• Bachelor's degree or equivalent relevant experience
• 6-8 years of industry experience in data engineering or software engineering with a focus on data systems
• Strong proficiency in Python and SQL for data pipeline development and analysis
• Experience with AWS data platforms (Glue, S3, Athena, Lambda, Step Functions)
• Familiarity with Snowflake or similar cloud data platforms
• Familiarity with streaming technologies such as Kafka or Kinesis
• Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
• Proficiency in infrastructure-as-code tools like Terraform
• Understanding of data modeling principles
• Excellent written and verbal communication with a strong collaborative focus
• Experience with CI/CD tailored for machine learning systems (e.g., automating model training, validation, and deployment)
• Prior experience working within the insurance industry or another highly regulated environment, demonstrating an understanding of pertinent regulatory, security, and data governance challenges
• Familiarity with ML infrastructure and supporting data science teams in productionizing models
• Experience designing and building feature stores or real-time feature serving systems
• Exposure to data governance and cataloging tools (e.g., DataHub, Atlan, or similar)

Benefits

• Medical, dental, vision, life insurance and supplemental income plans for you and your dependents
• A Headspace app subscription
• Monthly wellness allowance
• A 401(k) Plan with a company match
• A one-time payment of $2K will be provided to cover the purchase of in-home office equipment and furniture at your discretion
• Teams work with MacBook Pros, which we will deliver to you fully provisioned prior to your first day
• All employees accrue four weeks of PTO in their first year of employment
• New parents receive twelve weeks of fully paid parental leave which may be taken within one year after the birth and/or adoption of a child. The twelve weeks is applicable to both birthing and non-birthing parent
• All employees receive up to $5000 each year for professional learning, continuing education and career development
• All team members also receive LinkedIn Learning subscriptions and access to multiple different coaching opportunities through BetterUp

Company Overview

Company H1B Sponsorship