Note: The job is a remote job and is open to candidates in USA. Alpine Solutions Group is a large international consulting firm seeking a Senior Data Engineer to support their health insurance client. The role involves designing, building, and operating real-time data infrastructure while ensuring data quality and integration for AI initiatives.

Responsibilities

• Design and support real-time data streaming solutions using Kafka and Confluent technologies, ensuring scalable and reliable data processing across enterprise platforms
• Manage Kafka infrastructure on Kubernetes, including performance tuning, monitoring, capacity planning, and production support
• Develop Python-based data pipelines and streaming applications that enable efficient data ingestion, transformation, and delivery
• Integrate data platforms across Google Cloud and Microsoft Azure environments to support analytics and business operations
• Maintain data quality, schema governance, and service-level objectives for both streaming and batch workloads
• Collaborate with DevOps teams to automate deployments and infrastructure management through CI/CD pipelines and infrastructure-as-code practices
• Implement monitoring, alerting, and observability solutions to improve platform reliability and operational visibility
• Partner with stakeholders to define data contracts, manage schema evolution, and ensure seamless integration with downstream applications and services

Skills

• 6+ years in data engineering roles + has been a tech lead before
• Very strong hands on experience with data bricks
• Expert with data pipeline development
• Strong Python (idiomatic, tested, production-grade)
• Hands-on Confluent Kafka — producers, consumers, Connect, Schema Registry
• Kubernetes experience (deployments, namespaces, resource management)
• Solid SQL and experience with columnar/analytical stores (BigQuery, Synapse)
• Comfort operating in multi-cloud environments (GCP + Azure)
• Understanding of data stream processing concepts (offsets, partitions, exactly-once semantics), constant movement of data
• Has done data integration work
• Strong with CDC- change data capture, concept, tools that support that (how you handle data integration into databricks)
• Someone who has an interest in being Ai driven, large amounts of data streaming between systems
• Very good communication + can speak with clients
• Insurance/healthcare insurance background

Company Overview