All roles

Open role

[Remote] Senior Data Engineer – AI-Driven Data Pipeline Automation

Remote · Sri Lanka Full-time

Note: The job is a remote job and is open to candidates in USA. Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. In this role, you will design, build, and optimize scalable data pipelines and infrastructure to power advanced analytic solutions, collaborating closely with software engineers and business stakeholders to ensure robust and secure data flows.

Responsibilities

  • Design, build, and maintain scalable data pipelines and ETL processes to support machine learning and AI initiatives on Google Cloud Platform (GCP)
  • Implement and optimize data storage solutions using GCP services such as BigQuery, Cloud Storage, and Dataflow
  • Ensure data quality, integrity, and security throughout the data lifecycle
  • Collaborate with analysts and business stakeholders to understand data requirements and deliver actionable insights
  • Monitor, troubleshoot, and maintain the health and performance of cloud-based data infrastructure
  • Automate manual processes and repetitive tasks to improve efficiency and reduce errors
  • Apply data governance and compliance best practices to protect sensitive information and meet regulatory standards
  • Stay current with new GCP features, tools, and best practices to continuously enhance data management capabilities
  • Document solutions, processes, and architectural decisions to facilitate knowledge sharing and maintainability

Skills

  • BS or MS in Computer Science or a related major, or equivalent experience
  • 7+ years of software engineering experience, with a strong emphasis on system design and backend development
  • 2+ years hands-on experience with Google Cloud Platform ecosystem (BigQuery, Dataproc, Composer, Dataflow, Data Catalog, Observability) or AWS equivalent
  • Proven ability to design, build, and maintain data pipelines that support machine learning and AI model development, training, and deployment
  • Fluency with at least one object-oriented programming language from Java, Python, or Scala is highly desirable, as these skills are critical for developing robust applications and managing data workflows effectively
  • SQL proficiency is also valued for database operations
  • Familiarity with data security, compliance, and governance best practices
  • Strong problem-solving skills, attention to detail, and ability to work collaboratively with cross-functional teams
  • Excellent communication skills and ability to tell insightful stories using data and also manage communication within internal teams and stakeholders
  • Exposure to AI-assisted development tools such as Claude, GitHub Copilot, Cursor, or similar is highly desirable
  • Experience with Google Analytics 360 is a plus

Benefits

  • Incentive compensation opportunities in the form of discretionary annual bonus or commissions
  • Healthcare
  • A great 401k
  • Backup childcare
  • Education stipends

Company Overview

  • Yahoo is a technology and media company that serves users through its portfolio of digital platforms, products, and services. It is a sub-organization of Verizon Media. It was founded in 1994, and is headquartered in Sunnyvale, California, USA, with a workforce of 5001-10000 employees. Its website is http://www.yahoo.com.
  • Company H1B Sponsorship

  • Yahoo has a track record of offering H1B sponsorships, with 197 in 2023, 646 in 2022, 381 in 2021, 463 in 2020. Please note that this does not guarantee sponsorship for this specific role.
  • More open positions

    [Remote] Lead Product Manager - Services Experience (Remote - United States)

    Work from home Full-time role

    [Remote] Senior / Lead / Principal Software Engineer - Foundations Team (Infrastructure/Platform)

    Work from home Full-time role

    [Remote] Lead Sales Enterprise Account Executive - Strategic Expansion

    Work from home Full-time role

    [Remote] Lead Sales Enterprise Account Executive - Strategic Expansion

    Work from home Full-time role

    [Remote] Lead Sales Enterprise Account Executive - Strategic Expansion

    Work from home Full-time role

    HUBZone Qualified Candidates – Part-Time Technical Writer

    Work from home Full-time role

    Video Evaluator (AI Content)

    Work from home Full-time role

    Experienced Data Entry Specialist – Entry Level, Fully Remote Opportunity at careerzynith

    Work from home Full-time role

    Project Manager, Supply Chain Services

    Work from home Full-time role

    [Remote] Content & Growth systems strategist

    Work from home Full-time role

    Bilingual Psychiatric Advanced Practice Provider- Oregon, Remote

    Work from home Full-time role

    Experienced Remote Customer Experience Travel Agent – Text, Email, or Chat

    Work from home Full-time role

    Experienced Data Entry Specialist – Remote Part-Time Opportunity at careerzynith

    Work from home Full-time role

    Experienced Full Stack Data Scientist III – Customer Technology and Data-Driven Insights

    Work from home Full-time role

    Lead Animal Care Tech

    Work from home Full-time role

    AT, SLO, CRO Sales Manager m/f/d Flavours and Food Ingredients Distribution

    Work from home Full-time role

    Supply Chain & Quality Manager - Cockpit & Avionics equipment (Atlanta or Washington D.C.)

    Work from home Full-time role

    Remote Call Center Customer Service Representative – Healthcare Support & Patient Communication Specialist

    Work from home Full-time role

    Remote West Coast College Counselor— Univ Admissions

    Work from home Full-time role

    Lead Software Developer

    Work from home Full-time role

    Telehealth Occupational Therapist - Visit Based Earning - SC and NC

    Work from home Full-time role