Job Details

Weekly Hours: 40

Role Number: 200651443-3337

Summary

Are you passionate about building scalable and reliable big data pipelines for modern search engines? Join the Apple Services Engineering AI/ML Search Platform team! We build the common infrastructure that powers search and recommendations across Apple Media products, including the App Store, Music, TV, Podcasts, Books, and Fitness+.

As part of our team, you will enhance thousands of compute and big data pipelines to deliver greater scalability, reliability, and efficiency. By leveraging innovative approaches with machine learning and large language models, you will improve pipeline quality, optimize Spark and Kubernetes resource utilization, and create automation that accelerates developer agility.

Description

Develop automation and LLM-based agents to automatically increase testing coverage for data pipelines in a monorepo environment.
Develop automation and LLM-based agents to optimize Spark job resource utilization, including both CPU and memory efficiency.
Develop LLM-powered agents to automatically diagnose failures in large-scale data pipelines.
Build tools and automation to accelerate engineer productivity across development, testing, and production deployment of new pipelines.
Design and maintain dashboards to improve observability of pipeline execution and verification.
Deliver cost-efficient solutions for storage and compute platform migrations through automation and advanced machine learning techniques.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field.

• 3+ years of experience with large-scale data processing and pipelines.

• Proficiency in Scala, Python, and scripting languages.

• Experience in and solid understanding of distributed systems, performance tuning, and resource optimization.

• Strong hands-on expertise with Apache Spark and the Hadoop ecosystem.

Preferred Qualifications

• Experience developing or applying machine learning techniques or LLM-based agentic workflows for data pipeline optimization and data quality improvements.

• Knowledge of cost optimization strategies for big data infrastructure.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .