AIML - Data Scientist, Evaluation
Do you get excited by driving product impact via measurement and evaluation, for products and services used by hundreds of millions of people globally? The vision for the Data and Machine Learning Innovation organization is to advance machine learning across Apple to enrich lives. Within this organization the mission of the Search Analytics team is to guild product development, decisions and directions through principled evaluation and rigorous use of data. You will partner with Apple Foundation Model engineering teams to improve quality and guide feature development with data, to deliver amazing experiences across platforms and dozens of languages. Description Advance the performance of Apple Intelligence Large Language Models, across Apple platforms, languages, and modalities. Advise the data training and product roadmap, for both Foundation Models and feature Adapter Models. Design detailed evaluation methodologies in close partnership with engineering and product teams to support critical go/no-go decisions. Develop and evangelize robust metrics for hillclimbing. Prototype impactful analysis and productionalize novel pipelines. Regularly present to partner teams and executive sponsors, both at a technical and high level.
Minimum Qualifications
Bachelors degree and 5 years of work experience in Data Science, Machine Learning, or Analytics. Expertise in evaluation, either Human Evaluation, A/B Testing, UX Studies, Automated Testing, or similar. Strong intuition for metrics, including their strengths and shortcomings. A track record of positive impact on shipped products.
Preferred Qualifications
Experience with LLMs, especially as it related to evaluation and data. Strong communication skills and experience persuading both technical audiences and high level executive audiences. Passion for Apple products. Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant . Apply Job! Apply to this Job