Software Engineer, Trainium Collectives Job at Annapurna Labs Inc., Cupertino, CA

  • Annapurna Labs Inc.
  • Cupertino, CA

Job Description

Salary: $165,200 - 223,600 per year Requirements:

  • We require 3 years of non-internship professional software development experience.
  • We require 2 years of non-internship experience in system design or architecture, including design patterns, reliability, and scaling for new and existing systems.
  • We require experience programming in at least one software language.
  • We prefer 3 years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • We prefer a bachelors degree in computer science or an equivalent qualification.
Responsibilities:
  • We will enhance collective algorithms and topologies to improve training efficiency.
  • We will use tools such as Neuron Explorer to diagnose compute and bus bandwidth bottlenecks.
  • We will monitor and analyze processor, DMA, firmware, and workload metrics.
  • We will optimize collective operations to scale AI compute across the data center through low-level device driver development.
  • We will collaborate closely with hardware teams to co-optimize software and Trainium silicon.
  • We will develop and refine C and C++ implementations of collective communication patterns.
  • We will investigate and implement improvements for training topologies used by modern large language models.
  • We will build and maintain analysis frameworks and automation solutions.
Technologies:
  • AI
  • AWS
  • EC2
  • Firmware
  • Hardware
  • Support
  • Machine Learning
  • Cloud

More:

We are Annapurna Labs, part of AWS, and we build hardware and software components for EC2 infrastructure. Our team develops networking solutions for machine learning and high-performance computing workloads on AWS. You will work in a mixed-discipline, international environment alongside infrastructure experts, hardware engineers, RTL engineers, scientists, and architects. We value mentorship, encourage continuous learning, support flexibility in working hours, and prioritize work-life balance. The team collaborates with principal-level engineers and directors, creating strong opportunities for career growth. We also offer comprehensive benefits, including health coverage, 401(k) matching, paid time off, parental leave, sign-on payments, and restricted stock units. The role is based in Cupertino, California, with an annual base salary range of 165,200 to 223,600 USD.

last updated 42 week of 2026

Job Tags

Full time

Similar Jobs

Hueman PE Talent Solutions

Director/VP of Finance Job at Hueman PE Talent Solutions

 ...A top client is hiring for a Vice President of Finance to work full-time in Salisbury, MA. As the VP of Finance, you will be a critical member of the executive leadership team, collaborating closely with senior management, the Board of Directors, and the private equity... 

Confidential

Help Desk Technician Job at Confidential

 ...enthusiastic and customer-focused IT Support Technician to provide both help desk and desktop support within a large enterprise environment....  ...users through a combination of phone-based troubleshooting and hands-on technical support, assisting with device deployments, Office... 

Mastercard

Associate Consultant, Launch Program 2027 - Warsaw, Poland Job at Mastercard

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, were helping build asustainableeconomy where everyone can prosper. We support a wide range of digital payments choices, making transactions...

AuraOne Human Data

Creative Writers Job at AuraOne Human Data

 ...Creative Writers is a remote review track for evaluating AI outputs across domain writing workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on... 

TubeScience

Remote Copywriter Job at TubeScience

[WANTED] Remote Copywriter - Bring the Words, We'll Bring the Data Location: Remote, U.S $18-40/h Full-Time About TubeScienceFounded in 2016, TubeScience is creative strategy and production company that builds high-performing video ads for direct-to-...