OverviewThe Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team focuses on maximizing performance for AWS's custom ML accelerators by crafting high-performance kernels for ML functions at the hardware-software boundary. We combine deep hardware knowledge with ML expertise to push the boundaries of AI acceleration. The AWS Neuron SDK includes an ML compiler, runtime, and application framework that integrates with popular ML frameworks like PyTorch for optimized inference and training performance.As part of the broader Neuron Compiler organization, this role works across multiple technology layers—from frameworks and compilers to runtime and collectives—to optimize current performance and contribute to future architectures. You will work at the intersection of machine learning, high-performance computing, and distributed architectures to shape the future of AI acceleration technology. This is a unique opportunity to work on cutting-edge products, architect and implement business-critical features, publish research, and mentor a team of engineers while operating in an agile environment with close collaboration with customers for model enablement and performance optimization.Explore the product and our history at the following resources: AWS Neuron guide (https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/index.html), AWS Neuron page (https://aws.amazon.com/machine-learning/neuron/), AWS Neuron SDK on GitHub (https://github.com/aws/aws-neuron-sdk), and related industry content (https://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-success).Key job responsibilitiesOur kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize ML workloads for a global customer base. Working at the intersection of software, hardware, and ML systems, you will bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming modelsAnalyze and optimize kernel-level performance across multiple generations of Neuron hardwareConduct detailed performance analysis using profiling tools to identify and resolve bottlenecksImplement compiler optimizations such as fusion, sharding, tiling, and schedulingWork directly with customers to enable and optimize their ML models on AWS acceleratorsCollaborate across teams to develop innovative kernel optimization techniquesAbout the team1. Diverse Experiences: AWS values diverse experiences. Even if you do not meet all of the qualifications listed, we encourage you to apply. If your career is just starting or follows an unconventional path, don’t let it stop you from applying.2. Why AWS: AWS is the world’s most comprehensive and broadly adopted cloud platform. We pioneer cloud computing and continuously innovate to power customers from startups to Global 500 companies.3. Inclusive Team Culture: We embrace our differences and support a culture of inclusion with various employee-led affinity groups and learning opportunities. Our Leadership Principles guide interactions, curiosity, trust, and collaboration.4. Work/Life Balance: We value a healthy balance and offer flexible working hours.5. Mentorship & Career Growth: We support career development and knowledge sharing, assigning projects to help each member grow into more complex roles.Basic Qualifications- 5+ years of non-internship professional software development experience- 5+ years of programming with at least one software programming language- 5+ years of leading design or architecture of new and existing systems- 5+ years of full software development life cycle experience- Experience as a mentor, tech lead, or leading an engineering teamPreferred Qualifications- Bachelor’s degree in computer science or equivalent- 6+ years of full software development experience- Expertise in accelerator architectures for ML or HPC (GPUs, CPUs, FPGAs, or custom architectures)- Experience with GPU kernel optimization and GPGPU computing (CUDA, OpenCL, SYCL, ROCm, etc.)- Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA- Experience developing high-performance libraries for HPC applications- Proficiency in low-level performance optimization for GPUs- Experience with LLVM/MLIR backend development for GPUs- Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends- Experience with parallel programming and optimization techniques- Understanding of GPU memory hierarchies and optimization strategiesAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Los Angeles County applicants: job duties include working safely, communicating effectively, adhering to policies, and following laws. Criminal history may affect employment. We will consider qualified applicants with arrest and conviction records per applicable laws. For accommodations during the application process, visit https://amazon.jobs/content/en/how-we-hire/accommodations. If the country/region you’re applying in isn’t listed, contact your Recruiting Partner.Our compensation reflects the cost of labor across US markets. The base pay ranges from $151,300/year to $261,500/year, depending on location and experience. This position may offer equity, sign-on, and other compensation as part of a total package. For more information, visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.Posted: September 23, 2025 (Updated about 1 hour ago)Posted: September 22, 2025 (Updated about 3 hours ago)Posted: March 4, 2025 (Updated about 6 hours ago)Posted: September 22, 2025 (Updated about 6 hours ago)Posted: September 22, 2025 (Updated about 7 hours ago)Share this jobImportant FAQs for current Government employees. Before proceeding, please review the following FAQs: https://www.amazon.jobs/en/faqs#faqs-for-us-government-employeesAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
#J-18808-Ljbffr