Sr Software Development Engineer

Job Description

AWS AI is looking for world-class software developers to join the Deep Learning cross-framework team to develop solutions for supporting Large Language Model training in a cluster of nodes.

Requirements

• Bachelor's degree in computer science or equivalent
• 4+ years of non-internship professional software development experience
• 4+ years of programming with at least one software programming language experience
• 4+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team

Responsibilities

• Developing innovative solutions for supporting Large Language Model training in a cluster of nodes
• Implementing model parallelism methods as extensions to the PyTorch framework
• Implementing sharding of the model training state and other memory saving techniques
• Optimizing distributed training by profiling and addressing bottlenecks
• Optimizing communication collectives for the AWS network infrastructure

Benefits

• Medical, dental, and vision coverage (multiple plan options)
• Health savings and flexible spending accounts
• 24/7 Employee Assistance Program for mental health support
• 401(k) with company match and various investment choices
• Company-paid life/AD&D and disability insurance
• Restricted stock units (RSUs) for employee ownership
• Child care and elder care referrals, adoption assistance
• Paid maternity and parental leave (including Ramp Back)
• Paid time off (PTO) and company holidays
• Employee discount on Amazon.com products
• Career Choice program (95% tuition and textbook coverage)