Job ID: 2933964 | Amazon Web Services, Inc. - A97 Doyou want to be part of AI revolution? At AWS our vision is to makedeep learning pervasive for everyday developers and to democratizeaccess to AI hardware and software infrastructure. In order todeliver on that vision, we’ve created innovative software andhardware solutions that make it possible. AWS Neuron is the SDKthat optimizes the performance of complex ML models executed on AWSInferentia and Trainium, our custom chips designed to acceleratedeep-learning workloads. This role is for a software engineer inthe Compiler team for AWS Neuron. As part of this role, you will beresponsible for building next generation Neuron compiler whichtransforms ML models written in ML frameworks (e.g, PyTorch,TensorFlow, and JAX) to be deployed AWS Inferentia and Trainiumbased servers in the Amazon cloud. You will be responsible forsolving hard compiler optimization problems to achieve optimumperformance for variety of ML model families including massivescale large language models like Llama, Deepseek, and beyond aswell as stable diffusion, vision transformers and multi-modelmodels. You will be required to understand how these models workinside-out to make informed decisions on how to best coax thecompiler to generate optimal implementation instruction. You willleverage your technical communications skill to partner withinternal and external customers/stakeholders and will be involvedin pre-silicon design, bringing new products/features to market,ultimately, making Neuron compiler highly performant andeasy-to-use. Experience in object-oriented languages like C++/Javais a must, experience with compilers or building ML models using MLframeworks on accelerators (e.g., GPUs) is preferred but notrequired. Experience with technologies like OpenXLA, StableHLO,MLIR will be added bonus! Explore the product and our history!https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-cc/indexhtmlhttps://www.amazon.science/how-silicon-innovation-became-the-secret-sauce-behind-awss-successAWS Utility Computing (UC) provides product innovations — fromfoundational services such as Amazon’s Simple Storage Service (S3)and Amazon Elastic Compute Cloud (EC2), to consistently releasednew product innovations that continue to set AWS’s services andfeatures apart in the industry. As a member of the UC organization,you’ll support the development and management of Compute, Database,Storage, Internet of Things (Iot), Platform, and Productivity Appsservices in AWS, including support for customers who requirespecialized security solutions for their cloud services. Key jobresponsibilities You will design, implement, test, deploy andmaintain innovative software solutions to transform Neuroncompiler’s performance, stability and user-interface. You will workside by side with chip architects, runtime/OS engineers, scientistsand ML Apps teams to seamlessly deploy state of the art ML modelsfrom our customers on AWS accelerators with optimalcost/performance benefits. You will have opportunity to work withopen-source software (e.g., StableHLO, OpenXLA, MLIR) to pioneeroptimizing advanced ML workloads on AWS software and hardware. Youwill also work on building innovative features that will deliverbest possible experiences for our customers – developers across theglobe. A day in the life As you design and code solutions to helpour team drive efficiencies in compiler architecture, you’ll createcompiler optimization and verification passes, build featuressurface features and peculiarities of AWS accelerators todevelopers, implement tools to analyze numerical errors, andresolve the root cause of compiler defects. You’ll also participatein design discussions, code review, and communicate with internal(other Neuron SDK and Amazon wide teams) and external stakeholders(open-source communities). Lastly, work in a startup-likedevelopment environment, where you’re always working on the mostimportant stuff. About the team About the Team Our team isdedicated to supporting new members. We have a broad mix ofexperience levels and tenures, and we’re building an environmentthat celebrates knowledge-sharing and mentorship. Our seniormembers enjoy one-on-one mentoring and thorough, but kind, codereviews. We care about your career growth and strive to assignprojects that help our team members develop your engineeringexpertise so you feel empowered to take on more complex tasks inthe future. Diverse Experiences AWS values diverse experiences.Even if you do not meet all of the qualifications and skills listedin the job description, we encourage candidates to apply. If yourcareer is just starting, hasn’t followed a traditional path, orincludes alternative experiences, don’t let it stop you fromapplying. About AWS Amazon Web Services (AWS) is the world’s mostcomprehensive and broadly adopted cloud platform. We pioneeredcloud computing and never stopped innovating — that’s why customersfrom the most successful startups to Global 500 companies trust ourrobust suite of products and services to power their businesses.Inclusive Team Culture Here at AWS, it’s in our nature to learn andbe curious. Our employee-led affinity groups foster a culture ofinclusion that empower us to be proud of our differences. Ongoingevents and learning experiences, including our Conversations onRace and Ethnicity (CORE) and AmazeCon (gender diversity)conferences, inspire us to never stop embracing our uniqueness.Work/Life Balance We value work-life harmony. Achieving success atwork should never come at the expense of sacrifices at home, whichis why we strive for flexibility as part of our working culture.When we feel supported in the workplace and at home, there’snothing we can’t achieve in the cloud. Mentorship & CareerGrowth We’re continuously raising our performance bar as we striveto become Earth’s Best Employer. That’s why you’ll find endlessknowledge-sharing, mentorship and other career-advancing resourceshere to help you develop into a better-rounded professional. BASICQUALIFICATIONS - 3+ years of non-internship professional softwaredevelopment experience - 2+ years of non-internship design orarchitecture (design patterns, reliability and scaling) of new andexisting systems experience - Experience programming with at leastone software programming language PREFERRED QUALIFICATIONS -Master's degree or PhD in Computer Science, or a related technicalfield. - 3+ years of experience writing production grade code inobject-oriented languages such as C++/Java. - Experience incompiler design for CPU/GPU/Vector engines/ML-accelerators. -Experience with OpenSource compiler toolset like LLVM/MLIR. -Experience with the following technologies: PyTorch, OpenXLA,StableHLO, JAX, TVM, deep learning models, and algorithms. -Experience with modern build systems like Bazel/CMake. Amazon is anequal opportunity employer and does not discriminate on the basisof protected veteran status, disability, or other legally protectedstatus. Los Angeles County applicants: Job duties for this positioninclude: work safely and cooperatively with other employees,supervisors, and staff; adhere to standards of excellence despitestressful conditions; communicate effectively and respectfully withemployees, supervisors, and staff to ensure exceptional customerservice; and follow all federal, state, and local laws and Companypolicies. Criminal history may have a direct, adverse, and negativerelationship with some of the material job duties of this position.These include the duties and responsibilities listed above, as wellas the abilities to adhere to company policies, exercise soundjudgment, effectively manage stress and work safely andrespectfully with others, exhibit trustworthiness andprofessionalism, and safeguard business operations and theCompany’s reputation. Pursuant to the Los Angeles County FairChance Ordinance, we will consider for employment qualifiedapplicants with arrest and conviction records. Our inclusiveculture empowers Amazonians to deliver the best results for ourcustomers. If you have a disability and need a workplaceaccommodation or adjustment during the application and hiringprocess, including support for the interview or onboarding process,please visithttps://amazon.jobs/content/en/how-we-hire/accommodations for moreinformation. If the country/region you’re applying in isn’t listed,please contact your Recruiting Partner. Our compensation reflectsthe cost of labor across several US geographic markets. The basepay for this position ranges from $129,300/year in our lowestgeographic market up to $223,600/year in our highest geographicmarket. Pay is based on a number of factors including marketlocation and may vary depending on job-related knowledge, skills,and experience. Amazon is a total compensation company. Dependenton the position offered, equity, sign-on payments, and other formsof compensation may be provided as part of a total compensationpackage, in addition to a full range of medical, financial, and/orother benefits. For more information, please visithttps://www.aboutamazon.com/workplace/employee-benefits . Thisposition will remain posted until filled. Applicants should applyvia our internal or external career site. Important FAQs forcurrent Government employees Before proceeding, please review thefollowing FAQshttps://www.amazon.jobs/en/faqs#faqs-for-us-government-employeesAmazon is an equal opportunity employer and does not discriminateon the basis of protected veteran status, disability, or otherlegally protected status. #J-18808-Ljbffr
