Sr. AI/LLM Infrastructure SW Engineer

About NIO

NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO's mission is to shape a joyful lifestyle. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.

NIO designs, develops, jointly manufactures and sells premium smart electric vehicles, driving innovations in next-generation technologies in autonomous driving, digital technologies, electric powertrains and batteries. NIO differentiates itself through its continuous technological breakthroughs and innovations, such as its industry-leading battery swapping technologies, Battery as a Service, or BaaS, as well as its proprietary autonomous driving technologies and Autonomous Driving as a Service, or ADaaS.

NIO's product portfolio consists of the ES8, a six-seater smart electric flagship SUV, the ES7 (or the EL7), a mid-large five-seater smart electric SUV, the ES6, a five-seater all-round smart electric SUV, the EC7, a five-seater smart electric flagship coupe SUV, the EC6, a five-seater smart electric coupe SUV, the ET7, a smart electric flagship sedan, and the ET5, a mid-size smart electric sedan.

Roles and Responsibilities:

• Architect technical solutions that help us deliver AIOS foundation capability in SkyOS across ECU domains.
• Lead the proof-of-concept development to evaluate the architectural designs in terms of functionality, performance, security, and dependability.
• Partner with engineering teams to understand real-world constraints and to support the high-quality implementation of AIOS designs for product development, validation and integration.
• Define the evolution roadmap for AIOS solutions.
• Define and deliver requirements for development team.
• Follow industry trends and study competitors' technical stacks.

Must Qualifications:

• 2+ years of experience in software design and development for AI model training, and/or inference optimization, and deployment.
• Familiar with LLM and VLM and optimization on resource constrained edge devices for inferences.
• In-depth knowledge and hands-on experience in the latest AI model architectures used in the industry and research areas, e.g. Transformer.
• Solid experience in GPU/NPU architectures and toolchains, AI training frameworks such as PyTorch / TensorFlow / etc.
• 3+ years development experience of building complex software systems.
• Proficient C/C++ programming and Python.
• BS / MS in Electrical Engineering, Computer Engineering, Computer Science or equivalent.
• Excellent communication skills, and technical writing proficiency.
• Organized mindset, and passionate about delivering high-quality software.

Preferred Qualifications:

• Masters degree + 2 years of relevant industry experience, or Ph.D. degree in computer science, artificial intelligence, or related fields.
• Familiar with LLM and VLM and optimization on resource constrained edge devices for inferences
• Experience in performance tuning & inference optimization techniques of deep learning models or libraries on hardware architectures.
• In-depth knowledge of computer architectures, CPU / MPU, GPU / NPU.
• Solid understanding of embedded / mobile operating systems.
• Familiar with microkernel architecture, Linux kernel, hypervisor, middleware, and application framework.

Compensation:

The US base salary range for this full-time position is $143,200.00 - $186,000.00.

• Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
• Please note that the compensation details listed in US role postings reflect the base salary only. It does not include discretionary bonus, equity, or benefits.

Benefits:

Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO:

• CIGNA EPO, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
• Dental (including orthodontic coverage) and vision plan. Both provide options with a $0 paycheck contribution covering you and your eligible dependents.
• Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible CIGNA medical plan
• Healthcare and Dependent Care Flexible Spending Accounts (FSA)
• 401(k) with Brokerage Link option
• Company paid Basic Life, AD&D, short-term and long-term disability insurance
• Employee Assistance Program
• Sick and Vacation time
• 13 Paid Holidays a year
• Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
• Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
• Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
• Commuter benefits
• Mobile Cell Phone Credit
• Healthjoy mobile benefit app supporting you and your dependents with benefit questions on the go & support with benefit billing questions
• Free lunch and snacks
• Onsite gym
• Employee discounts and perks program