AI Large Language Model (LLM) Inference Engineer (Full-Time)

About NIO

NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO’s mission is to shape a joyful lifestyle. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.

NIO’s product portfolio consists of the ES8, a six-seater smart electric flagship SUV, the ES7 (or the EL7), a mid-large five-seater smart electric SUV, the ES6, a five-seater all-round smart electric SUV, the EC7, a five-seater smart electric flagship coupe SUV, the EC6, a five-seater smart electric coupe SUV, the ET7, a smart electric flagship sedan, and the ET5, a mid-size smart electric sedan.

Job Title: AI Large Language Model (LLM) Inference Engineer

Responsibilities:

• Architect technical solutions that help us deliver AIOS foundation capability in SkyOS across ECU domains.
• Lead the proof-of-concept development to evaluate the architectural designs in terms of functionality, performance, security, and dependability.
• Partner with engineering teams to understand real-world constraints and to support the high-quality implementation of AIOS designs for product development, validation and integration.
• Define the evolution roadmap for AIOS solutions.
• Define and deliver requirements for development team.
• Follow industry trends and study competitors’ technical stacks.
   

Qualifications:

• 2+ years of experience in software design and development for AI model training, and/or inference optimization, and deployment.
• Familiar with LLM and VLM and optimization on resource constrained edge devices for inferences.
• In-depth knowledge and hands-on experience in the latest AI model architectures used in the industry and research areas, e.g. Transformer.
• Solid experience in GPU/NPU architectures and toolchains, AI training frameworks such as PyTorch / TensorFlow / etc.
• 3+ years development experience of building complex software systems.
  Proficient C/C++ programming and Python.
• BS / MS in Electrical Engineering, Computer Engineering, Computer Science or equivalent.
• Excellent communication skills, and technical writing proficiency.
• Organized mindset, and passionate about delivering high-quality software.
   

Preferred Qualifications:

• Masters degree + 2 years of relevant industry experience, or Ph.D. degree in computer science, artificial intelligence, or related fields.
• Familiar with LLM and VLM and optimization on resource constrained edge devices for inferences
• Experience in performance tuning & inference optimization techniques of deep learning models or libraries on hardware architectures.
• In-depth knowledge of computer architectures, CPU / MPU, GPU / NPU.
  Solid understanding of embedded / mobile operating systems.
• Familiar with microkernel architecture, Linux kernel, hypervisor, middleware, and application framework.

Benefits:

Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO:

• CIGNA EPO, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
• Dental (including orthodontic coverage) and vision plan. Both provide options with a $0 paycheck contribution covering you and your eligible dependents.
• Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible CIGNA medical plan
• Healthcare and Dependent Care Flexible Spending Accounts (FSA)
• 401(k) with Brokerage Link option
• Company paid Basic Life, AD&D, short-term and long-term disability insurance
  Employee Assistance Program
• Sick and Vacation time
• 13 Paid Holidays a year
• Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
• Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
• Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
• Commuter benefits
• Mobile Cell Phone Credit
• Healthjoy mobile benefit app supporting you and your dependents with benefit questions on the go & support with benefit billing questions
• Free lunch and snacks
• Onsite gym
• Employee discounts and perks program