Agentic AI Architect

Job Details:

Job Description:

Location: Shanghai, China

Role Overview

We are seeking a Principal Engineer – Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms .

This role sits at the intersection of:

-

Large Language Models (LLMs)

-

Agent frameworks & autonomous systems

-

Retrieval-Augmented Generation (RAG)

-

Hardware-aware AI system design (FPGA / ASIC / EDA)

You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration .

Key Responsibilities

AI Architecture & System Design

-

Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration

-

Architect RAG pipelines for enterprise-scale knowledge integration

-

Define end-to-end AI system architecture from data ingestion → reasoning → action

Agentic AI & LLM Development

-

Develop advanced workflows using:

-

tool-using agents

-

planning & reasoning agents

-

multi-agent collaboration frameworks

-

Evaluate and integrate leading LLMs (open-source and proprietary)

-

Optimize prompt engineering, memory, and reasoning capabilities

Hardware-Aware AI Optimization

-

Co-design AI systems with:

-

FPGA acceleration

-

ASIC platforms

-

heterogeneous compute (CPU/GPU/FPGA)

-

Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)

-

Collaborate with hardware teams on EDA and system integration

Framework & Platform Development

-

Build internal platforms using

-

LangChain

-

LlamaIndex

-

custom agent orchestration framework

-

Develop reusable components for:

-

memory management

-

tool integration

-

knowledge retrieval

Technical Leadership

-

Lead architecture reviews and guide engineering teams

-

Mentor senior engineers and influence cross-functional teams

-

Drive innovation in AI + hardware convergence

What Makes This Role Unique

-

Opportunity to define agentic AI architecture for hardware-driven systems

-

Work at the convergence of:

-

AI reasoning systems

-

FPGA acceleration

-

next-generation computing platforms

-

High-impact role influencing future AI + semiconductor integration

Impact

You will help shape how AI agents interact with hardware , enabling:

-

intelligent system orchestration

-

real-time decision-making pipelines

-

scalable AI deployment on FPGA platforms

Summary

This role is ideal for a senior technical leader who can:

-

bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture

-

and drive innovation in next-generation AI systems .

Qualifications:

-

Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following:

-

AI/ML systems

-

Distributed systems

-

Hardware–software co-design

-

Recognized expertise in AI/ Large Language Models (LLMs)

-

Deep understanding of:

-

LLM architectures and inference

-

RAG systems and vector databases

-

Agentic AI / autonomous agents

-

Hands-on experience building:

-

Production-grade LLM applications

-

Multi-step reasoning and orchestration workflows

-

Scalable and reliable AI systems in production

-

Strong background in:

-

FPGA / ASIC / EDA systems

-

Heterogeneous computing architectures

-

Familiarity with:

-

Hardware acceleration for AI workloads

-

Performance optimization across system stack

Technical Skills

-

Programming:

-

Python

-

C++ (preferred)

-

Experience with:

-

Distributed systems design

-

APIs and microservices architecture

-

Cloud and/or edge AI deployment

-

Hands-on experience with:

-

LLM fine-tuning, quantization, and model distillation

-

On-device / edge AI deployment

-

Robotics, autonomous systems, or real-time AI pipelines

-

Knowledge of:

-

Compiler stacks (e.g., MLIR, TVM)

-

AI model optimization for FPGA platforms

Job Type:

Regular

Shift:

Shift 1 (China)

Primary Location:

Shanghai, China

Additional Locations:

Posting Statement: