Senior Software Engineer, Applied AI

About Syllo

Syllo is leading the Litigation AI category. In 2019, a team of litigators and engineers founded Syllo to redefine how complex litigation works. Today it is the first unified Litigation AI system built to manage the entire case lifecycle, helping legal teams decide what matters and what comes next. Backed by top-tier VCs, Syllo empowers leading law firms and Fortune 500 companies to move faster and mitigate risk. Awarded ILTA Transformative Project of the Year and ALM eDiscovery Technology of the Year for 2026, we deliver enterprise-grade Litigation AI. We’re building a team to push the boundaries of what technology can achieve.

About the Role

We are seeking a skilled and fast-moving Applied AI Engineer to join our team. This role is focused on the practical application of AI, specifically leveraging Large Language Models (LLMs), to build robust, scalable, and impactful user-facing features. This is an engineering-centric role. You will be an expert at building and integrating production systems, not primarily a research scientist.

Responsibilities

• Design and build high-performance, production-level AI-powered features and services, with a focus on reliability and scalability.
• Develop robust engineering solutions to mitigate the inherent unreliability of LLMs. This includes implementing effective guardrails, validation pipelines, error handling, caching, and failover/fallback mechanisms to ensure a high-quality user experience even when the model misbehaves.
• Design long-running batch processing that is idempotent, resumable, and resilient to individual item failures.
• Focus on optimizing latency, throughput, and cost efficiency for all AI-powered services.
• Serve as an engineering expert in integrating models and data feeds with existing business logic and APIs.
• Define and implement evaluation for AI feature output quality, not only system correctness.
• Implement rigorous testing strategies, including unit, integration, and performance testing, to ensure the robustness of AI features before and after deployment.
• Champion and enforce high standards for code quality, architectural design, and system documentation, and participate actively in peer code reviews to maintain a high bar across the team.
• Take ownership of the full lifecycle of new AI features, from initial design and prototyping through API design, integration with front-end services, persistent data storage, deployment, and comprehensive monitoring and alerting.
• Quickly onboard onto our existing codebase to understand, maintain, and significantly enhance existing data and feature pipelines, improving their efficiency and robustness.
• Work closely with product managers and other engineers to scope, estimate, and deliver features on a fast iterative cycle.

Qualifications

• Deep Engineering Fluency and Quality Focus: Proven ability to build and deploy complex, high-quality software systems with an emphasis on maintainable code, rigorous testing, and engineering best practices.
• Python Proficiency: Fluent in Python and its ecosystem for backend services and data processing.
• System Design Expertise: Strong grasp of system design principles, including distributed systems and API design, and demonstrated ability to design scalable distributed systems.
• AI/ML Feature Experience: Experience directly building, shipping, and maintaining AI-powered products, agents, or intelligent features in a commercial setting.
• LLM Production Experience: Hands-on experience with the engineering challenges of integrating Large Language Models into a production environment, including prompt engineering, working with vector databases, RAG systems, and managing context windows.
• Codebase Agility: Excellent ability to read, understand, and navigate an unfamiliar codebase quickly.

Great to Have

• Experience fine-tuning or distilling smaller task-specific models, and judgment about when that is worth doing.
• Familiarity with agent frameworks and their failure modes.
• Familiarity with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes) for deploying and managing services.

United States - Remote Pay Range

$160,000 — $200,000 USD