We use PostHog and Clarity to improve the site, and Meta Pixel to measure page views and ad effectiveness. Usage data may include page addresses and browser identifiers. You can opt out of collection at any time. Details in the Privacy Policy
Senior Data Scientist - AI Agents Team at Surf AI · Trevo
Surf AI is the agentic operations platform for enterprise security teams. We don't just surface risk, we close it. Our platform connects context across identity, cloud, HR, IT, and SaaS systems, and uses specialized AI agents to drive remediation end-to-end, with human oversight at every step.
We're backed by Accel, Cyberstarts, and Boldstart Ventures, and trusted by Fortune 500 enterprises already deploying Surf in production.
Our team is small and senior, with deep roots in identity, security, and enterprise infrastructure. We work at the intersection of agentic AI and applied security - and we take seriously what it means to build systems that act in real enterprise environments.
Who are we looking for?
We’re looking for a Senior Data Scientist with strong experience in LLMs, NLP, and agentic systems to join our AI team.
You’ll help build the data, evaluation, and learning systems behind advanced AI agents. This is a hands-on role for someone who combines data science rigor with strong engineering instincts and product thinking.
We’re looking for someone who is deeply engaged with the rapid evolution of AI—actively experimenting with new models and tools, understanding their limitations, and turning emerging capabilities into reliable production systems.
What you'll do
Design and scale the continuous-learning ecosystem behind advanced AI agents, combining benchmarks, automated evaluations and feedback loops to drive measurable improvements in quality, reliability, and performance.
Build robust evaluation frameworks for agent behavior, model quality, and product impact.
Lead applied AI initiatives from early experimentation through production.
Collaborate with AI engineers, backend engineers, and product managers to deploy scalable and observable AI systems.
Stay current with developments in LLMs and agentic AI, translating relevant advances into practical product improvements.
Requirements
5+ years of experience in data science, applied machine learning
Proven experience building and shipping AI or ML systems to production.
Strong proficiency in Python and experience with modern ML and LLM tooling.
Hands-on experience with LLM evaluation, prompting, embeddings, RAG, tool use, and agent workflows.
Strong understanding of experimentation, benchmarking, metrics, data analysis, and model performance.
The ability to write production-quality code and work closely with engineering teams.
Strong technical judgment, curiosity, and a hands-on approach to exploring new AI capabilities.
Nice to have
Experience with PyTorch, Hugging Face, LangGraph, LangChain, or similar tools.
Experience with fine-tuning, recommendation systems, search, or information retrieval.
Experience building evaluation, observability, or continuous-learning infrastructure for AI agents.
Why Join Us?
If you want to work on foundational systems, ship AI into production, and help define how agentic security actually operates, this is an opportunity to do it early and with real ownership.