About PointFive
PointFive is the AI Efficiency OS. From the cloud to the coding agent, we're the only platform that manages AI spend everywhere it happens.
Engineering and FinOps teams use PointFive to make their organizations more efficient and their cloud and AI more effective. We don't just show what you spend. We show what you're wasting, and we fix it autonomously. NuBank saw ROI in 10 days. Customers average 1,200%+ ROI and a 4.9 rating on G2.
Founded by the team behind IntSights (acquired by Rapid7), PointFive recently closed a $60M Series B led by Accel, with participation from Entrée Capital and Salesforce Ventures.
We're looking for a Research Scientist to design the next generation of evaluation methodologies for API-based coding agents. This role combines systems research, benchmarking, and applied machine learning to answer fundamental questions about how coding agents can become more accurate, efficient, and cost-effective without requiring access to model weights. You'll help define how AI coding systems are measured, optimized, and deployed at scale while working on problems that have immediate impact on real production workloads.
What you'll do
Design rigorous evaluation methodologies for API-based coding agents, with and without access to external tools.
Build statistically sound benchmarks that measure cost, latency, accuracy, reliability, and developer productivity.
Develop novel techniques for optimizing agent context, retrieval, memory, and tool interactions while preserving correctness.
Built and sold IntSights to Rapid7. Backed by top-tier investors with deep conviction in this category.
Category-defining product
Building AI systems that reduce engineering waste and improve the efficiency of software development through measurable optimization.
Research with real-world impact
Your work will be validated on production-scale workloads, influence shipping products, and shape how next-generation coding agents are evaluated.
Opportunity to define a new research field
Help establish the benchmarks, methodologies, and scientific standards for evaluating and optimizing API-based coding agents—an area that is only beginning to emerge.
Equal Opportunity Statement
PointFive is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We welcome candidates from all backgrounds, experiences, and perspectives to apply.