Patronus AI, a New York-based startup that develops an automated evaluation and security platform for large language models (LLMs), today announced the launch of its platform and the closing of a $3 million seed funding round.

The round was led by Lightspeed Venture Partners, with participation from Factorial Capital, the CEO of Replit Amjad Masad, Gokul Rajaram, and several other Fortune 500 executives and board members.

Patronus AI’s platform uses proprietary AI to help enterprise development teams score model performance, generate adversarial test cases, benchmark models, and more. The platform automates and scales the manual and costly model evaluation methods prevalent in the enterprise today, enabling organizations to confidently deploy LLMs while minimizing the risk of model failures and misaligned outputs.

Patronus AI is currently in private beta and is available to a select group of early adopters. The company plans to launch a public beta in the coming months.