OpenAI has announced the acquisition of Promptfoo, an AI security startup focused on testing and securing large language models and AI agents from cyber threats. The move is part of OpenAI’s effort to improve the safety and reliability of its enterprise AI systems.
The financial terms of the deal were not disclosed.
Startup focused on AI security testing
Founded in 2024, Promptfoo develops tools that help organizations identify vulnerabilities in AI models during development and deployment.
The platform enables companies to test AI systems for risks such as:
- Prompt injection attacks
- Data leakage
- Unsafe responses
- Model misuse or manipulation
These tests allow organizations to detect weaknesses before AI systems are deployed in real-world applications.
Integration with OpenAI’s enterprise platform
OpenAI said Promptfoo’s technology will be integrated into OpenAI Frontier, the company’s enterprise platform for building and operating AI agents.
Once integrated, the tools will allow businesses to automatically stress-test and evaluate AI agents, ensuring they behave safely and securely in production environments.
The acquisition aims to make security testing, evaluation and red-teaming a built-in part of developing AI agents on the platform.
Growing need for AI security
The deal reflects increasing concern about security risks as companies deploy autonomous AI agents capable of performing complex tasks and interacting with external systems.
Experts warn that AI systems can be vulnerable to attacks such as malicious prompts, data manipulation and exploitation of system weaknesses.
By acquiring Promptfoo, OpenAI hopes to help enterprises identify and fix vulnerabilities before malicious actors exploit them.
Promptfoo widely used by enterprises
Promptfoo’s open-source testing tools are already widely used by developers and security teams. According to reports, the platform is used by more than 25% of Fortune 500 companies for evaluating the safety of AI systems.
The company’s team will join OpenAI following the acquisition and continue developing the platform within the organization.
Focus on safer AI deployment
The acquisition highlights a broader trend in the AI industry as companies focus on security, governance and reliability while expanding the use of AI agents in business environments.
As AI systems gain more autonomy and responsibility, developers are increasingly prioritizing tools that ensure they remain safe, predictable and resistant to cyber threats.
About the author – Ayesha Aayat is a law student and contributor covering cybercrime, online frauds, and digital safety concerns. Her writing aims to raise awareness about evolving cyber threats and legal responses.
