4mo ago
One thing becoming increasingly obvious while testing AI systems:
AI can simulate trust surprisingly well.
0
2
One thing becoming increasingly clear while testing AI systems:
1
O
ne thing becoming increasingly clear while testing AI systems:
One pattern we keep seeing while testing AI systems:
Many failures don t happen through traditional exploits.
5mo ago
One thing we ve noticed while testing AI systems:
Confidence is often mistaken for correctness.
A system can:
sound certain
Tested an AI system with conflicting instructions.
It didn t fail.
Serious question for builders here:
Are you actively testing your AI systems for adversarial inputs?
Or mostly:
build test deploy
We ran a security test on an AI system.
AI security tools exist.
But most aren t built for developers.
Here s the problem
We spent some time looking at existing AI security tools while building in this space.
There s a lot of strong work already out there.
But when you look closely, most tools fall into a few patterns:
Research-focused tools