Jev and other decision models can still be tricked with prompt injection

Some of the excitement about decision models follows from TypeSafe AI's claim that its Jev decision model cannot hallucinate and that "the model never makes type errors." Yet decision models, which answer questions with a set of probabilities and a confidence score rather than freeform text, can still get things wrong and can still be exploited through indirect prompt injection. These vulnerabilities don't erase the potential cost and performance advantages of a model that returns decision probabilities instead of boiling the training data ocean for a text answer. But they do suggest approaching decision models with some caution. HiddenLayer, a security biz, recently evaluated Jev, which TypeSafe AI refers to as a System One model, to see whether it resists manipulation better than a text-emitting LLM. And according to HiddenLayer, the two model types are not all that different. …