Jev vs GPT-4.1 on a synthetic survey

runs Jev and GPT-4.1 as the same 300 synthetic respondents over 24,596 paired Twin-2K-500 cells under criteria fixed in advance, finding that asking a yes/no item as `Noul` rather than `Choice` moves the result more than the gap between the two models, at a thirty-fourth of the cost. Write-up: [jjd-lab.github.io](https://jjd-lab.github.io/jev-synthetic-survey/)

THE SHAPE OF A NOUL CALL

A generic skeleton for this question type, not this project's actual code.

from typesafe import TypeSafe

ts = TypeSafe()
result = ts.evaluate(
    state=tool_call,
    questions={
        "is_risky": {
            "type": "noul",
            "instructions": "Could this call delete or overwrite user data?",
        }
    },
)
if result["is_risky"] and result["is_risky_confidence"] > 0.6:
    escalate_to_human(tool_call)