ASSAY-001
Independent pre-registered check of Jev calibration and type safety on Banking77 / CLINC150. Split verdict, full logs. Write-up: [donttrustme.ai](https://donttrustme.ai/assay-001.html)
무엇을 판단하는가
CHOICE
Picks one option from a fixed set
SCORE
Rates against ordered levels
NOUL
Answers a yes / no question
Inferred from this project's own one-line summary in the community list — it reads as a NOUL decision. Read the source to confirm.
NOUL 호출은 이렇게 생겼다
이 질문 유형의 일반적인 뼈대이지 이 프로젝트의 실제 코드가 아니다.
from typesafe import TypeSafe
ts = TypeSafe()
result = ts.evaluate(
state=tool_call,
questions={
"is_risky": {
"type": "noul",
"instructions": "Could this call delete or overwrite user data?",
}
},
)
if result["is_risky"] and result["is_risky_confidence"] > 0.6:
escalate_to_human(tool_call)평가와 벤치마크 프로젝트 더 보기
Jev Web Analyzeranalyzes a public SaaS landing page as clean Markdown and asks Jev ten bounded `Choice` questions about first-visit understanding, returning inspectable findings for the first change to make.Jev Playgroundbenchmarks Jev against Luna, Haiku, and Gemini at choosing validated legal moves in explicit-state games, scoring decision quality and consistency across a sequence of moves.Jev vs Mistral and Gemini for event validationhead-to-head test of Jev against Mistral Small and Gemini Flash-Lite at validating local event listings.jev-research-evalreproducible eval harness plus field note for Jev Ultrafast research-browser tasks, with QC'd cases, a suite runner, and a report generator.