LlamaIndex Jev

unofficial LlamaIndex adapter where Jev `Score`s each retrieved passage and `Choice`/`Noul` selects the query engine, with nfcorpus nDCG@5 0.340→0.396 at about $0.0003/query.

CHOICE 呼び出しの形

この質問型の一般的な骨格であって、このプロジェクトの実際のコードではない。

from typesafe import TypeSafe

ts = TypeSafe()  # reads TYPESAFE_API_KEY
result = ts.evaluate(
    state=page_state,
    questions={
        "next_action": {
            "type": "choice",
            "options": ["click", "scroll", "type", "done"],
            "instructions": "What should the agent do next?",
        }
    },
)
action = result["next_action"]          # the chosen option
confidence = result["next_action_confidence"]