LlamaIndex Jev

unofficial LlamaIndex adapter where Jev `Score`s each retrieved passage and `Choice`/`Noul` selects the query engine, with nfcorpus nDCG@5 0.340→0.396 at about $0.0003/query.

OWNER

WiktorB2004

INDUSTRY

Retrieval / RAG

WHAT IT DECIDES

CHOICE

Picks one option from a fixed set

SCORE

Rates against ordered levels

NOUL

Answers a yes / no question

Inferred from this project's own one-line summary in the community list — it reads as a CHOICE + SCORE decision. Read the source to confirm.

THE SHAPE OF A CHOICE CALL

A generic skeleton for this question type, not this project's actual code.

from typesafe import TypeSafe

ts = TypeSafe()  # reads TYPESAFE_API_KEY
result = ts.evaluate(
    state=page_state,
    questions={
        "next_action": {
            "type": "choice",
            "options": ["click", "scroll", "type", "done"],
            "instructions": "What should the agent do next?",
        }
    },
)
action = result["next_action"]          # the chosen option
confidence = result["next_action_confidence"]