Jev AI

laya-mlx

independent MLX port of the Laya checkpoints that runs typed decisions natively on Apple Silicon — 13.4 ms median end-to-end per short English decision, 7.4 ms with the multilingual checkpoint, and zero output tokens, with no PyTorch, Transformers runtime, or cloud API.

作者
mizorewww
领域
Local runtime
分类
基础设施 / SDK / 集成
类型
REPO
托管于
github.com
在 GITHUB 上查看

它做什么判断

CHOICE

Picks one option from a fixed set

SCORE

Rates against ordered levels

NOUL

Answers a yes / no question

Inferred from this project's own one-line summary in the community list — it reads as a NOUL decision. Read the source to confirm.

NOUL 调用长什么样

这是该提问类型的通用骨架,不是这个项目的真实代码。

from typesafe import TypeSafe

ts = TypeSafe()
result = ts.evaluate(
    state=tool_call,
    questions={
        "is_risky": {
            "type": "noul",
            "instructions": "Could this call delete or overwrite user data?",
        }
    },
)
if result["is_risky"] and result["is_risky_confidence"] > 0.6:
    escalate_to_human(tool_call)
更多基础设施 / SDK / 集成项目