laya-mlx

independent MLX port of the Laya checkpoints that runs typed decisions natively on Apple Silicon — 13.4 ms median end-to-end per short English decision, 7.4 ms with the multilingual checkpoint, and zero output tokens, with no PyTorch, Transformers runtime, or cloud API.

OWNER

mizorewww

INDUSTRY

Local runtime

WHAT IT DECIDES

CHOICE

Picks one option from a fixed set

SCORE

Rates against ordered levels

NOUL

Answers a yes / no question

Inferred from this project's own one-line summary in the community list — it reads as a NOUL decision. Read the source to confirm.

THE SHAPE OF A NOUL CALL

A generic skeleton for this question type, not this project's actual code.

from typesafe import TypeSafe

ts = TypeSafe()
result = ts.evaluate(
    state=tool_call,
    questions={
        "is_risky": {
            "type": "noul",
            "instructions": "Could this call delete or overwrite user data?",
        }
    },
)
if result["is_risky"] and result["is_risky_confidence"] > 0.6:
    escalate_to_human(tool_call)