run_evaluator

langsmith.evaluation.evaluator.run_evaluator(func: Callable[[Run, Example | None], EvaluationResult | EvaluationResults | dict | Awaitable[EvaluationResult | EvaluationResults | dict]])

Create a run evaluator from a function.

Decorator that transforms a function into a RunEvaluator.

Parameters:

func (Callable[[Run, Example | None], EvaluationResult | EvaluationResults | dict | Awaitable[EvaluationResult | EvaluationResults | dict]]) –