Optional clientOptional evaluationPass keys directly to the RunOnDatasetParams instead
This feature is deprecated and will be removed in the future.
It is not recommended for use.
Optional evaluatorsEvaluators to apply to a dataset run. You can optionally specify these by name, or by configuring them with an EvalConfig object.
Optional formatConvert the evaluation data into formats that can be used by the evaluator. This should most commonly be a string. Parameters are the raw input from the run, the raw output, raw reference output, and the raw run.
// Chain input: { input: "some string" }
// Chain output: { output: "some output" }
// Reference example output format: { output: "some reference output" }
const formatEvaluatorInputs = ({
rawInput,
rawPrediction,
rawReferenceOutput,
}) => {
return {
input: rawInput.input,
prediction: rawPrediction.output,
reference: rawReferenceOutput.output,
};
};
The prepared data.
Optional maxMaximum concurrency level for dataset processing.
Optional projectAdditional metadata for the project.
Optional projectName of the project for logging and tracking.
Generated using TypeDoc
Client instance for LangSmith service interaction.