LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • Client
  • AsyncClient
  • Run Helpers
  • Run Trees
  • Evaluation
  • Schemas
  • Utilities
  • Wrappers
  • Anonymizer
  • Testing
  • Expect API
  • Middleware
  • Pytest Plugin
  • Deployment SDK
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

OverviewClientAsyncClientRun HelpersRun TreesEvaluationSchemasUtilitiesWrappersAnonymizerTestingExpect APIMiddlewarePytest PluginDeployment SDK
Language
Theme
PythonlangsmithclientClientaevaluate_run
Method●Since v0.0

aevaluate_run

Copy
aevaluate_run( self, run: Union[ls_schemas.Run, str, uuid.UUID], evaluator: 
View source on GitHub
ls_evaluator
.
RunEvaluator
,
*
,
source_info
:
Optional
[
dict
[
str
,
Any
]
]
=
None
,
reference_example
:
Optional
[
Union
[
ls_schemas
.
Example
,
str
,
dict
,
uuid
.
UUID
]
]
=
None
,
load_child_runs
:
bool
=
False
)
->
ls_evaluator
.
EvaluationResult

Parameters

NameTypeDescription
run*Union[Run, str, UUID]

The run to evaluate.

evaluator*RunEvaluator

The evaluator to use.

source_infoOptional[Dict[str, Any]]
Default:None
reference_exampleOptional[Union[Example, str, dict, UUID]]
Default:None
load_child_runsbool, default=False
Default:False

Evaluate a run asynchronously.

Additional information about the source of the evaluation to log as feedback metadata.

The example to use as a reference for the evaluation. If not provided, the run's reference example will be used.

Whether to load child runs when resolving the run ID.