You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/prompt_engineering/how_to_guides/multiple_messages.mdx
+8-11Lines changed: 8 additions & 11 deletions
Original file line number
Diff line number
Diff line change
@@ -1,10 +1,7 @@
1
-
# How to set up a multi-turn evaluation
1
+
# How to use multiple messages in the playground
2
2
3
-
LangSmith makes it easy to evaluate multi-turn conversations in the playground. This allows you to evaluate how changing your system prompt,
4
-
the tools available to the model, or the output schema affects a conversation with multiple messages.
5
-
6
-
This how-to guide walks you through the various ways you can set up the playground for multi-turn evaluation, which will allow you to
7
-
test different tool configurations and system prompts to see how they impact your system.
3
+
This how-to guide walks you through the various ways you can set up the playground for multi-turn conversations, which will allow you to
4
+
test different tool configurations and system prompts against longer threads of messages.
8
5
9
6

10
7
@@ -22,7 +19,7 @@ You can then edit the system prompt, tweak the tools and/or output schema and ob
22
19
Before starting, make sure you have [set up your dataset](../../evaluation/how_to_guides/manage_datasets_in_application). Since you want to evaluate
23
20
multi-turn conversations, make sure there is a key in your inputs that contains a list of messages.
24
21
25
-
Once you have created your dataset, head to the playground and [load your dataset](/evaluation/how_to_guides/manage_datasets_in_application#from-the-prompt-playground) to evaluate.
22
+
Once you have created your dataset, head to the playground and [load your dataset](../../evaluation/how_to_guides/manage_datasets_in_application#from-the-prompt-playground) to evaluate.
26
23
27
24
Then, add a messages list variable to your prompt, making sure to name it the same as the key in your inputs that contains the list of messages:
This allows you to just tweak the system prompt or the tools, while allowing any multi-turn conversation to take the place
46
-
of the `Messages List` variable, allowing you to reuse this prompt across various evaluations.
43
+
of the `Messages List` variable, allowing you to reuse this prompt across various runs.
47
44
48
45
## Next Steps
49
46
50
-
Now that you know how to set up your multi-turn evaluation, you can either manually
51
-
inspect and judge the outputs, or you can [add evaluators](../how_to_guides#define-an-evaluator) to get repeatable, quantitative results.
47
+
Now that you know how to set up the playground for multi-turn interactions, you can either manually
48
+
inspect and judge the outputs, or you can [add evaluators](../../evaluation/how_to_guides#define-an-evaluator) to classify results.
52
49
53
-
You can also read [these how-to guides](../../prompt_engineering/how_to_guides#playground) to learn more about how to use the playground to run evaluations.
50
+
You can also read [these how-to guides](../../prompt_engineering/how_to_guides#playground) to learn more about how to use the playground to run evaluations.
0 commit comments