diff --git a/docs/changelog/index.md b/docs/changelog/index.md new file mode 100644 index 000000000..2fcae581e --- /dev/null +++ b/docs/changelog/index.md @@ -0,0 +1,24 @@ +--- +sidebar_position: 1 +--- + +import { RegionalUrl } from "@site/src/components/RegionalUrls"; + +# Changelog + +What's new in LangSmith — new features, enhancements, and bugs fixed — organized by release date and release version. Looking for just the major product updates & highlights? [Check out our website feed.](https://changelog.langchain.com/?categories=cat_FvjDMlZoyaKkX) + +## 2025‑04‑28 + +### LangSmith v0.10.31 + +#### LangSmith + +- Directly [add example metadata](/evaluation/how_to_guides/manage_datasets_in_application#edit-example-metadata) when editing examples in the UI +- Prompt previews now render when [running an experiment in the UI](/evaluation/how_to_guides/run_evaluation_from_prompt_playground) or configuring an [online evaluator](/observability/how_to_guides/online_evaluations) with f-string prompts +- [Group by](/evaluation/how_to_guides/analyze_single_experiment#group-results-by-metadata) [dataset split](/evaluation/how_to_guides/manage_datasets_in_application#create-and-manage-dataset-splits) when analyzing experiment results + +#### LangGraph Studio + +- Improved layout when expanding [subgraphs](https://langchain-ai.github.io/langgraph/how-tos/subgraph/?h=subgraph) +- Render errors and [interrupts](https://langchain-ai.github.io/langgraph/concepts/human_in_the_loop/?h=#interrupt) correctly in Studio Chat UI diff --git a/docs/evaluation/how_to_guides/manage_datasets_in_application.mdx b/docs/evaluation/how_to_guides/manage_datasets_in_application.mdx index 3fc0cebc7..794bd3bc2 100644 --- a/docs/evaluation/how_to_guides/manage_datasets_in_application.mdx +++ b/docs/evaluation/how_to_guides/manage_datasets_in_application.mdx @@ -141,19 +141,19 @@ you can select and unselect splits for the selected examples, or create a new sp ### Edit example metadata -You can add metadata to your examples by clicking on an example and then clicking on the "Metadata" tab in the side pane. +You can add metadata to your examples by clicking on an example and then clicking "Edit" on the top righthand side of the popover. From this page, you can update/delete existing metadata, or add new metadata. You may use this to store information about -your examples, such as tags or version info, which you can [then filter by when you call `list_examples` in the SDK](./manage_datasets_programmatically#list-examples-by-metadata). +your examples, such as tags or version info, which you can then [group by](./analyze_single_experiment#group-results-by-metadata) when analyzing experiment results or [filter by](./manage_datasets_programmatically#list-examples-by-metadata) when you call `list_examples` in the SDK. -![Add Metadata](./static/add_metadata.png) +![Add Metadata](./static/add_metadata.gif) ### Filter examples -You can filter examples by metadata key/value or full-text search. To filter examples, click "Filter" in the top left of the table: +You can filter examples by split, metadata key/value or perform full-text search over examples. These filtering options are available to the top left of the examples table. +- **Filter by split**: Select split > Select a split to filter by +- **Filter by metadata**: Filters > Select "Metadata" from the dropdown > Select the metadata key and value to filter on +- **Full-text search**: Filters > Select "Full Text" from the dropdown > Enter your search criteria -![Filter Examples](./static/filter_examples.png) - -Next, click "Add filter" and select "Full Text" or "Metadata" from the resulting dropdown. You may add multiple filters, and only examples that satisfy all of the -filters will be displayed in the table. +You may add multiple filters, and only examples that satisfy all of the filters will be displayed in the table. ![Filters Applied to Examples](./static/filters_applied.png) diff --git a/docs/evaluation/how_to_guides/static/add_metadata.gif b/docs/evaluation/how_to_guides/static/add_metadata.gif new file mode 100644 index 000000000..609c7bfb8 Binary files /dev/null and b/docs/evaluation/how_to_guides/static/add_metadata.gif differ diff --git a/docs/evaluation/how_to_guides/static/add_metadata.png b/docs/evaluation/how_to_guides/static/add_metadata.png deleted file mode 100644 index 54c525508..000000000 Binary files a/docs/evaluation/how_to_guides/static/add_metadata.png and /dev/null differ diff --git a/docs/evaluation/how_to_guides/static/add_to_split2.png b/docs/evaluation/how_to_guides/static/add_to_split2.png index dbdc402c6..c1f14e159 100644 Binary files a/docs/evaluation/how_to_guides/static/add_to_split2.png and b/docs/evaluation/how_to_guides/static/add_to_split2.png differ diff --git a/docs/evaluation/how_to_guides/static/filter_examples.png b/docs/evaluation/how_to_guides/static/filter_examples.png deleted file mode 100644 index 04f337b8e..000000000 Binary files a/docs/evaluation/how_to_guides/static/filter_examples.png and /dev/null differ diff --git a/docs/evaluation/how_to_guides/static/filters_applied.png b/docs/evaluation/how_to_guides/static/filters_applied.png index 01e29e70c..1ab9ed42f 100644 Binary files a/docs/evaluation/how_to_guides/static/filters_applied.png and b/docs/evaluation/how_to_guides/static/filters_applied.png differ diff --git a/sidebars.js b/sidebars.js index 9e9cde97d..85d8deee4 100644 --- a/sidebars.js +++ b/sidebars.js @@ -277,6 +277,20 @@ const sidebars = { ], link: { type: "doc", id: "reference/index" }, }, + { + type: "category", + label: "Changelog", + collapsed: false, + collapsible: false, + items: [ + { + type: "autogenerated", + dirName: "reference", + className: "hidden", + }, + ], + link: { type: "doc", id: "changelog/index" }, + }, ], };