โก๏ธ Enhancement Notes
- Enforce JSON mode on OpenAI LLM-based evaluators so that they always return valid JSON output. This is to ensure that the output is always in a consistent format, regardless of the input.
๐ Bug Fixes
FaithfullnessEvaluatorandContextRelevanceEvaluatornow return0instead ofNaNwhen applied to an empty context or empty statements.- Azure generators components fixed, they were missing the
@componentdecorator. - Updates the
from_dictmethod ofSentenceTransformersTextEmbedder,SentenceTransformersDocumentEmbedder,NamedEntityExtractor,SentenceTransformersDiversityRankerandLocalWhisperTranscriberto allowNoneas a valid value for device when deserializing from a YAML file. This allows a deserialized pipeline to auto-determine what device to use using theComponentDevice.resolve_devicelogic. - Improves/fixes type serialization of PEP 585 types (e.g.
list[Document], and their nested version). This improvement enables better serialization of generics and nested types and improves/fixes matching oflist[X]and List ` types in component connections after serialization. - Fixed (de)serialization of
NamedEntityExtractor. Includes updated tests verifying these fixes whenNamedEntityExtractoris used in pipelines. - The
include_outputs_fromparameter inPipeline.runcorrectly returns outputs of components with multiple outputs.
