Google introduces Just Keep Prompting, a framework to evaluate Vision-Language Models under sustained conversational pressure, revealing instability in models like GPT-4o, Gemini 2.5 Pro, and Qwen3-VL-30B. The study highlights the importance of assessing VLMs' epistemic stability in real-world settings. The findings have significant implications for the development and deployment of VLMs in various applications.

A new study introduces a benchmark evaluation framework for measuring the faithfulness of LLM-generated clinical trial summaries, identifying Unsupported Claims as the dominant failure mode. The study evaluates three language models, including GPT-4o, Claude Sonnet 4.6, and Gemini 2.5 Flash, and proposes a knowledge-graph-augmented retrieval system to improve faithfulness scores. This research has significant implications for the use of LLMs in high-stakes contexts such as healthcare.