47 stories tagged with #evaluating, in publish-time order across the WeSearch catalog. Tag pages update as new stories ingest.
⌘ RSS feed for this tag → or search "Evaluating"
Evaluating performance and efficiency of the GitHub Copilot agentic harness
Explore how the GitHub Copilot agentic harness delivers strong results across multiple benchmarks and leading token efficiency.…
A curated, non-BS library of the best resources for evaluating agents
A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow. - benchflow-ai/awesome-eva…
OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents
arXiv:2606.26350v1 Announce Type: new Abstract: Although large language model agents are increasingly applied to quantitative-finance workflows, their evaluation remains fragmented…
I Spent May Evaluating Different Engines for OCR
Testing fourteen engines on ninety-three human documents…
Evaluating Transformer and LSTM Frameworks for Prediction in Ungauged Basins
Watershed networks exhibit convergent topologies in which multiple tributaries merge into downstream channels,integrating diverse upstream hydrological processes. In ungauged basin…
Thinking Past the Answer: Evaluating Harmful Overthinking in Large Reasoning Models
Large Reasoning Models (LRMs) improve performance by generating explicit intermediate reasoning traces through increased test-time compute, yet the assumption that longer reasoning…
What Benchmarks Don't Measure: The Case for Evaluating Abstention Competence in Autonomous Agents
Benchmarks for autonomous agents measure whether agents complete tasks, yet this framing is systematically blind to whether an agent should have proceeded at all. Agents trained un…
GTBench: A Curriculum-Grounded Benchmark for Evaluating LLMs as Mathematical Research Assistants in Graph Theory
Large language models (LLMs) are increasingly used as self-study assistants in technical disciplines, yet their reliability as mathematical reasoning assistants remains poorly unde…
Emergence World: A Laboratory for Evaluating Long-Horizon Agent Autonomy
Emergence builds mission-critical agentic infrastructure for enterprise. Verified, governed AI agents that plan, reason, and act across your most complex systems — from semiconduct…
A practical checklist for evaluating npm packages (supply chain attacks, slopsquatting, etc.)
Quick checklist for evaluating npm packages before installing
Evaluating "Co-Scientist", a New AI Science System
The ReAct Pattern in 10 Lines: How to turn ChatGPT into a self-evaluating, autonomous agent without external code or APIs
Doctor euthanizes man, 45, with Crohn’s disease and depression after evaluating him outside Tim Hortons
The doctor even personally drove the patient to a morgue facility to carry out the procedure.…
Evaluating Rashee Rice’s 2025 season
What was the controversial Kansas City wideout able to do on the field?…
Evaluating auth providers in 2026 and the demos all look identical. how do you tell them apart?
VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
Large language models (LLMs) have evolved into interactive agents that collaborate with users in real-world tasks. Effective collaboration in such settings increasingly depends on …
LGMT: Logic-Grounded Metamorphic Testing for Evaluating the Reasoning Reliability of LLMs
Large Language Models (LLMs) achieve strong performance on logical reasoning benchmarks, yet their reliability remains uncertain. Existing evaluations rely on static benchmarks, wh…
EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions
Coding agents are increasingly used as iterative development partners, but most benchmarks still evaluate one specification followed by one final assessment. This leaves out a basi…
GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibration
While large language models (LLMs) hold transformative potential for medicine, their reasoning robustness and safety in real-world clinical scenarios remain critically underexplore…
Evaluating Quarkdown for Agentic Typesetting
An overview and evaluation of the agent skill shipped in Quarkdown 2.1, for a frictionless agentic authoring experience.…
Evaluating Large Language Models in a Complex Hidden Role Game
Quantifying the deceptive potential of Large Language Models (LLMs) is critical for AI safety, yet difficult to achieve in uncontrolled environments. This work investigates the rea…
PrefBench: Evaluating Zero-Shot LLM Agents in Hidden-Preference Personalized Pricing Negotiations
Personalized pricing negotiations are a challenging testbed for LLM agents because successful interaction does not guarantee profitable decision making. A seller may produce valid …
Duolingo's CEO says he backtracked on evaluating AI use in performance reviews
Duolingo is among tech firms, including Meta and Google, that are deciding whether AI use should be mandated and factored into performance reviews.…
Evaluating Spec CPU2026
SPEC’s CPU benchmark suite has been a long established industry standard, and is almost impossible to miss when reading through various publications.…
Evaluating SPEC CPU2026
Evaluating Temporal Semantic Caching and Workflow Optimization in Agentic Plan-Execute Pipelines
Industrial asset operations workflows are latency-sensitive because a single user query may require coordination over sensor data, work orders, failure modes, forecasting tools, an…
PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models
Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequen…
Evaluating multimodal emotion recognition in proactive conversational agents: A user study
This article presents a multimodal emotion recognition module integrated into a proactive Socially Interactive Agent (SIA) powered by generative artificial intelligence. The system…
ProcBench: Evaluating Process-Level Defects and Control Preservation in LLM Coding Agents
Existing benchmarks for LLM coding agents primarily evaluate final outcomes. While useful for measuring overall capability, these metrics provide limited visibility and often miss …
SDM: A Powerful Tool for Evaluating Model Robustness
Gradient-based attacks are important methods for evaluating model robustness. However, since the proposal of APGD, it has been difficult for such methods to achieve significant bre…
Hack-Verifiable Environments: Towards Evaluating Reward Hacking at Scale
Aligning autonomous agents with human intent remains a central challenge in modern AI. A key manifestation of this challenge is reward hacking, whereby agents appear successful und…
LLM INQUISITOR: Evaluating how AI models handle long, realistic tasks
Evaluating AI behaviour under real‑world work conditions to surface issues before they become problems. LLM INQUISITOR identifies failures (drift, instability etc) by observing AI …
Why Did Jason Kidd Get Fired? Evaluating All Possible Reasons Behind Mavericks HC’s Shocking Departure
The Dallas Mavericks made a shocking decision to fire Jason Kidd on Tuesday as part of one of their first major moves under new president of basketball operations Masai Ujiri. Kidd…
Evaluating the Utility of Personal Health Records in Personalized Health AI
Patient-managed Personal Health Records (PHRs) promises to empower patients to better understand their health; but information in the record is complex, potentially hindering insig…
Evaluating job search ranking with LLM judged NDCG
Upgrading/Evaluating my "old" 2017/2018 gaming PC and need some advice!
PersonaArena: Dynamic Simulation for Evaluating and Enhancing Persona-Level Role-Playing in Large Language Models
Large language models (LLMs) increasingly serve as interactive social agents, yet their ability to maintain coherent and authentic persona-level role-playing remains limited, parti…
CAREBench: Evaluating LLMs' Emotion Understanding by Assessing Cognitive Appraisal Reasoning
Emotion understanding is a core capability for LLMs to interact effectively with humans, yet existing evaluation paradigms rely on discrete emotion label prediction and fail to cap…
CBT-Audio: Evaluating Audio Language Models for Patient-Side Distress Intensity Estimation in CBT Session Recordings
Cognitive behavioural therapy is widely used to help patients understand and manage psychological distress. It is often delivered through spoken conversation, where therapists atte…
Evaluating Deep Research Agents on Expert Consulting Work: A Benchmark with Verifiers, Rubrics, and Cognitive Traps
Frontier deep research agents (DRAs) plan a research task, synthesize across documents, and return a structured deliverable on demand. They are being deployed in enterprise workflo…
Evaluating Cognitive Age Alignment in Interactive AI Agents
While agentic AI and its core multimodal large language models (MLLMs) have demonstrated remarkable promise in language and visual reasoning across domains ranging from daily life …
Agree Realty: Evaluating The Risk And Return Of Common Versus Preferred Shares, Hold Both
Agree Realty’s recession-resistant portfolio is anchored by investment-grade tenants like Walmart and Home Depot. Read why I rate ADC stock a Hold.…
I built a NuGet package for evaluating Excel formulas in C# without Excel/COM installed
RoadmapBench: Evaluating Long-Horizon Agentic Software Development Across Version Upgrades
Coding agents are increasingly deployed in real software development, where a single version iteration requires months of coordinated work across many files. However, most existing…
Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs
NVIDIA's CUDA Tile (CuTile) introduces a Python-based, tile-centric abstraction for GPU kernel development that aims to simplify programming while retaining Tensor Core and Tensor …