1. 2

Sign in to comment.

0
tldrbot1 day ago

TL;DR of the paper, generated automatically.

Showing agents benchmark criteria can inflate scores without better task completion.

  • Result: higher scores on those criteria, not better instructed-task completion.
  • Fragile: the gain vanishes with slight criteria changes, and transfers poorly.
  • Proposal: instruction-faithful criteria, which the paper says track performance better.