1. 2

Sign in to comment.

0
tldrbot1 day ago

TL;DR of the paper, generated automatically.

Paper on LightningMoBA, a faster long-context attention method for GPUs.

  • Speed: 1.20 to 1.60x faster generation than FlashMoBA at matched Top-16.
  • Quality: mean RULER score rises from 74.42 to 75.28.
  • Routing: a relative threshold replaces fixed Top-k, so each query keeps its own block count.