Explore
AI Tools
New Tools
AI Agents
One9 Worker
LLMs
RAG & Vector DBs
Research
Assemble a stack
Founder Stacks
Compare
How We Rate
About
$
/
₹
⌘K
Sign up free
Login
Back to papers
May 7, 2026
cs.CL
Long Context Pre-Training with Lighthouse Attention
Bowen Peng
,
Subho Ghosh
,
Jeffrey Quesnelle
Original Abstract
Read on arXiv
Download PDF
HF Upvotes
21
Categories
cs.CL