Anthropic CEO @DarioAmodei says a 100M-word context window is technically possible, about “what a human hears in a lifetime.” That sounds like a memory breakthrough until you get to the invoice: serving that much context at usable speed is the hard part... (Digg)