For example, I know that sites like duck.ai let you use LLMs for free, but they limit input to 16,000 characters, so you can’t actually leverage models like Llama 4 Scout, which supposedly has a 10 million token context window. Are there any platforms or tools (preferably without a paywall or input cap) where I could use models with context windows in the millions, as advertised? Or are all the free tools similarly restricted by much smaller limits?

https://eqbench.com/creative_writing.html

  • Ledivin@lemmy.world
    link
    fedilink
    arrow-up
    6
    ·
    edit-2
    21 hours ago

    Unfortunately, you’re probably not gonna find one.

    The size of the context window is almost the only thing that matter re: cost to run these agents, so you’ll never get a large one for free.