For example, I know that sites like duck.ai let you use LLMs for free, but they limit input to 16,000 characters, so you can’t actually leverage models like Llama 4 Scout, which supposedly has a 10 million token context window. Are there any platforms or tools (preferably without a paywall or input cap) where I could use models with context windows in the millions, as advertised? Or are all the free tools similarly restricted by much smaller limits?

https://eqbench.com/creative_writing.html

  • FrankLaskey@lemmy.ml
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    21 hours ago

    Openrouter provides some limited free usage of popular LLMs with context sizes up to 175k etc. This is probably as good as you’ll get for completely free. The prices are usually pretty reasonable per million tokens as well if you don’t mind paying a bit. https://openrouter.ai/

    Edit: looks like there’s a Gemini Pro free option with million plus token context size as well.