They use HBM (High Bandwidth Memory). PCs, laptops and phones don’t use this type of RAM.

  • kmirl@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    18 days ago

    If RAM and GPUs were cheap people like us would be more likely to set up local LLMs to prevent our data from being productized by power-grabbing corporations.

      • kmirl@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        17 days ago

        Not claiming it’s the reason since it clearly isn’t, only that it will help drive traffic to commercial AI products.