I don’t know much about graphics cards, but the framework laptop seems to offer an “AMD Radeon™ RX 7700S” and stable diffusion requires Linux ROCm.

It’s not completely clear if ROCm runs on AMD Radeon™ RX 7700S, so I was wondering if anyone had any experience with setting it up on framework.

  • LalSalaamComrade@lemmy.ml
    link
    fedilink
    English
    arrow-up
    5
    ·
    7 months ago

    I think that would still be a bad idea - running billions of parameters on a laptop - because it’s not just the battery, you might also want to think about how much the heat-sink can handle cooling. However, there’s nothing wrong with running the model a few times. If that were a desktop GPU, it would handle a load as heavy as that easily.

    Might I suggest you try using KOALA once? It has way lesser parameters than your typical large-scale diffusion model, so it will be forgiving on your device. Best of luck with your attempt.