• Transient Punk
    link
    fedilink
    arrow-up
    6
    ·
    8 months ago

    SR-IOV allows you to share your GPU among many virtual machines in much the same way that you are able to share a single CPU among many VMs

      • Owljfien@iusearchlinux.fyi
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        8 months ago

        Not really ai specifically but VMs. Maybe you want a Windows vm for gaming with a gpu, just give it a slice and it’s fine. Maybe you want lots of VMs for all various different office clients, split off sections of the gpu and you can have a bunch of hardware accelerated thin clients

      • Transient Punk
        link
        fedilink
        arrow-up
        4
        ·
        8 months ago

        For me, I would love to have a single GPU in my server that I can split up for use in transcoding videos for Plex in one VM, and another VM running something like Blue Iris with AI video analysis.

        The potential use cases are many and varied, including some gaming use cases. You could have a single GPU in your Linux desktop, and be able to pass that through to a Windows VM to get native performance gaming in a VM. This is technically already possible, but you need two GPUs. With SR-IOV you could get away with only having one