It’s the kind of thing that in a few years you’ll be glad to have because some tasks will be offloaded from the GPU to the NPU, one I can think of is the background blur in video conferencing software or microphone noise suppression
GPUs are already good at those things. But NPUs can be better at those things - and probably more energy efficient too - given optimized domain-specific models to work with.
That’s still something that works more than good enough without the use of an NPU. We’ll see if better use cases come out in future but I’d still prefer that power and die area go to raw CPU processing power.
You’re likely already paying for silicon you don’t use. Take AVX512 instructions (or other more exotic instructions) for example, or unused PCIe lanes, certain encoders on your GPU etc.
Also, people thinking they have no use for an NPU are almost certainly already using them, for example when taking a photo with their phone.
Is there a non-AI model?
I don’t want to pay money and watts for silicon I won’t use
It’s the kind of thing that in a few years you’ll be glad to have because some tasks will be offloaded from the GPU to the NPU, one I can think of is the background blur in video conferencing software or microphone noise suppression
GPUs are already really good at those, and GPUs are not a fad.
GPUs are already good at those things. But NPUs can be better at those things - and probably more energy efficient too - given optimized domain-specific models to work with.
Cpus are already good enough for terminal display, why would I want a GPU? ;)
This but unironically. I’m obsessed with off-grid, low power processing. I don’t want a stupid fucking NPU I won’t need nor use.
deleted by creator
That’s still something that works more than good enough without the use of an NPU. We’ll see if better use cases come out in future but I’d still prefer that power and die area go to raw CPU processing power.
You’re likely already paying for silicon you don’t use. Take AVX512 instructions (or other more exotic instructions) for example, or unused PCIe lanes, certain encoders on your GPU etc.
Also, people thinking they have no use for an NPU are almost certainly already using them, for example when taking a photo with their phone.
It’s actually extremely power efficient.