¡Desconecta con la aplicación Player FM !
Solving the GPU shortage: software to 2-4X existing GPU utilization
Manage episode 376711847 series 2809813
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
320 episodios
Manage episode 376711847 series 2809813
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
320 episodios
Alle episoder
×Bienvenido a Player FM!
Player FM está escaneando la web en busca de podcasts de alta calidad para que los disfrutes en este momento. Es la mejor aplicación de podcast y funciona en Android, iPhone y la web. Regístrate para sincronizar suscripciones a través de dispositivos.