Artwork

Contenido proporcionado por Hugo Bowne-Anderson. Todo el contenido del podcast, incluidos episodios, gráficos y descripciones de podcast, lo carga y proporciona directamente Hugo Bowne-Anderson o su socio de plataforma de podcast. Si cree que alguien está utilizando su trabajo protegido por derechos de autor sin su permiso, puede seguir el proceso descrito aquí https://es.player.fm/legal.
Player FM : aplicación de podcast
¡Desconecta con la aplicación Player FM !

Episode 32: Building Reliable and Robust ML/AI Pipelines

1:15:10
 
Compartir
 

Manage episode 430925619 series 3317544
Contenido proporcionado por Hugo Bowne-Anderson. Todo el contenido del podcast, incluidos episodios, gráficos y descripciones de podcast, lo carga y proporciona directamente Hugo Bowne-Anderson o su socio de plataforma de podcast. Si cree que alguien está utilizando su trabajo protegido por derechos de autor sin su permiso, puede seguir el proceso descrito aquí https://es.player.fm/legal.

Hugo speaks with Shreya Shankar, a researcher at UC Berkeley focusing on data management systems with a human-centered approach. Shreya's work is at the cutting edge of human-computer interaction (HCI) and AI, particularly in the realm of large language models (LLMs). Her impressive background includes being the first ML engineer at Viaduct, doing research engineering at Google Brain, and software engineering at Facebook.

In this episode, we dive deep into the world of LLMs and the critical challenges of building reliable AI pipelines. We'll explore:

  • The fascinating journey from classic machine learning to the current LLM revolution
  • Why Shreya believes most ML problems are actually data management issues
  • The concept of "data flywheels" for LLM applications and how to implement them
  • The intriguing world of evaluating AI systems - who validates the validators?
  • Shreya's work on SPADE and EvalGen, innovative tools for synthesizing data quality assertions and aligning LLM evaluations with human preferences
  • The importance of human-in-the-loop processes in AI development
  • The future of low-code and no-code tools in the AI landscape

We'll also touch on the potential pitfalls of over-relying on LLMs, the concept of "Habsburg AI," and how to avoid disappearing up our own proverbial arseholes in the world of recursive AI processes.

Whether you're a seasoned AI practitioner, a curious data scientist, or someone interested in the human side of AI development, this conversation offers valuable insights into building more robust, reliable, and human-centered AI systems.

LINKS

In the podcast, Hugo also mentioned that this was the 5th time he and Shreya chatted publicly. which is wild!

If you want to dive deep into Shreya's work and related topics through their chats, you can check them all out here:

  1. Outerbounds' Fireside Chat: Operationalizing ML -- Patterns and Pain Points from MLOps Practitioners
  2. The Past, Present, and Future of Generative AI
  3. LLMs, OpenAI Dev Day, and the Existential Crisis for Machine Learning Engineering
  4. Lessons from a Year of Building with LLMs

Check out and subcribe to our lu.ma calendar for upcoming livestreams!

  continue reading

40 episodios

Artwork
iconCompartir
 
Manage episode 430925619 series 3317544
Contenido proporcionado por Hugo Bowne-Anderson. Todo el contenido del podcast, incluidos episodios, gráficos y descripciones de podcast, lo carga y proporciona directamente Hugo Bowne-Anderson o su socio de plataforma de podcast. Si cree que alguien está utilizando su trabajo protegido por derechos de autor sin su permiso, puede seguir el proceso descrito aquí https://es.player.fm/legal.

Hugo speaks with Shreya Shankar, a researcher at UC Berkeley focusing on data management systems with a human-centered approach. Shreya's work is at the cutting edge of human-computer interaction (HCI) and AI, particularly in the realm of large language models (LLMs). Her impressive background includes being the first ML engineer at Viaduct, doing research engineering at Google Brain, and software engineering at Facebook.

In this episode, we dive deep into the world of LLMs and the critical challenges of building reliable AI pipelines. We'll explore:

  • The fascinating journey from classic machine learning to the current LLM revolution
  • Why Shreya believes most ML problems are actually data management issues
  • The concept of "data flywheels" for LLM applications and how to implement them
  • The intriguing world of evaluating AI systems - who validates the validators?
  • Shreya's work on SPADE and EvalGen, innovative tools for synthesizing data quality assertions and aligning LLM evaluations with human preferences
  • The importance of human-in-the-loop processes in AI development
  • The future of low-code and no-code tools in the AI landscape

We'll also touch on the potential pitfalls of over-relying on LLMs, the concept of "Habsburg AI," and how to avoid disappearing up our own proverbial arseholes in the world of recursive AI processes.

Whether you're a seasoned AI practitioner, a curious data scientist, or someone interested in the human side of AI development, this conversation offers valuable insights into building more robust, reliable, and human-centered AI systems.

LINKS

In the podcast, Hugo also mentioned that this was the 5th time he and Shreya chatted publicly. which is wild!

If you want to dive deep into Shreya's work and related topics through their chats, you can check them all out here:

  1. Outerbounds' Fireside Chat: Operationalizing ML -- Patterns and Pain Points from MLOps Practitioners
  2. The Past, Present, and Future of Generative AI
  3. LLMs, OpenAI Dev Day, and the Existential Crisis for Machine Learning Engineering
  4. Lessons from a Year of Building with LLMs

Check out and subcribe to our lu.ma calendar for upcoming livestreams!

  continue reading

40 episodios

Todos los episodios

×
 
Loading …

Bienvenido a Player FM!

Player FM está escaneando la web en busca de podcasts de alta calidad para que los disfrutes en este momento. Es la mejor aplicación de podcast y funciona en Android, iPhone y la web. Regístrate para sincronizar suscripciones a través de dispositivos.

 

Guia de referencia rapida