Jeff Huber of Chroma: Building the open-source toolkit for AI Engineering

High Agency: The Podcast for AI Builders

#Tech #Raza Habib #Large Language Models #Generativeai #AI Products #Ai Playbooks

1:16:55

On her son’s prom night, Mel Robbins fussed over details that didn’t matter. Her daughter grabbed her arm and said, “Let them. Let them run in the rain. Let them eat where they want. Let them.” Those two simple words hit Mel like a ton of bricks and completely changed how she thinks about control. In this episode, Mel shares some of the pivotal moments that shaped her career, her innovative strategies for overcoming adversity, and how the Let Them Theory can help you navigate business challenges, strengthen relationships, and unlock your true power. In this episode, Hala and Mel will discuss: (00:00) Introduction (02:57) The Power of Action (04:22) Mel's Unforgettable TED Talk Debut (07:00) The 5 Second Rule (07:52) Building Unshakable Confidence (12:04) Turning Adversity into Strength (22:00) The Power of Showing Up for Others (30:40) Why Details Matter in Business (42:32) Understanding the Let Them Theory (51:14) The Let Them Theory in Business Mel Robbins is a motivational speaker, the host of The Mel Robbins Podcast, and a bestselling author of several influential books, including her latest, The Let Them Theory. Known for her groundbreaking 5 Second Rule, she has helped millions of people take action and transform their lives. With 30 million views, her TEDx talk made her a recognized voice in behavior change. Mel is also the CEO of 143 Studios, a female-driven media company creating award-winning content for top brands like LinkedIn and Audible. She is a Forbes 50 Over 50 Honoree and one of USA Today’s Top 5 Mindset Coaches. Resources Mentioned: Mel’s Books: The Let Them Theory: A Life-Changing Tool That Millions of People Can't Stop Talking About : https://amzn.to/4h6quLh The 5 Second Rule: Transform your Life, Work, and Confidence with Everyday Courage : https://amzn.to/3WdAgTX Sponsored By: OpenPhone - Get 20% off 6 months at https://www.openphone.com/PROFITING Shopify - Sign up for a one-dollar-per-month trial period at https://www.youngandprofiting.co/shopify Airbnb - Your home might be worth more than you think. Find out how much at https://www.airbnb.com/host Rocket Money - Cancel your unwanted subscriptions and reach your financial goals faster with Rocket Money. Go to https://www.rocketmoney.com/profiting Indeed - Get a $75 job credit at indeed.com/profiting Active Deals - youngandprofiting.com/deals Key YAP Links Reviews - ratethispodcast.com/yap Youtube - youtube.com/c/YoungandProfiting LinkedIn - linkedin.com/in/htaha/ Instagram - instagram.com/yapwithhala/ Social + Podcast Services : yapmedia.com Transcripts - youngandprofiting.com/episodes-new All Show Keywords: Entrepreneurship, entrepreneurship podcast, Business, Business podcast, Self Improvement, Self-Improvement, Personal development, Starting a business, Strategy, Investing, Sales, Selling, Psychology, Productivity, Entrepreneurs, AI, Artificial Intelligence, Technology, Marketing, Negotiation, Money, Finance, Side hustle, Startup, mental health, Career, Leadership, Mindset, Health, Growth mindset. Career & Entrepreneurship Career, Success, Entrepreneurship, Productivity, Careers, Startup, Entrepreneurs, Business Ideas, Growth Hacks, Career Development, Money Management, Opportunities, Professionals, Workplace, Career podcast, Entrepreneurship podcast…

hace un año 54:59

MP3•Episodio en casa

00:00 - Introduction
02:30 - Why vector databases matter for AI
06:00 - Understanding embeddings and similarity search
12:00 - Chroma early days
15:45 - Problems with existing vector database solutions
19:30 - Workload patterns in AI applications
23:40 - Real-world use cases and search applications
27:15 - The problem with RAG terminology
31:45 - Dynamic retrieval and model interactions
35:30 - Email processing and instruction management
39:15 - Context windows vs vector databases
42:30 - Enterprise adoption and production systems
45:45 - The journey from GPT-3 to production AI
48:15 - Internal vs customer-facing applications
51:00 - Advice for AI engineers

--------------------------------------------------------------------------------------------------------------------------------------------------
Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com

31 episodios

Jeff Huber of Chroma: Building the open-source toolkit for AI Engineering

High Agency: The Podcast for AI Builders

published hace un año

MP3•Episodio en casa

31 episodios

#Tech #Raza Habib #Large Language Models #Generativeai #AI Products #Ai Playbooks

Todos los episodios

High Agency: The Podcast for AI Builders

1
Saving Pharma Companies Billions with AI l Patrick Leung from Faro Health 48:04

hace 12 días48:04

48:04

In this episode of High Agency, Patrick Leung from Faro Health explains how they're using AI to revolutionize clinical trial design by both generating regulatory documents and extracting insights from thousands of existing trials. Patrick emphasises the essential collaboration between clinical experts and AI engineers when building reliable systems in healthcare's high-stakes environment. Chapters: 00:00 - Introduction 04:26 - Clinical trials before: Microsoft Word Documents 08:17 - Document generation using AI 12:26 - What makes clinical trials so expensive 16:26 - Parsing and processing clinical trial data 18:04 - Challenges with traditional evaluation metrics 21:28 - Importance of domain experts in the evaluation process 24:35 - Collaboration between domain experts and engineering 31:26 - Building a graph-based knowledge system 34:27 - Roles and skillsets required 38:06 - Lessons learned building LLM products 40:56 - Discussion on AI capabilities and limitations 46:07 - Is AI overhyped or underhyped ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
100x Hiring Speed with Superhuman Recruiters l Metaview Co-Founder 53:07

hace 26 días53:07

53:07

In this episode, Raza is joined by Shahriar Tajbakhsh, the co-founder of Metaview. They discuss how Metaview’s AI scribe automates interview note-taking, how AI agents can surface top candidates from thousands of resumes, and why hiring managers should think of AI as a co-worker, not just a tool. Raza's recomended reading: Creating a LLM-as-a-Judge That Drives Business Results . Chapters: 00:00 - Introduction 03:32 - How AI Co-Workers Are Transforming Recruiting 06:21 - Inside MetaView: AI Scribe and Workflow Automation 09:11 - Unlocking Hiring Insights with AI-Driven Conversations 11:30 - Balancing AI Innovation and User Adoption 14:05 - Metaview’s Tech Stack and the Role of LLMs 18:29 - How MetaView Generates Superhuman Interview Notes 23:18 - The Challenges of Building Reliable AI Hiring Agents 32:40 - The Future of AI in Hiring: Automating Job Descriptions 40:26 - AI Co-Workers That Work While You Sleep 47:08 - Why Vertical AI Will Win Over General AI Agents 50:24 - The Underrated Power of Graph-Based AI ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
AI Will Replace Command Lines I Ex-Google Tech Lead and Founder at Warp 47:45

hace 6 weeks47:45

47:45

In this episode, Raza Habib chats with Zach Lloyd, CEO and founder of Warp, about how AI is transforming the developer experience. They explore how Warp is reimagining the command line, the power of AI-driven automation, and what the future holds for coding workflows. Chapters: 00:00 - Introduction 04:06 - Why the terminal needed reinvention 07:11 - AI’s role in Warp’s evolution 08:55 - Key AI features in Warp 12:49 - Balancing safety, reliability, and usability 19:43 - Challenges in AI-Powered development 22:33 - Changing developer behavior with AI 27:24 - Prompt engineering and context optimization 31:05 - Lessons for building AI products 37:50 - The future of AI in software development 46:42 - Underappreciated AI innovations ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Google Is Dead: How This 144-GPU Startup Is Building Einstein-Level AI Search I Will Bryk | Exa CEO 38:44

hace 8 weeks38:44

38:44

Will Bryk, CEO of Exa, sits down with Raza Habib to reveal why traditional search engines are becoming obsolete and how his startup is building an AI-powered search engine for the future. From constructing a massive GPU cluster to predicting AI will surpass human mathematicians by 2026, Will shares fascinating insights about the technological breakthroughs that will reshape society in the coming months. Chapters: 00:00 - Introduction 05:13 - Exa as a Tool for LLMs and Neural Search 06:19 - Introducing "Websets" and Its Use Cases 10:16 - Building a Compute Cluster: Why Own vs. Rent? 12:00 - The Bitter Lesson and Scalability in AI 17:11 - Interesting Use Cases for Exa 19:44 - People Search and CRM Opportunities 21:10 - Predictions for AI Progress and Test-Time Compute 27:10 - Implications of AI on Creative Tasks and Society 29:15 - Automation, Jobs, and the Knowledge Economy 33:57 - What Could Stop AI Progress? 36:22 - Advice for AI Builders and Entrepreneurs ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
$100M raised: How Decagon is building better AI agents I Jesse Zhang 41:45

hace 10 weeks41:45

41:45

In this episode, Jesse Zhang joins Raza to discuss building cutting-edge AI agents for customer support. They explore how his early passion for LLMs led to creating a company that’s transforming the way businesses like Rippling, Duolingo, and Webflow interact with customers. Jesse breaks down the challenges of scaling AI systems, the importance of customer feedback, and his predictions for the future of AI. Chapters: 00:00 - Introduction and Jesse Zhang's Background 01:17 - First Exposure to LLMs and Building Early Projects 04:32 - Decagon’s Rapid Growth and Differentiation in AI 06:37 - Understanding Decagon’s AI Customer Support Product 10:21 - Challenges in Building High-Performance AI Systems 13:14 - Evolution from Simple RAG to Agent Architectures 16:54 - Measuring Accuracy with Evals and Customer Feedback 19:05 - Balancing Customization and Reusability Across Clients 22:35 - Handling Customer Data and Incremental Deployment 25:21 - Restructuring Support Teams for AI Integration 27:03 - Team Composition and the Role of Domain Expertise 29:19 - Advice for New AI Builders: Customer-Driven Development 32:21 - Key Insights on AI Agents and Enterprise Adoption 36:34 - Predictions for AI Advancements in 2025 39:41 - Is AI Overhyped or Underhyped? 41:07 - Closing Remarks and Final Thoughts ------------------------------------------------------------------------------------------------------------------------------------------------ Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How GitHub Copilot Became the First LLM-Powered Developer Tool with Ryan Salva 38:53

hace 12 weeks38:53

38:53

On this week's episode, former GitHub Copilot lead Ryan Salva breaks down how AI coding tools became ubiquitous almost overnight. They discuss the critical differences between what novice and expert developers expect from AI, why starting with predictive text was both a blessing and a curse, and how the rapid adoption of AI assistance is reshaping the future of software development. Chapters: 00:00 - Introduction 01:09 - The Creation of GitHub Copilot 05:39 - From Prototype to Product: Challenges in Scaling 07:37 - How GitHub Copilot Works Behind the Scenes 11:18 - Metrics That Matter: Evaluating AI Success 14:43 - Building Momentum: What It Feels Like to Launch a Hit 17:51 - The Evolution of AI Tools for Developers 21:13 - Evaluations and Testing in AI Development 26:00 - The Role of Automation and the Future of Coding 30:53 - Will Engineers Still Write Code in the Future? 33:16 - Advice for Aspiring AI Builders 36:51 - Is AI Overhyped or Underhyped? 38:17 - Closing Reflections ---------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
What Gives an AI Founder Staying Power I James Theuerkauf, CEO of Syrup Tech I Sara Ittelson, Partner at Accel 43:36

hace 14 weeks43:36

43:36

In this week's episode, Raza speaks with James Theuerkauf, CEO of Syrup Tech, and Sara Ittelson, Partner at Accel, to explore the challenges and opportunities for entrepreneurs in this transformative era. They discuss building AI-first companies and the lessons learned from scaling in a rapidly evolving space. With practical tips on leveraging data, creating competitive advantages, and sustaining passion for the long haul, this episode offers invaluable guidance for founders in AI. Chapters: 00:00 - Introduction and Guest Backgrounds 01:27 - Syrup Tech’s Approach to AI in Retail 03:29 - The Role of AI in Demand Forecasting 08:49 - Building Effective AI Systems and Teams 15:30 - How Generative AI is Shaping Businesses 19:18 - Advice for Founders in the AI Era 28:15 - Building an AI-First Company 33:26 - Innovations and Trends in AI 38:47 - Is AI Overhyped or Underhyped? 42:46 - Closing Thoughts and Reflections -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How to build great AI products with Vanta Software Developer Noam Rubin 40:57

hace 15 weeks40:57

40:57

In this episode, Noam Rubin, a Software Developer at Vanta reveals how his team uses data-driven strategies to design, test, and improve cutting-edge AI features. Learn how customer insights, rapid prototyping, and iterative development transform raw ideas into tools that make compliance and security easier for businesses everywhere. Chapters: 00:00 - Introduction 02:47 - The process of building AI products at Vanta 04:51 - The role of customer feedback in product development 06:59 - Integrating AI into security and compliance workflows 08:06 - Using data specifications to guide product development 10:10 - Collaborating with subject matter experts to refine AI models 12:14 - Iterative testing and refining AI features 14:10 - Quality control and ensuring AI accuracy 16:00 - The importance of dogfooding and internal feedback loops 18:23 - Scaling AI features and rolling them out to wider audiences 20:50 - Educating engineers and democratizing AI at Vanta 22:20 - Key lessons learned from building AI products 24:12 - Maintaining AI quality through continuous feedback 26:00 - The future of AI in business and product development…

High Agency: The Podcast for AI Builders

1
Predictions for AI in 2025 I Ex-OpenAI, Ex-Stripe researcher Stanislav Polu 44:27

hace 16 weeks44:27

44:27

In this episode of High Agency, former OpenAI researcher Stan Polu shares his journey from AI research to founding Dust, an enterprise AI platform. Stan offers a contrarian view on the future of AI, suggesting we may be hitting a plateau in model capabilities since GPT-4. He discusses why startups should focus on product-market fit before investing in GPUs, shares practical lessons for building AI products, and predicts increased competition between AI labs and API developers. Chapters: 00:00 - Introducing Dust: an enterprise AI platform 06:07 - From Stripe to OpenAI: Stan's journey 10:29 - Why research wasn't enough: building Dust 15:10 - Best practices for building an AI product 20:50 - Is prompt engineering here to stay 23:40 - Understanding language models and their limitations 32:56 - Predictions for AI in 2025 39:53 - Measuring progress toward AGI 42:26 - The true value of AI technology -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is the LLM evals platform for enterprises. We give you the tools that top teams use to ship and scale AI with confidence. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How Replicate is Democratizing AI with Open-Source Resources 36:15

hace 20 weeks36:15

36:15

In this episode, we explore how Replicate is breaking down barriers in AI development through its open-source platform. CEO Ben Firshman shares how Replicate enables developers without machine learning expertise to run AI models in the cloud. 00:00 Introduction 00:29 Overview of Replicate 03:13 Replicate's user base 05:45 Enterprise use cases and lowering the AI barrier 07:45 The complexity of traditional AI deployment 10:24 Simplifying AI with Replicate's API 13:50 ControlNets and the challenges of image models 19:42 Fragmentation in AI models: images vs. language 25:05 Customization and multi-model pipelines in production 26:33 Learning by doing: skills for AI engineers 28:44 Applying AI in governments 31:12 Iterative development and co-evolution of AI specs 33:13 Final reflections on AI hype 35:18 Conclusion -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
The Principles for Building Excellent AI Features with Superhuman’s Lorilyn McCue 42:35

hace 21 weeks42:35

42:35

How do you build AI tools that actually meet users’ needs? In this episode of High Agency, Raza speaks with Lorilyn McCue, the driving force behind Superhuman’s AI-powered features. Lorilyn lays out the principles that guide her team’s work, from continuous learning to prioritizing user feedback. Learn how Superhuman’s "learning-first" approach allows them to fine-tune features like Ask AI and AI-driven summaries, creating practical solutions for today’s professionals. 00:00 - Introduction 04:20 - Overview of the Superhuman 06:50 - Instant Reply and Ask AI 10:00 - Building On-Demand vs. Always-On AI Features 13:45 - Prompt Engineering for Effective Summarization 22:35 - The Importance of Seamless AI Integration in User Workflows 25:10 - Developing Advanced Email Search with Contextual Reasoning 29:45 - Leveraging User Feedback 32:15 - Balancing Customization and Scalability in AI-Generated Emails 36:05 - Approach to Prioritization 39:30 - Real-World Use Cases: The Versatility of Current AI Capabilities 43:15 - Learning and Staying Updated in the Rapidly Evolving AI Field 46:00 - Is AI Overhyped or Underhyped? 49:20 - Final Thoughts and Closing Remarks -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Jeff Huber of Chroma: Building the open-source toolkit for AI Engineering 54:59

hace 23 weeks54:59

54:59

This week on High Agency, Raza Habib is joined by Chroma founder Jeff Huber. They cover the evolution of vector databases in AI engineering, challenge common assumptions about RAG and share insights from Chroma's journey. Jeff shares insights from Chroma's development, including their focus on developer experience and observations about real-world usage patterns. They also get into whether or not we can expect a super AI any time soon and what is over and under hyped in the industry today. 00:00 - Introduction 02:30 - Why vector databases matter for AI 06:00 - Understanding embeddings and similarity search 12:00 - Chroma early days 15:45 - Problems with existing vector database solutions 19:30 - Workload patterns in AI applications 23:40 - Real-world use cases and search applications 27:15 - The problem with RAG terminology 31:45 - Dynamic retrieval and model interactions 35:30 - Email processing and instruction management 39:15 - Context windows vs vector databases 42:30 - Enterprise adoption and production systems 45:45 - The journey from GPT-3 to production AI 48:15 - Internal vs customer-facing applications 51:00 - Advice for AI engineers -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
How to Create AI Strategy in Enterprises with Peter Gostev from Moonpig 39:54

hace 24 weeks39:54

39:54

In this episode of High Agency podcast, Peter Gostev shares his experiences implementing LLMs at NatWest and Moonpig. He discusses creating an AI strategy, talks about challenges in deploying LLMs in large organizations, and shares thoughts on underappreciated AI developments. 00:00 - Introduction 00:44 - OpenAI dev day reactions 03:47 - Using AI to automate customer service 10:43 - Impact of AI products 13:41 - Who are the users of LLMs 14:47 - Challenges building with AI in a large enterprise 21:22 - AI use cases at Moonpig 24:34 - How to create an AI strategy 28:10 - Underappreciated AI developments -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an LLM evals platform for enterprises. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Ex-Coinbase CPO's Next Big Thing: AI Employees I Surojit Chatterjee 44:43

hace 26 weeks44:43

44:43

In this episode of High Agency, we're joined by Surojit Chatterjee, former CPO of Coinbase and now CEO of Ema. Surojit unveils his audacious plan to create universal AI employees and revolutionize Fortune 1000 workforce. Drawing from his career at tech giants like Google and Coinbase, he shares how these experiences fueled his vision for Ema. Surojit dives into the challenges of building AI agents, explores the concept of artificial humans, and predicts how this technology could transform the future of SaaS (00:00:00) Introduction and Surojit’s background (00:03:00) Founding story of Ema (Universal AI Employee) (00:04:53) How the Universal AI Employee works (00:08:39) Ema’s data integration and security (00:12:57) AI employee use cases in enterprises (00:15:02) Challenges with building AI agents (00:16:45) Evaluations, hallucinations, customizing models (00:19:52) Artificial human metaphor (00:25:42) AI employee vs humans (00:31:25) Advice for AI builders (00:37:14) Is AI overhyped or underhyped? (00:39:28) How the business model of SaaS will change -------------------------------------------------------------------------------------------------------------------------------------------------- Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com…

High Agency: The Podcast for AI Builders

1
Why Your AI Product Needs Evals with Hamel Husain and Swyx 1:09:02

hace 27 weeks1:09:02