REX - GenAI in prod : practical tech & product insight for delivering value

Speaker

• François Paupier, Machine Learning Engineer

Prerequisites

- Good knowledge in ML/Data/IA
Basic understanding of LLM, and RAG advised. Ideally you got yours hands dirty trying to build or sell a user a RAG solution by yourself.

Présentation REX :

GenAI and especially large language models (LLMs) are reshaping the tech and AI ecosystem since ChatGPT release in nov 2022. Since then, an increasing number of organisations are sharing the weights of their pretrained and finetuned model with relatively permissive license. Among the use cases of LLM, the possibility to use them on top of a database of (un)structured documents to perform retrieval and synthesis for question answering with accurate semantics is booming - this is Retrieval Augmented Generation (RAG).

If it sounds promising, building a RAG-based solution that actually solves a user’s need is no easy task. On the tech side, choosing the appropriate models for embedding and generation, evaluating performances, and monitoring costs have no silver bullet solutions as of today and many machine learning engineer teams develop their own pipeline. Meanwhile, on the product side, articulating the unique value proposition of RAG and educating the market about its potential benefits and limitations remains a challenging task when handling data protection and dealing with hallucinations.
This meetup is a synthesis of interviewing several organisations, with various level of maturity in their LLM and RAG journey to gather insights and share with you actionnable tips you can leverage in building incredibly helpful products.

Key Takeaways

Slides in pdf will be made available for free on the speaker twitter at the end of the talk @fpaupier.
Technical Challenges of RAG: we’ll review the complexities of selecting models, evaluating performance, and managing costs in the development of RAG-based solutions.
Product Strategy: we’ll share insights into defining the unique value proposition of RAG for your users and navigating the market's learning curve.
Actionable Tips: we’ll distill the feedback of interviews with several C levels, tech lead and ML lead from various companies on their experiences in RAG implementation.

Cet événement est réservé à nos membres, mais nous gardons quelques places pour ceux qui souhaiteraient découvrir le club. N'hésitez à vous inscrire vous serez sur liste d'attente et nous vous confirmerons votre participation 3 jours avant l'événement.

2409-Paupier-GenAIinProd

Host or Publisher datacraft