Productionize LLM RAG App in Django — Part I: Celery | by Wen Yang | Apr, 2024


Automate Pinecone Daily Upsert Task with Celery and Slack monitoring

Image credit: Outside Inc

It’s been a while since my last LLM post and I’m excited to share that my prototype has been successfully productionized as Outside’s first LLM-powered chatbot, Scout. If you are an Outside+ member, you can check it out over at https://scout.outsideonline.com/.

This journey began as my weekend curiosity project back in March 2023. I had the idea to build a Q&A chatbot using OpenAI’s LLMs and Outside’s content as a knowledge base. Later I shared my prototype at our internal product demo day and I was thrilled by the interest it managed to spark. Scout quickly became an official project. On November 28th 2023, we launched Scout to limited Outside+ members. Fast forward to today, April 12th, 2024, over 28.3k unique users have already utilized this Outdoor Companion AI tool.

I couldn’t be more grateful for this moonstruck experience and I’ve been planning to write a mini-series to share some behind-the-scenes insights into what it takes to bring LLM & RAG powered apps to life. So far I’ve planned to cover the following three parts:

  • 🦦 Part 1: Automate Pinecone Daily Upserts with Celery and Slack monitoring
  • 🦦 Part 2: Building an LLM Websocket…



Source link

Be the first to comment

Leave a Reply

Your email address will not be published.


*