PrivateGPT is a production-ready service offering Contextual Generative AI primitives like document ingestion and contextual completions through a new API that extends OpenAI’s standard.
Talk to your documents privately using the default UI and RAG pipeline or integrate your own.
Zylon
99 posts
The On-Premise AI Infrastructure for Regulated Industries keeping your data secure and cost fixed with unlimited tokens.
Builders of PrivateGPT (57k GitHub ⭐)
Joined October 2023
- In case you missed today's @llama_index webinar "Building Production RAG with Local Models (featuring PrivateGPT)", here you can find the slides we presented with a complete overview of the project so far 👀 drive.google.com/file/d/1RxBjoE… Thanks to @jerryjliu0 for hosting the team 🙏
- 🚀 Exciting Project Update: v.0.2.0 is out!🚀 Contributors have been working hard transforming PrivateGPT for a faster, more secure, and customizable experience! 🌐 Dive into the details below 👇
- @llama_index has been a reference project for us since day 1, so we are proud to be speaking about PrivateGPT, RAG design, privacy in GenAI products and much more in their next webinar 😊 📺 Join us and @jerryjliu0 on Wednesday at 9am PTWant to learn how to build a production-ready RAG stack using purely local models? We’re excited to be hosting a special webinar with @ivanmartit and @thanos_malkav on @PrivateGPT_AI - the leading project for privacy-aware RAG. it’s powered by @llama_index, and you can also
- Less than a month after releasing our new revamped version, PrivateGPT is back to being the Top Trending repository on @github 🥇 while passing the 40K stars ⭐️ THANKS everyone for your support!!! ♥️ Stick around, great things are coming to this project and its community 🚀
- Really interesting way of bringing the power of ColBERT (github.com/stanford-futur…) to use advance retrieval techniques based on fine-grained contextual late interaction 👀 Should we create a new RAG implementation in PrivateGPT following this approach❓The RAG wave is here to stay, but in practice, it's hard to retrieve the right docs w/ embdings, & better IR models are hard to use! Let's fix that: Introducing 🪤RAGatouille, a lib to train&use SotA retrieval model, ColBERT, in just a few lines of code! github.com/bclavie/RAGato…
- Happy to announce that @qdrant_engine has become the default #VectorDatabase for us 🚀 As a result, we incorporate high-performance vector similarity search into #private AI applications 💪 Cheers to a fantastic collaboration! 👏 👀 Integrations docs: qdrant.tech/documentation/…
- 📺 @MatthewBerman just published a new great video describing all the new features we have recently launched youtu.be/XFiof0V3nhA?fe… 🙏Thanks again for supporting us since day 1 and helping sharing the project with the community 🎁 Stay until the end for a little surprise!
- 📃 Sources in Completions API: Get info (text + metadata) about the Chunks used during inference by the contextual Completions APIs by adding: {"include_sources": true } to the request Body. Sources are enabled by default in the UI. 👩💻 Docs: docs.privategpt.dev/#tag/Contextua…
- 🧠PrivateGPT's Ingest API returns the *doc_id* and the extracted *doc_metadata* - btw, it works great with @llama_index's Metadata Extractors! Here are a few cool use cases that illustrate why this is incredibly useful for developers: 🧵
- Here is a great hands-on article by @CognitiveTech_ who uses @PrivateGPT_AI to compare the impact of - 🤖 Models - 🔡 Prompt styles - 🦾 System prompts - ✍️ User prompts on private, AI-powered book summarization Article: hackernoon.com/privategpt-for… Project: github.com/cognitivetech/…
- Replying to @ZylonPrivateGPT💬 And for those just wanting to talk to their documents in a plug-and-play way, we have made things easier with the new PrivateGPT UI! Now you can upload documents, select the interaction mode with your LLM (query, chat or chunks) and talk to it through a prompt.
- 🗓️ 3 months ago we launched the brand new version of PGPT along with its Discord server and we are already 2.3K members collaborating on a daily basis in it: discord.gg/bK6mRVpErU Big thanks to this amazing community: you are the real fuel of this project 🥰🚀












