Skip to content

ammarsaf/llm_rag_pgvector

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Overview

  • Implementing pgVector as vector database on top of PostgreSQL, use it as retriever and pass it to LLM as RAG.

Pre-requisite

  • Docker: To pull pgvector, postgresql and pgadmin interface images from DockerHub and run it, setup vector database and serve as retriever.
  • OpenAI account: To call the LLM api.
  • Memory: 12GB and above.

Docker Setup

Compose

  1. cd into the project dir. Please ensure the docker-compose.yml is exist.
  2. Run
docker-compose up
  1. Login PGadmin4 thru http://localhost:82/
  2. Create server group.
  3. Register server
    • Ensure to check "IP address" of pgvector container inspect as this is the Hostname to register server. ie "IPAddress": "172.17.0.3",
    • Connect to the pgvector database server.

Source

Todo

  • Create docker-compose.yml to run both container at the same time easily.
  • Building multimodal RAG db on PGvector.

About

Implementing pgVector as vector database on top of PostgreSQL, use it as retriever and pass it to LLM as RAG.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors