AI Starter Kit
A minimal code base for creating AI apps to do Question Answering (QA) over PDF documents, completely locally.
How to get started
- Clone this repo:
git clone https://github.com/mallahyari/ai-starter-kit.git
- Install backend dependencies:
cd backend/app pip install -r requirements.txt
- Install frontend dependencies:
cd frontend npm install
- Start the Qdrant vector database (you need Docker). See here for other options information:
docker run -p 6333:6333 qdrant/qdrant
Install Ollama Instructions are here
Run the FastApi server (from inside
- Open a new terminal and start the React development server (from inside
You can change configurations in
.config file, such as the embedding model, chunk size, and chunk overlap. If you plan to use Qdrant Cloud, you can or you can create your own
.env file and set necessary api keys.
Additional Use Cases
Although current app only support pdf files, it’s very straightforward to add other types of files such as text files, etc. Also, you can easily add the open-ended chat in addition to QA over document use case.