This chatbot is a generative AI chatbot that can answer questions about React documentation using RAG (retrieval augmented generation) pipeline.
It is built using Next.js ai sdk and cheerio for web scraping and langchain to split the text into sentences. It uses drizzle ORM to store the embeddings of the scraped data and uses the embeddings to generate answers to the questions asked by the user.
First, run the development server:
npm run dev
# or
yarn dev
# or
pnpm dev
# or
bun devOpen http://localhost:3000 with your browser to see the result.
This project uses next/font to automatically optimize and load Geist, a new font family for Vercel.
- Generative AI Chatbot: The chatbot is built using Vercel's AI SDK and can answer questions about React documentation.
- RAG (retrieval augmented generation) pipeline: The chatbot uses cheerio to scrape the React documentation website (or any website) and generate embeddings and store them to vector db.
This project is deployed on vercel and can be accessed here
NOTE: there is a rate limit applied and hence the chatbot may not work after a certain number of requests.
To learn more about Next.js, take a look at the following resources:
-
Next.js Documentation - learn about Next.js features and API.
-
Learn Next.js - an interactive Next.js tutorial.
-
Learn Vercel ai sdk - The AI SDK is the TypeScript toolkit designed to help developers build AI-powered applications with React, Next.js, Vue, Svelte, Node.js, and more.
-
RAG chatbot - Learn how to build a RAG (retrieval augmented generation) pipeline chatbot using Vercel's AI SDK.
-
Learn Cheerio - Fast, flexible & lean implementation of core jQuery designed specifically for the server.