A CLI tool to interact with open-source LLMs

Installation

1. Clone the repository

git clone https://github.com/debangshu919/chatbotLM.git
cd chatbotLM

2. Install dependencies

pnpm install

3. Create the .env file

cp .env.example .env

4. Add your Nebius Studio API key into the .env file

5. Run the application

pnpm run dev

Tech Stack

• TypeScript
• OpenAI SDK
• CLack

Available models

• openai/gpt-oss-20b
• openai/gpt-oss-120b
• deepseek-ai/DeepSeek-V3
• deepseek-ai/DeepSeek-R1-0528
• google/gemma-2-9b-it-fast
• google/gemma-2-2b-it
• meta-llama/Llama-3.3-70B-Instruct
• meta-llama/Meta-Llama-3.1-8B-Instruct
• mistralai/Devstral-Small-2505
• Qwen/Qwen3-Coder-30B-A3B-Instruct
• Qwen/Qwen3-14B
• zai-org/GLM-4.5-Air

Supported commands

• /help - Shows all available commands
• /clear - Clears the memory
• /switch - Switch LLM
• /exit - Exit the CLI
• /stats - Shows a summary of token consumptions.