Skip to content

Green0-0/propagate

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

239 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

header

Train thinking models using evolutionary strategies!

🏃 Quick Start:

  1. Clone this repo: git clone https://github.com/Green0-0/propagate

  2. Setup your venv and install vllm: https://docs.vllm.ai/en/v0.11.2/getting_started/installation/

  3. Install the dependencies: cd propagate && pip install -e .

Propagate should work wherever vLLM does, including on windows! Look for a fork of https://github.com/SystemPanic/vllm-windows with the appropriate CUDA version, and remove distributed_executor_backend="ray", from vllm_backend.py.

  1. Run python examples/demo_countdown.py. You should be prompted to login to wandb, and then training will begin!

📖 Guide

📜 Credits:

About

Evolutionary strategies finetuning library for LLMs

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages