llm_alignment

---

DPO

• create env and install dependencies:

  conda create -n dpo python=3.9
  conda activate dpo
  pip install -r requirements.txt
  pip install --upgrade datasets