Releases: Modern-Compilers-Lab/Tiny-Language-Models-Framework
Releases · Modern-Compilers-Lab/Tiny-Language-Models-Framework
2023-2024 edition
- @kamel-yamani @MarwaNair final version of the repository at the end of their 2023-2024 final year project at ESI.
- Includes the first version of TinyPy Generator which consisted in the 4 complexity levels.
- Uses an adapted version of nano-GPT from Andrej Karpathy for training models from scratch
- Comprises code for fine tuning Llama for generalization of the obtained results