The repository is based on MMSA.
We strongly recommend integrating the core code directly into the MMSA framework. This repository is structured entirely in line with the MMSA setup. However, minor issues may still arise, and we suggest directly incorporating the files from this repository into the MMSA framework for seamless execution.
The main model is in GsiT/src/MMSA-GsiT/models/custom/GSIT/.
The main model trainer is in GsiT/src/MMSA-GsiT/trains/custom/GSIT.py.
The main configuration is in GsiT/src/MMSA-GsiT/config/config_regression.json.
The Triton kernel is in GsiT/src/MMSA-GsiT/models/custom/GSIT/modules/Kernel.
New kernel implementation is as follows:
We are planning to add a PR to MMSA framework.