Skip to content

feat: integrate Marlin/AllSpark INT8 W8A16 quantization strategy

dde9962
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Feat/kv cache fp8 support #23

feat: integrate Marlin/AllSpark INT8 W8A16 quantization strategy
dde9962
Select commit
Loading
Failed to load commit list.
Job log options

This job was skipped