Skip to content

Releases: SKKU-ESLAB/specinfer.cpp

b5704

19 Jun 11:12
4dfbeed

Choose a tag to compare

[EAGLE] Initial support for EAGLE model (#1)

* [EAGLE] Initial support for EAGLE model

Added the definition and ```decode``` function for the EAGLE model.
Also added a sequence-based speculative decoding example using the EAGLE draft model under ```examples/speculative-simple-eagle```.