Metrics script

[pribadihcr]

Hi, Thanks for the repository.
Bdw is there a convenient script to measure the four metrics (BLEU, SARI, FGL, FRE, and DIFF) mentioned in the paper?

BEST

[tnomoto]

Take a look at https://pypi.org/project/textstat/ for conventional readability metrics like FGL, FRE. SARI can be found at https://github.com/cocoxu/simplification. For BLEU, go to https://www.nltk.org/api/nltk.translate.bleu_score.html. You need to write a code for DIFF by yourself. As it is an average difference in the number of words in a sentence between source and output, it wouldn't be such a hassle.