Missing files

[Jalilnkh]

You mentioned that for making the model Android-Compatible: We use an entirely different tokenization procedure.
Could you let us know where are these files?

1. Run final_tokenizer_train.py
2. Run spm_extractor.py

I couldn't find them in GitHub.

[harshitadd]

Please navigate to the transformer-dev branch and use (a) make_concatenated_vocab.py followed by (b) spm_model_generator.py and finally (c) spm_extractor.py to train and generate the android compatible vocal files.

You can use the directory structure explanation to see the right description of each file for the transformer in case you notice any other files missing (possibly renamed and not adequately updated in the readme).