The following would be great to add: - [mlc](https://llm.mlc.ai/docs/) - [FlexFlow](https://github.com/flexflow/FlexFlow) - [skypilot](https://skypilot.readthedocs.io/en/latest/) - [aphrodite](https://github.com/PygmalionAI/aphrodite-engine) - [HuggingFace TGI](https://github.com/huggingface/text-generation-inference)
