Skip to content

Custom implementation for secure selfhosted LLM inferencing. This repository implements a method to set up two machines, one host, and one client, to allow for completely encrypted connections to ensure secure LLM inferencing.

License

Notifications You must be signed in to change notification settings

Vivekpsps3/Secure-LLM

Repository files navigation

Secure-LLM

Custom implementation for secure selfhosted LLM inferencing. This repository implements a method to set up two machines, one host, and one client, to allow for completely encrypted connections to ensure secure LLM inferencing.

About

Custom implementation for secure selfhosted LLM inferencing. This repository implements a method to set up two machines, one host, and one client, to allow for completely encrypted connections to ensure secure LLM inferencing.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •