InferenceParams backend specific #92
Description
Use backend specific inference params - That means create abstraction ofer current inference params, assumption is that then each backend specific service can interpret them as needed
{{ message }}
Use backend specific inference params - That means create abstraction ofer current inference params, assumption is that then each backend specific service can interpret them as needed