Skip to content

entrypoint: Add support for starting CMS container with model URI #30

@phoevos

Description

@phoevos

Currently, the entrypoint used for CMS containers only allows serving from local model files. This can be restrictive in cases where using an MLflow URI is desired. Given that the functionality is already supported by the backend and exposed through the CLI, the entrypoint script can simply be extended to use the --mlflow-model-uri option if the associated environment variable is provided on deployment (e.g. through the compose file) instead of the model path.

The added flexibility will benefit upstream apps like the CogStack Model Gateway, which allows deploying CMS instances, but currently has to hardcode the complete entrypoint command (in order to explicitly set the desired flags), leading to potential inconsistencies when changes are introduced on the CMS side.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions