Skip to content

Conversation

@mathurk
Copy link
Collaborator

@mathurk mathurk commented Dec 27, 2025

Development Package

  • Use uipath pack --nolock to get the latest dev build from this PR (requires version range).
  • Add this package as a dependency in your pyproject.toml:
[project]
dependencies = [
  # Exact version:
  "uipath==2.3.4.dev1010533563",

  # Any version from PR
  "uipath>=2.3.4.dev1010530000,<2.3.4.dev1010540000"
]

[[tool.uv.index]]
name = "testpypi"
url = "https://test.pypi.org/simple/"
publish-url = "https://test.pypi.org/legacy/"
explicit = true

[tool.uv.sources]
uipath = { index = "testpypi" }

[tool.uv]
override-dependencies = [
    "uipath>=2.3.4.dev1010530000,<2.3.4.dev1010540000",
]

@github-actions github-actions bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository labels Dec 27, 2025
logger.warning(f"Model settings ID '{self.context.model_settings_id}' not found in evaluation set")
return None

console.info(f"Found model settings: model='{target_model_settings.model_name}', temperature='{target_model_settings.temperature}'")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use logger, console is a CLI concept (imagine we extract the evals engine to another library)

return None

# Load the original entrypoint file
entrypoint_path = Path(self.context.entrypoint or "agent.json")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We shouldn't leak agent.json concepts here .. similar comment: #1048 (review)

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1.

The other PR uses protocols to break this. Maybe we need to update the protocol method to return EvaluationSetModelSettings instead of model_name.

max_tokens: int | None = Field(default=None, alias="maxTokens")


class EvaluationSetModelSettings(BaseModel):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we reuse ModelSettings instead? EvaluationSetModelSettings seems to be a subset of ModelSettings, so it should be forward-compatible.

@mathurk mathurk added the build:dev Create a dev build from the pr label Dec 30, 2025
@cristipufu
Copy link
Member

@mathurk @Chibionos we added this "metadata" bag to UiPathRuntimeSchema: UiPath/uipath-runtime-python@01ec08b

You can add these settings in the low-code agents repo, and access them here via the schema.metadata prop. It should simplify things

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build:dev Create a dev build from the pr test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants