Skip to content

support for tokenids logprobs #1468

support for tokenids logprobs

support for tokenids logprobs #1468

Triggered via pull request November 26, 2025 02:09
Status Success
Total duration 8m 34s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 5s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 18s
Batch Evaluation Tests
MCP End-to-End Tests
55s
MCP End-to-End Tests
Upload Coverage
6s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 3 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.3 KB
sha256:3f3bde47a2c2968dda2f6d74c5356dff8ad31748049f329db721c0572d3868ad
coverage-core-3.10 Expired
62.5 KB
sha256:be4e02099980c179d4c36104d63e63e6ab97b1f0d8fdd2c9e941b8ef658fc22f
coverage-core-3.11 Expired
62.5 KB
sha256:fe8afd8ec6a1847fb3fc8ce4dbdffc01421d1f624fba2771a04bcff5aa205ea2
coverage-core-3.12 Expired
62.5 KB
sha256:1457296927e324dc2366471729d0860f30de766c973cdd53d3d6bb5910bd74a2