Skip to content
Python CI

Text to SQL RFT example #1442

Sign in to view logs

Text to SQL RFT example

Text to SQL RFT example #1442

Triggered via pull request November 23, 2025 17:28
@benjibcbenjibc
synchronize #324
text_to_sql_example
Status Failure
Total duration 8m 40s
Artifacts 1

ci.yml

on: pull_request
Lint & Type Check
1m 11s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 14s
Batch Evaluation Tests
MCP End-to-End Tests
55s
MCP End-to-End Tests
Upload Coverage
0s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

13 errors and 3 warnings
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1352
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1270
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1196
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1124
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1006
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L914
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L837
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L738
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L682
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_aime25.py#L98
Argument of type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "str"       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartTextParam | ChatCompletionContentPartImageParam]" is not assignable to "None" (reportArgumentType)
Core Tests (Python 3.10)
Process completed with exit code 1.
Core Tests (Python 3.11)
Process completed with exit code 1.
Core Tests (Python 3.12)
Process completed with exit code 1.
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.3 KB
sha256:b137e7b72203e4ae6d6b070ce60bfce5745b89c3dfd49b2ea898465be314b1a3