Skip to content

issue/818 - Create a test api and add load test case from file feature #844

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
wooway777 merged 2 commits into from
Dec 26, 2025
Merged

issue/818 - Create a test api and add load test case from file feature #844

wooway777 merged 2 commits into from
Dec 26, 2025
+585 −168

Conversation

@baominghelly
Copy link
Contributor

@baominghelly baominghelly commented Dec 25, 2025

Description

Create a test api and add load test case from file feature

Test evidence

test command

python test/infinicore/run.py --help

python test/infinicore/run.py --list

python test/infinicore/run.py --nvidia

python test/infinicore/run.py --ops add acos acosh --nvidia --bench

python test/infinicore/run.py --ops add acos acosh --bench --num_prerun 5 --save

python test/infinicore/run.py --load *.json --bench --num_prerun 5 --save

python test/infinicore/run.py --load ./ --bench --num_prerun 50 --save

Test output

test_log.txt

@baominghelly baominghelly linked an issue Dec 25, 2025 that may be closed by this pull request
[DEV] Add test load from test file #818
Closed
wooway777
wooway777 requested changes Dec 26, 2025
View reviewed changes
test/infinicore/framework/api.py Outdated
from .utils.op_test_utils import DynamicCaseGenerator


class TestDiscoverer:
Copy link
Collaborator

@wooway777 wooway777 Dec 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个类感觉叫TestCollector好一些

test/infinicore/framework/api.py Outdated
return False


class TestAPI:
Copy link
Collaborator

@wooway777 wooway777 Dec 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个要不改叫TestManager吧？

test/infinicore/framework/utils/load_utils.py
Copy link
Collaborator

@wooway777 wooway777 Dec 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个文件应该叫load_utils

wooway777
wooway777 requested changes Dec 26, 2025
View reviewed changes
test/infinicore/framework/utils/op_test_utils.py Outdated
main()
'''

class DynamicCaseGenerator:
Copy link
Collaborator

@wooway777 wooway777 Dec 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dynamic是否有必要？以及这里parse出来的是file不是case是吧？

@baominghelly baominghelly requested a review from a team December 26, 2025 10:26
@wooway777 wooway777 self-requested a review December 26, 2025 10:29
@wooway777 wooway777 merged commit 27777ee into main Dec 26, 2025
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@wooway777 wooway777 wooway777 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[DEV] Add test load from test file

3 participants

@baominghelly @wooway777