Skip to content

[WeeklyReport] zeroRains 2024.10.28~2024.11.22 #415

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
zeroRains wants to merge 2 commits into
base: main
Choose a base branch
from
Open

[WeeklyReport] zeroRains 2024.10.28~2024.11.22 #415

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
8046ccf
add weeklyreport
zeroRains Nov 23, 2024
c3d82ed
update date
zeroRains Nov 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions WeeklyReports/Hackathon_7th/10_zerorains/[WeeklyReports]2024.10.28~2024.11.22.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
### 卢林军

### 实习项目

推理 Predictor 及 IR Pass 建设

### 本周工作

1. 调研Hugging Face中的设计，并在PaddleNLP中设计并实现了AutoInferenceModel类，实现了推理模型的自动加载。

- https://github.com/PaddlePaddle/PaddleNLP/pull/9416

2. 调研TRT-LLM推理流程，学习用户端推理使用流程。尝试在PaddleNLP中设计AutoPredictor。

- https://github.com/PaddlePaddle/PaddleNLP/pull/9445

### 下周工作

1. 在PaddleNLP中完善AutoPredictor设计并实现
2. 参考append_atten的集成PR，思考SageAttention集成到PaddleNLP中的方式

### 导师点评
Loading