Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WeeklyReport] zty-king 2024.12.05~2024.12.12 #430

Merged
merged 18 commits into from
Dec 13, 2024

Conversation

zty-king
Copy link
Collaborator

姓名

郑天宇

实习项目

自动并行在复杂模型结构下的能力摸底和技术储备

本周工作

  1. vpp去尾
  • 验证hidden_layer不为vpp_degree整数倍时是否报错
  • 给出策略同时支持整数倍和(hidden_layer+1)为vpp_degree整数倍时的vpp编排策略
  • 开发vpp去尾代码,提交相关pr

下周工作

  1. 基于VPP编排的灵活模型层分配策略研究
  2. 基于VPP编排的灵活模型层分配策略开发
  3. 非均衡vpp的bubble优化

相关pr:PaddlePaddle/Paddle#70164

@From00 From00 merged commit caa54d7 into PFCCLab:main Dec 13, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants