[Feature] Support IterableDataset on distributed environment #1151
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
HydrogenSulfate
changed the title
HydrogenSulfate
force-pushed
the
support_dist_iterdataset
branch
from
71560ef to
2151a8a
Compare
HydrogenSulfate
force-pushed
the
support_dist_iterdataset
branch
from
1728383 to
d15265d
Compare
zhiminzhang0830
approved these changes
May 13, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
New features
PR changes
Others
Describe
支持
io.IterableDataset类的数据集在分布式环境下训练，每个进程生成同一份原始数据（记其大小为batch_size)，然后根据当前进程的rank和world_size信息，得到进程内的切片数据(大小为batch_size/world_size)（要求batch_size能被world_size整除)。简化使用文档中，数据并行的运行命令
AllenCahn精度验证
单卡精度：1.2e-5
双卡精度：1.5e-5
3.1 双卡数据分布
3.2 每张卡上，切分前的全量数据集相同
3.3 每张卡上，切分后的数据集不同，并且无交集
