Skip to content

[fast_inference] 回退策略，减少padding影响，开放选项，同步代码 #986

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 30 commits into from
Apr 19, 2024
Merged

[fast_inference] 回退策略，减少padding影响，开放选项，同步代码 #986

merged 30 commits into from
Apr 19, 2024

Conversation

ChasonJiang
Copy link
Contributor

改动

  • 回退mask策略至上一个版本；
  • 回退pad策略至上一个版本；
  • 在T2SBlock中添加padding_mask，以减少padding的影响；
  • 开放repetition_penalty参数，让用户自行调整重复惩罚的强度；
  • 增加parallel_infer参数，用于开启或关闭并行推理，关闭时与0307版本保持一致；
  • 在webui中增加“保持随机”选项；
  • 同步main分支代码。

讨论

  • pad的策略会影响复读。在推理时，当使用0207版本和此PR，pad到相同长度时，均出现了明显的复读情况。
  • 已知的是，当num_dim>1时，改变张量形状之后（如pad），会使接下来的张量计算产生误差（与没有改变形状相比）。
  • 令人困惑的是，产生的误差是在精度范围内的，所以无法直接确定，复读现象是否是由于误差累积导致的。
  • 如图：
    2c88465aeae9eec6d1995952f84461fe

Lion-Wu and others added 28 commits March 17, 2024 13:06
@Lion-Wu
Update README
6c2a7f1
@RVC-Boss
Merge pull request #790 from Lion-Wu/doc/README
a495540 
Update README
@KamioRinn
Optimize-English-G2P
ca57a01
@pengooseDev
docs: change akward expression
8fdc7e3
@pengooseDev
docs: update Changelog_KO.md
a6e4b38
@RVC-Boss
Merge pull request #804 from KamioRinn/Optimize-English-G2P
f740949 
英文G2P优化
@RVC-Boss
Merge pull request #809 from pengooseDev/main
06ec491 
Update Changelog_KO.md
@KamioRinn
Fix CN punc in EN,add 's match
e3d3c32
@RVC-Boss
Merge pull request #812 from KamioRinn/Optimize-English-G2P
b451372 
修复中文标点在英文中的问题，添加所有格匹配
@KamioRinn
Adjust normalize and g2p logic
97f304c
@RVC-Boss
Merge pull request #821 from KamioRinn/Optimize-English-G2P
7bc0836 
调整英文格式化输出和英文G2P逻辑
@Yuan-ManX
Update zh_CN.json
2cf8e79
@RVC-Boss
Merge pull request #841 from Yuan-ManX/zh_CN-3
41431d0 
Update zh_CN.json
@XXXXRT666
Update README (#827)
17aff21 
Update README.md
Update some outdated file paths and commands
@KamioRinn
修复英文多音字,调整字典热加载,新增姓名匹配 (#869)
6ccfd36 
* Fix homograph dict

* Add JSON in dict

* Adjust hot dict to hot reload

* Add English name dict

* Adjust get name dict logic
@KamioRinn
Make API Great Again (#894)
4afecd1 
* Add zh/jp/en mix

* Optimize code readability and formatted output.

* Try OGG streaming

* Add stream mode arg

* Add media type arg

* Add cut punc arg

* Eliminate punc risk
@Lion-Wu
Update README (#895)
2885f96 
* Update README

* Update README

* update README

* update README
@digger-yu
fix typo s/Licence /License (#904)
1fca6b2
@SapphireLab
fix reformat cmd (#917)
8582131 
Co-authored-by: starylan <[email protected]>
@RVC-Boss
Update README.md
4e43f60
@KamioRinn
Normalize chinese arithmetic operations (#947)
a3c4e04
@ChasonJiang
改变训练和推理时的mask策略，以修复当batch_size>1时，产生的复读现象
f0138ea
@ChasonJiang
Merge branch 'main' of https://github.com/RVC-Boss/GPT-SoVITS into sy…
b1e9593 
…nc_main
@ChasonJiang
同步main分支代码，增加“保持随机”选项
4ec2c5c
@shadow01a
在colab中运行colab_webui.ipynb发生的uvr5模型缺失问题 (#968)
b162848 
在colab中使用git下载uvr5模型时报错：
fatal: destination path 'uvr5_weights' already exists and is not an empty directory.
通过在下载前将原本从本仓库下载的uvr5_weights文件夹删除可以解决问题。
@SapphireLab
[ASR] 修复FasterWhisper遍历输入路径失败 (#956)
e1ba8d7 
* remove glob

* rename

* reset mirror pos
@ChasonJiang
Merge branch 'main' of https://github.com/RVC-Boss/GPT-SoVITS into sy…
302cf08 
…nc_main
@ChasonJiang
回退mask策略；
ef1cd01 
回退pad策略；
在T2SBlock中添加padding_mask，以减少pad的影响；
开放repetition_penalty参数，让用户自行调整重复惩罚的强度；
增加parallel_infer参数，用于开启或关闭并行推理，关闭时与0307版本保持一致；
在webui中增加“保持随机”选项；
同步main分支代码。
@ChasonJiang ChasonJiang reopened this Apr 16, 2024
@RVC-Boss
Copy link
Owner

这回退的东西有点多啊，只回退你写的部分吧

@ChasonJiang
Copy link
Contributor Author

这回退的东西有点多啊，只回退你写的部分吧

看着commit多是因为merge了 main分支，或者你先merge一下main分支我再提PR

@RVC-Boss RVC-Boss merged commit 29f2211 into RVC-Boss:fast_inference_ Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.