Skip to content

Conversation

@KakaruHayate
Copy link

@KakaruHayate KakaruHayate commented Jul 9, 2024

LYNXNet(Linear Gated Depthwise Separable Convolution Network)

refer to:
https://github.com/CNChTu/Diffusion-SVC/blob/v2.0_dev/diffusion/naive_v2/model_conformer_naive.py
https://github.com/CNChTu/Diffusion-SVC/blob/v2.0_dev/diffusion/naive_v2/naive_v2_diff.py

Refactoring the code, removing unnecessary parts, and adapting to OpenVPI/DiffSinger

The following parameters are recommended for use:
Please note that when dim>512, Layernorm will be enabled by default to ensure stability during training

# LYNXNet-small(Not recommended)
backbone_type: 'lynxnet'
residual_channels: 256
residual_layers: 3
dilation_cycle_length: 2

# LYNXNet-base(Recommended)
backbone_type: 'lynxnet'
residual_channels: 512
residual_layers: 6
dilation_cycle_length: 2

# LYNXNet-medium(Not recommended)
backbone_type: 'lynxnet'
residual_channels: 768
residual_layers: 8
dilation_cycle_length: 2

# LYNXNet-medium-new(Recommended)
backbone_type: 'lynxnet'
residual_channels: 1024
residual_layers: 6
dilation_cycle_length: 2

# LYNXNet-large
backbone_type: 'lynxnet'
residual_channels: 1024
residual_layers: 12
dilation_cycle_length: 2

TIPS:You can control the style of the generated results by modifying the 'activation'(LYNXNet.py,Line:129),

  • 'PReLU'(default) : Similar to WaveNet
  • 'SiLU' : Voice will be more pronounced, not recommended for use under DDPM
  • 'ReLU' : Contrary to 'SiLU', Voice will be weakened

@KakaruHayate KakaruHayate deleted the patch-2 branch July 9, 2024 12:17
@KakaruHayate KakaruHayate restored the patch-2 branch July 9, 2024 12:20
@KakaruHayate KakaruHayate reopened this Jul 9, 2024
@KakaruHayate KakaruHayate changed the title [WIP]New AUX_Decoder/Backbone Network : LYNXNet [DONE]New AUX_Decoder/Backbone Network : LYNXNet Jul 9, 2024
@KakaruHayate KakaruHayate changed the base branch from main to lynxnet August 26, 2024 02:27
@yxlllc yxlllc merged commit 96e8ac2 into openvpi:lynxnet Aug 28, 2024
yxlllc added a commit that referenced this pull request Nov 3, 2024
* Faster NSF inference (#202)

* faster nsf

* faster nsf

* Slightly optimize

* Pad negative length

---------

Co-authored-by: yqzhishen <yangqian_1015@icloud.com>

* [DONE]New AUX_Decoder/Backbone Network : LYNXNet (#200)

* Update __init__.py

* Update LYNXNet

* add dropout

* Lynxnet outnorm (#206)

* post-norm

* fix

* add norm+mlp

* Update LYNXNet.py

* Update LYNXNetDecoder.py

* do not need mlp

* do not need mlp

* Add out norm for LYNXNET

* Add out norm for LYNXNETDecoder

* delete lynxnet aux_decoder (#212)

* refactor configuration options

---------

Co-authored-by: yqzhishen <yangqian_1015@icloud.com>
Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
yqzhishen added a commit that referenced this pull request Nov 15, 2024
* [DONE]New AUX_Decoder/Backbone Network : LYNXNet (#200)

* Update __init__.py

* Update LYNXNet

* add dropout

* Lynxnet outnorm (#206)

* post-norm

* fix

* add norm+mlp

* Update LYNXNet.py

* Update LYNXNetDecoder.py

* do not need mlp

* do not need mlp

* Add out norm for LYNXNET

* Add out norm for LYNXNETDecoder

* delete lynxnet aux_decoder (#212)

* refactor configuration options

* fix onnx exporter for lynxnet

* Add Pytorch version check when export onnx (#216)

* recommended lynxnet hyperparameters for variance models

* remove invalid items

* Refactor code

* Finish configuration schemas

---------

Co-authored-by: KakaruHayate <97896816+KakaruHayate@users.noreply.github.com>
Co-authored-by: yxlllc <llc1995@sina.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants