Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问在ECB和DCB中为啥第一个和第二个卷积层中的输出通道为什么要除2 #4

Open
scz5221201 opened this issue Jul 19, 2023 · 3 comments

Comments

@scz5221201
Copy link

在DenseBlock_light中,这里为啥要做这个操作:out_channels_def = int(in_channels / 2),有什么原因吗

@hli1221
Copy link
Owner

hli1221 commented Jul 19, 2023

主要是为了防止通道数太大,因为dense每层都要级联。

@scz5221201
Copy link
Author

好的,谢谢李博士。我目前已顺着您博士论文的看算法,请问下在RFN-Nest的后续还能往哪个方向走会有潜力些

@hli1221
Copy link
Owner

hli1221 commented Jul 19, 2023

还是能做一些增量性的工作。
1 可以引入transformer,虽然有人已经做了,但是可以更深入一些。
2 其次就是在这个训练框架上做纯transformer的结构。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants