Computing-Power-Networks-Resources

Review

Computing power network: The architecture of convergence of computing and networking towards 6G requirement.
X Tang, C Cao, Y Wang, S Zhang, Y Liu, et al.
China Communication, 2021. [Paper]

Computing power network: A survey.
S Yukun, L Bo, L Juniin, H Haonan, Z Xing, et al.
China Communication, 2024. [Paper]

DPU-Enhanced Multi-Agent Actor-Critic Algorithm for Cross-Domain Resource Scheduling in Computing Power Network.
S Wang, S Guo, J Hao, Y Ren, et al.
IEEE Transactions on Network and Service Management, 2024.

Training Cluster

Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings.
N Jouppi, G Kurian, S Li, P Ma, R Nagarajan, et al.
ISCA, 2023. [Paper]

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs.
Z Jiang, H Lin, Y Zhong, Q Huang, Y Chen, et al.
arXiv, 2024. [Paper]

Alibaba HPN: A Data Center Network for Large Language Model Training.
K Qian, Y Xi, J Cao, J Gao, Y Xu, Y Guan, B Fu, X Shi, F Zhu, R Miao, C Wang, P Wang, et al.
SigComm, 2024. [Paper]

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning.
W An, X Bi, G Chen, S Chen, C Deng, H Ding, K Dong, Q Du, W Gao, K Guan, J Guo, Y Guo, et al.
arXiv:2408.14158, 2024. [Paper]

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey.
J Duan, S Zhang, Z Wang, L Jiang, W Qu, Q Hu, et al.
arXiv, 2024. [Paper]

Distributed Deep Learning

Distributed training of large language models.
F Zeng, W Gan, Y Wang, et al.
2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS), 2023. [Paper]

Flexible silicon photonic architecture for accelerating distributed deep learning.
Zhenguo Wu, Liang Yuan Dai, Yuyang Wang, Songli Wang, and Keren Bergman.
Journal of Optical Communications and Networking, 2024. [Paper]

Reliable and efficient RAR-based distributed model training in computing power network.
Chen, Ling; Li, Yajie; Natalino, Carlos; Li, Yongcheng; Zhang, Boxin; Fan, Yingbo; Wang, Wei; Zhao, Yongli; Zhang, Jie.
Journal of Optical Communications and Networking, 2024.

HetHub: A Heterogeneous distributed hybrid training system for large-scale models.
S Xu, Z Huang, Y Zeng, S Yan, X Ning, H Ye, S Gu, C Shui, Z Lin, H Zhang, S Wang, G Dai, et al.
arXiv:2405.16256, 2024. [Paper]

DataCenter

Recent advances in optical technologies for data centers: a review.
Q Cheng, M Bahadori, M Glick, S Rumley, K Bergman.
Optica, 2018.

Optical switching will innovate intra data center networks.
Sato, Ken-ichi.
Journal of Optical Communications and Networking, 2024.

New trends in photonic switching and optical networking architectures for data centers and computing systems.
Yoo, S. J. Ben.
Journal of Optical Communications and Networking, 2024.

Generative AI in Data Center Networking: Fundamentals, Perspectives, and Case Study.
Y Liu, H Du, D Niyato, J Kang, Z Xiong, Y Wen, et al.
arXiv, 2024. [Paper]

Optical Interconnection

Photonic network-on-wafer for multichiplet GPUs.
S Zhang, Z Zhang, M Naderan-Tahan, H SeyyedAghaei, X Wang, H Li, S Qin, D Colle, et al.
IEEE Micro, 2023. [Paper]

A Scalable Methodology for Designing Efficient Interconnection Network of Chiplets.
Y Feng, D Xiang, K Ma.
HPCA, 2023. [Paper]

SEECHIP: A Scalable and Energy-Efficient Chiplet-based GPU Architecture Using Photonic Links.
H Zhang, Y Chen, Z Huang, H Zhang, F Dai.
Proceedings of the 52nd International Conference on Parallel Processing, 2023.

Connect-A-PIC: an open-source automated photonic circuit design and simulation platform for fast iteration and education.
M Aigner, M Kissner, F Päsler, L Del Bino.
Optical Interconnects XXIV, 2024.

Optical Network

On Network Design and Planning 2.0 for Optical-Computing-Enabled Networks.
DT Hai, I Woungang.
Advanced Information Networking and Applications, 2024. [Paper]

Software-defined optical networking applications enabled by programmable integrated photonics.
Z Xie, D Sánchez-Jácome, L Torrijos-Morán, D Pérez-López.
Journal of Optical Communications and Networking, 2024. [Paper]

What comes after optical-bypass network? A study on optical-computing-enabled network.
DT Ha.
Optical Fiber Technology, 2024.

Optical Communication

Machine learning techniques in optical communication.
D Zibar, M Piels, R Jones, CG Schäeffer.
Journal of Lightwave Technology, 2015.

Silicon photonics for high-speed communications and photonic signal processing.
X Zhou, D Yi, DWU Chan, HK Tsang.
npj Nanophotonics, 2024. [Paper]

Learnable digital signal processing: a new benchmark of linearity compensation for optical fiber communications.
Z Niu, H Yang, L Li, M Shi, G Xu, W Hu, L Yi.
Light: Science & Applications, 2024. [Paper]

Integrated Sensing & Communications & Computing (ISCC)

Integrated sensing and communication in an optical fibre.
H He, L Jiang, Y Pan, A Yi, X Zou, W Pan, AE Willner, X Fan, Z He, L Yan.
Light: Science & Applications, 2023.

Integrated sensing-communication-computation for edge artificial intelligence.
D Wen, X Li, Y Zhou, Y Shi, S Wu, et al.
IEEE Internet of Things Magazine, 2024.

A Survey on Integrated Sensing, Communication, and Computation.
D Wen, Y Zhou, X Li, Y Shi, K Huang, KB Letaief.
arXiv:2408.08074, 2024.