About
- I have been working with Prof. Shengchao Liu since June 2025, and formally serve as a Research Assistant at the Department of Computer Science and Engineering, The Chinese University of Hong Kong starting from Spring 2026.
- I was a visiting student at Hefei Institutes of Physical Science, Chinese Academy of Sciences, hosted by Prof. Jianhui Zhou, from July 2025 to Oct. 2025.
- I received my Bachelor of Science degree from the School of Physics, Sun Yat-sen University, in June 2025. During this period, I was a member of the PMI Lab and was advised by Prof. Haiping Huang from Oct. 2022 to June 2025.
Interests
- Theoretical Mechanism of LLM and Deep Learning
- Statistical Mechanics of Disordered Systems
- Mean Field Theory of Spin Glass Models (Replica Method, Cavity Method, etc.)
- Random Matrix Theory, Dynamical Mean Field Theory, Nonlinear Dynamics
- Applications of LLM in Science and Engineering
Publications
- Yuhao Li, Ruoran Bai, and Haiping Huang. "Spin Glass Model of In-Context Learning." Phys. Rev. E 112, L013301, 2025.
Notes
- Note on Ensemble Theory (Equilibrium Statistical Physics)
Writing
Timeline of Deep Learning
A timeline highlighting key milestones in the development of deep learning.
Read Post
Phase Transition Point in Classical Dynamics
A brief derivation of the stability/chaos transition in a classical random dynamical system using mean-field theory.
Read Post
Timeline for Statistical Mechanics of Neural Networks
A timeline highlighting key developments in the application of statistical mechanics to neural networks.
Read Post
Replica Method for Boolean Perceptron with Continuous Weight
An brief derivation for the asymptotic generalization error of a Boolean perceptron with continuous weights using the replica method. This problem was also the final assignment in the 'Statistical Mechanics of Neural Networks' course at SYSU, Fall 2024.
Read Post
Replica Method for the Sherrington-Kirkpatrick Model
This note reviews the replica symmetric solution of the SK model, including sufficiently detailed derivations, and then shows the phase diagrams of the order parameters and free energy by numerical calculations.
Read Post