Elon Musk Praises Moonlight's Kimi AI Paper; Official Responds Humorously: Your Rockets Are Great Too!

Recently, Elon Musk praised Moonlight's Kimi for its Attention Residuals technical report on the X platform, calling the research 'well done'. Later, Moonlight Kimi's official account responded humorously: 'Your rockets are great too!'

The report introduces a new deep network component called Attention Residuals (AttnRes), which reconstructs the information flow of Transformer models in the depth direction, offering a new direction for AI model performance optimization.