It is said on the Internet that Huawei's Pangu model is suspected of plagiarizing Tongyi Qianwen, but the Pangu team denies it
Recently, a study published on GitHub has sparked heated discussions in the industry. The author of the study believes that the Pangu Pro MoE model launched by Huawei and the Tongyi Qianwen Qwen-2.5 14B model released by Alibaba have "amazing consistency" in parameter structure. Through empirical comparison, the author found that the average correlation between the Pangu Pro MoE model and the Qwen-2.5 14B model in the distribution of attention parameters is as high as 0.927, far exceeding the normal range of other model comparisons. Netizens believe that this may mean that Pangu Pro MoE is plagiarized. It is reported that the Pangu Pro MoE team responded in GitHub, denying the accusation of plagiarism and believing that the author's evaluation method is unscientific. As of press time, Huawei has not yet commented on this matter.
