Meet AntAngelMed: A 103B-Parameter Open-Source Medical Language Model Built on a 1/32 Activation-Ratio MoE Architecture
A crew researchers from China have launched AntAngelMed, a massive open-source medical language mannequin that the crew describes as the biggest and most able to its sort presently out there. What Is AntAngelMed? AntAngelMed is a medical-domain language mannequin with 103 billion whole parameters, however it doesn’t activate all of these parameters throughout inference. Instead,…
