OpenBMB Releases MiniCPM5-2B: A 2.52B Dense Model Averaging 53.9 Across 34 Benchmarks and Built to Run On Device
OpenBMB has launched MiniCPM5-2B, the second checkpoint within the MiniCPM5 sequence and the follow-up to MiniCPM5-1B. It is a dense causal language mannequin with 2,516,756,480 parameters, of which 1,981,982,720 sit exterior the embeddings. It makes use of 42 layers, grouped-query consideration with 16 question heads and 2 key/worth heads, and a local context window of…
