DCAI, the AI infrastructure company that operates the Gefion AI Supercomputer, has achieved ISO/IEC 27001 certification, the globally recognized standard for information security management systems (ISMS). This milestone underscores DCAI’s commitment to delivering secure, compliant, and enterprise-grade AI infrastructure. ISO/IEC 27001 is the global benchmark for information security. The certification was awarded by an independent firm after…
Thinking Machines Lab has moved its Tinker training API into general availability and added 3 major capabilities, support for the Kimi K2 Thinking reasoning model, OpenAI compatible sampling, and image input through Qwen3-VL vision language models. For AI engineers, this turns Tinker into a practical way to fine tune frontier models without building distributed training…
Thinking Machines Lab has moved its Tinker training API into general availability and added 3 major capabilities, support for the Kimi K2 Thinking reasoning model, OpenAI compatible sampling, and image input through Qwen3-VL vision language models. For AI engineers, this turns Tinker into a practical way to fine tune frontier models without building distributed training…
OpenAI team has released their openai/circuit-sparsity model on Hugging Face and the openai/circuit_sparsity toolkit on GitHub. The release packages the models and circuits from the paper ‘Weight-sparse transformers have interpretable circuits‘. https://arxiv.org/pdf/2511.13653 What is a weight sparse transformer? The models are GPT-2 style decoder only transformers trained on Python code. Sparsity is not added after…
OpenAI team has released their openai/circuit-sparsity model on Hugging Face and the openai/circuit_sparsity toolkit on GitHub. The release packages the models and circuits from the paper ‘Weight-sparse transformers have interpretable circuits‘. https://arxiv.org/pdf/2511.13653 What is a weight sparse transformer? The models are GPT-2 style decoder only transformers trained on Python code. Sparsity is not added after…
The new LiteRT NeuroPilot Accelerator from Google and MediaTek is a concrete step towards operating actual generative fashions on telephones, laptops, and IoT {hardware} with out delivery each request to a knowledge heart. It takes the present LiteRT runtime and wires it straight into MediaTek’s NeuroPilot NPU stack, so builders can deploy LLMs and embedding…
How do you retain reinforcement studying for massive reasoning fashions from stalling on a couple of very lengthy, very sluggish rollouts whereas GPUs sit beneath used? a crew of researchers from Moonshot AI and Tsinghua University introduce ‘Seer’, a brand new on-line context studying system that targets a selected programs bottleneck in reinforcement studying for…
Large language fashions at the moment are restricted much less by coaching and extra by how briskly and cheaply we will serve tokens underneath actual site visitors. That comes down to a few implementation particulars: how the runtime batches requests, the way it overlaps prefill and decode, and the way it shops and reuses the…
Large language mannequin serving usually wastes GPU reminiscence as a result of engines pre-reserve massive static KV cache areas per mannequin, even when requests are bursty or idle. Meet ‘kvcached‘, a library to allow virtualized, elastic KV cache for LLM serving on shared GPUs. kvcached has been developed by a analysis from Berkeley’s Sky Computing…
IBM simply launched Granite 4.0, an open-source LLM household that swaps monolithic Transformers for a hybrid Mamba-2/Transformer stack to chop serving reminiscence whereas maintaining high quality. Sizes span a 3B dense “Micro,” a 3B hybrid “H-Micro,” a 7B hybrid MoE “H-Tiny” (~1B lively), and a 32B hybrid MoE “H-Small” (~9B lively). The fashions are Apache-2.0,…