Server-Ready Module for AI Inference at Edge

Server-Ready Module for AI Inference at Edge

A new AI module runs generative models locally, reducing power use and cloud reliance while handling complex workloads with efficiency. Unigen Expands AI Portfolio with High-Performance On-Prem GenAI Module Unigen has introduced the Amaretti E1.S AI Module, its first hardware solution built specifically for generative AI. The module is designed for on-premise deployment and can…

Edge AI inference set for 10x growth; Nokia, Blaize advance hybrid AI compute

Edge AI inference set for 10x growth; Nokia, Blaize advance hybrid AI compute

From left: Dion Leung, Nokia APAC AI and Cloud head; Joseph Sulistyo, Blaize SVP; Benny Sumitro, Datacomm Cloud and IT MD. Credit: DIGITIMES As generative AI demand shifts from centralized cloud training to edge inference, Nokia and AI chip startup Blaize have expanded their partnership in Singapore, unveiling a full-stack solution for hybrid heterogeneous computing…

Your developers are already running AI locally: Why on-device inference is the CISO’s new blind spot

Your developers are already running AI locally: Why on-device inference is the CISO’s new blind spot

For the last 18 months, the CISO playbook for generative AI has been relatively simple: Control the browser. Security teams tightened cloud access security broker (CASB) policies, blocked or monitored traffic to well-known AI endpoints, and routed usage through sanctioned gateways. The operating model was clear: If sensitive data leaves the network for an external…

AI Inference Performance Crosses Threshold

AI Inference Performance Crosses Threshold

MLPerf results show how new GPUs and system-level design are enabling faster, scalable inference for large language models and emerging generative AI workloads in real deployment environments. AI Inference Performance AMD has reported a major leap in AI inference performance with its latest MLPerf Inference v6.0 results, crossing the 1-million tokens-per-second threshold and signalling growing…