Semiconductors
SK hynix’s StreamDQ: Breaking the Memory Wall for AI Inference
SK hynix has introduced StreamDQ, a near-memory dequantization architecture designed to accelerate LLM inference. By performing weight dequantization directly in HBM, the system reduces data transfer bottlenecks and improves energy efficiency.