Opening book details…
Can I read At-Memory Architecture for AI Inference on EtoBox?
At-Memory Architecture for AI Inference by mh.howard.liao is a document available to read on EtoBox.
What is At-Memory Architecture for AI Inference about?
The Untether AI at-memory architecture, exemplified by the runAI200 chip, optimizes deep learning inference by minimizing data movement, resulting in superior performance and energy efficiency. This architecture interleaves processing elements with dedicated SRAM, achieving up to 502 INT8 TOPs in Sport Mode and over 8 TOPs per watt in Eco Mode. The design addresses the limitations of traditional von Neumann architectures, making it well-suited for the growing demands of neural network inference workloads.
- Author
- mh.howard.liao
- Language
- EN