Graphcore
Simon R. Knowles
Abstract
IPU Foundations • AI is nascent – facilitating exploration is as vital as executing known algorithms. • Tera-scale models will be necessary for “super-human” AI. • Sparse evaluation will be necessary at tera-scale, $\text{for} \$ $ and Watts. • Rich natural data is sequences, images, and graphs. • Post-Dennard, keep memory and logic close. • Post-Moore, parallel computing over many chips.
Topics & Concepts
Tera-Computer scienceScale (ratio)Parallel computingTheoretical computer scienceArtificial intelligenceOperating systemGeographyCartographyGraph Theory and Algorithms