Sun 18 Jun 2023 10:20 - 10:35 at Magnolia 4 - CTSTA: Session 1

This talk introduces the Sparse Abstract Machine (SAM), an abstract machine model for targeting sparse tensor algebra to reconfigurable and fixed-function spatial dataflow accelerators. SAM defines a streaming dataflow abstraction with sparse primitives that encompass a large space of scheduled tensor algebra expressions. SAM dataflow graphs naturally separate tensor formats from algorithms and are expressive enough to incorporate arbitrary iteration orderings and many hardware-specific optimizations. In this talk, we also present Custard, a compiler from a high-level language to SAM that demonstrates SAM’s usefulness as an intermediate representation. Following Custard, the SAM system also automatically binds from SAM to a streaming dataflow simulator. This talk will also provide a brief evaluation of SAM as: a general system for the whole domain of sparse tensor algebra, a design-space exploration tool for sparse accelerator performance, and as a representation that can model dataflow hardware implementations.

Sun 18 Jun

Displayed time zone: Eastern Time (US & Canada) change

09:00 - 11:00
09:00
5m
Day opening
Introduction
CTSTA
Fredrik Kjolstad Stanford University
09:05
15m
Talk
Software and Hardware for Sparse ML
CTSTA
Fredrik Kjolstad Stanford University
09:20
15m
Talk
Integrating Data Layout into Compilers and Code Generators
CTSTA
Mary Hall University of Utah
09:35
15m
Talk
Tackling the challenges of high-performance graph analytics at compiler level
CTSTA
Gokcen Kestor Pacific Northwest National Laboratory
09:50
10m
Panel
Discussion
CTSTA

10:00
5m
Break
BreakSocial
CTSTA

10:05
15m
Talk
Challenges and Opportunities for Sparse Compilers in LLM
CTSTA
Zihao Ye University of Washington
10:20
15m
Talk
The Sparse Abstract Machine
CTSTA
Olivia Hsu Stanford University
10:35
15m
Talk
TeAAL: A Declarative Framework for Modeling Sparse Tensor Accelerators
CTSTA
Nandeeka Nayak University of Illinois at Urbana-Champaign
10:50
10m
Panel
Discussion
CTSTA