Tags: A Framework for Distributed Event Ordering
The rise of large-scale machine learning applications consuming unprecedented amounts of data necessitates throughput-oriented machines. Dataflow computing has thus regained traction lately due to its ability to capitalize on fine-grained parallelism in both the vector and pipeline dimensions. Furthermore, modern reconfigurable dataflow accelerators (RDAs) provide the ability to express flexible memory orderings, enabling algorithm developers to explore detailed synchronization schemes tailored to each application. However, there lacks a generalized framework for reasoning about event orderings that suits the unique constraints of RDAs like strict pipeline timing. Such an abstract model can also provide stronger correctness guarantees by making the programming model more amenable to formal verification. In this talk, we describe the shortcomings of existing frameworks and propose a new approach called Tags based on a generalized notion of the token-credit system. We also outline potential future works in integrating Tags into new languages and compilers, as well as exploring relationships between Tags and session types.
Sat 17 JunDisplayed time zone: Eastern Time (US & Canada) change
11:20 - 12:30 | |||
11:20 10mTalk | Tags: A Framework for Distributed Event Ordering PLARCH Paul Mure Stanford University, Nathan Zhang Stanford University, Caroline Trippel Stanford University, Kunle Olukotun Stanford University | ||
11:30 15mTalk | Stellar: A DSL to Build and Explore Sparse Accelerators PLARCH Hasan Genc UC Berkeley, Hansung Kim University of California, Berkeley, Prashanth Ganesh University of California, Berkeley, Yakun Sophia Shao University of California, Berkeley | ||
11:45 15mTalk | PEak: A Single Source of Truth for Hardware Design and Verification PLARCH Caleb Donovick Stanford University, Ross Daly Stanford University, USA, Jackson Melchert Stanford University, Leonard Truong Stanford University, Priyanka Raina Stanford University, Pat Hanrahan Stanford University, USA, Clark Barrett Stanford University | ||
12:00 10mTalk | Challenges with Hardware-Software Co-design for Sparse Machine Learning on Streaming Dataflow PLARCH Rubens Lacouture Stanford University, Olivia Hsu Stanford University, Kunle Olukotun Stanford University, Fredrik Kjolstad Stanford University |