Mon 19 Jun 2023 17:00 - 17:20 at Royal - PLDI: Machine Learning Chair(s): Yaniv David

Deep neural networks (DNNs) are becoming increasingly important components of software, and are considered the state-of-the-art solution for a number of problems, such as image recognition. However, DNNs are far from infallible, and incorrect behavior of DNNs can have disastrous real-world consequences. This paper addresses the problem of architecture-preserving V-polytope provable repair of DNNs. A V-polytope defines a convex bounded polytope using its vertex representation. V-polytope provable repair guarantees that the repaired DNN satisfies the given specification on the infinite set of points in the given V-polytope. An architecture-preserving repair only modifies the parameters of the DNN, without modifying its architecture. The repair has the flexibility to modify multiple layers of the DNN, and runs in polynomial time. It supports DNNs with activation functions that have some linear pieces, as well as fully-connected, convolutional, pooling and residual layers. To the best our knowledge, this is the first provable repair approach that has all of these features. We implement our approach in a tool called APRNN. Using MNIST, ImageNet, and ACAS Xu DNNs, we show that it has better efficiency, scalability, and generalization compared to PRDNN and REASSURE, prior provable repair methods that are not architecture preserving.

Mon 19 Jun

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 18:00
PLDI: Machine LearningPLDI Research Papers at Royal
Chair(s): Yaniv David Columbia University

#pldi-mon-1600-ml-royal Discord icon small YouTube icon small

16:00
20m
Talk
Scallop: A Language for Neurosymbolic Programming
PLDI Research Papers
Ziyang Li UPenn, Jiani Huang UPenn, Mayur Naik University of Pennsylvania
DOI
16:20
20m
Talk
Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networks
PLDI Research Papers
Mark Niklas Müller ETH Zurich, Marc Fischer ETH Zurich, Robin Staab ETH Zurich, Martin Vechev ETH Zurich
DOI
16:40
20m
Talk
Register Tiling for Unstructured Sparsity in Neural Network Inference
PLDI Research Papers
Lucas Wilkinson University of Toronto, Kazem Cheshmi McMaster University, Maryam Mehri Dehnavi University of Toronto
DOI
17:00
20m
Talk
Architecture-Preserving Provable Repair of Deep Neural Networks
PLDI Research Papers
Zhe Tao University of California, Davis, Stephanie Nawas University of California, Davis, Jacqueline Mitchell University of California, Davis, Aditya V. Thakur University of California at Davis
DOI Pre-print
17:20
20m
Talk
Incremental Verification of Neural Networks
PLDI Research Papers
Shubham Ugare University of Illinois at Urbana-Champaign, Debangshu Banerjee UIUC, Sasa Misailovic University of Illinois at Urbana-Champaign, Gagandeep Singh University of Illinois at Urbana-Champaign
DOI
17:40
20m
Talk
Prompting Is Programming: A Query Language for Large Language Models
PLDI Research Papers
Luca Beurer-Kellner ETH Zurich, Marc Fischer ETH Zurich, Martin Vechev ETH Zurich
DOI