Tue 20 Jun 2023 09:40 - 10:00 at Royal - PLDI: Synthesis Chair(s): Ilya Sergey

This paper presents a new synthesis-based approach for batch image processing. Unlike existing tools that can only apply global edits to the entire image, our method can apply fine-grained edits to individual objects within the image. For example, our method can selectively blur or crop specific objects that have a certain property. To facilitate such fine-grained image editing tasks, we propose a neuro-symbolic domain-specific language (DSL) that combines pre-trained neural networks for image classification with other language constructs that enable symbolic reasoning. Our method can automatically learn programs in this DSL from user demonstrations by utilizing a novel synthesis algorithm. We have implemented the proposed technique in a tool called ImageEye and evaluated it on 50 image editing tasks. Our evaluation shows that ImageEye is able to automate 96% of these tasks.

Tue 20 Jun

Displayed time zone: Eastern Time (US & Canada) change

09:00 - 11:00
PLDI: SynthesisPLDI Research Papers at Royal
Chair(s): Ilya Sergey National University of Singapore

#pldi-tue-0900-synthesis-royal Discord icon small YouTube icon small

09:00
20m
Talk
Trace-Guided Inductive Synthesis of Recursive Functional ProgramsDistinguished Paper
PLDI Research Papers
Yongwei Yuan Purdue University, Arjun Radhakrishna Microsoft, Roopsha Samanta Purdue University
DOI
09:20
20m
Talk
Inductive Program Synthesis via Iterative Forward-Backward Abstract Interpretation
PLDI Research Papers
Yongho Yoon Seoul National University, Woosuk Lee Hanyang University, Kwangkeun Yi Seoul National University
DOI
09:40
20m
Talk
ImageEye: Batch Image Processing using Program Synthesis
PLDI Research Papers
Celeste Barnaby University of Texas at Austin, Jocelyn (Qiaochu) Chen University of Texas at Austin, Roopsha Samanta Purdue University, Işıl Dillig University of Texas at Austin
DOI
10:00
20m
Talk
One Pixel Adversarial Attacks via Sketched Programs
PLDI Research Papers
DOI
10:20
20m
Talk
Absynthe: Abstract Interpretation-Guided Synthesis
PLDI Research Papers
Sankha Narayan Guria University of Maryland, Jeffrey S. Foster Tufts University, David Van Horn University of Maryland
DOI Pre-print
10:40
20m
Talk
Conflict-Driven Synthesis for Layout Engines
PLDI Research Papers
Junrui Liu University of California, Santa Barbara, Yanju Chen University of California at Santa Barbara, Eric Atkinson MIT, Yu Feng University of California at Santa Barbara, Rastislav Bodík Google Research, Brain Team
DOI