ImageEye: Batch Image Processing using Program Synthesis
This paper presents a new synthesis-based approach for batch image processing. Unlike existing tools that can only apply global edits to the entire image, our method can apply fine-grained edits to individual objects within the image. For example, our method can selectively blur or crop specific objects that have a certain property. To facilitate such fine-grained image editing tasks, we propose a neuro-symbolic domain-specific language (DSL) that combines pre-trained neural networks for image classification with other language constructs that enable symbolic reasoning. Our method can automatically learn programs in this DSL from user demonstrations by utilizing a novel synthesis algorithm. We have implemented the proposed technique in a tool called ImageEye and evaluated it on 50 image editing tasks. Our evaluation shows that ImageEye is able to automate 96% of these tasks.
Tue 20 JunDisplayed time zone: Eastern Time (US & Canada) change
09:00 - 11:00 | |||
09:00 20mTalk | Trace-Guided Inductive Synthesis of Recursive Functional ProgramsDistinguished Paper PLDI Research Papers DOI | ||
09:20 20mTalk | Inductive Program Synthesis via Iterative Forward-Backward Abstract Interpretation PLDI Research Papers Yongho Yoon Seoul National University, Woosuk Lee Hanyang University, Kwangkeun Yi Seoul National University DOI | ||
09:40 20mTalk | ImageEye: Batch Image Processing using Program Synthesis PLDI Research Papers Celeste Barnaby University of Texas at Austin, Jocelyn (Qiaochu) Chen University of Texas at Austin, Roopsha Samanta Purdue University, Işıl Dillig University of Texas at Austin DOI | ||
10:00 20mTalk | One Pixel Adversarial Attacks via Sketched Programs PLDI Research Papers DOI | ||
10:20 20mTalk | Absynthe: Abstract Interpretation-Guided Synthesis PLDI Research Papers Sankha Narayan Guria University of Maryland, Jeffrey S. Foster Tufts University, David Van Horn University of Maryland DOI Pre-print | ||
10:40 20mTalk | Conflict-Driven Synthesis for Layout Engines PLDI Research Papers Junrui Liu University of California, Santa Barbara, Yanju Chen University of California at Santa Barbara, Eric Atkinson MIT, Yu Feng University of California at Santa Barbara, Rastislav Bodík Google Research, Brain Team DOI |