NL2Viz: natural language to visualization via constrained syntax-guided synthesis
Abstract
Recent development in NL2CODE (Natural Language to Code) research allows end-users, especially novice programmers to create a concrete implementation of their ideas such as data visualization by providing natural language (NL) instructions. An NL2CODE system often fails to achieve its goal due to three major challenges: the user's words have contextual semantics, the user may not include all details needed for code generation, and the system results are imperfect and require further refinement. To address the aforementioned three challenges for NL to Visualization, we propose a new approach and its supporting tool named NL2VIZ with three salient features: (1) leveraging not only the user's NL input but also the data and program context that the NL query is upon, (2) using hard/soft constraints to reflect different confidence levels in the constraints retrieved from the user input and data/program context, and (3) providing support for result refinement and reuse.
BibTeX
@inproceedings{Wu-al:FSE22,
author = {Zhengkai Wu and
Vu Le and
Ashish Tiwari and
Sumit Gulwani and
Arjun Radhakrishna and
Ivan Radicek and
Gustavo Soares and
Xinyu Wang and
Zhenwen Li and
Tao Xie},
title = {{NL2Viz:} natural language to visualization via constrained syntax-guided synthesis},
booktitle = {{ESEC/SIGSOFT} {FSE}},
pages = {972--983},
publisher = {{ACM}},
year = {2022},
}