Intelligent Assistant for Exploring Data Visualizations

The System Pipeline

Authors: Kumar, A., Aurisano, J., Di Eugenio, B., Johnson, A.

Publication: In the Proceedings of the FLAIRS 2020 Conference, Miami, FL

Visualization, while an effective tool for identifying patterns and insights, requires expert knowledge due to challenges faced when translating user queries to visual encodings. Research has shown that using a natural language interface (NLI) is effective for these challenges because the user can simply talk to a computer capable of producing the graphs directly. In this paper, we discuss our intelligent assistant which processes speech and hand pointing gestures while also dealing with any number of visualizations on a large screen display. Evaluation of the system shows that it is capable of quickly producing visualizations. It also particularly effective at responding to less ambiguous queries, while in certain cases can handle ambiguous or complex queries.

Date: May 17, 2020 - May 20, 2020

Document: View PDF

Related Entries

Directory:

Research:

Related Categories