Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services

Jinho Lee, Inseok Hwang, Thomas S. Hubregtsen, Anne E. Gattiker, Christopher M. Durham

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a speculative inference framework accelerating conversational agent systems built with off-the-shelf modules, while keeping the modules unchanged.

Original languageEnglish
Article number8794690
Pages (from-to)47-57
Number of pages11
JournalIEEE Pervasive Computing
Volume18
Issue number2
DOIs
Publication statusPublished - 2019 Apr 1

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this