Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services

Jinho Lee, Inseok Hwang, Thomas S. Hubregtsen, Anne E. Gattiker, Christopher M. Durham

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a speculative inference framework accelerating conversational agent systems built with off-the-shelf modules, while keeping the modules unchanged.

Original languageEnglish
Article number8794690
Pages (from-to)47-57
Number of pages11
JournalIEEE Pervasive Computing
Volume18
Issue number2
DOIs
Publication statusPublished - 2019 Apr 1

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this

Lee, J., Hwang, I., Hubregtsen, T. S., Gattiker, A. E., & Durham, C. M. (2019). Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services. IEEE Pervasive Computing, 18(2), 47-57. [8794690]. https://doi.org/10.1109/MPRV.2019.2907004