In this paper, we propose a simple yet powerful text generation model, called diversity regularized autoencoders (DRAE). The key novelty of the proposed model lies in its ability to handle various sentence modifications such as insertions, deletions, substitutions, and maskings, and to take them as input. Because the noise-injection strategy enables an encoder to make the latent distribution smooth and continuous, the proposed model can generate more diverse and coherent sentences. Also, we adopt the Wasserstein generative adversarial networks with a gradient penalty to achieve stable adversarial training of the prior distribution. We evaluate the proposed model using quantitative, qualitative, and human evaluations on two public datasets. Experimental results demonstrate that our model using a noise-injection strategy produces more natural and diverse sentences than several baseline models. Furthermore, it is found that our model shows the synergistic effect of grammar correction and paraphrase generation in an unsupervised way.
|Title of host publication||35th Annual ACM Symposium on Applied Computing, SAC 2020|
|Publisher||Association for Computing Machinery|
|Number of pages||9|
|Publication status||Published - 2020 Mar 30|
|Event||35th Annual ACM Symposium on Applied Computing, SAC 2020 - Brno, Czech Republic|
Duration: 2020 Mar 30 → 2020 Apr 3
|Name||Proceedings of the ACM Symposium on Applied Computing|
|Conference||35th Annual ACM Symposium on Applied Computing, SAC 2020|
|Period||20/3/30 → 20/4/3|
Bibliographical noteFunding Information:
This work was supported by the National Research Foundation of Korea (NRF) grant (No. NRF-2018R1A2B6009135) and by the Korean National Police Agency and the Ministry of Science and ICT for Police field customized research and development project (No. NRF-2018M3E2A1081572). Also, this work was supported by the Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2019-0-00421, AI Graduate School Support Program and No. 2019-0-01590, High-Potential Individuals Global Training Program).
© 2020 ACM.
All Science Journal Classification (ASJC) codes