Combinatorial feature embedding based on CNN and LSTM for biomedical named entity recognition

Minsoo Cho, Jihwan Ha, Chihyun Park, Sanghyun Park

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)


With the rapid advancement of technology and the necessity of processing large amounts of data, biomedical Named Entity Recognition (NER) has become an essential technique for information extraction in the biomedical field. NER, which is a sequence-labeling task, has been performed using various traditional techniques including dictionary-, rule-, machine learning-, and deep learning-based methods. However, as existing biomedical NER models are insufficient to handle new and unseen entity types from the growing biomedical data, the development of more effective and accurate biomedical NER models is being widely researched. Among biomedical NER models utilizing deep learning approaches, there have been only a few studies involving the design of high-level features in the embedding layer. In this regard, herein, we propose a deep learning NER model that effectively represents biomedical word tokens through the design of a combinatorial feature embedding. The proposed model is based on Bidirectional Long Short-Term Memory (bi-LSTM) with Conditional Random Field (CRF) and enhanced by integrating two different character-level representations extracted from a Convolutional Neural Network (CNN) and bi-LSTM. Additionally, an attention mechanism is applied to the model to focus on the relevant tokens in the sentence, which alleviates the long-term dependency problem of the LSTM model and allows effective recognition of entities. The proposed model was evaluated on two benchmark datasets, the JNLPBA and NCBI-Disease, and a comparative analysis with the existing models is performed. The proposed model achieved a relatively higher performance with an F1-score of 86.93% in case of NCBI-Disease, and a competitive performance for the JNLPBA with an F1-score of 75.31%.

Original languageEnglish
Article number103381
JournalJournal of Biomedical Informatics
Publication statusPublished - 2020 Mar

Bibliographical note

Funding Information:
This research was supported by the MSIT ( Ministry of Science and ICT ), Korea, under the SW Starlab support program (IITP-2017-0-00477) supervised by the IITP (Institute for Information & communications Technology Promotion).

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Health Informatics

Fingerprint Dive into the research topics of 'Combinatorial feature embedding based on CNN and LSTM for biomedical named entity recognition'. Together they form a unique fingerprint.

Cite this