This book provides an overview of the recent advances in representation learning theory, algorithms, and applications for natural language processing (NLP), ranging from word embeddings to pre-trained language models. It is divided into four parts. Part I presents the representation learning techniques for multiple language entries, including words, sentences and documents, as well as pre-training techniques. Part II then introduces the related representation techniques to NLP, including graphs, cross-modal entries, and robustness. Part III then introduces the representation techniques for the knowledge that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, legal domain knowledge and biomedical domain knowledge. Lastly, Part IV discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing. As compared to the first edition, the second edition (1) provides a more detailed introduction to representation learning in Chapter 1; (2) adds four new chapters to introduce pre-trained language models, robust representation learning, legal knowledge representation learning and biomedical knowledge representation learning; (3) updates recent advances in representation learning in all chapters; and (4) corrects some errors in the first edition. The new contents will be approximately 50%+ compared to the first edition. This is an open access book.

This book constitutes the proceedings of the 17th China National Conference on Computational Linguistics, CCL 2018, and the 6th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2018, held in Changsha, China, in October 2018. The 33 full papers presented in this volume were carefully reviewed and selected from 84 submissions. They are organized in topical sections named: Semantics; machine translation; knowledge graph and information extraction; linguistic resource annotation and evaluation; information retrieval and question answering; text classification and summarization; social computing and sentiment analysis; and NLP applications.

This book constitutes the thoroughly refereed papers of the 4th National Conference of Social Media Processing, SMP 2015, held in Guangzhou, China, in November 2015. The 14 revised full papers and 9 short papers presented were carefully reviewed and selected from 105 submissions. The papers address issues such as: mining social media and applications; natural language processing; data mining; information retrieval; emergent social media processing problems.

This book constitutes the refereed proceedings of the 13th China National Conference on Computational Linguistics, CCL 2014, and of the First International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2014, held in Wuhan, China, in October 2014. The 27 papers presented were carefully reviewed and selected from 233 submissions. The papers are organized in topical sections on word segmentation; syntactic analysis and parsing the Web; semantics; discourse, coreference and pragmatics; textual entailment; language resources and annotation; sentiment analysis, opinion mining and text classification; large-scale knowledge acquisition and reasoning; text mining, open IE and machine reading of the Web; machine translation; multilinguality in NLP; underresourced languages processing; NLP applications.

This book constitutes the refereed proceedings of the 12th China National Conference on Computational Linguistics, CCL 2013, and of the First International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2013, held in Suzhou, China, in October 2013. The 32 papers presented were carefully reviewed and selected from 252 submissions. The papers are organized in topical sections on word segmentation; open-domain question answering; discourse, coreference and pragmatics; statistical and machine learning methods in NLP; semantics; text mining, open-domain information extraction and machine reading of the Web; sentiment analysis, opinion mining and text classification; lexical semantics and ontologies; language resources and annotation; machine translation; speech recognition and synthesis; tagging and chunking; and large-scale knowledge acquisition and reasoning.

This book provides an overview of the recent advances in representation learning theory, algorithms, and applications for natural language processing (NLP), ranging from word embeddings to pre-trained language models. It is divided into four parts. Part I presents the representation learning techniques for multiple language entries, including words, sentences and documents, as well as pre-training techniques. Part II then introduces the related representation techniques to NLP, including graphs, cross-modal entries, and robustness. Part III then introduces the representation techniques for the knowledge that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, legal domain knowledge and biomedical domain knowledge. Lastly, Part IV discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing. As compared to the first edition, the second edition (1) provides a more detailed introduction to representation learning in Chapter 1; (2) adds four new chapters to introduce pre-trained language models, robust representation learning, legal knowledge representation learning and biomedical knowledge representation learning; (3) updates recent advances in representation learning in all chapters; and (4) corrects some errors in the first edition. The new contents will be approximately 50%+ compared to the first edition. This is an open access book.

This book constitutes the refereed proceedings of the 7th China Conference on Knowledge Graph and Semantic Computing: Knowledge Graph Empowers the Digital Economy, CCKS 2022, in Qinhuangdao, China, August 24-27, 2022. The 15 full papers and 2 short papers included in this book were carefully reviewed and selected from 100 submissions. They were organized in topical sections as follows: knowledge representation and reasoning; knowledge acquisition and knowledge base construction; linked data, knowledge integration, and knowledge graph storage managements; natural language understanding and semantic computing; knowledge graph applications; and knowledge graph open resources.

This book constitutes the proceedings of the 21st China National Conference on Computational Linguistics, CCL 2022, held in Nanchang, China, in October 2022. The 22 full English-language papers in this volume were carefully reviewed and selected from 293 Chinese and English submissions. The conference papers are categorized into the following topical sub-headings: Linguistics and Cognitive Science; Fundamental Theory and Methods of Computational Linguistics; Information Retrieval, Dialogue and Question Answering; Text Generation and Summarization; Knowledge Graph and Information Extraction; Machine Translation and Multilingual Information Processing; Minority Language Information Processing; Language Resource and Evaluation; NLP Applications.

This book constitutes the proceedings of the 20th China National Conference on Computational Linguistics, CCL 2021, held in Hohhot, China, in August 2021.The 31 full presented in this volume were carefully reviewed and selected from 90 submissions. The conference papers covers the following topics such as Machine Translation and Multilingual Information Processing, Minority Language Information Processing, Social Computing and Sentiment Analysis, Text Generation and Summarization, Information Retrieval, Dialogue and Question Answering, Linguistics and Cognitive Science, Language Resource and Evaluation, Knowledge Graph and Information Extraction, and NLP Applications.

heterogeneous graphs. Further, the book introduces different applications of NE such as recommendation and information diffusion prediction. Finally, the book concludes the methods and applications and looks forward to the future directions.

This book constitutes the proceedings of the 19th China National Conference on Computational Linguistics, CCL 2020, held in Hainan, China, in October/November 2020.The 32 full and 2 short papers presented in this volume were carefully reviewed and selected from 99 submissions. They were organized in topical sections named: fundamental theory and methods of computational linguistics; information retrieval, dialogue and question answering; text generation and summarization; knowledge graph and information extraction; machine translation and multilingual information processing; minority language information processing; language resource and evaluation; social computing and sentiment analysis; and NLP applications.

This open access book provides an overview of the recent advances in representation learning theory, algorithms and applications for natural language processing (NLP). It is divided into three parts. Part I presents the representation learning techniques for multiple language entries, including words, phrases, sentences and documents. Part II then introduces the representation techniques for those objects that are closely related to NLP, including entity-based world knowledge, sememe-based linguistic knowledge, networks, and cross-modal entries. Lastly, Part III provides open resource tools for representation learning techniques, and discusses the remaining challenges and future research directions. The theories and algorithms of representation learning presented can also benefit other related domains such as machine learning, social network analysis, semantic Web, information retrieval, data mining and computational biology. This book is intended for advanced undergraduate and graduate students, post-doctoral fellows, researchers, lecturers, and industrial engineers, as well as anyone interested in representation learning and natural language processing.

This book constitutes the proceedings of the 18th China National Conference on Computational Linguistics, CCL 2019, held in Kunming, China, in October 2019. The 56 full papers presented in this volume were carefully reviewed and selected from 134 submissions. They were organized in topical sections named: linguistics and cognitive science, fundamental theory and methods of computational linguistics, information retrieval and question answering, text classification and summarization, knowledge graph and information extraction, machine translation and multilingual information processing, minority language processing, language resource and evaluation, social computing and sentiment analysis, NLP applications.

This book constitutes the proceedings of the 16th China National Conference on Computational Linguistics, CCL 2017, and the 5th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2017, held in Nanjing, China, in October 2017. The 39 full papers presented in this volume were carefully reviewed and selected from 272 submissions. They were organized in topical sections named: Fundamental theory and methods of computational linguistics; Machine translation and multilingual information processing; Knowledge graph and information extraction; Language resource and evaluation; Information retrieval and question answering; Text classification and summarization; Social computing and sentiment analysis; NLP applications; Minority language information processing.

This book constitutes the proceedings of the 15th China National Conference on Computational Linguistics, CCL 2016, and the 4th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2016, held in Yantai City, China, in October 2016. The 29 full papers and 8 short papers presented in this volume were carefully reviewed and selected from 85 submissions. They were organized in topical sections named: semantics; machine translation; multilinguality in NLP; knowledge graph and information extraction; linguistic resource annotation and evaluation; information retrieval and question answering; text classification and summarization; social computing and sentiment analysis; and NLP applications.

This book constitutes the refereed proceedings of the 14th China National Conference on Computational Linguistics, CCL 2014, and of the Third International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2015, held in Guangzhou, China, in November 2015. The 34 papers presented were carefully reviewed and selected from 283 submissions. The papers are organized in topical sections on lexical semantics and ontologies; semantics; sentiment analysis, opinion mining and text classification; machine translation; multilinguality in NLP; machine learning methods for NLP; knowledge graph and information extraction; discourse, coreference and pragmatics; information retrieval and question answering; social computing; NLP applications.