contextual embedding 综述 Contextual embeddings, such as ELMo and BERT, move beyond global word represen- tations like Word2Vec and achieve ground- breaking performance on a wide range of natu- ral language processing tasks. Contextual em- beddings assign each word a representation based on its contex