BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

PLM 标签

2022

04-24

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

04-22

A Brief Introduction to PLMs

2021

11-27

ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

10-10

ERNIE: Enhanced Language Representation with Informative Entities

10-10

ERNIE: Enhanced Representation through Knowledge Integration

09-26

Xlnet: Generalized autoregressive pretraining for language understanding

09-11

RoBERTa: A Robustly Optimized BERT Pre-training Approach

09-07

BART: Bidirectional and Auto-Regressive Transformers

09-02

Attention is all you need

08-30

Pretrain, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing