BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper Note 分类

2022

04-24

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

04-22

A Brief Introduction to PLMs

04-03

Transformer Feed-Forward Layers are Key-Value Memories

03-30

Towards a Unified View of Parameter Efficient Transfer Learning

03-23

Integrating Multimodal Information in Large Pretrained Transformers

03-12

Knowledge-Aware Languege Model Pretraining

03-08

Differentiable Reasoning over a Virtual Knowledge Base

03-06

A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models

03-01

K-Adapter: Infusing Knowledge into Pre-Training Models with Adapters

02-26

LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention