BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model

机译：BERT开口，它必须说话：BERT作为马尔可夫随机场语言模型

获取原文

页面导航

摘要
著录项
相似文献
相关主题

摘要

We show that BERT (Devlin et al., 2018) is a Markov random field language model. This formulation gives way to a natural procedure to sample sentences from BERT. We generate from BERT and find that it can produce high-quality, fluent generations. Compared to the generations of a traditional left-to-right language model, BERT generates sentences that are more diverse but of slightly worse quality.

机译：我们证明BERT（Devlin等人，2018）是马尔可夫随机场语言模型。这种表述让自然程序从BERT抽取句子成为可能。我们从BERT产生，发现它可以产生高质量，流畅的世代。与传统的从左到右语言模型的世代相比，BERT产生的句子更加多样化，但质量稍差。

著录项

来源
《Annual conference of the North American Chapter of the Association for Computational Linguistics: human language technologies;Naturalgen workshop》|2019年|30-36|共7页
会议地点 Minneapolis(US)
作者
Alex Wang; Kyunghyun Cho;
展开▼
作者单位

New York University;

New York University Facebook AI Research CIFAR Azrieli Global Scholar;

展开▼
会议组织
原文格式 PDF
正文语种
中图分类
关键词

相似文献

外文文献
中文文献
专利

1. Zero‐anaphora resolution in Korean based on deep language representation model: BERT [J] . Youngtae Kim, Dongyul Ra, Soojong Lim ETRI journal . 2021,第2期

机译：基于深语陈述模型的韩国零安息日分辨率：伯特
2. Business Application of BERT, a General-purpose Natural-language-processing Model [J] . Tokuma Wachi NTT Technical Review . 2021,第5期

机译：BERT的业务应用，通用自然语言处理模型
3. Patent classification by fine-tuning BERT language model [J] . Jieh-Sheng Lee, Jieh Hsiang World Patent Information . 2020,第Juna期

机译：通过微调BERT语言模型进行专利分类
4. BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model [C] . Alex Wang, Kyunghyun Cho Annual conference of the North American Chapter of the Association for Computational Linguistics: human language technologies . 2019

机译：伯特有一个嘴巴，它必须发言：伯特作为马尔可夫随意场语言模型
5. Markov random field models for natural language [D] . Mark, Kevin Edward. 1997

机译：马尔可夫自然语言随机场模型
6. Connecting Markov random fields and active contour models: application to gland segmentation and classification [O] . Jun Xu, James P. Monaco, Rachel Sparks, 2017

机译：连接马尔可夫随机场和主动轮廓模型：在腺体分割和分类中的应用
7. Innovative Bert-Based Reranking Language Models for Speech Recognition [O] . Shih-Hsuan Chiu, Berlin Chen 2021

机译：基于创新的BERT的Reranking语言模型进行语音识别
8. Fast Variational Approach for Learning Markov Random Field Language Models. [R] . Jernite, Y., Rush, A. M., Sontag, D. 2015

机译：学习马尔可夫随机场语言模型的快速变分方法。

BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model

摘要

著录项

相似文献

相关主题

期刊订阅