阳光

verify-tagPAWS (Paraphrase Word Scrambling)

earth and naturenlptext miningtexttext pre-processing

6

已售 0
52.66MB

数据标识:D17222544729133801

发布时间:2024/07/29

以下为卖家选择提供的数据验证报告:

数据描述

PAWS (Paraphrase Word Scrambling)

A dataset for modeling structure, context, and word order information


Source

> Huggingface Hub: link

About this dataset

> PAWS: Paraphrase Adversaries from Word Scrambling > This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification. The dataset has two subsets, one based on Wikipedia and the other one based on the Quora Question Pairs (QQP) dataset. > For further details, see the accompanying paper: PAWS: Paraphrase Adversaries from Word Scrambling (https://arxiv.org/abs/1904.01130) > PAWS-QQP is not available due to license of QQP. It must be reconstructed by downloading the original data and then running our scripts to produce the data and attach the labels.

How to use the dataset

> https://www.kaggle.com/google-research-datasets/paws#_=_ > > To use this dataset for the task of paraphrase identification, you will need to first split the data into a training set and a test set. You can do this by using the labeled_final_train.csv and labeled_final_test.csv files. Next, you will need to train a paraphrase identification model on the training set. Finally, you can test the performance of your model on the test set

Research Ideas

> - The PAWS dataset can be used to train a machine learning model to identify paraphrases. > - The PAWS dataset can be used to improve the accuracy of a machine translation system. > - The PAWS dataset can be used to develop a system that can detect plagiarism

Acknowledgements

> > > ### License > > > > License: CC0 1.0 Universal (CC0 1.0) - Public Domain Dedication > > No Copyright - You can copy, modify, distribute and perform the work, even for commercial purposes, all without asking permission. See Other Information.

Columns

File: labeled_final_train.csv

Column name Description
sentence1 The first sentence in the pair. (string)
sentence2 The second sentence in the pair. (string)
label A label indicating whether the two sentences are paraphrases of each other (1) or not (0). (integer)

File: unlabeled_final_validation.csv

Column name Description
sentence1 The first sentence in the pair. (string)
sentence2 The second sentence in the pair. (string)
label A label indicating whether the two sentences are paraphrases of each other (1) or not (0). (integer)

File: labeled_final_test.csv

Column name Description
sentence1 The first sentence in the pair. (string)
sentence2 The second sentence in the pair. (string)
label A label indicating whether the two sentences are paraphrases of each other (1) or not (0). (integer)

File: labeled_final_validation.csv

Column name Description
sentence1 The first sentence in the pair. (string)
sentence2 The second sentence in the pair. (string)
label A label indicating whether the two sentences are paraphrases of each other (1) or not (0). (integer)

File: unlabeled_final_train.csv

Column name Description
sentence1 The first sentence in the pair. (string)
sentence2 The second sentence in the pair. (string)
label A label indicating whether the two sentences are paraphrases of each other (1) or not (0). (integer)

File: labeled_swap_train.csv

Column name Description
sentence1 The first sentence in the pair. (string)
sentence2 The second sentence in the pair. (string)
label A label indicating whether the two sentences are paraphrases of each other (1) or not (0). (integer)
data icon
PAWS (Paraphrase Word Scrambling)
6
已售 0
52.66MB
申请报告