Rexa Coreference Dataset Version 0.5

10/4/06
Data is available here: rexa_coref_datav0.5.tgz

The file citations.xml contains citation data annotated for coreference among several different entity types: titles, authors, venues, and institutions. The data was harvested from REXA (http://rexa.info), a digital library and search engine covering the computer science research literature and the people who create it.

Most of the xml format should be self-explanatory. The attributes 'id' and 'clusterid' have been added to some elements, indicating their mention id and cluster id, respectively. Additionally, fileid refers to the file from which the reference was found, and refID identifies which reference in the paper. The concatenation of fileid and refID uniquely identifies a reference.

Some statistics about the dataset:

15524 entity mentions (author title venue institution)
203 clusters
avg cluster size=19.8669950738916
max cluster size 301
min cluster size 1
2454 citation mentions
243 header mentions
9411 authors
2811 titles
2031 venues
1271 institutions

IMPORTANT

Our goal is to construct a large, real-world coreference dataset. Since labeling all coreference decisions in such a large dataset is infeasible, we have partially labeled it in the following way: If a mention is labeled with a clusterid attribute, then all of its coreferent mentions have been labeled. If a mention does not have a clusterid attribute, then there may exist coreferent mentions that have not been labeled as such. The idea is to allow researchers to leverage this unlabeled data, while still enabling evaluation on the labeled portion.

COMING SOON

In the future, we plan to expand the amount of labeled data as well as the overlap among the mentions and also include scripts for partitioning the data and evaluating predictions. There are likely still errors in the labeling, and we will be updating and expanding the dataset shortly. Send questions to Aron Culotta (culotta at cs dot umass dot edu)