SIGHAN Second International Chinese Word Segmentation Bakeoff

The Second International Chinese Word Segmentation Bakeoff took place over the summer of 2005 and the results were presented at the 4th SIGHAN Workshop, held at IJCNLP'05, October 14-15.

Corpora from the following organizations were used:

The complete training, testing, and gold-standard data sets, as well as the scoring script, are available for research use:

The Detailed Instructions for the bakeoff are available. Please read them carefully.

Segmentation guidelines for the following corpora are available. These were supplied to SIGHAN by each data provider, and converted into PDF by the organizer:

CorpusMS WordPDF
Academia Sinica516 KB336 KB
City University of Hong Kong154 KB237 KB
Peking University177 KB294 KB
Microsoft Research41 KB70 KB

The collected results of all participating systems are also available.

Many thanks to the data providers and the bakeoff participants!

Contact Information

The bakeoff was organized by Tom EMERSON of Basis Technology Corp.

Questions on the bakeoff should be addressed to Tom Emerson.
Last edited: November 18 2005 12:58:09.