Skip to content

An Indonesian dependency treebank that automatically generated from a constituency treebank

License

Notifications You must be signed in to change notification settings

ir-nlp-csui/ID-DepTB-CSUI

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 

Repository files navigation

The UD Indonesian-CSUI Dependency Treebank

The CSUI treebank is a conversion from an Indonesian constituency treebank in the Penn Treebank format named Kethu that was also a conversion from a constituency treebank built by Dinakaramani et al. (2015). We named this treebank CSUI, since all the three versions of the treebanks were built at Faculty of Computer Science, Universitas Indonesia.

Other characteristics of the treebank:

  • This treebank consists of 1030 sentences and 28,263 words.
  • The genre of the sentences are mainly news in formal Indonesian.
  • Average sentence length is around 27.4 words per-sentence, which is very high compare to the Indonesian-PUD treebank that has average sentence length of 19.4.

The Split

We provide two splits of the CSUI Dependency Treebank:

  • Split-105-925, that was used on the experiment on a paper that described how the treebank was constructed (Alfina et a., 2020). This split consists of two dataset:

    • csui-test-105, the gold standard that manually annotated
    • csui-train-925, the training dataset that automatically converted
  • Split-UD, thas was published in UD website with name UD Indonesian CSUI. We need to create this split since UD treebank has requirement that a dataset with 20-30 K words should be split into 2 set, with the testing dataset consist of around 10K words. This split consists of two dataset:

    • id_csui-ud-test.conllu, consists of around 10K words
    • id_csui-ud-train.conllu, consists of around 18K words

Acknowledgments

  • The original constituency treebank was built with manual annotation by Arawinda Dinakaramani, Fam Rashel, Andry Luthfi, and Ruli Manurung at Faculty of Computer Science, Universitas Indonesia in 2015.
  • The previous treebank was converted to the Penn Treebank format by Ika Alfina and Jessica Naraiswari Arwidarasti at Faculty of Computer Science, Universitas Indonesia in 2019. This PTB version was named Kethu.

References

Changelog

2020-10-15 v1.0

  • Initial release

Licence

You can use this dataset for free. You don't need our permission to use it. Please cite our paper if your work uses our data in your publication. Please note that you are not allowed to create a copy of this dataset and share it publicly in your own repository withour our permission.

Contact

ika.alfina [at] cs.ui.ac.id

About

An Indonesian dependency treebank that automatically generated from a constituency treebank

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published