Blue Sky Ideas

How much is a Triple?

Kiln October 10, 2018 16:15 - 16:30

Bookmark and Share

Heiko Paulheim.  

Abstract:  Knowledge graphs like Cyc, Freebase, DBpedia, or YAGO are popular sources of the community, which are widely used and analyzed. A question that is not very well researched is: what is the price of their production? In this paper, we propose ways to estimate the cost of those knowledge graphs. We show that the cost of manually curating a triple is between $2 and $6, and that the cost for automatically created knowledge graphs is roughly a factor of 100 to 250 cheaper (i.e., 1c to 2c per statement). Furthermore, we advocate for taking cost into account as an evaluation metric, showing the correspondence between cost per triple and semantic validity as an example.

Keywords:  Knowledge Graphs;  Cost Estimation;  Automation