Metrics in proceedings meta data

A widely used metric for assessing the quality of a workshop/conference is the acceptance rate. The lower the acceptance rate, the higher the presumable quality, since it indicates a rigorous peer review.

Many editors of volume at CEUR-WS.org include such data (number of submissions, number of accepted papers) in their preface.

So, why not include it as semantic annotation into the main index file of a published volume.  This would allow to query a volume on basis of such metrics, e.g. “give me all volumes with an acceptance rate lower than 25% for full papers”.

Are there standards available to represent such data, e.g. in RDF?

Advertisements
2 comments
  1. I dimly remember that, probably in the context of the Semantic Publishing Challenge, we have discussed this before. Thanks for remembering it and writing it down!

    Indeed it would make sense to utilise information such as the acceptance rate, where it exists, and to make it semantically explicit. We could extract it from the PDF full text in any case. When processing EasyChair-generated proceedings with ceur-make, we even have the chance to make this extraction easier and more precise, as EasyChair by default puts a plain-text sentence about the number of submissions, acceptance rate and number of reviews per paper (another quality indicator!) into the preface.

    I am not aware of existing RDF vocabulary for this. I did a quick search for “acceptance” on LOV and didn’t find anything useful. Keep in mind that even for more basic workshop-related concepts there is no standard vocabulary; this was once more proved during the Challenge. For “acceptance rate” and other terms I think we can feel free to start our own vocabulary, e.g. in the namespace http://ceur-ws.org/vocab#.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: