Informatics in Education logo


Login Register

  1. Home
  2. Issues
  3. Volume 5, Issue 1 (2006)
  4. Random Factors in IOI 2005 Test Case Sco ...

Informatics in Education

INFORMATION Submit your article Help
  • Article info
  • Related articles
  • More
    Article info Related articles

Random Factors in IOI 2005 Test Case Scoring
Volume 5, Issue 1 (2006), pp. 5–14
Gordon CORMACK  

Authors

 
Placeholder
https://doi.org/10.15388/infedu.2006.01
Pub. online: 15 April 2006      Type: Article     

Published
15 April 2006

Abstract

We examine the precision with which the cumulative score from a suite of test cases ranks participants in the International Olympiad in Informatics (IOI). Our concern is the ability of these scores to reflect achievement at all levels, as opposed to reflecting chance or arbitrary factors involved in composing the test suite. Test cases are assumed to be drawn from an infinite population of similar cases; variance in standardized rank is estimated by the bootstrap method and used to compute confidence intervals which contain the hypothetical true ranking with 95% probability. We examine the relative contribution of easy (so-called fifty-percent rule) cases and hard cases to the overall ranking. Empirical results based on IOI 2005 suggest that easy and hard cases are both material to the ranking, but the proportion of each is unimportant.

Related articles PDF XML
Related articles PDF XML

Copyright
No copyright data available.

Keywords
informatics olympiad programming contest classical test theory

Metrics
since February 2020
1018

Article info
views

0

Full article
views

592

PDF
downloads

276

XML
downloads

Export citation

Copy and paste formatted citation
Placeholder

Download citation in file


Share


RSS

INFORMATICS IN EDUCATION

  • Online ISSN: 2335-8971
  • Print ISSN: 1648-5831
  • Copyright © 2024 Vilnius University
  •  

For contributors

  • Submit
  • OA Policy

Contact us

  • Institute of Data Science and Digital Technologies,
  • Vilnius University, Akademijos St. 4, 08412, Vilnius, Lithuania
  • E-mail: gabriele.stupuriene@mif.vu.lt
Powered by PubliMill  •  Privacy policy