Challenge competitions provide a viable method to incentivize the engagement of talented individuals and teams toward the development, validation and benchmarking of innovative solutions (tools), while making great use of shared reference data. Although the goal of a challenge may be developmental, the process of implementation and execution of the challenge can help address issues in data quality, access, and data standards, while participation in a data challenge may help address reproducibility in algorithmic performance. The Childhood Cancer Data Initiative could include use of challenges to engage the research community in addressing its various components, including Research Questions, Data Analysis Tools, Data Infrastructure, and Data Sharing.
Idea No. 1006