Competition Examples

Example bundles can be found here:

https://github.com/codalab/competition-examples/tree/master/codabench

More details are given below, to help you select the bundle that suits your own requirements. You can easily clone a template and customize it to match your project.

Iris¶

Iris Codabench Bundle is a simple benchmark involving two phases, code submission and results submission.

Classify Wheat Seeds¶

We propose three versions of the Classify Wheat Seeds:

• Result submission bundle, with simple submission of predictions
• Code submission bundle, with submission of Python algorithm
• Ingestion during scoring bundle, where ingestion and scoring run in parallel

Mini-AutoML¶

Mini-AutoML Bundle is a benchmark template for Codabench, featuring code submission to multiple datasets (tasks).

Shortest Path on Weighted Graph (SPoWG)¶

SPoWG Bundle is a benchmark template for Codabench, featuring code submission to solve an optimization problem on graphs.

AutoWSL¶

You can find two versions of the Automated Weakly Supervised Learning Benchmark:

• Code submission benchmark
• Dataset submission benchmark

GPU test¶

GPU test bundle is an example bundle to test if GPUs are available or not. It serves as testing compute workers and does not contain any problem to solve.