logo_long Home About Registration Rules Data News Results FAQ Contact

Rules of the KTC2023

The rules and information about KTC2023 can also be conveniently accessed in this pdf document.
Updated Sep 20th: fixed the number of injections in Table 1.

How to Participate

To take part in the KTC2023 competition:

  • Ensure your enrollment by registering before 23:59 EET (Eastern European Time) on September 30th, 2023. Utilize this electronic form.
  • Submit your entry to ktc2023@fips.fi before 23:59 EET (Eastern European Time) on November 5th, 2023. What's required for submission? Refer to the instructions below.

Only submissions meeting the stipulated criteria outlined below will be accepted.

Requirements of the competition

What needs to be submitted? Briefly, the codes must be in Matlab or Python 3.X and the algorithms must be shared with us as a private GitHub repository at latest on deadline. Check the following subsections for detailed instructions. Only submissions that fulfill the requirements listed below will be accepted.

The teams can submit more than one reconstruction algorithm to the challenge, however, each algorithm must be in a separate repository. The maximum number of algorithms is the number of members of the team. Your team does not need to register multiple times in case you decide to submit more than one algorithm to the challenge. The team can send a single email with the links to all the repositories.

After the deadline, there is a brief period during which we can troubleshoot the codes together with the competing teams. This is to ensure that we are able to run the codes. The troubleshoot communication is done mainly via 'Issues' section of the submitted repository, so pay attention to any activities in the repository after the deadline.

Special situations: The spirit of the competition is that the algorithm is a general-purpose algorithm, capable of reconstructing electrical impedance tomography images of the targets. The organizing committee has the right to disqualify an algorithm trying to violate that spirit.

Conflict of interest: researchers affiliated with the Department of Technical Physics of University of Eastern Finland will not be added to the leaderboard and cannot win the competition.

Deadline and what needs to be submitted:

Deadline: November 5th, 2023 23:59 EET (Eastern European Time)

The algorithms must be shared with us as a private GitHub repository at latest on the deadline. The codes should be in Matlab or Python3.

After the deadline there is a brief period during which we can troubleshoot the codes together with the competing teams. This is to ensure that we are able to run the codes.

Github repository

Competitors can update the contents of the shared repository as many times as needed before the deadline. We will consider only the latest release of your repository on Github.

Attention: Simple commits to the main branch will not be considered. You MUST also create a release. You can find Github's documentation on how to create releases here. If the latest release does not work we will not accept older versions.

Your repository must contain a README.md file with at least the following sections:

  • Authors, institution, location.
  • Brief description of your algorithm and a mention of the competition.
  • Installation instructions, including any requirements.
    • Matlab users: Please specify any toolboxes used.
    • Python users: Please specify any modules used. If you use Anaconda, please add to the repository an environment.yml file capable of creating an environment than can run your code (instructions). Otherwise, please add a requirements.txt file generated with pip freeze (instructions)
  • Usage instructions.
  • Show few examples.

If your algorithm requires uploading large files to Github (e.g. with trained coefficients of a neural network), you can use Git Large File Storage (preferable way) or store them in another server and add the link to the Github installation instructions.

The teams can submit more than one algorithm to the challenge, each algorithm must be in a separate repository. The maximum number of algorithms is the number of members of the team. The teams don't need to register multiple times in case they decide to submit more than one algorithm to the challenge.

Your code on Github

The repository must contain a main routine that we can run to apply your algorithm automatically to every dataset in a given directory. This is the file we will run to evaluate your code. Give it an easy to identify name like main.m or main.py.

Important: The input directory contains only the test dataset. No training dataset is provided to your code during the assessment. Therefore, any training procedures must be performed by your team before the submission.

Your main routine must require three input arguments:

  1. (string) Folder where the input image files are located
  2. (string) Folder where the output images must be stored
  3. (int) Difficulty category number. Values between 1 and X
Below are the expected formats of the main routines in python and Matlab:



Matlab: The main function must be a callable function:

function main(inputFolder,outputFolder,categoryNbr)

...

your code comes here

...

Example calling the function:

>> main('path/to/input/files', 'path/to/output/files', 3)



Python: The main function must be a callable function from the command line. To achieve this you can use sys.argv or argparse module.

Example calling the function:

$ python3 main.py path/to/input/files path/to/output/files 3



The main routine must produce a reconstructed PNG file in the output folder for each dataset in the input folder. The output PNG images must have dimensions 256 x 256 pixels and the same filename as the dataset apart from the extension. All datasets in the input directory belong to the same difficulty category, specified by the input argument.

The teams are allowed to use freely available python modules or Matlab toolboxes. Toolboxes, libraries and modules with paid licenses can also be used if the organizing committee also have the license. For example, the most usual Matlab toolboxes for image processing and deconvolution can be used (Image processing toolbox, wavelet toolbox, PDE toolbox, computer vision toolbox, deep learning toolbox, optimization toolbox). The teams can contact us to check if other toolboxes are available.

Scores and leaderboard

We refer to the instructions PDF linked at the top of this page.

Open science spirit of KTC2023

Finally, the competitors must make their GitHub repositories public at latest on November 30th, 2023. In the spirit of open science, only a public code can win KTC2023. Note: the date has been corrected - it previously read November 5th by mistake on this website.