PBC4cip Test

This is a repository for the PBC4cip test with the ODTE paper datasets.

TL;DR

Friedman test

Setup

To run the tests, you need to install the requirements:

./setup

Compile

To compile the code, you need to run the following command:

./compile

Run

To run the tests, you need to run the following command:

./run

Output screen

               5 fold cross validation stratified               
 #  Dataset                        Seeds                        
--- ------------------------------ -----------------------------
  0 balance-scale                  57 31 1714 17 23 79 83 97 7 1 
  1 balloons                       57 31 1714 17 23 79 83 97 7 1 
  2 breast-cancer-wisc-diag        57 31 1714 17 23 79 83 97 7 1 
  3 breast-cancer-wisc-prog        57 31 1714 17 23 79 83 97 7 1 
  4 breast-cancer-wisc             57 31 1714 17 23 79 83 97 7 1 
  5 breast-cancer                  57 31 1714 17 23 79 83 97 7 1 
  6 cardiotocography-10clases      57 31 1714 17 23 79 83 97 7 1 
  7 cardiotocography-3clases       57 31 1714 17 23 79 83 97 7 1 
  8 conn-bench-sonar-mines-rocks   57 31 1714 17 23 79 83 97 7 1 
  9 cylinder-bands                 57 31 1714 17 23 79 83 97 7 1 
 10 dermatology                    57 31 1714 17 23 79 83 97 7 1 
 11 echocardiogram                 57 31 1714 17 23 79 83 97 7 1 
 12 fertility                      57 31 1714 17 23 79 83 97 7 1 
 13 haberman-survival              57 31 1714 17 23 79 83 97 7 1 
 14 heart-hungarian                57 31 1714 17 23 79 83 97 7 1 
 15 hepatitis                      57 31 1714 17 23 79 83 97 7 1 
 16 ilpd-indian-liver              57 31 1714 17 23 79 83 97 7 1 
 17 ionosphere                     57 31 1714 17 23 79 83 97 7 1 
 18 iris                           57 31 1714 17 23 79 83 97 7 1 
 19 led-display                    57 31 1714 17 23 79 83 97 7 1 
 20 libras                         57 31 1714 17 23 79 83 97 7 1 
 21 low-res-spect                  57 31 1714 17 23 79 83 97 7 1 
 22 lymphography                   57 31 1714 17 23 79 83 97 7 1 
 23 mammographic                   57 31 1714 17 23 79 83 97 7 1 
 24 molec-biol-promoter            57 31 1714 17 23 79 83 97 7 1 
 25 musk-1                         57 31 1714 17 23 79 83 97 7 1 
 26 oocytes_merluccius_nucleus_4d  57 31 1714 17 23 79 83 97 7 1 
 27 oocytes_merluccius_states_2f   57 31 1714 17 23 79 83 97 7 1 
 28 oocytes_trisopterus_nucleus_2f 57 31 1714 17 23 79 83 97 7 1 
 29 oocytes_trisopterus_states_5b  57 31 1714 17 23 79 83 97 7 1 
 30 parkinsons                     57 31 1714 17 23 79 83 97 7 1 
 31 pima                           57 31 1714 17 23 79 83 97 7 1 
 32 pittsburg-bridges-MATERIAL     57 31 1714 17 23 79 83 97 7 1 
 33 pittsburg-bridges-REL-L        57 31 1714 17 23 79 83 97 7 1 
 34 pittsburg-bridges-SPAN         57 31 1714 17 23 79 83 97 7 1 
 35 pittsburg-bridges-T-OR-D       57 31 1714 17 23 79 83 97 7 1 
 36 planning                       57 31 1714 17 23 79 83 97 7 1 
 37 post-operative                 57 31 1714 17 23 79 83 97 7 1 
 38 seeds                          57 31 1714 17 23 79 83 97 7 1 
 39 statlog-australian-credit      57 31 1714 17 23 79 83 97 7 1 
 40 statlog-german-credit          57 31 1714 17 23 79 83 97 7 1 
 41 statlog-heart                  57 31 1714 17 23 79 83 97 7 1 
 42 statlog-image                  57 31 1714 17 23 79 83 97 7 1 
 43 statlog-vehicle                57 31 1714 17 23 79 83 97 7 1 
 44 synthetic-control              57 31 1714 17 23 79 83 97 7 1 
 45 tic-tac-toe                    57 31 1714 17 23 79 83 97 7 1 
 46 vertebral-column-2clases       57 31 1714 17 23 79 83 97 7 1 
 47 wine                           57 31 1714 17 23 79 83 97 7 1 
 48 zoo                            57 31 1714 17 23 79 83 97 7 1 
* End.

Create experiment result json file

python create_json.py

3.9 KiB Raw Blame History