Files
PBC4cipTest/README.md

4.8 KiB

PBC4cip Test

This is a repository for the PBC4cip test with the ODTE paper datasets.

TL;DR

Friedman test

Setup

To run the tests, you need to install the requirements:

./setup

Compile

To compile the code, you need to run the following command:

./compile

Run

To run the tests, you need to run the following command:

./run

Output screen

               5 fold cross validation stratified               
 #  Dataset                        Seeds                         Accuracy  Time     
--- ------------------------------ ----------------------------- --------- ---------
  0 balance-scale                  57 31 1714 17 23 79 83 97 7 1 0.9067200     0.712
  1 balloons                       57 31 1714 17 23 79 83 97 7 1 0.6900000     0.012
  2 breast-cancer-wisc-diag        57 31 1714 17 23 79 83 97 7 1 0.9632697     0.790
  3 breast-cancer-wisc-prog        57 31 1714 17 23 79 83 97 7 1 0.6115128     0.763
  4 breast-cancer-wisc             57 31 1714 17 23 79 83 97 7 1 0.9703875     0.620
  5 breast-cancer                  57 31 1714 17 23 79 83 97 7 1 0.6195160     0.959
  6 cardiotocography-10clases      57 31 1714 17 23 79 83 97 7 1 0.8685813    13.496
  7 cardiotocography-3clases       57 31 1714 17 23 79 83 97 7 1 0.9238461     6.487
  8 conn-bench-sonar-mines-rocks   57 31 1714 17 23 79 83 97 7 1 0.8351568     0.640
  9 cylinder-bands                 57 31 1714 17 23 79 83 97 7 1 0.7812317     2.965
 10 dermatology                    57 31 1714 17 23 79 83 97 7 1 0.9707738     0.864
 11 echocardiogram                 57 31 1714 17 23 79 83 97 7 1 0.7800000     0.200
 12 fertility                      57 31 1714 17 23 79 83 97 7 1 0.6690000     0.134
 13 haberman-survival              57 31 1714 17 23 79 83 97 7 1 0.6434056     0.284
 14 heart-hungarian                57 31 1714 17 23 79 83 97 7 1 0.8149328     0.571
 15 hepatitis                      57 31 1714 17 23 79 83 97 7 1 0.7729032     0.341
 16 ilpd-indian-liver              57 31 1714 17 23 79 83 97 7 1 0.6763587     1.990
 17 ionosphere                     57 31 1714 17 23 79 83 97 7 1 0.9378913     0.876
 18 iris                           57 31 1714 17 23 79 83 97 7 1 0.9653333     0.051
 19 led-display                    57 31 1714 17 23 79 83 97 7 1 0.7287000     0.868
 20 libras                         57 31 1714 17 23 79 83 97 7 1 0.8383333     4.448
 21 low-res-spect                  57 31 1714 17 23 79 83 97 7 1 0.8913454     3.692
 22 lymphography                   57 31 1714 17 23 79 83 97 7 1 0.8409655     0.476
 23 mammographic                   57 31 1714 17 23 79 83 97 7 1 0.8185244     1.825
 24 molec-biol-promoter            57 31 1714 17 23 79 83 97 7 1 0.8785714     0.323
 25 musk-1                         57 31 1714 17 23 79 83 97 7 1 0.8922346     3.034
 26 oocytes_merluccius_nucleus_4d  57 31 1714 17 23 79 83 97 7 1 0.8326925     5.481
 27 oocytes_merluccius_states_2f   57 31 1714 17 23 79 83 97 7 1 0.9045017     2.144
 28 oocytes_trisopterus_nucleus_2f 57 31 1714 17 23 79 83 97 7 1 0.8132817     3.835
 29 oocytes_trisopterus_states_5b  57 31 1714 17 23 79 83 97 7 1 0.9210509     3.326
 30 parkinsons                     57 31 1714 17 23 79 83 97 7 1 0.8600000     0.300
 31 pima                           57 31 1714 17 23 79 83 97 7 1 0.7462236     2.220
 32 pittsburg-bridges-MATERIAL     57 31 1714 17 23 79 83 97 7 1 0.7973593     0.103
 33 pittsburg-bridges-REL-L        57 31 1714 17 23 79 83 97 7 1 0.6720952     0.158
 34 pittsburg-bridges-SPAN         57 31 1714 17 23 79 83 97 7 1 0.6247368     0.134
 35 pittsburg-bridges-T-OR-D       57 31 1714 17 23 79 83 97 7 1 0.7877143     0.081
 36 planning                       57 31 1714 17 23 79 83 97 7 1 0.4685736     0.537
 37 post-operative                 57 31 1714 17 23 79 83 97 7 1 0.3988889     0.313
 38 seeds                          57 31 1714 17 23 79 83 97 7 1 0.9376190     0.113
 39 statlog-australian-credit      57 31 1714 17 23 79 83 97 7 1 0.5549275     2.918
 40 statlog-german-credit          57 31 1714 17 23 79 83 97 7 1 0.7245000     5.255
 41 statlog-heart                  57 31 1714 17 23 79 83 97 7 1 0.8285185     0.554
 42 statlog-image                  57 31 1714 17 23 79 83 97 7 1 0.9755844     6.262
 43 statlog-vehicle                57 31 1714 17 23 79 83 97 7 1 0.7786161     3.333
 44 synthetic-control              57 31 1714 17 23 79 83 97 7 1 0.9861667     2.141
 45 tic-tac-toe                    57 31 1714 17 23 79 83 97 7 1 0.9867430     1.953
 46 vertebral-column-2clases       57 31 1714 17 23 79 83 97 7 1 0.8222581     0.294
 47 wine                           57 31 1714 17 23 79 83 97 7 1 0.9702857     0.167
 48 zoo                            57 31 1714 17 23 79 83 97 7 1 0.9742857     0.144
* End.

Create experiment result json file

python create_json.py