Files
PBC4cipTest/Friedman.md

6.5 KiB

Best results for accuracy as of 2024-12-23 20:12
------------------------------------------------
 #  Dataset                        Odte         TBRRoF       TBRaF        TBRoF        pbc4cip      
=== ============================== ============ ============ ============ ============ ============ 
  0 balance-scale                  0.9750428259 0.9044194023 0.9023101421 0.7786507839 0.9067200000 
  1 balloons                       0.7250000060 0.6287500000 0.6000000000 0.6187500000 0.6900000000 
  2 breast-cancer                  0.7516938877 0.7347472506 0.7331207795 0.7227416554 0.6195160000 
  3 breast-cancer-wisc             0.9706747293 0.9688476524 0.9690400351 0.9618093707 0.9703870000 
  4 breast-cancer-wisc-diag        0.9761007452 0.9740889392 0.9713513247 0.9734280508 0.9632700000 
  5 breast-cancer-wisc-prog        0.8031222689 0.8114785914 0.7998559424 0.8043037215 0.6115130000 
  6 cardiotocography-10clases      0.8404853785 0.8326822555 0.8324371518 0.7827072711 0.8685810000 
  7 cardiotocography-3clases       0.9263860846 0.9222234235 0.9196784360 0.8954016281 0.9238460000 
  8 conn-bench-sonar-mines-rocks   0.8586967516 0.8356730769 0.8216346154 0.7904807692 0.8351570000 
  9 cylinder-bands                 0.7841918910 0.7728125000 0.7510156250 0.7148437500 0.7812320000 
 10 dermatology                    0.9805705738 0.9751872858 0.9741096538 0.9731673166 0.9707740000 
 11 echocardiogram                 0.8550358975 0.8506562500 0.8496339286 0.8291785714 0.7800000000 
 12 fertility                      0.8806014967 0.8810000000 0.8804000000 0.8800000000 0.6690000000 
 13 haberman-survival              0.7349814928 0.7373734818 0.7355786100 0.7325691633 0.6434060000 
 14 heart-hungarian                0.8231630635 0.8183260274 0.8203068493 0.8067561644 0.8149330000 
 15 hepatitis                      0.8424690831 0.8180006418 0.8194833119 0.8099101412 0.7729030000 
 16 ilpd-indian-liver              0.7315809560 0.7132868127 0.7142758621 0.7072269338 0.6763590000 
 17 ionosphere                     0.9498350000 0.9471168582 0.9320804598 0.9069444444 0.9378910000 
 18 iris                           0.9653333235 0.9653153153 0.9629868330 0.9771552322 0.9653330000 
 19 led-display                    0.7274587321 0.6861600000 0.7126200000 0.7028800000 0.7287000000 
 20 libras                         0.8726855135 0.8851111111 0.8527222222 0.7556111111 0.8383330000 
 21 low-res-spect                  0.9115328133 0.8993678451 0.9006565657 0.8686498316 0.8913450000 
 22 lymphography                   0.8636181998 0.8559459459 0.8485135135 0.7733783784 0.8409660000 
 23 mammographic                   0.8352833545 0.8260945712 0.8295917185 0.8129815871 0.8185240000 
 24 molec-biol-promoter            0.9013679683 0.8146428571 0.8230357143 0.7479807692 0.8785710000 
 25 musk-1                         0.9331642866 0.8939075630 0.8807142857 0.8628991597 0.8922350000 
 26 oocytes_merluccius_nucleus_4d  0.8410942197 0.8388691539 0.8391387808 0.8256020447 0.8326920000 
 27 oocytes_merluccius_states_2f   0.9325797427 0.9270210575 0.9238093385 0.9195349050 0.9045020000 
 28 oocytes_trisopterus_nucleus_2f 0.8557010734 0.8365350877 0.8345175439 0.8048684211 0.8132820000 
 29 oocytes_trisopterus_states_5b  0.9309143639 0.9323026316 0.9278508772 0.9303508772 0.9210510000 
 30 parkinsons                     0.9344102585 0.9310110294 0.9143321078 0.8947732843 0.8600000000 
 31 pima                           0.7726720953 0.7685416667 0.7633072917 0.7675260417 0.7462240000 
 32 pittsburg-bridges-MATERIAL     0.8731722212 0.8602335165 0.8666620879 0.8014423077 0.7973590000 
 33 pittsburg-bridges-REL-L        0.7060952485 0.6904285714 0.6955642857 0.6185142857 0.6720950000 
 34 pittsburg-bridges-SPAN         0.6941609919 0.6923913043 0.6865217391 0.6221739130 0.6247370000 
 35 pittsburg-bridges-T-OR-D       0.8686441112 0.8702074074 0.8649703704 0.8714222222 0.7877140000 
 36 planning                       0.7309008932 0.7202198582 0.7145531915 0.7131205674 0.4685740000 
 37 post-operative                 0.7120519483 0.7108901515 0.7074242424 0.7114583333 0.3988890000 
 38 seeds                          0.9604761744 0.9467770655 0.9438782051 0.9506552707 0.9376190000 
 39 statlog-australian-credit      0.6782657218 0.6782701818 0.6782668404 0.6782691794 0.5549280000 
 40 statlog-german-credit          0.7681999898 0.7577600000 0.7548000000 0.7560800000 0.7245000000 
 41 statlog-heart                  0.8481481481 0.8367207441 0.8373837335 0.8249686351 0.8285190000 
 42 statlog-image                  0.9711255431 0.9759832138 0.9697836166 0.9568146987 0.9755840000 
 43 statlog-vehicle                0.8132791913 0.7862973099 0.7764671918 0.8032546781 0.7786160000 
 44 synthetic-control              0.9910000086 0.9919666667 0.9913000000 0.9807000000 0.9861670000 
 45 tic-tac-toe                    0.9939462876 0.9856599073 0.9799358496 0.9832547440 0.9867430000 
 46 vertebral-column-2clases       0.8635483825 0.8504972875 0.8500682229 0.8505170146 0.8222580000 
 47 wine                           0.9843730736 0.9826086957 0.9816847826 0.9878903162 0.9702860000 
 48 zoo                            0.9706897533 0.9465538462 0.9410846154 0.9461615385 0.9742860000 
=== ============================== ============ ============ ============ ============ ============ 
    Average.......................   0.85950053   0.84634616   0.84245834   0.82428080   0.80930857 

***************************************************************************************************************
Friedman test: H0: 'There is no significant differences between all the classifiers.'
Friedman statistic: 87,6408
Critical χ2 Value for df=4 and alpha=0,05: 9,4877290e+00
p-value: 4,1741784e-18 is less than 0,05
The null hypothesis H0 is rejected.
***************************************************************************************************************
  *************************************************************************************************************
  Post-hoc Holm test: H0: 'There is no significant differences between the control model and the other models.'
  Control model: Odte
  Model   p-value      rank      win tie loss Status
  ======= ============ ========= === === ==== =============
  Odte                 1,4285715
  TBRRoF  1,401302e-03 2,4489796  40   0    9 ✗ rejected H0
  TBRaF   3,816278e-09 3,3469388  46   0    3 ✗ rejected H0
  pbc4cip 8,726353e-14 3,8571429  45   0    4 ✗ rejected H0
  TBRoF   2,575717e-14 3,9183674  44   0    5 ✗ rejected H0
  *************************************************************************************************************