Database kNN (size) CNN (size) SNN (size) IB2 (size) IB3 (size) DEL (size) DROP1 (size) DROP2 (size) DROP3 (size) DROP4 (size) DROP5 (size) ENN (size) RENN (size) AllKNN (size) ELGrow (size) Explore (size) ELH (size) MCS (size) anneal 93.11 100.00 96.99 9.56 -- 86.09 10.50 ++ 96.74 9.48 -- 91.35 9.79 ++ 93.85 9.30 87.70 5.05 ++ 95.61 8.08 -- 94.11 8.65 94.36 11.67 95.24 9.93 89.73 92.00 ++ 89.48 90.70 ++ 89.98 92.43 ++ 88.35 0.70 ++ 91.11 0.75 + 95.73 9.30 93.11 100.00 australian 84.78 100.00 77.68 24.22 ++ 81.31 28.38 + 78.26 24.15 ++ 85.22 4.78 - 84.78 2.56 64.49 2.30 ++ 83.62 7.28 83.92 5.96 84.78 7.99 83.91 9.18 84.50 86.49 84.21 84.80 86.09 78.07 -- 83.62 0.32 85.80 0.32 - 83.04 7.91 84.78 100.00 breast-cancer-wisconsin 96.28 100.00 95.71 7.09 93.85 8.35 ++ 95.71 7.09 96.57 3.47 96.28 1.89 77.52 1.14 ++ 95.85 3.13 96.14 3.58 96.28 4.05 95.71 4.07 97.00 96.80 - 96.85 96.61 - 97.00 94.58 - 89.85 0.32 ++ 96.71 0.32 94.13 1.92 + 96.28 100.00 bridges 66.09 100.00 -- 61.18 49.48 61.37 52.52 62.18 48.64 - 64.73 28.83 -- 64.27 35.64 -- 39.64 10.17 ++ 61.18 17.30 - 56.36 17.60 57.36 21.28 62.82 22.22 - 59.46 68.23 58.36 65.93 - 59.36 58.48 56.27 5.35 57.18 5.67 58.55 34.18 66.09 100.00 -- crx 83.63 100.00 ++ 79.42 24.15 ++ 81.59 27.52 ++ 79.42 24.15 ++ 86.09 4.28 83.63 3.08 ++ 65.94 3.75 ++ 84.64 7.31 85.80 5.46 85.51 7.33 83.77 7.68 + 85.36 86.17 85.80 85.64 85.08 78.82 85.22 0.32 85.51 0.32 83.05 7.52 ++ 83.63 100.00 ++ echocardiogram 94.82 100.00 85.18 14.72 + 48.75 26.29 ++ 85.18 14.72 + 72.86 11.57 ++ 93.39 6.91 93.39 9.61 94.82 10.51 93.39 10.66 94.82 10.96 93.39 9.16 93.39 92.94 93.39 92.94 93.39 92.18 93.39 3.01 94.82 3.01 94.82 6.16 94.82 100.00 flag 61.34 100.00 53.63 50.29 ++ 53.63 51.66 ++ 53.11 49.95 ++ 49.47 34.14 ++ 56.18 45.88 + 43.18 9.04 ++ 62.79 20.62 61.29 20.45 59.58 27.09 58.13 25.26 63.32 67.07 62.76 62.83 61.24 55.67 55.50 2.00 56.16 2.06 55.13 47.42 + 61.34 100.00 glass 73.83 100.00 -- 68.14 38.53 64.39 42.63 66.78 39.25 62.14 33.80 69.59 38.42 - 62.97 15.47 65.04 23.11 65.02 23.88 65.91 29.54 65.45 24.82 65.91 70.82 64.00 69.06 67.75 65.89 50.54 2.28 ++ 63.98 3.53 68.66 41.07 73.83 100.00 -- heart.cleveland.2 81.19 100.00 73.95 30.84 ++ 76.25 33.88 ++ 73.96 30.29 ++ 81.16 11.11 79.49 13.64 70.91 6.09 ++ 79.55 11.92 80.84 12.76 78.19 15.26 79.84 15.37 82.50 83.46 82.16 82.51 81.51 72.72 81.52 0.73 82.15 0.73 77.87 21.56 81.19 100.00 heart.hungarian.2 79.55 100.00 70.40 28.87 ++ 75.84 34.01 ++ 73.87 27.44 ++ 79.20 9.90 77.18 12.28 ++ 72.17 5.74 ++ 78.52 8.80 80.29 9.86 79.22 11.53 79.60 11.15 80.28 82.12 79.25 79.93 80.62 70.79 80.61 0.75 82.30 0.75 77.84 18.33 79.55 100.00 heart.long-beach-va.2 70.00 100.00 61.00 35.67 ++ 67.00 43.56 ++ 57.00 35.39 ++ 70.00 4.89 70.00 19.28 69.00 4.39 70.00 11.83 + 73.50 4.50 74.00 11.72 73.00 14.94 74.00 75.44 74.00 72.72 74.00 62.28 72.50 0.84 + 74.50 1.11 71.00 28.61 70.00 100.00 heart.more.2 73.78 100.00 ++ 69.69 33.21 ++ 72.22 43.64 ++ 69.69 33.21 ++ 76.31 9.36 75.15 16.81 ++ 63.46 3.51 ++ 73.98 10.72 ++ 76.38 9.14 74.36 13.19 ++ 74.63 14.62 ++ 76.31 76.58 76.51 74.41 75.60 66.97 67.48 0.14 ++ 73.13 0.14 ++ 72.74 21.24 ++ 73.78 100.00 ++ heart 81.48 100.00 70.00 26.17 ++ 77.04 33.78 ++ 70.00 26.17 ++ 80.00 13.58 ++ 78.89 4.73 ++ 72.59 5.47 ++ 81.85 12.22 83.33 13.62 81.85 16.71 81.11 16.67 81.11 83.13 ++ 81.11 81.98 ++ 81.85 72.02 74.44 0.82 ++ 81.85 0.82 74.45 13.70 ++ 81.48 100.00 heart.swiss.2 92.69 100.00 91.09 11.38 92.69 15.90 90.26 11.38 + 93.46 3.70 92.69 4.25 93.46 1.81 93.46 2.53 93.46 1.81 93.46 2.35 92.63 5.42 93.46 93.49 93.46 93.49 93.46 88.71 93.46 0.90 93.46 0.90 93.46 4.79 92.69 100.00 hepatitis 80.62 100.00 75.50 25.30 ++ 81.92 30.96 74.17 25.66 ++ 73.08 5.09 80.00 7.59 72.38 4.66 ++ 80.75 10.54 81.87 7.81 78.75 9.75 ++ 83.29 9.39 81.25 83.73 80.58 82.80 81.33 75.20 76.67 1.00 ++ 78.67 1.29 + 76.83 10.25 + 80.62 100.00 horse-colic 57.84 100.00 ++ 59.90 35.66 ++ 64.47 48.65 ++ 60.24 35.36 ++ 66.75 8.49 67.73 21.82 59.15 1.55 ++ 70.74 8.20 70.13 10.30 67.73 20.41 68.45 14.14 45.89 58.21 ++ 32.91 27.87 ++ 45.89 52.16 ++ 67.09 0.37 67.09 0.37 63.12 21.89 ++ 57.84 100.00 ++ image.segmentation.all 93.10 100.00 90.00 16.61 ++ 77.38 13.02 ++ 89.53 16.93 ++ 92.15 16.01 91.91 11.11 81.19 6.61 ++ 92.86 10.45 92.62 10.98 94.05 12.41 - 89.29 11.35 ++ 91.91 92.73 91.43 91.77 92.14 91.46 85.95 2.23 ++ 89.76 2.43 ++ 89.76 11.30 ++ 93.10 100.00 ionosphere 84.62 100.00 ++ 82.93 21.62 ++ 81.74 19.22 ++ 82.93 21.62 ++ 85.75 14.59 86.32 12.88 79.77 3.23 ++ 86.60 7.79 87.75 7.06 86.90 10.61 86.90 9.78 84.04 84.23 ++ 84.04 82.27 ++ 84.05 82.18 ++ 73.77 0.63 ++ 80.89 0.63 ++ 88.89 10.03 84.62 100.00 ++ iris 94.00 100.00 90.00 12.74 ++ 83.34 14.07 ++ 90.00 12.74 ++ 94.67 19.78 93.33 9.56 ++ 84.67 8.59 ++ 94.67 14.22 95.33 14.81 95.33 14.89 94.00 12.15 95.33 94.74 95.33 94.67 95.33 93.78 88.67 2.29 ++ 92.66 2.29 92.00 10.59 ++ 94.00 100.00 led+17 67.10 100.00 ++ 55.50 43.14 ++ 59.10 51.38 ++ 55.50 43.16 ++ 60.70 32.31 ++ 66.60 20.90 ++ 61.40 9.94 ++ 69.20 12.98 70.40 12.66 69.50 16.37 + 69.80 14.96 71.00 71.42 - 70.90 70.00 70.90 58.98 71.20 1.66 72.20 1.40 -- 64.50 31.91 ++ 67.10 100.00 ++ led-creator 73.40 100.00 - 64.90 35.79 ++ 71.80 92.78 64.60 35.71 ++ 70.40 22.04 72.30 13.92 68.30 10.05 ++ 71.80 11.85 71.70 11.93 71.90 13.71 72.00 12.33 72.10 73.88 72.00 72.86 71.80 72.07 70.40 1.53 72.10 1.52 72.00 14.72 73.40 100.00 - liver.bupa 65.57 100.00 - 56.80 40.87 57.70 52.59 56.80 40.87 58.24 10.66 61.38 38.36 58.23 10.92 67.77 24.77 -- 60.84 24.99 62.59 32.56 65.50 31.08 -- 61.12 68.15 58.77 63.13 60.24 52.34 56.74 0.55 ++ 57.65 0.65 59.69 46.99 65.57 100.00 - pima-indians-diabetes 73.56 100.00 65.76 36.89 ++ 67.97 42.95 ++ 65.76 36.89 ++ 69.78 10.97 ++ 71.61 12.65 ++ 65.22 6.50 ++ 70.44 17.59 ++ 75.01 16.90 72.53 21.76 + 73.05 21.95 + 75.39 76.37 75.91 74.52 74.87 64.61 67.84 0.29 ++ 75.27 0.29 67.06 20.62 ++ 73.56 100.00 promoters 93.45 100.00 - 86.73 13.83 87.09 15.51 84.91 14.35 91.64 18.12 83.09 7.34 87.00 6.40 84.91 13.63 86.82 16.67 86.82 16.67 87.00 12.58 93.45 96.33 - 93.45 96.33 - 93.45 95.07 - 88.82 2.10 91.36 2.10 - 86.82 8.18 93.45 100.00 - sonar 87.55 100.00 -- 74.12 32.85 79.81 28.26 80.88 33.87 69.38 12.02 ++ 83.29 29.86 -- 64.93 11.38 ++ 80.88 26.60 - 78.00 26.87 82.81 31.20 - 79.88 29.81 81.79 84.35 78.38 81.78 80.36 80.29 70.24 1.07 ++ 70.29 1.07 ++ 81.78 28.95 87.55 100.00 -- soybean-large 88.59 100.00 - 83.10 24.97 80.44 20.27 + 84.06 24.61 86.63 30.33 87.27 24.76 77.20 19.51 ++ 86.60 22.77 - 84.97 25.26 86.29 28.41 83.73 25.44 86.61 89.90 -- 85.97 87.41 86.62 88.24 - 82.70 7.35 85.92 7.78 85.01 24.32 88.59 100.00 - vehicle 71.76 100.00 -- 67.50 37.04 67.27 43.21 - 67.50 37.04 67.62 28.36 68.10 32.51 - 59.91 12.07 ++ 67.37 21.49 65.85 23.00 67.03 27.88 70.22 26.71 -- 69.52 73.81 -- 69.05 69.75 -- 70.21 64.74 -- 58.15 2.24 ++ 60.76 2.47 ++ 67.74 38.05 -- 71.76 100.00 -- voting 95.64 100.00 93.59 9.12 ++ 95.40 10.22 93.59 9.12 ++ 95.64 5.44 94.26 2.02 + 93.11 2.91 + 94.50 4.90 ++ 95.87 5.11 95.87 5.36 95.85 7.12 95.41 95.84 95.41 95.81 95.41 94.35 88.99 0.51 ++ 94.25 0.51 + 92.65 3.29 ++ 95.64 100.00 vowel 96.57 100.00 -- 86.72 30.05 + 78.56 19.97 ++ 87.48 29.71 89.57 36.59 93.17 36.15 -- 83.31 39.16 ++ 91.08 44.66 -- 89.56 45.22 90.70 46.02 -- 93.36 42.66 -- 92.40 96.57 -- 91.27 95.94 - 93.55 96.69 -- 50.20 4.69 ++ 57.77 6.65 ++ 89.39 36.43 96.57 100.00 -- wine 94.93 100.00 92.65 14.30 96.05 14.23 92.65 14.30 91.50 16.60 + 94.38 9.05 90.98 5.74 + 93.23 11.42 + 94.93 16.11 94.93 16.17 96.08 9.74 94.93 95.57 94.93 95.57 94.93 94.75 81.47 1.94 ++ 95.46 2.12 95.46 7.80 94.93 100.00 zoo 94.44 100.00 -- 91.11 12.47 76.67 10.62 ++ 91.11 12.47 92.22 29.38 90.00 18.27 88.89 18.02 88.89 15.80 90.00 20.00 91.11 21.61 95.56 17.16 -- 91.11 92.96 91.11 92.59 93.33 94.07 -- 94.44 7.90 -- 95.56 8.39 -- 92.22 18.02 94.44 100.00 -- Average: 82.11 100.00 76.48 26.69 75.44 31.63 76.58 26.64 78.85 16.13 80.65 16.88 72.65 8.41 81.07 14.03 81.14 14.31 81.11 17.30 81.39 16.09 80.95 83.34 80.09 80.92 81.01 77.44 75.68 1.83 79.24 2.01 79.53 19.58 82.11 100.00 SD: 11.70 0.00 13.11 12.22 12.13 18.46 13.23 12.14 12.89 10.51 11.46 12.54 13.93 7.33 11.05 8.43 11.66 9.01 11.88 9.71 11.32 8.79 12.75 10.75 14.29 14.56 12.97 14.60 13.28 1.98 13.12 2.21 12.38 13.17 11.70 0.00 #times DROP3 better/worse: 14-17 31-0 26-5 25-6 24-7 25-6 25-6 25-6 20-10 20-11 20-10 17-14 28-1 0-30 17-13 10-21 0-0 0-0 11-15 30-0 18-12 25-6 10-18 31-0 10-17 31-0 12-16 31-0 24-5 0-31 16-14 0-31 18-12 22-9 14-17 31-0 #times sig. better/worse: 5-10 31-0 19-1 25-5 20-1 25-4 19-2 25-5 8-2 13-9 9-5 15-12 24-0 0-29 5-6 8-11 0-0 0-0 4-3 26-0 4-5 22-6 4-6 31-0 4-5 31-0 3-7 31-0 17-1 0-31 9-4 0-31 12-1 20-8 5-10 31-0 T Prob: -87.42 100.00 100.00 100.00 99.95 100.00 100.00 100.00 98.85 91.16 82.04 94.86 100.00 -100.00 57.03 -76.34 -50.00 50.00 54.11 100.00 -71.14 99.71 58.46 100.00 79.58 100.00 55.88 100.00 99.97 -100.00 94.86 -100.00 99.44 99.74 -87.42 100.00 Wilcoxon: -78.99 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.32 93.53 91.97 87.55 99.50 -99.50 70.23 -91.03 50.00 -50.00 56.25 99.50 62.42 99.50 -91.85 99.50 -57.88 99.50 -84.48 99.50 99.50 -99.50 95.62 -99.50 98.97 99.50 -78.99 99.50 Database kNN (size) CNN (size) SNN (size) IB2 (size) IB3 (size) DEL (size) DROP1 (size) DROP2 (size) DROP3 (size) DROP4 (size) DROP5 (size) ENN (size) RENN (size) AllKNN (size) ELGrow (size) Explore (size) ELH (size) MCS (size) anneal 93.11 100.00 96.99 9.56 -- 86.09 10.50 ++ 96.74 9.48 -- 91.35 9.79 ++ 93.85 9.30 87.70 5.05 ++ 95.61 8.08 -- 94.11 8.65 94.36 11.67 95.24 9.93 89.73 92.00 ++ 89.48 90.70 ++ 89.98 92.43 ++ 88.35 0.70 ++ 91.11 0.75 + 95.73 9.30 93.11 100.00 SD 2.07 0.00 1.35 0.52 3.91 0.20 2.30 0.57 2.99 0.59 2.42 0.44 8.84 0.76 1.98 0.42 2.50 0.69 2.78 0.58 1.93 1.03 3.04 0.63 2.69 0.60 2.93 0.43 6.43 0.22 5.63 0.24 2.31 0.59 2.07 0.00 T-conf that DROP3 > 83.33 100.00 -99.73 99.92 99.94 100.00 -98.96 99.27 96.50 99.82 60.12 98.84 96.98 -100.00 -98.15 -98.26 -50.00 50.00 -64.18 100.00 -82.51 99.63 99.99 100.00 100.00 100.00 99.98 100.00 99.06 -100.00 93.72 -100.00 -89.85 95.57 83.33 100.00 Wilcoxon conf 81.25 99.50 -99.50 99.50 99.50 99.50 -99.50 99.25 97.75 99.50 60.00 99.00 97.50 -99.50 -96.88 -98.25 50.00 -50.00 -56.67 99.50 -78.33 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.38 -99.50 94.17 -99.50 -87.50 95.63 81.25 99.50 australian 84.78 100.00 77.68 24.22 ++ 81.31 28.38 + 78.26 24.15 ++ 85.22 4.78 - 84.78 2.56 64.49 2.30 ++ 83.62 7.28 83.92 5.96 84.78 7.99 83.91 9.18 84.50 86.49 84.21 84.80 86.09 78.07 -- 83.62 0.32 85.80 0.32 - 83.04 7.91 84.78 100.00 SD 3.30 0.00 5.93 1.26 3.65 0.89 3.49 1.33 3.85 0.64 3.63 0.82 9.15 1.42 2.74 1.25 3.52 0.52 3.22 1.12 2.86 1.18 3.62 0.61 2.94 0.99 3.82 0.84 4.04 0.00 3.12 0.00 5.16 1.14 3.30 0.00 T-conf that DROP3 > -78.28 100.00 99.68 100.00 94.60 100.00 99.93 100.00 -90.89 -99.99 -82.81 -100.00 99.98 -100.00 67.88 98.95 -50.00 50.00 -85.17 99.98 50.00 100.00 -73.91 100.00 -62.83 100.00 -96.67 100.00 57.67 -100.00 -94.23 -100.00 77.41 99.86 -78.28 100.00 Wilcoxon conf -80.00 99.50 99.50 99.50 95.00 99.50 99.50 99.50 -92.50 -99.50 -80.00 -99.50 99.50 -99.50 65.00 99.00 50.00 -50.00 -88.33 99.50 52.00 99.50 -78.33 99.50 -72.50 99.50 -96.25 99.50 67.50 -99.50 -95.00 -99.50 68.33 99.50 -80.00 99.50 breast-cancer-wisconsin 96.28 100.00 95.71 7.09 93.85 8.35 ++ 95.71 7.09 96.57 3.47 96.28 1.89 77.52 1.14 ++ 95.85 3.13 96.14 3.58 96.28 4.05 95.71 4.07 97.00 96.80 - 96.85 96.61 - 97.00 94.58 - 89.85 0.32 ++ 96.71 0.32 94.13 1.92 + 96.28 100.00 SD 2.53 0.00 1.16 0.76 3.01 0.49 1.16 0.76 1.20 0.24 2.35 0.34 15.55 0.28 2.64 0.66 3.16 0.44 2.25 0.43 2.23 0.75 2.73 0.31 2.76 0.33 2.73 0.54 4.83 0.00 2.70 0.00 3.12 0.67 2.53 0.00 T-conf that DROP3 > -60.93 100.00 67.79 100.00 99.69 100.00 67.79 100.00 -68.50 -74.50 -58.17 -100.00 99.75 -100.00 66.16 -98.48 -50.00 50.00 -60.00 99.48 69.22 97.86 -91.60 100.00 -93.08 100.00 -91.60 100.00 99.96 -100.00 -84.53 -100.00 94.50 -99.98 -60.93 100.00 Wilcoxon conf 50.00 99.50 78.33 99.50 99.38 99.50 78.33 99.50 -60.00 -63.33 -55.00 -99.50 99.50 -99.50 72.50 -97.75 50.00 -50.00 60.00 99.25 80.00 97.08 -50.00 99.50 -50.00 99.50 -50.00 99.50 99.50 -99.50 -80.00 -99.50 96.25 -99.50 50.00 99.50 bridges 66.09 100.00 -- 61.18 49.48 61.37 52.52 62.18 48.64 - 64.73 28.83 -- 64.27 35.64 -- 39.64 10.17 ++ 61.18 17.30 - 56.36 17.60 57.36 21.28 62.82 22.22 - 59.46 68.23 58.36 65.93 - 59.36 58.48 56.27 5.35 57.18 5.67 58.55 34.18 66.09 100.00 -- SD 12.55 0.00 11.68 2.82 12.86 3.02 11.99 1.73 13.04 4.03 12.22 3.79 20.14 3.38 14.51 6.02 15.32 3.24 15.05 4.21 14.11 3.86 13.57 2.85 15.69 2.02 17.53 2.81 15.71 0.93 12.61 1.75 13.13 5.28 12.55 0.00 T-conf that DROP3 > -95.01 100.00 -82.80 100.00 -79.53 100.00 -92.08 100.00 -95.01 100.00 -95.52 100.00 95.83 -100.00 -93.38 -55.54 -50.00 50.00 -64.79 99.88 -92.95 99.63 -87.15 100.00 -91.61 100.00 -81.54 100.00 51.12 -100.00 -57.59 -100.00 -66.85 100.00 -95.01 100.00 Wilcoxon conf -96.25 99.50 -75.00 99.50 -76.67 99.50 -90.00 99.50 -93.75 99.50 -99.50 99.50 95.00 -99.50 -93.75 -65.00 50.00 -50.00 -80.00 99.50 -92.50 99.50 -90.00 99.50 -50.00 99.50 -80.00 99.50 50.00 -99.50 -52.50 -99.50 -65.00 99.50 -96.25 99.50 crx 83.63 100.00 ++ 79.42 24.15 ++ 81.59 27.52 ++ 79.42 24.15 ++ 86.09 4.28 83.63 3.08 ++ 65.94 3.75 ++ 84.64 7.31 85.80 5.46 85.51 7.33 83.77 7.68 + 85.36 86.17 85.80 85.64 85.08 78.82 85.22 0.32 85.51 0.32 83.05 7.52 ++ 83.63 100.00 ++ SD 2.90 0.00 4.15 1.12 3.75 1.01 4.15 1.12 2.39 0.97 2.90 0.71 10.64 0.84 3.07 0.99 4.67 1.44 3.55 1.24 3.12 0.98 3.89 0.39 3.79 0.58 4.05 1.03 3.33 0.00 3.74 0.00 3.75 1.31 2.90 0.00 T-conf that DROP3 > 98.90 100.00 99.98 100.00 99.05 100.00 99.98 100.00 -58.11 -96.26 95.46 -99.93 100.00 -99.99 81.36 99.97 -50.00 50.00 60.99 100.00 94.74 99.96 72.02 100.00 -50.00 100.00 77.35 100.00 64.45 -100.00 66.91 -100.00 97.25 99.90 98.90 100.00 Wilcoxon conf 99.00 99.50 99.50 99.50 99.13 99.50 99.50 99.50 72.50 -98.00 92.50 -99.50 99.50 -99.50 85.00 99.50 50.00 -50.00 50.00 99.50 95.42 99.50 72.50 99.50 56.00 99.50 72.50 99.50 86.67 -99.50 72.50 -99.50 97.50 99.50 99.00 99.50 echocardiogram 94.82 100.00 85.18 14.72 + 48.75 26.29 ++ 85.18 14.72 + 72.86 11.57 ++ 93.39 6.91 93.39 9.61 94.82 10.51 93.39 10.66 94.82 10.96 93.39 9.16 93.39 92.94 93.39 92.94 93.39 92.18 93.39 3.01 94.82 3.01 94.82 6.16 94.82 100.00 SD 6.71 0.00 13.96 1.84 31.45 9.53 13.96 1.84 29.10 6.05 7.00 1.28 7.00 0.76 6.71 1.40 7.00 1.31 6.71 1.22 7.00 0.46 7.00 1.02 7.00 1.02 7.00 3.43 7.00 0.02 6.71 0.02 6.71 0.50 6.71 0.00 T-conf that DROP3 > -82.83 100.00 94.26 99.99 99.92 99.98 94.26 99.99 95.91 68.18 -50.00 -99.98 -50.00 -99.51 -82.83 -61.11 -50.00 50.00 -82.83 82.83 -50.00 -99.25 -50.00 100.00 -50.00 100.00 -50.00 100.00 -50.00 -100.00 -82.83 -100.00 -82.83 -100.00 -82.83 100.00 Wilcoxon conf -50.00 99.50 93.75 99.50 99.50 99.50 93.75 99.50 50.00 68.33 50.00 -99.50 50.00 -99.50 -50.00 -56.67 50.00 -50.00 -50.00 50.00 50.00 -98.63 50.00 99.50 50.00 99.50 50.00 99.50 50.00 -99.50 -50.00 -99.50 -50.00 -99.50 -50.00 99.50 flag 61.34 100.00 53.63 50.29 ++ 53.63 51.66 ++ 53.11 49.95 ++ 49.47 34.14 ++ 56.18 45.88 + 43.18 9.04 ++ 62.79 20.62 61.29 20.45 59.58 27.09 58.13 25.26 63.32 67.07 62.76 62.83 61.24 55.67 55.50 2.00 56.16 2.06 55.13 47.42 + 61.34 100.00 SD 13.29 0.00 13.01 3.14 11.06 2.29 12.64 3.26 14.18 3.11 14.66 4.16 12.88 2.71 13.59 1.93 15.57 2.06 18.40 3.86 13.30 2.53 13.91 1.45 12.32 2.07 12.00 3.07 9.95 0.73 14.11 0.55 10.40 2.93 13.29 0.00 T-conf that DROP3 > -50.50 100.00 95.21 100.00 96.56 100.00 97.94 100.00 99.97 100.00 91.40 100.00 99.83 -100.00 -73.50 57.29 -50.00 50.00 71.66 100.00 89.26 100.00 -79.41 100.00 -68.98 100.00 51.06 100.00 85.59 -100.00 83.89 -100.00 91.33 100.00 -50.50 100.00 Wilcoxon conf 60.00 99.50 95.42 99.50 95.83 99.50 98.25 99.50 99.50 99.50 93.33 99.50 99.50 -99.50 -65.00 55.00 50.00 -50.00 80.00 99.50 88.33 99.50 -75.00 99.50 -70.00 99.50 60.00 99.50 82.50 -99.50 85.00 -99.50 90.00 99.50 60.00 99.50 glass 73.83 100.00 -- 68.14 38.53 64.39 42.63 66.78 39.25 62.14 33.80 69.59 38.42 - 62.97 15.47 65.04 23.11 65.02 23.88 65.91 29.54 65.45 24.82 65.91 70.82 64.00 69.06 67.75 65.89 50.54 2.28 ++ 63.98 3.53 68.66 41.07 73.83 100.00 -- SD 10.09 0.00 6.54 2.12 7.68 1.58 9.66 1.58 7.60 2.36 11.11 1.88 15.15 2.57 9.27 3.40 5.43 3.21 9.55 1.43 6.50 2.20 7.13 2.52 6.21 3.48 10.57 2.02 13.45 0.66 10.21 0.98 10.01 3.01 10.09 0.00 T-conf that DROP3 > -99.74 100.00 -87.19 100.00 58.17 100.00 -70.47 100.00 87.79 100.00 -93.19 100.00 63.74 -100.00 -50.50 -68.71 -50.00 50.00 -62.49 100.00 -58.10 75.78 -68.40 100.00 68.52 100.00 -81.33 100.00 99.70 -100.00 59.68 -100.00 -89.71 100.00 -99.74 100.00 Wilcoxon conf -99.50 99.50 -85.00 99.50 75.00 99.50 -60.00 99.50 91.67 99.50 -88.75 99.50 52.00 -99.50 70.00 -76.67 50.00 -50.00 50.00 99.50 -53.33 75.00 50.00 99.50 81.67 99.50 -75.00 99.50 99.50 -99.50 67.50 -99.50 -80.00 99.50 -99.50 99.50 heart.cleveland.2 81.19 100.00 73.95 30.84 ++ 76.25 33.88 ++ 73.96 30.29 ++ 81.16 11.11 79.49 13.64 70.91 6.09 ++ 79.55 11.92 80.84 12.76 78.19 15.26 79.84 15.37 82.50 83.46 82.16 82.51 81.51 72.72 81.52 0.73 82.15 0.73 77.87 21.56 81.19 100.00 SD 5.37 0.00 7.67 1.99 4.49 1.14 7.62 1.30 8.80 2.16 5.95 1.57 6.21 1.89 9.05 2.23 6.10 2.03 8.23 1.45 7.35 1.89 6.51 1.31 7.43 1.51 7.16 1.41 6.49 0.00 7.76 0.00 7.38 1.10 5.37 0.00 T-conf that DROP3 > -57.83 100.00 98.20 100.00 95.77 100.00 99.81 100.00 -55.31 -91.09 71.94 88.07 99.84 -100.00 71.30 -81.78 -50.00 50.00 86.97 99.72 74.04 99.64 -86.24 100.00 -78.71 100.00 -65.70 100.00 -61.19 -100.00 -74.33 -100.00 85.92 100.00 -57.83 100.00 Wilcoxon conf -57.50 99.50 99.38 99.50 93.75 99.50 99.50 99.50 58.00 -90.00 68.33 86.25 99.50 -99.50 71.67 -87.50 50.00 -50.00 87.50 99.50 65.00 99.50 -81.67 99.50 -72.50 99.50 -75.00 99.50 -58.00 -99.50 -72.50 -99.50 85.00 99.50 -57.50 99.50 heart.hungarian.2 79.55 100.00 70.40 28.87 ++ 75.84 34.01 ++ 73.87 27.44 ++ 79.20 9.90 77.18 12.28 ++ 72.17 5.74 ++ 78.52 8.80 80.29 9.86 79.22 11.53 79.60 11.15 80.28 82.12 79.25 79.93 80.62 70.79 80.61 0.75 82.30 0.75 77.84 18.33 79.55 100.00 SD 5.94 0.00 7.93 1.57 7.97 1.87 8.37 1.49 8.52 1.34 6.47 1.60 9.34 1.91 8.63 2.09 6.73 1.21 6.40 2.27 6.88 2.86 7.02 1.34 6.36 1.17 5.55 2.08 6.59 0.01 7.12 0.01 7.53 3.01 5.94 0.00 T-conf that DROP3 > 62.11 100.00 99.98 100.00 98.86 100.00 98.62 100.00 66.16 52.46 96.07 99.86 99.72 -100.00 78.85 -90.95 -50.00 50.00 74.91 97.38 65.71 94.21 50.32 100.00 78.63 100.00 -59.98 100.00 -57.01 -100.00 -83.36 -100.00 82.43 100.00 62.11 100.00 Wilcoxon conf 55.00 99.50 99.50 99.50 98.25 99.50 98.25 99.50 62.50 55.00 95.00 99.50 99.50 -99.50 85.00 -90.00 50.00 -50.00 86.67 98.00 70.00 93.33 53.33 99.50 75.00 99.50 -60.00 99.50 -65.00 -99.50 -75.00 -99.50 85.00 99.50 55.00 99.50 heart.long-beach-va.2 70.00 100.00 61.00 35.67 ++ 67.00 43.56 ++ 57.00 35.39 ++ 70.00 4.89 70.00 19.28 69.00 4.39 70.00 11.83 + 73.50 4.50 74.00 11.72 73.00 14.94 74.00 75.44 74.00 72.72 74.00 62.28 72.50 0.84 + 74.50 1.11 71.00 28.61 70.00 100.00 SD 9.13 0.00 9.37 1.22 12.06 1.93 8.23 1.89 12.69 1.99 10.27 3.02 12.65 1.03 10.54 2.65 5.80 3.70 6.99 2.85 7.89 3.17 5.68 1.41 5.68 1.37 5.68 1.98 5.89 0.29 9.56 0.00 9.66 3.90 9.13 0.00 T-conf that DROP3 > 83.92 100.00 99.85 100.00 95.84 100.00 99.98 100.00 89.54 65.06 86.44 100.00 84.88 -53.54 93.38 100.00 -50.00 50.00 -63.68 99.99 57.99 100.00 -82.83 100.00 -82.83 100.00 -82.83 100.00 91.61 -99.49 -67.88 -99.12 82.83 100.00 83.92 100.00 Wilcoxon conf 85.00 99.50 99.50 99.50 94.17 99.50 99.50 99.50 88.33 55.00 85.00 99.50 81.25 -65.00 92.50 99.50 50.00 -50.00 -60.00 99.50 56.00 99.50 -50.00 99.50 -50.00 99.50 -50.00 99.50 50.00 -99.50 -60.00 -99.50 83.33 99.50 85.00 99.50 heart.more.2 73.78 100.00 ++ 69.69 33.21 ++ 72.22 43.64 ++ 69.69 33.21 ++ 76.31 9.36 75.15 16.81 ++ 63.46 3.51 ++ 73.98 10.72 ++ 76.38 9.14 74.36 13.19 ++ 74.63 14.62 ++ 76.31 76.58 76.51 74.41 75.60 66.97 67.48 0.14 ++ 73.13 0.14 ++ 72.74 21.24 ++ 73.78 100.00 ++ SD 4.42 0.00 4.08 0.83 3.58 1.15 4.08 0.83 5.71 1.06 4.64 1.02 5.36 0.75 4.49 1.29 4.94 0.68 4.73 0.83 4.91 1.07 4.14 0.57 4.40 0.65 4.08 0.88 5.63 0.00 5.35 0.00 3.63 0.95 4.42 0.00 T-conf that DROP3 > 99.65 100.00 99.95 100.00 98.55 100.00 99.95 100.00 52.50 69.27 96.79 100.00 99.99 -100.00 99.21 99.93 -50.00 50.00 99.82 100.00 95.26 100.00 54.50 100.00 -57.63 100.00 88.80 100.00 100.00 -100.00 98.31 -100.00 98.36 100.00 99.65 100.00 Wilcoxon conf 99.50 99.50 99.50 99.50 98.25 99.50 99.50 99.50 -58.00 68.33 95.63 99.50 99.50 -99.50 99.38 99.50 50.00 -50.00 99.50 99.50 92.50 99.50 52.50 99.50 -60.00 99.50 82.50 99.50 99.50 -99.50 98.25 -99.50 98.25 99.50 99.50 99.50 heart 81.48 100.00 70.00 26.17 ++ 77.04 33.78 ++ 70.00 26.17 ++ 80.00 13.58 ++ 78.89 4.73 ++ 72.59 5.47 ++ 81.85 12.22 83.33 13.62 81.85 16.71 81.11 16.67 81.11 83.13 ++ 81.11 81.98 ++ 81.85 72.02 74.44 0.82 ++ 81.85 0.82 74.45 13.70 ++ 81.48 100.00 SD 6.98 0.00 5.91 2.06 6.72 1.78 5.91 2.06 7.45 1.16 7.42 1.08 5.58 1.78 9.15 2.57 8.95 1.68 8.09 2.00 8.27 2.62 8.63 1.43 8.63 1.19 7.50 1.78 7.90 0.00 8.63 0.00 7.29 2.53 6.98 0.00 T-conf that DROP3 > 82.82 100.00 99.93 100.00 98.43 100.00 99.93 100.00 95.27 -53.14 98.16 -100.00 99.87 -100.00 76.90 -97.36 -50.00 50.00 81.35 100.00 84.33 99.79 97.45 100.00 97.45 100.00 78.85 100.00 99.97 -100.00 81.33 -100.00 99.84 53.37 82.82 100.00 Wilcoxon conf 86.67 99.50 99.50 99.50 97.50 99.50 99.50 99.50 95.00 -52.50 95.63 -99.50 99.50 -99.50 91.67 -98.25 50.00 -50.00 75.00 99.50 75.00 99.50 91.25 99.50 91.25 99.50 83.33 99.50 99.50 -99.50 81.25 -99.50 99.50 54.00 86.67 99.50 heart.swiss.2 92.69 100.00 91.09 11.38 92.69 15.90 90.26 11.38 + 93.46 3.70 92.69 4.25 93.46 1.81 93.46 2.53 93.46 1.81 93.46 2.35 92.63 5.42 93.46 93.49 93.46 93.49 93.46 88.71 93.46 0.90 93.46 0.90 93.46 4.79 92.69 100.00 SD 6.13 0.00 10.43 2.05 6.13 2.03 9.96 2.05 6.54 1.16 6.13 2.56 6.54 0.01 6.54 1.58 6.54 0.01 6.54 1.73 6.14 2.00 6.54 0.71 6.54 0.71 6.54 1.77 6.54 0.00 6.54 0.00 6.54 1.71 6.13 0.00 T-conf that DROP3 > 82.83 100.00 82.82 100.00 82.83 100.00 92.07 100.00 -50.00 99.97 82.83 99.27 -50.00 50.00 -50.00 90.90 -50.00 50.00 -50.00 82.83 82.83 99.99 -50.00 100.00 -50.00 100.00 -50.00 100.00 -50.00 -100.00 -50.00 -100.00 -50.00 99.98 82.83 100.00 Wilcoxon conf 50.00 99.50 85.00 99.50 50.00 99.50 93.75 99.50 50.00 99.50 50.00 99.00 50.00 -50.00 50.00 50.00 50.00 -50.00 50.00 50.00 50.00 99.50 50.00 99.50 50.00 99.50 50.00 99.50 50.00 -99.50 50.00 -99.50 50.00 99.50 50.00 99.50 hepatitis 80.62 100.00 75.50 25.30 ++ 81.92 30.96 74.17 25.66 ++ 73.08 5.09 80.00 7.59 72.38 4.66 ++ 80.75 10.54 81.87 7.81 78.75 9.75 ++ 83.29 9.39 81.25 83.73 80.58 82.80 81.33 75.20 76.67 1.00 ++ 78.67 1.29 + 76.83 10.25 + 80.62 100.00 SD 10.98 0.00 13.99 2.27 12.55 2.88 14.15 2.12 24.86 2.61 9.69 2.31 18.00 2.06 8.93 1.45 9.00 2.39 9.35 2.91 10.90 1.83 8.85 0.87 9.19 1.15 8.63 2.67 12.77 0.37 11.94 0.30 13.41 2.64 10.98 0.00 T-conf that DROP3 > 68.23 100.00 97.79 100.00 -50.68 100.00 99.56 100.00 85.05 -99.60 89.65 -62.84 97.01 -99.87 67.02 99.75 -50.00 50.00 97.39 97.04 -74.00 91.94 62.98 100.00 77.35 100.00 61.69 100.00 98.78 -100.00 94.87 -100.00 93.64 99.33 68.23 100.00 Wilcoxon conf 65.00 99.50 95.00 99.50 -56.67 99.50 99.50 99.50 80.00 -99.50 70.00 -60.00 97.88 -99.50 -60.00 99.50 50.00 -50.00 99.50 99.50 -80.00 92.50 50.00 99.50 50.00 99.50 50.00 99.50 96.88 -99.50 87.50 -99.50 85.00 99.00 65.00 99.50 horse-colic 57.84 100.00 ++ 59.90 35.66 ++ 64.47 48.65 ++ 60.24 35.36 ++ 66.75 8.49 67.73 21.82 59.15 1.55 ++ 70.74 8.20 70.13 10.30 67.73 20.41 68.45 14.14 45.89 58.21 ++ 32.91 27.87 ++ 45.89 52.16 ++ 67.09 0.37 67.09 0.37 63.12 21.89 ++ 57.84 100.00 ++ SD 9.23 0.00 12.83 2.26 9.58 2.23 12.87 2.28 10.01 1.97 8.72 2.64 9.61 0.88 11.57 1.27 8.30 2.55 12.15 1.70 13.22 2.24 10.43 3.20 7.85 2.54 12.08 2.14 7.85 0.00 7.85 0.00 9.75 2.87 9.23 0.00 T-conf that DROP3 > 99.95 100.00 99.32 100.00 96.42 100.00 99.14 100.00 84.37 -95.03 73.46 100.00 99.70 -100.00 -57.91 -97.93 -50.00 50.00 71.25 100.00 71.39 99.10 100.00 100.00 100.00 100.00 99.99 100.00 81.86 -100.00 81.86 -100.00 98.14 100.00 99.95 100.00 Wilcoxon conf 99.50 99.50 99.50 99.50 94.17 99.50 99.50 99.50 86.25 -92.50 73.33 99.50 99.50 -99.50 -65.00 -98.00 50.00 -50.00 70.00 99.50 76.67 99.00 99.50 99.50 99.50 99.50 99.50 99.50 85.00 -99.50 85.00 -99.50 99.25 99.50 99.50 99.50 image.segmentation.all 93.10 100.00 90.00 16.61 ++ 77.38 13.02 ++ 89.53 16.93 ++ 92.15 16.01 91.91 11.11 81.19 6.61 ++ 92.86 10.45 92.62 10.98 94.05 12.41 - 89.29 11.35 ++ 91.91 92.73 91.43 91.77 92.14 91.46 85.95 2.23 ++ 89.76 2.43 ++ 89.76 11.30 ++ 93.10 100.00 SD 5.77 0.00 4.74 1.04 5.41 0.69 4.08 1.16 3.56 0.93 4.79 1.14 5.88 1.16 5.26 1.10 4.82 0.79 3.41 1.05 5.41 0.85 5.64 0.97 6.17 1.05 5.84 1.14 8.21 0.18 5.51 0.11 6.26 0.48 5.77 0.00 T-conf that DROP3 > -66.91 100.00 98.41 100.00 100.00 99.99 98.34 100.00 65.37 100.00 75.21 59.48 100.00 -100.00 -60.98 -88.92 -50.00 50.00 -92.99 100.00 99.66 88.51 75.21 100.00 85.09 100.00 66.11 100.00 99.36 -100.00 96.33 -100.00 98.81 84.21 -66.91 100.00 Wilcoxon conf -57.50 99.50 96.67 99.50 99.50 99.50 99.25 99.50 57.50 99.50 67.50 56.00 99.50 -99.50 -62.50 -85.00 50.00 -50.00 -96.25 99.50 99.50 87.50 80.00 99.50 85.00 99.50 76.67 99.50 99.25 -99.50 96.67 -99.50 99.00 83.33 -57.50 99.50 ionosphere 84.62 100.00 ++ 82.93 21.62 ++ 81.74 19.22 ++ 82.93 21.62 ++ 85.75 14.59 86.32 12.88 79.77 3.23 ++ 86.60 7.79 87.75 7.06 86.90 10.61 86.90 9.78 84.04 84.23 ++ 84.04 82.27 ++ 84.05 82.18 ++ 73.77 0.63 ++ 80.89 0.63 ++ 88.89 10.03 84.62 100.00 ++ SD 5.41 0.00 4.72 1.09 7.06 0.72 4.72 1.09 5.87 2.17 5.54 0.98 5.95 0.49 4.69 1.20 5.57 0.58 5.41 0.92 6.31 0.85 6.07 1.18 6.07 1.08 5.41 0.77 5.91 0.00 5.10 0.00 5.29 1.00 5.41 0.00 T-conf that DROP3 > 98.78 100.00 97.57 100.00 95.98 100.00 97.57 100.00 81.77 100.00 89.39 100.00 99.75 -100.00 82.86 92.74 -50.00 50.00 73.82 100.00 71.80 100.00 99.90 100.00 99.90 100.00 99.81 100.00 100.00 -100.00 99.70 -100.00 -73.88 100.00 98.78 100.00 Wilcoxon conf 99.00 99.50 96.88 99.50 95.83 99.50 96.88 99.50 76.67 99.50 86.67 99.50 99.50 -99.50 86.67 90.83 50.00 -50.00 65.00 99.50 80.00 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.50 -99.50 99.50 -99.50 -70.00 99.50 99.00 99.50 iris 94.00 100.00 90.00 12.74 ++ 83.34 14.07 ++ 90.00 12.74 ++ 94.67 19.78 93.33 9.56 ++ 84.67 8.59 ++ 94.67 14.22 95.33 14.81 95.33 14.89 94.00 12.15 95.33 94.74 95.33 94.67 95.33 93.78 88.67 2.29 ++ 92.66 2.29 92.00 10.59 ++ 94.00 100.00 SD 5.84 0.00 5.66 0.76 16.10 0.78 5.66 0.76 5.26 1.94 4.44 0.89 8.92 1.64 5.26 1.67 4.50 1.75 4.50 1.69 6.63 0.94 4.50 0.96 4.50 1.04 4.50 1.12 7.06 0.23 5.84 0.23 5.26 1.67 5.84 0.00 T-conf that DROP3 > 77.85 100.00 98.88 -99.44 98.08 -89.40 98.88 -99.44 62.11 100.00 95.94 -100.00 99.34 -100.00 70.45 -75.60 -50.00 50.00 -50.00 66.21 69.03 -99.98 -50.00 100.00 -50.00 100.00 -50.00 100.00 99.81 -100.00 86.53 -100.00 95.22 -100.00 77.85 100.00 Wilcoxon conf 50.00 99.50 99.25 -99.00 99.50 -90.83 99.25 -99.00 50.00 99.50 50.00 -99.50 99.50 -99.50 50.00 52.00 50.00 -50.00 50.00 50.00 65.00 -99.50 50.00 99.50 50.00 99.50 50.00 99.50 99.50 -99.50 90.00 -99.50 96.88 -99.50 50.00 99.50 led+17 67.10 100.00 ++ 55.50 43.14 ++ 59.10 51.38 ++ 55.50 43.16 ++ 60.70 32.31 ++ 66.60 20.90 ++ 61.40 9.94 ++ 69.20 12.98 70.40 12.66 69.50 16.37 + 69.80 14.96 71.00 71.42 - 70.90 70.00 70.90 58.98 71.20 1.66 72.20 1.40 -- 64.50 31.91 ++ 67.10 100.00 ++ SD 3.35 0.00 4.12 1.29 1.91 0.46 4.12 1.31 4.57 0.94 3.24 1.95 7.11 2.08 3.12 1.63 3.60 0.96 4.06 1.30 2.57 0.97 3.86 0.65 3.96 0.98 3.90 0.73 4.71 0.24 3.88 0.21 4.74 1.90 3.35 0.00 T-conf that DROP3 > 99.45 100.00 100.00 100.00 100.00 100.00 100.00 100.00 100.00 100.00 99.84 100.00 99.85 -99.92 85.17 70.70 -50.00 50.00 90.33 100.00 75.87 100.00 -92.98 100.00 -87.78 100.00 -72.15 100.00 -79.15 -100.00 -99.18 -100.00 99.94 100.00 99.45 100.00 Wilcoxon conf 99.38 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.50 -99.50 85.00 70.00 50.00 -50.00 90.00 99.50 76.67 99.50 -91.67 99.50 -83.75 99.50 -76.67 99.50 -80.00 -99.50 -99.25 -99.50 99.50 99.50 99.38 99.50 led-creator 73.40 100.00 - 64.90 35.79 ++ 71.80 92.78 64.60 35.71 ++ 70.40 22.04 72.30 13.92 68.30 10.05 ++ 71.80 11.85 71.70 11.93 71.90 13.71 72.00 12.33 72.10 73.88 72.00 72.86 71.80 72.07 70.40 1.53 72.10 1.52 72.00 14.72 73.40 100.00 - SD 5.13 0.00 5.34 0.78 5.16 1.65 5.74 0.79 7.78 0.83 6.34 1.05 4.79 1.14 6.63 2.07 4.90 0.72 5.53 1.03 4.81 0.68 5.22 1.05 4.90 1.17 5.18 1.03 3.89 0.21 3.57 0.30 4.92 1.59 5.13 0.00 T-conf that DROP3 > -93.64 100.00 99.99 100.00 -53.77 100.00 99.99 100.00 73.24 100.00 -70.11 99.84 98.01 -99.99 -52.81 -56.08 -50.00 50.00 -61.24 99.98 -59.87 95.87 -70.85 100.00 -65.44 100.00 -53.46 100.00 89.67 -100.00 -65.20 -100.00 -59.64 99.86 -93.64 100.00 Wilcoxon conf -95.00 99.50 99.50 99.50 -55.00 99.50 99.50 99.50 71.67 99.50 -66.67 99.50 97.88 -99.50 -55.00 60.00 50.00 -50.00 50.00 99.50 -67.50 95.83 -63.33 99.50 55.00 99.50 61.67 99.50 90.00 -99.50 -60.00 -99.50 -52.50 99.50 -95.00 99.50 liver.bupa 65.57 100.00 - 56.80 40.87 57.70 52.59 56.80 40.87 58.24 10.66 61.38 38.36 58.23 10.92 67.77 24.77 -- 60.84 24.99 62.59 32.56 65.50 31.08 -- 61.12 68.15 58.77 63.13 60.24 52.34 56.74 0.55 ++ 57.65 0.65 59.69 46.99 65.57 100.00 - SD 7.85 0.00 7.83 1.33 11.08 1.08 7.83 1.33 7.31 1.03 8.72 3.42 9.45 3.44 8.17 2.33 8.42 2.47 5.46 3.32 7.85 3.21 7.11 1.84 10.41 2.44 9.52 2.12 11.27 0.16 10.95 0.01 6.30 3.62 7.85 0.00 T-conf that DROP3 > -90.81 100.00 83.72 100.00 80.33 100.00 83.72 100.00 79.92 -100.00 -56.49 100.00 72.45 -100.00 -99.68 -58.93 -50.00 50.00 -87.08 99.99 -97.31 99.99 -55.99 100.00 77.37 100.00 59.71 100.00 96.49 -100.00 83.72 -100.00 70.75 100.00 -90.81 100.00 Wilcoxon conf -93.13 99.50 82.50 99.50 73.33 99.50 82.50 99.50 66.67 -99.50 -60.00 99.50 -60.00 -99.50 -99.50 -63.33 50.00 -50.00 -90.00 99.50 -97.08 99.50 -60.00 99.50 80.00 99.50 50.00 99.50 95.00 -99.50 80.00 -99.50 70.00 99.50 -93.13 99.50 pima-indians-diabetes 73.56 100.00 65.76 36.89 ++ 67.97 42.95 ++ 65.76 36.89 ++ 69.78 10.97 ++ 71.61 12.65 ++ 65.22 6.50 ++ 70.44 17.59 ++ 75.01 16.90 72.53 21.76 + 73.05 21.95 + 75.39 76.37 75.91 74.52 74.87 64.61 67.84 0.29 ++ 75.27 0.29 67.06 20.62 ++ 73.56 100.00 SD 5.54 0.00 3.68 0.93 6.99 0.95 3.68 0.93 5.61 0.66 4.69 1.56 6.01 1.90 3.97 0.97 4.96 0.84 5.10 0.93 5.79 1.19 4.51 1.03 4.29 0.99 5.02 1.00 5.39 0.00 4.02 0.00 6.47 1.42 5.54 0.00 T-conf that DROP3 > 87.15 100.00 99.98 100.00 99.96 100.00 99.98 100.00 98.37 -100.00 99.52 -100.00 99.73 -100.00 99.67 96.96 -50.00 50.00 93.11 100.00 90.79 100.00 -65.40 100.00 -79.15 100.00 55.01 100.00 100.00 -100.00 -58.72 -100.00 99.84 100.00 87.15 100.00 Wilcoxon conf 86.67 99.50 99.50 99.50 99.50 99.50 99.50 99.50 98.00 -99.50 99.25 -99.50 99.50 -99.50 99.50 96.25 50.00 -50.00 90.00 99.50 92.50 99.50 -60.00 99.50 -75.00 99.50 72.50 99.50 99.50 -99.50 52.00 -99.50 99.50 99.50 86.67 99.50 promoters 93.45 100.00 - 86.73 13.83 87.09 15.51 84.91 14.35 91.64 18.12 83.09 7.34 87.00 6.40 84.91 13.63 86.82 16.67 86.82 16.67 87.00 12.58 93.45 96.33 - 93.45 96.33 - 93.45 95.07 - 88.82 2.10 91.36 2.10 - 86.82 8.18 93.45 100.00 - SD 7.57 0.00 7.89 1.94 12.95 1.45 6.46 2.07 6.75 3.42 12.98 2.99 8.67 0.34 10.03 2.19 12.75 2.52 12.75 2.52 8.67 2.78 7.57 1.73 7.57 1.73 7.57 1.78 11.31 0.02 7.07 0.02 9.99 2.49 7.57 0.00 T-conf that DROP3 > -90.95 100.00 50.80 -98.06 -52.96 -88.01 67.06 -96.25 -86.63 83.40 82.04 -100.00 -52.20 -100.00 73.80 -99.51 -50.00 50.00 -50.00 50.00 -51.73 -99.97 -90.95 100.00 -90.95 100.00 -90.95 100.00 -71.97 -100.00 -90.37 -100.00 -50.00 -100.00 -90.95 100.00 Wilcoxon conf -90.83 99.50 -52.50 -98.00 -53.33 -83.33 62.50 -95.83 -90.00 81.25 81.67 -99.50 -57.50 -99.50 70.00 -98.75 50.00 -50.00 50.00 -50.00 -52.50 -99.50 -90.83 99.50 -90.83 99.50 -90.83 99.50 -77.50 -99.50 -86.67 -99.50 55.00 -99.50 -90.83 99.50 sonar 87.55 100.00 -- 74.12 32.85 79.81 28.26 80.88 33.87 69.38 12.02 ++ 83.29 29.86 -- 64.93 11.38 ++ 80.88 26.60 - 78.00 26.87 82.81 31.20 - 79.88 29.81 81.79 84.35 78.38 81.78 80.36 80.29 70.24 1.07 ++ 70.29 1.07 ++ 81.78 28.95 87.55 100.00 -- SD 7.54 0.00 12.66 2.23 8.02 1.71 9.75 1.82 12.95 3.73 11.25 2.84 11.06 3.11 12.02 2.13 12.25 1.36 8.41 1.72 11.88 2.32 9.56 1.28 9.31 2.30 10.46 1.53 10.61 0.00 10.13 0.00 9.40 2.06 7.54 0.00 T-conf that DROP3 > -99.77 100.00 87.63 99.99 -67.71 95.43 -87.17 100.00 95.12 -100.00 -98.08 99.84 99.98 -100.00 -90.23 -61.84 -50.00 50.00 -93.26 100.00 -71.85 99.52 -89.18 100.00 -54.44 100.00 -76.41 100.00 97.16 -100.00 98.43 -100.00 -83.89 97.89 -99.77 100.00 Wilcoxon conf -99.50 99.50 90.00 99.50 -57.50 95.00 -88.33 99.50 92.50 -99.50 -98.63 99.50 99.50 -99.50 -80.00 -70.00 50.00 -50.00 -95.42 99.50 -72.50 99.50 -88.33 99.50 60.00 99.50 -62.50 99.50 98.25 -99.50 98.25 -99.50 -75.00 98.00 -99.50 99.50 soybean-large 88.59 100.00 - 83.10 24.97 80.44 20.27 + 84.06 24.61 86.63 30.33 87.27 24.76 77.20 19.51 ++ 86.60 22.77 - 84.97 25.26 86.29 28.41 83.73 25.44 86.61 89.90 -- 85.97 87.41 86.62 88.24 - 82.70 7.35 85.92 7.78 85.01 24.32 88.59 100.00 - SD 5.12 0.00 7.96 0.83 5.75 0.58 7.16 1.12 6.60 0.96 6.24 2.32 7.93 1.25 7.11 2.00 8.46 1.30 8.75 1.57 8.11 1.69 7.51 0.77 7.79 1.85 6.68 1.01 5.46 0.34 7.24 0.79 3.15 2.10 5.12 0.00 T-conf that DROP3 > -93.04 100.00 71.44 -69.82 94.47 -100.00 61.99 -82.96 -78.13 100.00 -78.92 -71.13 98.68 -100.00 -91.34 -99.95 -50.00 50.00 -84.52 100.00 70.29 65.40 -95.23 100.00 -80.75 100.00 -93.15 100.00 81.82 -100.00 -65.80 -100.00 -50.72 -86.71 -93.04 100.00 Wilcoxon conf -90.00 99.50 81.25 -52.00 96.25 -99.50 78.33 -81.67 -65.00 99.50 -67.50 -73.33 98.00 -99.50 -86.67 -99.50 50.00 -50.00 -80.00 99.50 60.00 61.67 -92.50 99.50 -90.00 99.50 -93.75 99.50 77.50 -99.50 -65.00 -99.50 57.50 -85.00 -90.00 99.50 vehicle 71.76 100.00 -- 67.50 37.04 67.27 43.21 - 67.50 37.04 67.62 28.36 68.10 32.51 - 59.91 12.07 ++ 67.37 21.49 65.85 23.00 67.03 27.88 70.22 26.71 -- 69.52 73.81 -- 69.05 69.75 -- 70.21 64.74 -- 58.15 2.24 ++ 60.76 2.47 ++ 67.74 38.05 -- 71.76 100.00 -- SD 2.54 0.00 6.12 0.98 4.27 0.42 6.12 0.98 4.51 1.05 3.96 2.06 5.90 1.20 3.00 0.94 2.73 1.18 3.16 1.02 3.84 1.53 4.59 0.79 5.12 1.05 4.31 0.89 4.87 0.39 3.54 0.37 2.37 1.74 2.54 0.00 T-conf that DROP3 > -99.99 100.00 -75.48 100.00 -92.31 100.00 -75.48 100.00 -85.01 100.00 -94.56 100.00 98.23 -100.00 -85.16 -99.89 -50.00 50.00 -85.95 100.00 -99.74 99.98 -98.90 100.00 -97.13 100.00 -98.68 100.00 99.85 -100.00 99.21 -100.00 -95.66 100.00 -99.99 100.00 Wilcoxon conf -99.50 99.50 -80.00 99.50 -92.50 99.50 -80.00 99.50 -81.67 99.50 -93.33 99.50 98.00 -99.50 -80.00 -99.50 50.00 -50.00 -87.50 99.50 -99.50 99.50 -99.00 99.50 -97.50 99.50 -98.25 99.50 99.50 -99.50 99.38 -99.50 -93.75 99.50 -99.50 99.50 voting 95.64 100.00 93.59 9.12 ++ 95.40 10.22 93.59 9.12 ++ 95.64 5.44 94.26 2.02 + 93.11 2.91 + 94.50 4.90 ++ 95.87 5.11 95.87 5.36 95.85 7.12 95.41 95.84 95.41 95.81 95.41 94.35 88.99 0.51 ++ 94.25 0.51 + 92.65 3.29 ++ 95.64 100.00 SD 2.29 0.00 4.23 0.62 2.16 0.67 4.23 0.62 2.27 0.81 2.45 0.25 4.69 0.49 3.41 1.02 3.00 0.90 3.00 1.32 2.38 1.52 2.42 0.42 2.42 0.40 2.42 0.37 4.76 0.00 4.52 0.00 3.58 0.61 2.29 0.00 T-conf that DROP3 > 64.02 100.00 96.28 100.00 70.87 100.00 96.28 100.00 66.12 78.01 94.59 -100.00 94.81 -99.99 97.47 -70.51 -50.00 50.00 -50.00 91.14 50.81 99.83 78.06 100.00 78.06 100.00 78.06 100.00 99.99 -100.00 93.33 -100.00 96.09 -99.97 64.02 100.00 Wilcoxon conf 80.00 99.50 95.00 99.50 70.00 99.50 95.00 99.50 50.00 66.67 99.50 -99.50 96.25 -99.50 99.50 -73.33 50.00 -50.00 50.00 50.00 65.00 99.50 50.00 99.50 50.00 99.50 50.00 99.50 99.50 -99.50 50.00 -99.50 95.00 -99.50 80.00 99.50 vowel 96.57 100.00 -- 86.72 30.05 + 78.56 19.97 ++ 87.48 29.71 89.57 36.59 93.17 36.15 -- 83.31 39.16 ++ 91.08 44.66 -- 89.56 45.22 90.70 46.02 -- 93.36 42.66 -- 92.40 96.57 -- 91.27 95.94 - 93.55 96.69 -- 50.20 4.69 ++ 57.77 6.65 ++ 89.39 36.43 96.57 100.00 -- SD 3.82 0.00 6.01 0.87 6.84 0.30 6.60 1.05 4.51 1.46 3.38 0.94 6.65 1.33 4.56 1.36 5.63 1.10 5.86 1.43 4.52 0.99 5.35 0.46 5.42 0.63 5.93 0.48 6.07 1.26 8.21 1.70 5.69 0.72 3.82 0.00 T-conf that DROP3 > -100.00 100.00 93.34 -100.00 99.99 -100.00 86.25 -100.00 -50.32 -100.00 -97.80 -100.00 99.79 -100.00 -98.17 -96.80 -50.00 50.00 -97.43 99.78 -97.00 -100.00 -99.85 100.00 -94.63 100.00 -99.97 100.00 100.00 -100.00 100.00 -100.00 53.83 -100.00 -100.00 100.00 Wilcoxon conf -99.50 99.50 93.33 -99.50 99.50 -99.50 83.33 -99.50 57.50 -99.50 -97.50 -99.50 99.50 -99.50 -97.50 -98.00 50.00 -50.00 -99.50 99.50 -97.75 -99.50 -99.50 99.50 -95.42 99.50 -99.50 99.50 99.50 -99.50 99.50 -99.50 -55.00 -99.50 -99.50 99.50 wine 94.93 100.00 92.65 14.30 96.05 14.23 92.65 14.30 91.50 16.60 + 94.38 9.05 90.98 5.74 + 93.23 11.42 + 94.93 16.11 94.93 16.17 96.08 9.74 94.93 95.57 94.93 95.57 94.93 94.75 81.47 1.94 ++ 95.46 2.12 95.46 7.80 94.93 100.00 SD 4.11 0.00 5.46 1.71 4.69 0.78 5.46 1.71 4.21 1.74 4.63 1.58 7.76 0.83 6.49 1.19 6.19 1.68 6.19 1.65 4.59 1.57 4.11 0.86 4.11 0.86 4.11 1.03 5.84 0.19 5.37 0.78 3.67 1.65 4.11 0.00 T-conf that DROP3 > -50.00 100.00 83.38 -99.24 -77.83 -99.90 83.38 -99.24 94.60 70.97 57.64 -100.00 92.50 -100.00 90.53 -100.00 -50.00 50.00 -50.00 82.83 -72.70 -100.00 -50.00 100.00 -50.00 100.00 -50.00 100.00 99.98 -100.00 -58.29 -100.00 -59.47 -100.00 -50.00 100.00 Wilcoxon conf 55.00 99.50 85.00 -99.00 -50.00 -99.50 85.00 -99.00 96.88 65.00 53.33 -99.50 92.50 -99.50 93.75 -99.50 50.00 -50.00 50.00 50.00 -72.50 -99.50 55.00 99.50 55.00 99.50 55.00 99.50 99.50 -99.50 -53.33 -99.50 -57.50 -99.50 55.00 99.50 zoo 94.44 100.00 -- 91.11 12.47 76.67 10.62 ++ 91.11 12.47 92.22 29.38 90.00 18.27 88.89 18.02 88.89 15.80 90.00 20.00 91.11 21.61 95.56 17.16 -- 91.11 92.96 91.11 92.59 93.33 94.07 -- 94.44 7.90 -- 95.56 8.39 -- 92.22 18.02 94.44 100.00 -- SD 5.86 0.00 8.76 1.79 21.88 0.64 8.76 1.79 13.91 2.08 9.73 2.59 7.41 2.11 12.83 3.18 9.73 1.82 7.03 2.04 5.74 2.50 10.21 1.75 10.21 2.02 7.77 1.91 7.86 0.64 5.74 0.52 9.15 2.74 5.86 0.00 T-conf that DROP3 > -98.16 100.00 -70.45 -100.00 96.70 -100.00 -70.45 -100.00 -72.23 100.00 50.00 -91.60 70.45 -99.84 60.12 -99.21 -50.00 50.00 -70.45 99.34 -97.39 -98.66 -82.83 100.00 -82.83 100.00 -95.94 100.00 -98.16 -100.00 -99.25 -100.00 -82.83 -97.57 -98.16 100.00 Wilcoxon conf -99.50 99.50 -50.00 -99.50 96.88 -99.50 -50.00 -99.50 -65.00 99.50 50.00 -87.50 50.00 -99.50 50.00 -98.50 50.00 -50.00 -50.00 99.50 -99.50 -98.50 -50.00 99.50 -50.00 99.50 -50.00 99.50 -99.50 -99.50 -99.50 -99.50 -82.50 -97.88 -99.50 99.50 Average: 82.11 100.00 76.48 26.69 75.44 31.63 76.58 26.64 78.85 16.13 80.65 16.88 72.65 8.41 81.07 14.03 81.14 14.31 81.11 17.30 81.39 16.09 80.95 83.34 80.09 80.92 81.01 77.44 75.68 1.83 79.24 2.01 79.53 19.58 82.11 100.00 SD: 11.70 0.00 13.11 12.22 12.13 18.46 13.23 12.14 12.89 10.51 11.46 12.54 13.93 7.33 11.05 8.43 11.66 9.01 11.88 9.71 11.32 8.79 12.75 10.75 14.29 14.56 12.97 14.60 13.28 1.98 13.12 2.21 12.38 13.17 11.70 0.00 #times DROP3 better/worse: 14-17 31-0 26-5 25-6 24-7 25-6 25-6 25-6 20-10 20-11 20-10 17-14 28-1 0-30 17-13 10-21 0-0 0-0 11-15 30-0 18-12 25-6 10-18 31-0 10-17 31-0 12-16 31-0 24-5 0-31 16-14 0-31 18-12 22-9 14-17 31-0 #times sig. better/worse: 5-10 31-0 19-1 25-5 20-1 25-4 19-2 25-5 8-2 13-9 9-5 15-12 24-0 0-29 5-6 8-11 0-0 0-0 4-3 26-0 4-5 22-6 4-6 31-0 4-5 31-0 3-7 31-0 17-1 0-31 9-4 0-31 12-1 20-8 5-10 31-0 T Value: 1.17 52.94 5.31 5.65 3.66 4.89 4.86 5.68 2.40 1.38 0.93 1.68 8.02 8.03 0.18 0.73 0.00 0.00 0.10 6.62 0.56 2.97 0.22 26.40 0.84 21.13 0.15 20.24 3.86 8.57 1.68 8.74 2.70 3.01 1.17 52.94 T Prob: -87.42 100.00 100.00 100.00 99.95 100.00 100.00 100.00 98.85 91.16 82.04 94.86 100.00 -100.00 57.03 -76.34 -50.00 50.00 54.11 100.00 -71.14 99.71 58.46 100.00 79.58 100.00 55.88 100.00 99.97 -100.00 94.86 -100.00 99.44 99.74 -87.42 100.00 Wilcoxon: -78.99 99.50 99.50 99.50 99.50 99.50 99.50 99.50 99.32 93.53 91.97 87.55 99.50 -99.50 70.23 -91.03 50.00 -50.00 56.25 99.50 62.42 99.50 -91.85 99.50 -57.88 99.50 -84.48 99.50 99.50 -99.50 95.62 -99.50 98.97 99.50 -78.99 99.50