Experiments
Comparative Study of Transfer Learning Algorithms
| Reaction Order |
1.0 |
0.5 |
1.5 |
2.0 |
Score |
| Degree of Mismatch |
10% |
15% |
20% |
15% |
|
| Raw Features |
| Baseline |
68.654 ± 0.769 |
64.519 ± 1.231 |
62.404 ± 1.154 |
56.923 ± 0.892 |
46.346 ± 1.709 |
32.981 ± 0.942 |
55.304 |
| KMM |
70.769 ± 0.638 |
64.423 ± 1.609 |
63.173 ± 1.889 |
57.212 ± 1.393 |
47.308 ± 0.490 |
32.885 ± 1.413 |
55.962 |
| KLIEP |
68.750 ± 0.745 |
64.519 ± 1.231 |
62.404 ± 1.153 |
56.923 ± 0.892 |
46.346 ± 1.709 |
32.981 ± 0.942 |
55.321 |
| uLSIF |
69.423 ± 1.346 |
63.846 ± 0.360 |
62.596 ± 1.860 |
56.731 ± 1.520 |
47.596 ± 0.527 |
27.692 ± 9.860 |
54.647 |
| PCA |
69.423 ± 0.490 |
64.519 ± 1.027 |
64.615 ± 0.577 |
57.212 ± 1.29 |
46.635 ± 0.804 |
36.058 ± 0.608 |
56.410 |
| TCA |
81.442 ± 0.990 |
71.923 ± 1.477 |
65.192 ± 0.990 |
66.346 ± 1.799 |
49.519 ± 1.747 |
40.385 ± 0.860 |
62.468 |
| GFK |
65.385 ± 1.290 |
59.135 ± 1.178 |
58.269 ± 0.561 |
53.173 ± 1.380 |
49.423 ± 1.027 |
42.692 ± 1.909 |
54.679 |
| OTDA |
89.423 ± 0.680 |
87.596 ± 0.769 |
80.673 ± 1.532 |
72.404 ± 1.380 |
85.769 ± 1.201 |
77.308 ± 1.113 |
82.196 |
| Monge Mapping |
89.327 ± 0.360 |
87.981 ± 1.008 |
84.038 ± 1.757 |
74.808 ± 0.892 |
86.538 ± 0.804 |
79.423 ± 0.707 |
83.686 |
| JDOT |
86.346 ± 0.838 |
83.846 ± 1.654 |
76.058 ± 2.284 |
70.000 ± 1.840 |
81.923 ± 0.942 |
75.000 ± 0.527 |
78.862 |
| ACF Features |
| Baseline |
97.692 ± 0.360 |
97.308 ± 0.385 |
92.019 ± 0.490 |
85.096 ± 3.145 |
62.981 ± 0.912 |
59.808 ± 0.942 |
82.484 |
| KMM |
97.692 ± 0.360 |
97.308 ± 0.385 |
92.019 ± 0.490 |
85.096 ± 3.145 |
62.981 ± 0.912 |
59.808 ± 0.942 |
82.484 |
| KLIEP |
97.692 ± 0.360 |
97.308 ± 0.385 |
92.019 ± 0.490 |
85.096 ± 3.145 |
62.981 ± 0.912 |
59.808 ± 0.942 |
82.484 |
| uLSIF |
97.956 ± 0.527 |
97.212 ± 0.360 |
91.538 ± 0.720 |
83.750 ± 4.504 |
62.122 ± 1.508 |
61.827 ± 1.985 |
82.356 |
| PCA |
97.596 ± 0.527 |
97.404 ± 0.490 |
91.923 ± 1.071 |
84.135 ± 0.304 |
62.885 ± 0.881 |
61.154 ± 1.704 |
82.516 |
| TCA |
96.923 ± 0.720 |
94.808 ± 0.827 |
89.808 ± 0.769 |
84.519 ± 0.707 |
61.827 ± 1.162 |
55.385 ± 1.407 |
80.545 |
| GFK |
95.962 ± 1.380 |
91.154 ± 0.892 |
81.250 ± 2.803 |
69.519 ± 6.589 |
60.288 ± 2.463 |
52.692 ± 4.736 |
75.144 |
| OTDA |
98.365 ± 0.385 |
95.000 ± 1.162 |
89.231 ± 1.709 |
94.038 ± 0.490 |
95.577 ± 1.439 |
76.442 ± 2.085 |
91.442 |
| Monge Mapping |
99.615 ± 0.192 |
96.538 ± 1.704 |
92.596 ± 1.736 |
82.500 ± 0.720 |
90.192 ± 0.838 |
76.635 ± 1.346 |
89.679 |
| JDOT |
96.923 ± 0.892 |
95.481 ± 0.838 |
90.288 ± 0.638 |
97.788 ± 0.490 |
75.288 ± 2.910 |
67.115 ± 1.508 |
87.147 |
| CNN Features |
| Baseline |
80.192 ± 3.001 |
75.288 ± 2.031 |
74.135 ± 3.815 |
62.500 ± 2.544 |
69.808 ± 5.400 |
60.288 ± 5.830 |
70.000 |
| DANN |
86.219 ± 2.745 |
76.594 ± 3.284 |
75.219 ± 2.331 |
71.875 ± 3.168 |
79.969 ± 1.457 |
69.844 ± 3.205 |
77.000 |
| KMM |
70.673 ± 4.641 |
67.981 ± 3.065 |
59.808 ± 2.878 |
35.962 ± 1.532 |
67.596 ± 5.237 |
44.712 ± 7.111 |
57.788 |
| KLIEP |
74.231 ± 3.019 |
70.385 ± 2.120 |
64.038 ± 1.783 |
44.327 ± 3.485 |
68.462 ± 4.392 |
47.308 ± 6.568 |
61.458 |
| uLSIF |
72.788 ± 2.763 |
71.154 ± 3.454 |
65.673 ± 2.679 |
49.135 ± 4.821 |
67.981 ± 5.512 |
44.615 ± 5.930 |
61.891 |
| PCA |
75.096 ± 5.137 |
69.904 ± 4.142 |
63.269 ± 4.242 |
43.558 ± 5.011 |
63.558 ± 4.888 |
37.308 ± 7.477 |
58.782 |
| TCA |
51.442 ± 9.035 |
52.308 ± 9.169 |
49.712 ± 7.446 |
39.231 ± 10.305 |
55.962 ± 5.048 |
39.519 ± 9.841 |
48.029 |
| GFK |
65.577 ± 5.315 |
59.615 ± 7.776 |
57.596 ± 7.646 |
38.077 ± 5.485 |
52.115 ± 5.854 |
33.846 ± 5.039 |
51.138 |
| OTDA |
89.327 ± 0.360 |
84.519 ± 3.803 |
77.981 ± 2.810 |
77.212 ± 2.288 |
84.135 ± 2.995 |
83.269 ± 1.113 |
82.740 |
| Monge Mapping |
89.808 ± 1.676 |
82.981 ± 2.862 |
78.077 ± 2.076 |
74.712 ± 2.518 |
87.115 ± 2.605 |
79.423 ± 2.777 |
82.019 |
| JDOT |
89.327 ± 0.932 |
85.673 ± 3.062 |
77.596 ± 2.076 |
77.692 ± 1.654 |
82.692 ± 2.107 |
84.519 ± 0.471 |
82.917 |
Distributional Shift Characterization
Negative Transfer under Optimal Transport