Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL...
Transcript of Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL...
![Page 1: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/1.jpg)
Interactive Multi-Task Relationship Learning
Kaixiang Lin and Jiayu Zhou ILLIDAN LabComputer Science and EngineeringMichigan State University
1
![Page 2: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/2.jpg)
Outline
• Introduction• Multi-task Learning, Active learning, Interactive Learning
• Method & Algorithms• Objective function, Algorithm
• Experimental Results
2
![Page 3: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/3.jpg)
Introduction
3
![Page 4: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/4.jpg)
• Multi-task Learning (MTL)• A learning paradigm that try to improve the generalization performance of a set of related machine learning
tasks by transferring knowledge among the tasks.
4
Introduction
![Page 5: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/5.jpg)
TrainingHuman Experts
Domain Knowledge
Knowledge Solicitation
DataModel
• Interactive Learning• A systematic way to include human in the learning loop, observing the results of learning and providing
feedback to improve the generalization performance of learning model.
5
Introduction
![Page 6: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/6.jpg)
• Active Learning• A learning algorithm that is allowed to choose data from which it learns, so that achieve higher performance
with few labeled data.
6
Introduction
12345678910 12345678910
Task1 Task4
Task9 Task6
Whichpairismore
informative?
![Page 7: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/7.jpg)
Methodology
7
![Page 8: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/8.jpg)
Human Experts
Domain Knowledge
Knowledge Solicitation
Knowledge-Aware Multi-Task Learning
Data
8
Key Challenges:1. What type of knowledge representation
should we choose?2. How to integrate domain knowledge to
MTL algorithm?3. How to solicit knowledge efficiently?
interactive Multi-Task Relationship LearningiMTRL Framework
![Page 9: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/9.jpg)
MTRL – revisit
9
Multi-Task Relationship Learning[1]
K: number of tasks; 𝒏𝒌: number of samples of task k; X: data matrix, 𝒏𝒌 ∗ 𝒅 ; y: responses, 𝒏𝒌 ∗ 𝟏 vectorW: model, 𝐝 ∗ 𝐊 matrix; b: bias, a scalar Ω: task correlation matrix, 𝐊 ∗ 𝐊|| ∗ ||𝑭: Frobenius norm; 𝒕𝒓(∗) : trace of a matrix
[1] Zhang Y, Yeung D Y. A convex formulation for learning task relationships in multi-task learning[J]. arXivpreprint arXiv:1203.3536, 2012.
![Page 10: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/10.jpg)
12345678910 12345678910
Task1 Task4
Task9 Task6
Onepair
MTRL – illustration of Ω
10
Multi-Task Relationship Learning[1]
[1] Zhang Y, Yeung D Y. A convex formulation for learning task relationships in multi-task learning[J]. arXivpreprint arXiv:1203.3536, 2012.
![Page 11: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/11.jpg)
An alternating algorithm
11
Multi-Task Relationship Learning[1]
1. Optimizing w.r.t. W and b when Ω is fixed
2. Optimizing w.r.t. Ω when W and b are fixed
[1] Zhang Y, Yeung D Y. A convex formulation for learning task relationships in multi-task learning[J]. arXivpreprint arXiv:1203.3536, 2012.
![Page 12: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/12.jpg)
kMTRL formulation
12
knowledge-aware MTRL
![Page 13: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/13.jpg)
English French English Math Piano MathIf
Then English French Piano Math
13
• A1: The domain knowledge acquired from human expert is accurate. The expert may choose not to label if he/she is not confident.
• A2: The acquired partial orders are compatible, i.e. when Ω𝒊,𝒋 > Ω𝒊,𝒌 and Ω𝒊,𝒌 > Ω𝒌,𝒑 are established, the Ω𝒊,𝒋 < Ω𝒌,𝒑 cannot be included.
kMTRL Assumptions
![Page 14: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/14.jpg)
14
• Step 1: Optimizing w.r.t. W and b when Ω is fixed
• Step 2: Optimizing w.r.t. Ω when W and b are fixed
• Step 3: Project Ω to the feasible set[2]
•
kMTRL Optimization
[2] Chang S, Qi G J, Aggarwal C C, et al. Factorized similarity learning in networks[C]//2014 IEEE International Conference on Data Mining. IEEE, 2014: 60-69.
![Page 15: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/15.jpg)
Human Experts
Domain Knowledge
Knowledge Solicitation
Knowledge-Aware Multi-Task Learning
Data
15
Key Challenges:1. What type of knowledge representation
should we choose?2. How to integrate domain knowledge to
MTL algorithm?3. How to solicit knowledge efficiently?
interactive Multi-Task Relationship LearningiMTRL Framework
![Page 16: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/16.jpg)
16
• (W, b, Ω) kMTRL
• Ω5 Calculate by analytical solution using W
• Ω Returned from kMTRL
• Query based on the discrepancy between Ω and Ω5
Query Strategy
![Page 17: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/17.jpg)
17
Inconsistency
![Page 18: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/18.jpg)
12345678910 12345678910
Task1 Task4
Task9 Task6
Task4 Task8
Task2 Task9
18
Inconsistency
Negative inconsistency
positive positive
negativepositive
Positive inconsistency
![Page 19: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/19.jpg)
19
iMTRL algorithm
![Page 20: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/20.jpg)
Experimental Results
20
![Page 21: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/21.jpg)
• y = wx + b + e• 10 tasks, 25 samples, x ~ Gaussian(0, 10), e~Gaussian(0,5)• w and b ~ Normal(0,1)• 20% are for training, 30% for validation and 50% for testing. • Change the number of features from 20 to 100 • truth-encoded multi-task relationship learning (eMTRL)
21
Importance of High-Quality Task RelationshipSynthetic dataset
![Page 22: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/22.jpg)
22
Importance of High-Quality Task Relationship
![Page 23: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/23.jpg)
23
Effectiveness of Query Strategy
1.095
1.1
1.105
1.11
1.115
1.12
1.125
1.13
1.135
1.14
1.145
0 5 10 15 20 25 30 35 40
The Average RMSE on Tesing set over 5 runs
Query Strategy Random Selection
![Page 24: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/24.jpg)
24
Effectiveness of kMTRL
![Page 25: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/25.jpg)
Brain Atrophy and Alzheimer’s Disease
• Alzheimer’s disease (AD) is a type of dementia that causes problems with memory, thinking and behavior.[3]
• AD has become one of the leading causes of death in the United States. • AD is characterized by structural atrophy in the brain, we want to
understand how the brain atrophy is related to the progression of the disease.
25
Case Study: Alzheimer’s Disease
[3] http://www.alz.org/alzheimers_disease_what_is_alzheimers.asp
![Page 26: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/26.jpg)
• Predict 99 brain volumes of each regions of interest (ROIs)• 648 samples, 51 cognitive markers as features.
• Ω6789: learned from 90% training samples by MTRL• Ω:;<=: the covariance matrix learned via MTRL on 10% data • Ω>:;<= : the covariance matrix learned via kMTRL on 10% data
Experimental settings
26
Case Study: Alzheimer’s Disease
![Page 27: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/27.jpg)
27
Case Study: Alzheimer’s Disease - Visualization
![Page 28: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/28.jpg)
• What type of knowledge representation should we choose?Pairwise encoding: The domain knowledge of task relationship is represented as partial orders, and can be encoded in the learning as pairwise constraints.
• How to integrate domain knowledge to MTL algorithm? Knowledge-Aware Multi-Task Learning:We propose a novel MTL algorithm that infers models and task relationship from data and conform the solicited knowledge.
• How to solicit knowledge efficiently?Active Learning based Knowledge Query: To maximize the usefulness of solicited knowledge, we propose a knowledge query strategy based on active learning.
28
Conclusion
![Page 29: Interactive Multi-Task Relationship Learning · interactive Multi-Task Relationship Learning iMTRL Framework. MTRL – revisit 9 Multi-Task Relationship Learning[1] ... ACKNOWLEDGEMENT:](https://reader034.fdocuments.us/reader034/viewer/2022042318/5f07de5e7e708231d41f2841/html5/thumbnails/29.jpg)
Q & A
29
Email: [email protected]
ACKNOWLEDGEMENT: This material is based in part upon work supported by the National Science Foundation under Grant IIS-1565596, IIS- 1615597 and Office of Naval Research N00014-14-1-0631.