Investigating Gradient Interference and Negative Transfer in Multi-Task Deep Learning
Summary Multi-task learning (MTL) enables a single neural network to learn several related tasks simultaneously, such as image segmentation, attribute prediction, and object classification. Although MTL often improves efficiency and generalization, competing objectives from different tasks can produce conflicting gradients during training, resulting in negative transfer and degraded performance. Recent studies suggest that gradient interference … Read more