Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Prediction

Created by
  • Haebom

Author

Marzieh Ajirak, Oded Bein, Ellen Rose Bowen, Dora Kanellopoulos, Avital Falk, Faith M. Gunning, Nili Solomonov, Logan Grosenick

Outline

We propose an integrated framework for adaptive routing in multi-task, multi-modal prediction settings where data heterogeneity and task interactions vary across samples. Inspired by psychotherapy applications where structured assessments and unstructured clinical notes coexist with partially missing data and correlated outcomes, we introduce a routing-based architecture that dynamically selects modality processing paths and task-sharing strategies on a sample-by-sample basis. The model defines multiple modality paths, including raw and fused representations of text and numeric features, and learns to route each input through the most informative combination of experts. Task-specific predictions are generated by shared or independent heads based on routing decisions, and the overall system is trained end-to-end. We evaluate the model using both synthetic data and real psychotherapy notes for depression and anxiety outcome prediction. Experimental results demonstrate that the proposed method consistently outperforms fixed multi-task or single-task baselines, and the learned routing policy provides interpretable insights into modality relevance and task structure. This addresses a critical challenge in personalized medicine by enabling individually adaptive information processing that accounts for data heterogeneity and task correlation. When applied to psychotherapy, this framework can improve mental health outcomes, enhance treatment allocation accuracy, and increase clinical cost-effectiveness through personalized intervention strategies.

Takeaways, Limitations

We propose an adaptive routing framework to handle data heterogeneity and task interactions in multi-modality and multi-task settings.
Improved performance for predicting depression and anxiety from psychotherapy note data.
Learned routing policies provide interpretable insights into modality relevance and task structure.
It has great potential for application in personalized medical and mental health treatment.
Generalizability should be further validated with limited experiments using synthetic and real data.
This model may be specialized for a specific dataset (psychotherapy notes), and further research is needed to determine its generalizability to other domains.
There is a lack of analysis of model complexity and computational cost.
👍