{"id":2728,"date":"2024-08-15T07:07:51","date_gmt":"2024-08-15T07:07:51","guid":{"rendered":"https:\/\/medgift.hevs.ch\/wordpress\/?p=2728"},"modified":"2024-08-15T07:07:52","modified_gmt":"2024-08-15T07:07:52","slug":"new-multimodal-architecture-for-computational-pathology-published-in-medical-image-analysis","status":"publish","type":"post","link":"https:\/\/medgift.hevs.ch\/wordpress\/new-multimodal-architecture-for-computational-pathology-published-in-medical-image-analysis\/","title":{"rendered":"New Multimodal Architecture for Computational Pathology published in Medical Image Analysis"},"content":{"rendered":"\n<p>Our article &#8220;<a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1361841524002287\">Multimodal representations of biomedical knowledge from limited training whole slide images and reports using deep learning<\/a>&#8220;, Niccol\u00f2 Marini et al., has been published in Medical Image Analysis.<\/p>\n\n\n\n<p>In this work, we developed a novel multimodal learning architecture that integrates images and reports, offering a robust new approach to histopathology data representation. This model can be used as a powerful backbone to solve various computational pathology tasks.<\/p>\n\n\n\n<p id=\"d1e1666\">The multimodal data representation outperforms unimodal representations in terms of whole slide image (WSI) classification, making it possible to exploit smaller datasets to train effective networks.<\/p>\n\n\n\n<p id=\"d1e1671\">The combination of unsupervised learning methods allows it to learn similarities and dissimilarities between images and reports. The model effectively represents medical ontologies through visual knowledge, creating meaningful connections between the visual information in images and the textual details in reports. This integration opens up new possibilities for enhancing the accuracy and efficiency of computational pathology, which can contribute to better patient outcomes and advancing the field of medical research.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"749\" src=\"https:\/\/medgift.hevs.ch\/wordpress\/wp-content\/uploads\/2024\/08\/1-s2.0-S1361841524002287-gr1_lrg-1024x749.jpg\" alt=\"\" class=\"wp-image-2729\" srcset=\"https:\/\/medgift.hevs.ch\/wordpress\/wp-content\/uploads\/2024\/08\/1-s2.0-S1361841524002287-gr1_lrg-1024x749.jpg 1024w, https:\/\/medgift.hevs.ch\/wordpress\/wp-content\/uploads\/2024\/08\/1-s2.0-S1361841524002287-gr1_lrg-300x219.jpg 300w, https:\/\/medgift.hevs.ch\/wordpress\/wp-content\/uploads\/2024\/08\/1-s2.0-S1361841524002287-gr1_lrg-768x562.jpg 768w, https:\/\/medgift.hevs.ch\/wordpress\/wp-content\/uploads\/2024\/08\/1-s2.0-S1361841524002287-gr1_lrg-1536x1124.jpg 1536w, https:\/\/medgift.hevs.ch\/wordpress\/wp-content\/uploads\/2024\/08\/1-s2.0-S1361841524002287-gr1_lrg.jpg 1721w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><figcaption class=\"wp-element-caption\">Some examples of colon WSIs paired with the corresponding pathology reports.<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Our article &#8220;Multimodal representations of biomedical knowledge from limited training whole slide images and reports using deep learning&#8220;, Niccol\u00f2 Marini et al., has been published in Medical Image Analysis. In this work, we developed a novel multimodal learning architecture that integrates images and reports, offering a robust new approach to histopathology data representation. This model &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/medgift.hevs.ch\/wordpress\/new-multimodal-architecture-for-computational-pathology-published-in-medical-image-analysis\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;New Multimodal Architecture for Computational Pathology published in Medical Image Analysis&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2728","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p8AP2d-I0","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/posts\/2728","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/comments?post=2728"}],"version-history":[{"count":1,"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/posts\/2728\/revisions"}],"predecessor-version":[{"id":2730,"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/posts\/2728\/revisions\/2730"}],"wp:attachment":[{"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/media?parent=2728"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/categories?post=2728"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/medgift.hevs.ch\/wordpress\/wp-json\/wp\/v2\/tags?post=2728"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}