{"id":9314,"date":"2024-11-18T13:50:00","date_gmt":"2024-11-18T10:50:00","guid":{"rendered":"https:\/\/msc2024.dit.hua.gr\/?p=9314"},"modified":"2025-11-25T13:57:24","modified_gmt":"2025-11-25T10:57:24","slug":"grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models","status":"publish","type":"post","link":"https:\/\/msc2024.dit.hua.gr\/en\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/","title":{"rendered":"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models"},"content":{"rendered":"<p><\/p>\n\n\n\n<p><em><em><strong>Dr.\u00a0EfstratiosGavves\u00a0<\/strong>(<\/em><a href=\"https:\/\/www.egavves.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.egavves.com\/<\/a>)is an Associate Professor at the University of Amsterdam teaching Deep Learning at the MSc in AI, an ELLIS Scholar, and co-founder of Ellogon.AI. He is a director of the QUVA Deep Vision Lab with Qualcomm, and the POP-AART Lab with the Netherlands Cancer Institute and Elekta.\u00a0Efstratios\u00a0received the ERC Career Starting Grant 2020 and NWO VIDI grant 2020 to research on the Computational Learning of Time for spatiotemporal sequences and video. His background is in computer vision, and now focusing on temporal machine learning and dynamical systems, efficient computer vision, and machine learning for oncology.\u00a0He is currently supervising 15 PhD students on various topics pertaining theory and applications of Deep Learning and Computer Vision, including neural network, dynamical systems, and physical laws in learning algorithms, causal and object-centric representation learning, open-world video understanding, deep probabilistic and generative models, deep learning geometry, and applications to histopathological analysis and to adaptive radiotherapy.\u00a0<\/em><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong><em>\u0391\u03ba\u03bf\u03bb\u03bf\u03c5\u03b8\u03b5\u03af \u03c3\u03cd\u03bd\u03c4\u03bf\u03bc\u03b7 \u03c0\u03b5\u03c1\u03b9\u03b3\u03c1\u03b1\u03c6\u03ae<\/em><\/strong><\/p>\n\n\n\n<p><em>Foundation Models have taken the AI world by storm with their ability to generalize to novel, complex tasks beyond the scope of their training data. Whether they achieve this through true generalization or by \u2018remembering\u2019 vast training sets is debatable, but their performance is undeniably superior to previous approaches. With this success, the critical questions now are: What are the limitations of current large-scale learning? What frontiers remain? And what are the implications of these developments?<\/em><\/p>\n\n\n\n<p><em>In this talk, I argue that Robot Learning represents one of the most exciting frontiers, with Robot General Intelligence standing as the quintessential goal for AI. However, current approaches to Robot Learning face fundamental limitations that prevent them from achieving this ideal. I will present my recent work on a novel paradigm that incorporates explicit physical and causal priors into world models, enabling real robots to perform one-shot policy learning. This approach allows robots to learn new tasks from as little as one demonstration, pushing the boundaries of what\u2019s possible in real-world robot learning.<\/em><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>21\/11\/2024 | \u039f\u03bc\u03b9\u03bb\u03b7\u03c4\u03ae\u03c2:  \u0395\u03c5\u03c3\u03c4\u03c1\u03ac\u03c4\u03b9\u03bf\u03c2 \u0393\u03b1\u03b2\u03b2\u03ad\u03c2, \u0391\u03bd\u03b1\u03c0\u03bb\u03b7\u03c1\u03c9\u03c4\u03ae\u03c2 \u039a\u03b1\u03b8\u03b7\u03b3\u03b7\u03c4\u03ae\u03c2 \u03c3\u03c4\u03bf \u03a0\u03b1\u03bd\u03b5\u03c0\u03b9\u03c3\u03c4\u03ae\u03bc\u03b9\u03bf \u03c4\u03bf\u03c5 \u0386\u03bc\u03c3\u03c4\u03b5\u03c1\u03bd\u03c4\u03b1\u03bc<\/p>","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[179,193],"tags":[],"class_list":["post-9314","post","type-post","status-publish","format-standard","hentry","category-anakoinoseis","category-seminaria"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.3 (Yoast SEO v22.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Grounding Foundation Models in Reality with Physics- and Causality-informed World Models - MSc | Informatics and Telematics | Harokopio University<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/msc2024.dit.hua.gr\/en\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models\" \/>\n<meta property=\"og:description\" content=\"21\/11\/2024 | \u039f\u03bc\u03b9\u03bb\u03b7\u03c4\u03ae\u03c2: \u0395\u03c5\u03c3\u03c4\u03c1\u03ac\u03c4\u03b9\u03bf\u03c2 \u0393\u03b1\u03b2\u03b2\u03ad\u03c2, \u0391\u03bd\u03b1\u03c0\u03bb\u03b7\u03c1\u03c9\u03c4\u03ae\u03c2 \u039a\u03b1\u03b8\u03b7\u03b3\u03b7\u03c4\u03ae\u03c2 \u03c3\u03c4\u03bf \u03a0\u03b1\u03bd\u03b5\u03c0\u03b9\u03c3\u03c4\u03ae\u03bc\u03b9\u03bf \u03c4\u03bf\u03c5 \u0386\u03bc\u03c3\u03c4\u03b5\u03c1\u03bd\u03c4\u03b1\u03bc\" \/>\n<meta property=\"og:url\" content=\"https:\/\/msc2024.dit.hua.gr\/en\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/\" \/>\n<meta property=\"og:site_name\" content=\"MSc | Informatics and Telematics | Harokopio University\" \/>\n<meta property=\"article:published_time\" content=\"2024-11-18T10:50:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-25T10:57:24+00:00\" \/>\n<meta name=\"author\" content=\"Foteini Daneli\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Foteini Daneli\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/\",\"url\":\"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/\",\"name\":\"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models - MSc | Informatics and Telematics | Harokopio University\",\"isPartOf\":{\"@id\":\"https:\/\/msc2024.dit.hua.gr\/#website\"},\"datePublished\":\"2024-11-18T10:50:00+00:00\",\"dateModified\":\"2025-11-25T10:57:24+00:00\",\"author\":{\"@id\":\"https:\/\/msc2024.dit.hua.gr\/#\/schema\/person\/5fd8b7b750bed08ba00a047749219d83\"},\"breadcrumb\":{\"@id\":\"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u0391\u03c1\u03c7\u03b9\u03ba\u03ae\",\"item\":\"https:\/\/msc2024.dit.hua.gr\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/msc2024.dit.hua.gr\/#website\",\"url\":\"https:\/\/msc2024.dit.hua.gr\/\",\"name\":\"MSc | Informatics and Telematics | Harokopio University\",\"description\":\"Postgraduate Studies in Informatics and Telematics\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/msc2024.dit.hua.gr\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/msc2024.dit.hua.gr\/#\/schema\/person\/5fd8b7b750bed08ba00a047749219d83\",\"name\":\"Foteini Daneli\",\"url\":\"https:\/\/msc2024.dit.hua.gr\/en\/author\/foteini\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models - MSc | Informatics and Telematics | Harokopio University","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/msc2024.dit.hua.gr\/en\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/","og_locale":"en_GB","og_type":"article","og_title":"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models","og_description":"21\/11\/2024 | \u039f\u03bc\u03b9\u03bb\u03b7\u03c4\u03ae\u03c2: \u0395\u03c5\u03c3\u03c4\u03c1\u03ac\u03c4\u03b9\u03bf\u03c2 \u0393\u03b1\u03b2\u03b2\u03ad\u03c2, \u0391\u03bd\u03b1\u03c0\u03bb\u03b7\u03c1\u03c9\u03c4\u03ae\u03c2 \u039a\u03b1\u03b8\u03b7\u03b3\u03b7\u03c4\u03ae\u03c2 \u03c3\u03c4\u03bf \u03a0\u03b1\u03bd\u03b5\u03c0\u03b9\u03c3\u03c4\u03ae\u03bc\u03b9\u03bf \u03c4\u03bf\u03c5 \u0386\u03bc\u03c3\u03c4\u03b5\u03c1\u03bd\u03c4\u03b1\u03bc","og_url":"https:\/\/msc2024.dit.hua.gr\/en\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/","og_site_name":"MSc | Informatics and Telematics | Harokopio University","article_published_time":"2024-11-18T10:50:00+00:00","article_modified_time":"2025-11-25T10:57:24+00:00","author":"Foteini Daneli","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Foteini Daneli","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/","url":"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/","name":"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models - MSc | Informatics and Telematics | Harokopio University","isPartOf":{"@id":"https:\/\/msc2024.dit.hua.gr\/#website"},"datePublished":"2024-11-18T10:50:00+00:00","dateModified":"2025-11-25T10:57:24+00:00","author":{"@id":"https:\/\/msc2024.dit.hua.gr\/#\/schema\/person\/5fd8b7b750bed08ba00a047749219d83"},"breadcrumb":{"@id":"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/msc2024.dit.hua.gr\/grounding-foundation-models-in-reality-with-physics-and-causality-informed-world-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u0391\u03c1\u03c7\u03b9\u03ba\u03ae","item":"https:\/\/msc2024.dit.hua.gr\/"},{"@type":"ListItem","position":2,"name":"Grounding Foundation Models in Reality with Physics- and Causality-informed World Models"}]},{"@type":"WebSite","@id":"https:\/\/msc2024.dit.hua.gr\/#website","url":"https:\/\/msc2024.dit.hua.gr\/","name":"MSc | Informatics and Telematics | Harokopio University","description":"Postgraduate Studies in Informatics and Telematics","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/msc2024.dit.hua.gr\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/msc2024.dit.hua.gr\/#\/schema\/person\/5fd8b7b750bed08ba00a047749219d83","name":"Foteini Daneli","url":"https:\/\/msc2024.dit.hua.gr\/en\/author\/foteini\/"}]}},"_links":{"self":[{"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/posts\/9314","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/comments?post=9314"}],"version-history":[{"count":4,"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/posts\/9314\/revisions"}],"predecessor-version":[{"id":9322,"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/posts\/9314\/revisions\/9322"}],"wp:attachment":[{"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/media?parent=9314"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/categories?post=9314"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/msc2024.dit.hua.gr\/en\/wp-json\/wp\/v2\/tags?post=9314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}