{"id":25725,"date":"2025-12-14T19:59:41","date_gmt":"2025-12-14T18:59:41","guid":{"rendered":"https:\/\/highpots.com\/?p=22687"},"modified":"2026-06-30T14:28:44","modified_gmt":"2026-06-30T12:28:44","slug":"limits-of-llms-in-the-physical-world","status":"publish","type":"post","link":"https:\/\/highpots.com\/en\/blog\/limits-of-llms-in-the-physical-world\/","title":{"rendered":"Limits of LLMs: Why today\u2019s LLMs do not understand the physical world \u2013 and what companies should learn from this."},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">For companies, this is more than just a technical nuance. The limitations of LLMs directly impact how AI can be utilized in medium-sized enterprises, what decisions make sense, and where specialized <strong>AI services<\/strong> become necessary. HighPots supports companies precisely at this interface: between language-driven AI, real business logic, and applications that reliably deliver results.<\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<h2 class=\"wp-block-heading\" id=\"h-llms-sind-machtig-aber-sie-bleiben-sprachmodelle\">LLMs are powerful \u2013 but they remain language models.<\/h2>\n\n<p class=\"wp-block-paragraph\">Current large language models are primarily based on the transformer architecture. They operate on discrete symbols extracted from language or images. This allows for high performance in text processing, analysis, automation, and AI agents for businesses.<\/p>\n\n<p class=\"wp-block-paragraph\">But this very strength also marks the boundary:<\/p>\n\n<ul class=\"wp-block-list\">\n<li>LLMs do <strong>not learn real physical states<\/strong>.<\/li>\n\n\n\n<li>They do <strong>not model dynamics<\/strong>, <strong>causality<\/strong>, <strong>physics<\/strong>.<\/li>\n\n\n\n<li>They generate plausible answers \u2013 but do not create world models.<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">AI pioneer Yann LeCun succinctly summarizes: <br\/><em>LLMs are &#8220;wordsmiths in the dark&#8221; \u2013 they operate in the dark, without understanding what happens in the real space.<\/em><\/p>\n\n<p class=\"wp-block-paragraph\">Even alternative architectures like <strong>state-space models (SSM)<\/strong> or <strong>RWKV<\/strong> still do not address the core problem. They are efficient sequence models but remain <strong>language- or token-based<\/strong>, not world-based.<\/p>\n\n<p class=\"wp-block-paragraph\">For companies, this means: <br\/><strong>Limits of LLMs: An LLM can interpret your data, but cannot comprehend physical reality.<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">It does not know forces, objects in space, or the consequences of an action \u2013 apart from what is described in text.<\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<h2 class=\"wp-block-heading\" id=\"h-warum-sprachmodelle-keine-echtzeit-sensordaten-verarbeiten-konnen\">Why language models cannot process real-time sensor data.<\/h2>\n\n<p class=\"wp-block-paragraph\">For applications related to the physical world \u2013 production facilities, logistics, navigation, automation \u2013 AI services based on an LLM are not sufficient.<\/p>\n\n<p class=\"wp-block-paragraph\">There are four technical reasons for this:<\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-1-die-datenformate-passen-nicht-zusammen\">1. The data formats do not match<\/h3>\n\n<p class=\"wp-block-paragraph\">Sensor streams and video data are continuous, high-dimensional, and time-critical.<br\/>However, LLMs:<\/p>\n\n<ul class=\"wp-block-list\">\n<li>process tokens instead of raw signals,<\/li>\n\n\n\n<li>lose continuous transitions,<\/li>\n\n\n\n<li>and cannot represent spatial structures.<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">A production robot does not operate in tokens. It works in Newton meters, pixel clouds, distances, forces, and rotational speeds.<\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-2-es-fehlt-ein-weltmodell\">2. There is a lack of a world model<\/h3>\n\n<p class=\"wp-block-paragraph\">LLMs do not have an internal representation of:<\/p>\n\n<ul class=\"wp-block-list\">\n<li>space<\/li>\n\n\n\n<li>time<\/li>\n\n\n\n<li>dynamics<\/li>\n\n\n\n<li>cause and effect<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">They cannot simulate how a machine behaves, how an object falls, or how a sensor value will evolve in the next milliseconds.<\/p>\n\n<p class=\"wp-block-paragraph\">Without such a world model, every control task remains uncertain.<\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-3-latenz-und-architektur\">3. Latency and architecture<\/h3>\n\n<p class=\"wp-block-paragraph\">Real-time applications allow for very few milliseconds of delay.<br\/>On the other hand, LLMs require large computational blocks because the entire sequence is processed \u2013 even optimized variants remain comparatively sluggish.<\/p>\n\n<p class=\"wp-block-paragraph\">For control systems, it holds:<br\/><strong>Too late is synonymous with wrong.<\/strong><\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-4-multimodalitat-weltverstandnis\">4. Multimodality \u2260 understanding of the world<\/h3>\n\n<p class=\"wp-block-paragraph\">Multimodal models such as GPT-4o or Gemini can analyze videos \u2013 but these data are also internally broken down into tokens. This is pattern recognition, not true physics simulation.<\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<h2 class=\"wp-block-heading\" id=\"h-was-unternehmen-aus-diesen-grenzen-ableiten-sollten\">What companies should derive from these limitations of LLMs<\/h2>\n\n<p class=\"wp-block-paragraph\">For decision-makers, it is crucial:<br\/><strong>For processes that need to represent or control real-world conditions, more than an LLM is required.<\/strong><\/p>\n\n<p class=\"wp-block-paragraph\">However, LLMs remain extremely valuable in companies \u2013 when used correctly:<\/p>\n\n<ul class=\"wp-block-list\">\n<li>for analysis, research, and knowledge automation<\/li>\n\n\n\n<li>for AI agents that structure internal processes<\/li>\n\n\n\n<li>for RAG systems that leverage corporate knowledge<\/li>\n\n\n\n<li>for automating communication, documentation, support, quality assurance<\/li>\n\n\n\n<li>as an interface between humans, systems, and business logic<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">The key lies in using <strong>LLMs where language and decisions dominate \u2013 and specialized models where physics, dynamics, or real-time are required.<\/strong><\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<h2 class=\"wp-block-heading\" id=\"h-warum-world-models-die-nachste-grosse-entwicklung-werden\">Why World Models will be the next major development<\/h2>\n\n<p class=\"wp-block-paragraph\">For true machine intelligence, systems need models that:<\/p>\n\n<ul class=\"wp-block-list\">\n<li>understand continuous state spaces,<\/li>\n\n\n\n<li>map dynamics over time,<\/li>\n\n\n\n<li>learn causality,<\/li>\n\n\n\n<li>be able to simulate scenarios.<\/li>\n<\/ul>\n\n<p class=\"wp-block-paragraph\">Such <strong>World Models<\/strong> currently exist only in early research stages. Nevertheless, it is foreseeable that they will become the foundation for future autonomous systems \u2013 from robotics to manufacturing to transportation.<\/p>\n\n<p class=\"wp-block-paragraph\">However, large technology companies primarily rely on LLMs because they scale commercially faster. This creates a gap where Europe can leverage technology.<\/p>\n\n<p class=\"wp-block-paragraph\"><strong>An opportunity: rethinking architecture, fundamental research, and industrial applications.<\/strong><br\/>HighPots is already accompanying this development today: with modern <strong>AI services<\/strong>, RAG-AI, agent-based systems, and solutions that reliably model real business processes.<\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<h2 class=\"wp-block-heading\" id=\"h-was-highpots-unternehmen-heute-schon-anbieten-kann\">What HighPots can already offer companies today<\/h2>\n\n<p class=\"wp-block-paragraph\">As a European <strong>AI service provider<\/strong> focused on feasibility, HighPots combines three competencies:<\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-1-ki-architektur-und-rag-systeme-fur-datengetriebene-entscheidungen\">1. AI architecture and RAG systems for data-driven decisions<\/h3>\n\n<p class=\"wp-block-paragraph\">We develop systems that securely utilize your company knowledge \u2013 On-Premises or in the Cloud.<\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-2-ki-agenten-fur-operative-prozesse\">2. AI agents for operational processes<\/h3>\n\n<p class=\"wp-block-paragraph\">We implement agent-based systems for support, documentation, processing, and automation \u2013 with stable interfaces into existing IT landscapes.<\/p>\n\n<h3 class=\"wp-block-heading\" id=\"h-3-softwareentwicklung-amp-middleware-fur-realen-geschaftsbetrieb\">3. Software development &amp; middleware for real business operations<\/h3>\n\n<p class=\"wp-block-paragraph\">Whether SAP Concur, WooCommerce, WordPress, or custom backend systems: We integrate AI directly into your existing processes and systems.<\/p>\n\n<p class=\"wp-block-paragraph\">This clearly positions HighPots: <br\/><strong>as a partner for companies that want to make AI truly productive.<\/strong><\/p>\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n<h2 class=\"wp-block-heading\" id=\"h-wie-unternehmen-ki-sinnvoll-implementieren\">Limits of LLMs: How companies can sensibly implement AI<\/h2>\n\n<p class=\"wp-block-paragraph\">A successful AI project does not follow trends, but the requirements of the business:<\/p>\n\n<ol class=\"wp-block-list\">\n<li>What tasks are language-based? \u2192 LLMs + RAG + AI agents.<\/li>\n\n\n\n<li>What tasks are based on measurement data or physical interaction? \u2192 Specialized models &amp; traditional ML methods.<\/li>\n\n\n\n<li>What systems need to be integrated? \u2192 Middleware &amp; API engineering.<\/li>\n\n\n\n<li>Where are data protection, security, and availability critical? \u2192 On-prem solutions.<\/li>\n<\/ol>\n\n<p class=\"wp-block-paragraph\">HighPots supports medium-sized companies in each of these phases \u2013 from concept to operation.<\/p>\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>K\u00fcnstliche Intelligenz ver\u00e4ndert die Art, wie Unternehmen arbeiten. Doch zwischen beeindruckenden Sprachmodellen und echter maschineller Intelligenz gibt es einen entscheidenden Unterschied:<br \/>\nLLMs verstehen die Welt nicht \u2013 sie beschreiben sie nur.<\/p>\n","protected":false},"author":5,"featured_media":22008,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[11,12],"class_list":["post-25725","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-ki-services","tag-llms"],"_links":{"self":[{"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/posts\/25725","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/comments?post=25725"}],"version-history":[{"count":1,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/posts\/25725\/revisions"}],"predecessor-version":[{"id":25726,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/posts\/25725\/revisions\/25726"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/media\/22008"}],"wp:attachment":[{"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/media?parent=25725"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/categories?post=25725"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/highpots.com\/en\/wp-json\/wp\/v2\/tags?post=25725"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}