Everyone Is Betting on Bigger LLMs. She's Betting They're Fundamentally Wrong. (Eve Bodnia, Founder & CEO of Logical Intelligence)

There's just a lot of healthcare areas where robotics can be crucial, like robotics for surgeries. Imagine if you let a lamp drive it, somebody says, oh, you know, the 20% of the time during brain surgery, it can go to like the wrong area. I'm so sorry. You can't have that. You need really fast inference. You need to speak on the millisecond, microsecond scale. Do it. AGI should be just like natural intelligence, something which plans, something which is able to predict, produce new knowledge. So we create an ecosystem. to serve us as humans. I see that AGI to me is that ecosystem, but for the AI models to serve us as humans. Kona is really cheap. It's very efficient. It doesn't need any special hardware. If your data changes, if your environment changes, you need to be able to recognize it like this. So I want people always be in charge of what AI can be doing. My biggest nightmare is if AI is doing something it wasn't meant to be doing. So you need to work with different architecture, which can self-align, which can adopt its behavior, which can be precise when it needs to be precise. Every major AI company is building a better language model. But Yves Bodnia thinks they're all solving the wrong problem. Yves is the founder and CEO of Logical Intelligence, a new AI lab built on an entirely different architecture. The company's energy-based reasoning model thinks in abstract mathematical space, solves problems with formal guarantees of correctness, and runs fast enough to control a surgical robot or design a chip in real time. In our conversation, Eva and I discuss why she left academia to start a company, what LLMs fundamentally can't do, the true nature of creativity, and the wisdom of legendary mathematician Grigori Perelman. I'm Mario. And this is The Generalist.

You can also chat with your notes, which is one of my favorite features. If someone says something on the call that you didn't quite catch or want to learn more about, Granola can help you out. It's an amazing way to be better informed during a conversation without having to interrupt everyone else's flow. You can also have Granola review all your recent conversations to pull out to-dos, write a weekly recap, or surface interesting ideas you might have forgotten. Another thing I love. To get started with Granola, head to granola.ai slash Mario. And for new users, you can get three months free with the code Mario. So go to granola.ai slash Mario and use code Mario for three months free. Eve, I'd love to start with an anecdote of yours that I saw on your Twitter account, which super intrigued me given the work that you do. Namely that as a teenager, you apparently met... Grigori Perelman, one of the greatest living mathematicians, and had a fascinating encounter with him. How did that happen? Yeah, apparently I was very lucky because it was not easy to meet him. So I had like some summer internship in St. Petersburg. I was working on just some websites just to make some extra money. And he was very noticeable in the community. He always, like, so by the office we had, like, a little park. And he was, like, walking the same route the same time every single day. And he looked very different according to the standards of Swabic culture. So people obviously paid attention to him and he was like a little celebrity in the community and people didn't know he was a mathematician. I don't know why I'm like naturally curious person and I'm attracted to different kinds of bizarre people. I love all kinds of people, but bizarre people are my favorite. And hence I went to academia for my career, but that's a hard story. And he just said that he was working on a problem in topology and yeah, so.

Obviously, I wanted to know more, but he was not really talkative. And when he went on news, he was all over the place. And I can't say more because there's nothing else to say more about it. So I was just lucky to ask a few questions. And I also asked him, like, why you did not get a Fields Medal? And he said, there's so many people were behind me. And I took... sort of they work and put the pieces together and um like it's it's an eager thing to receive it so that was my understanding while like those people did not receive it see what i mean yes yeah uh for for folks who are maybe less familiar he's as you mentioned sort of famous for declining the fields medal yeah so it's actually funny he he was trying to reduce attention to himself but It created the opposite effect. Yes. It made everyone curious as to how he could turn down this sort of Nobel version for mathematics. I'm curious, when you say bizarre people are your favorite people, that resonates with me. I think there's a part of me that feels the same. What does that feel like for you? What do you find most interesting about these strange birds? I just love this unconventional reasoning. thinking in general and the point of view of those people to the world and that's what like the major component of being creative right you just need to be able to think outside of your box but if you're thinking outside of your box you obviously like most likely gonna look different which is not true sometimes but sometimes some people it correlates and I claim myself being normal although most people laugh when I say it but I So I feel home when I'm surrounded by bizarre people. Looking at your background, I don't mean this offensively at all. I mean it complimentarily. You definitely don't seem normal. I don't know that many people who are studying particle physics when they're 13. So, you know, I'm super excited to get into all of this. But the Perelman story for me is so interesting because, as we'll get into, you're really building a form of mathematical genius yourself that hopefully extrapolates in lots of interesting ways too.

Maybe to take a step back, how did you grow up? Why were you so fascinated by mathematics and science from such a young age? The answer is, I don't know, because I've always been like this. And since I was a kid, I was reading books, I was trying to understand some fancy mathematics, because to me, math and science in general, it's... That representation of thinking outside of the box. I see like our human experience, we sort of bounded by our evolutionary memory. And it's very hard because of that to create something outside of this evolutional things. So this is why when we invent something, we're trying to tie it to things we already seen. And I was looking for ways to create something which has nothing to do. nothing to do with this intuition of what like we need in daily life so for example um you know when people invent black holes it's not something you see in daily life right it's very counterintuitive so quantum physics in general and mathematics is that tool which can take your imagination beyond your traditional daily limits and it has certain rules and you just need to follow the rules and you know the stepping stone it brings you is sort of correct like you could trust it but it also gives you something you might not understand and it takes like us time to understand what it gave us so the notion of quantum mechanics took a very long time to build intuition around the notion of black holes in general quantum information is very counterintuitive area so interesting yeah i was like attracted to this kind of idea can i can i be exposed to the tools which will take my personal imagination outside of my limit and the answer like was in theoretical physics and mathematics and yeah i was just like so obsessed with it from day one it's amazing i feel like the way that you describe that passion

is how maybe I might have described writing for me. There's some amount of unification in so many of these things where, you know, whatever the right methodology is to allow your imagination to go into these interesting places. But it's such a beautiful description. You bring a very interesting point. I think I met somebody who has said similar things to me and he was working in literature, like he was a writer. And he said that words have so many different shades and so many different languages. They have their own sort of colors and shades. And it's like such a not easy decoding problem to decode what's in your brain in the form of language in the most accurate way. Like language is something which we solve naturally. Like in mathematics, it's called manifold hypothesis or manifold problem. So it's interesting. I like that you bring it up. Can you actually tease out the manifold hypothesis a bit more so I understand that analogy better? Like when you say there's some comparison there with language, what's the sort of connection? Yeah, so the idea is your brain thinks in some sort of abstract way. Our thoughts is sometimes not in language. It's like in something else, right? It's a mix of images. It's a mix of words. It has something else. And for different people, it's a different thing. And when you try to communicate, you need to find representation of what's in your brain in language space in the most accurate way. And sometimes it's like your life depended on it, like in a court. So words can take you very far. But also like in literature, in poetry, it's like language is become an important part of channeling that creative. whatever is in your brain. See what I'm saying? Yeah, 100%. No, I think it's sort of a lossy distillation in some way. Like language is the best we have in many instances of trying to explain to people what we have in our heads. And it can be, you know, obviously so beautiful and descriptive, but there's still something that you lose in that translation. Yeah. So what you're describing is the heart of this manifold hypothesis is when you try to take something very complex and you map it.

something very simple and that simple needs to describe as accurate as possible what you originally meant to be. There is a huge information loss in like translation and yeah, it's a very popular question in AI, in biology, just like anything related to brain and languages and communication. Yeah, it feels like we're riffing in this really interesting way, but it actually feels like it also deeply connects to what you're building. On that subject, actually, I wondered if you'd ever come across this piece written by the novelist Cormac McCarthy on the Kekulé problem, where he talks about, I think, the mathematician Kekulé or scientist or something like that, where he came up with the structure of, I think, benzene. In this space beyond language, you know, he arose sort of with it from a dream with this snake like form of, you know, I'm doing a bad job explaining the science here. I clearly I I encoded it as a story, not as a science, you know, as a work of science. But it was really sort of even this legendary writer talking about how clearly there is this part of our mind that works way beyond language in this unconscious, symbolic way. Yeah. And it's amazing how like. Ability to extrapolate of our brain from one space to another, this is also like a major component for being creative, for creativity in general. I was also curious about the questions like, is there anything like consciousness? How can we define consciousness? Because then it brings you up to what you're talking about. There is a level of subconsciousness which takes over the processing, which is not directly related to your daily life. But this is something which can bring you something new. So some form of latent space of your subconsciousness, which always scans the information and just digest it and gives you something back. And there's so many scientists and just creative people in general get their insights from dreams or sometimes work on one area or another area. And like when I was doing the CBM.

I'm always thinking about the IBM, forgive me, like every topic people ask me, it all goes back to the IBM. No, I understand. Yeah, I was working in like entirely different field, which was nowhere close related to the EBS. Yes. The brain has amazing ability to extrapolate things from one place to another. And for listeners, EBM is energy-based model. It's the type of sort of AI that you're working on with logical intelligence. Yeah, yeah. Not based on language. Not based on language, yes, which is so interesting. Were your parents mathematicians or scientists? Did that sort of inform the way that you grew up such that these were the conversations you were having at home? No, actually, most people in my family, either in medical school or they're artists, we did not have such conversations at home. And actually, I was driving people nuts by having those conversations. And did you grow up in St. Petersburg? You mentioned that that's where you met Perelman. Yeah, so part of it, I was all over the place. I was born in Kazakhstan. I left with my parents to Russia when I was eight or something. And we just, we traveled a lot. We lived in new towns every three years on average because of my family job situations. And also I have very large family, so there was always a relative in another town we could visit and maybe like stay longer. And when I was 18, I moved to the U.S. In sort of researching you, it seemed like you had also spent some time around 13 or 14 working at CERN studying particle physics. How does that happen? Not that young. Not that young. Okay. I was like, how on earth does that happen? I'm not like a genius child prodigy, whatever, you know, like 13, you go to school. I just was lucky to participate in a different Olympics and I was lucky to win one and was invited to choose any school in Russia. So I chose something related to theoretical physics and math in general. And I was finishing up the high school.

I was like high school age and they gave me a project and they're like, well, we're working, like there's a place called CERN and we're trying to study new particles and make like new particles. And back then Higgs mechanism and everything about Higgs was a big deal. I got my first project, which was related to PP collisions. sort of trying to understand the origins of this quark gluant plasma so before the universe was formed there was quark gluant plasma and there was a lot of interesting plasma effects and just interesting numerical problem so they just gave it to me and i sold it we published the paper and then i was like well maybe i should just go and work at cern and we obviously had a lot of connections there and it's a great community i love spending time in switzerland it's one of my favorite countries and Yeah, and then I moved to the U.S. So, yeah, you know, nothing crazy, just as a high schooler. Well, now people, like, it's actually a goal even, like, there's a goal even younger. So what we're seeing is B, and there's a lot of students we had who were, like, at the end of the middle school for a research summer program, and they could already do, like, coding and understand. Things I did not understand at that age. I think right now kids are very, very smart. And back then, high school was like not also a big deal. There's a lot of high schoolers in Russia. Very smart. And so you went to Berkeley when you were 18 and then ended up staying in California through your PhD. What were you studying? And perhaps as you sort of have the benefit of hindsight now, what were the pieces of that journey that... maybe informed how you've thought about what you're building with logical intelligence? Well, the team was always the same, just trying to understand the fundamentals, laws of nature. I was specifically captured by the notion of symmetry. It's something which doesn't change while everything else change. And there are beautiful mathematics how to describe and how to define and how to derive what is not changing.

So I'm like, everything in nature has this phenomena. So maybe that's going to be my theme. And I'm just going to study this sort of invariance. That's what it's called. Things which are not changing as everything else is changing. Maybe I'm going to study this in brain and particle physics and condensed matter because mathematics was the same. But ability to extrapolate this knowledge from one domain to another makes you to bring something new to these fields. mathematical foundations to understand the symmetry groups and symmetry groups describe particle physics and if you understand particle physics you can work with condensed matter because there are some similar phenomena just different equations but the idea is the same and if you deal with condensed matter you obviously start dealing with quantum physics quantum information and naturally somebody from neuroscience department comes over and say hey you know we're using some mathematics which is like traditional doesn't give us anything new so maybe your methodology gonna help us describe something new and brain is also can be described uh the same equations as condensed matter because there are some things doesn't change in your brain while everything else changes so i'm like okay maybe interested to see what kind of invariants we can find with certain brain activities and i was studying that so the team was always the same just the areas were different and naturally when you start talking about brain people like maybe you you could apply this to ai and this is where like i felt the gap i'm like oh no it's i cannot use the same tools on llm and i started digging into llms and i'm like well i i'm not claiming i have understanding how brain works but i spent some years trying to understand And for me, it was clear it was not like searching for patterns in any language. It was as a writer, you feel it yourself. You're not just like what you create. You're not just searching for patterns. It's like something else. And you have a freedom how to decode it. And that realization to close this gap kind of put me on this path. So interesting. And there are so many pieces of that that I'm excited to think through together. To take a step back to maybe where you sort of started a piece of this journey.

symmetry and and sort of the idea of invariance in nature maybe maybe it's not possible to uh you know explain it to a word cell like me but like what is the what would be an example of that where you see like this sort of concept of invariant symmetry in nature everywhere literally everywhere so the example of symmetry i have like a water cup and like if you rotate it 360 degree it doesn't change It brings you back to the point. So I kind of like enforced that symmetry into the object. Then just think of magnets. Like if you take smaller pieces of metal and you put them on a table, sort of like a metallic dust. And then you put the magnet and they start arranging itself in the pattern. So we say symmetry is broken. It didn't have order. I mean, it had disorder and then it acquired some order. And that's called order rather. So pretty much any ordering in nature can be described by symmetries of some form. And your brain is another example. So like your brain naturally in like the background mode of our brain is very disorganized and dream as well. But sometimes you have like very clean, clear thought or thought process. So it's the same idea, right? You had something disorganized and then suddenly it became organized. You need to keep that order of chaos around it for things to be creative so you can come up with new things at the same time. So you need to have this notion of entropy. And the same phenomenon occurring in condensed matter. This is the subject about materials and material studies and how it's used in very hot temperature, very cold temperature. And they all have different properties, like high temperature semiconductor behave different from the low temperature ones. The same mathematics can be applied to a brain. And it turned out to be the same ideas can be applied to AI. Wow, that is so interesting. And those are very, very helpful analogies. When I was looking into some of the papers you published and some of your prior work, you know, I certainly...

uh, can't pretend to understand all of it, but there were some interesting, uh, indications of your, your thinking, even in places like the acknowledgements, like one of your acknowledgements, I think you, you, uh, thank both, uh, you know, fields medalist and also your Hindu gods. Uh, and it made me wonder how, how you think about spirituality, how you think about, I imagine there's some depth to, uh, what mathematics, uh, and. and science maybe means to you in that domain i really like some books from uh rick rubin he uh he the way he thinks about creativity in general like it's not it will obviously it's different theories about it and i don't want to go deeper about it but i love this idea that you just need to sort of like relax and channel and it just comes to you like this obviously this ties us to discussion of subconscious mind and how often you think about pro the problem how often you're exposed to like different areas and sometimes your subconscious mind is very creative or even conscious mind so I historically grew up even though I was growing up in Russia my mom was very spiritual and she was practicing Hinduism so I was exposed to meditation since relatively early age and I was always thinking that part of our creativity does not belong to us it just belongs to the entire world and we just hear us sort of a channel like yes all connected on the level of consciousness subconsciousness we all live in beings and you know sometimes it just comes to you and you're just grateful and you like it does not belong to you it you're just here to to receive it and to give it to the world i really love that uh framework for creativity in part because I remember reading a book, the book Impro by Keith Johnstone. I'm not sure if you've ever read it, but it's in theory about improvisational theater. But one of the things he talks about is how different cultures have such a different connection to creativity where they do connect it to the divine and how that really frees you as an artist much more. Because if you connect creativity solely to your ego,

then you feel really self-conscious about what you show other people. Whereas if you see yourself as a channel, then you sort of can separate yourself from it in some way. Exactly. You still feel responsible, but you just create unconditionally. And I think about ego a lot. And honestly, running a business is the biggest test for any human ego because you're facing competition, you're facing different kinds of... fears but you're also facing other side of things which like positive and feed your ego so you always like have to force yourself to stay grounded but also that brings a question of ownership right what we create doesn't really belong to us it's definitely belong to us but does belong to you not really so this brings us back to the point of gregory perlman he was working on something people worked for very long time and You can't just isolate one person and say, well, obviously he's brilliant. He is genius. He took all these pieces of a puzzle and put them in the picture. But in reality, each of these pieces of the puzzle was a very hard work for multiple generations of mathematicians. And this comes in every science field. So honestly, I don't like this idea of Nobel Prize in general. It's just given to one person. or one group but it should be given to entire community because all of us matters and all of us connected and collectively we contribute to its highest will maybe in your phd or somewhere else you mentioned there was a phase where maybe you were doing more experimental physics and that that was more challenging and that you never sort of wanted to go back to uh the touching lab equipment again what was it about that sort of modality uh or you know expression for you that didn't work? Well, I'm actually a very sarcastic person. So it was like, it was a little message to my experimental team who just saved my ass during this era of my PhD. And I love them. That was one of the best parts of my PhD. But they were like, you just need to like do something else because it's too much pain in the ass. I honestly also,

don't see that there is a need to separate experimental science and theoretical science. I know there's some people who just think that theory is the most important and some people who think experiments are the most important. But for real world, you need both. And you need to have decent understanding of both. So for example, there was like some supersymmetry theories. People were like, oh, now we understand how the particle physics work. We're going to build a large hydrogen collider. And this is what we discover. When they actually build it, the discoveries were different from what they expected. So experimental side of things telling you what's real and what's not for the physical world. And theories telling you about different kinds of options, giving your assumptions. So if you just isolate yourself only on experiments, you're going to feel limited. You still need theories to test, but you're only focusing on limitations of the physical world for your science, for your constraints. And if you force yourself only on the theoretical side, you just might end up working on something which might never be useful, which is fine. I had a bunch of useless topics during my PhD, like multidimensional donuts, and none of this would ever be useful. So no judgment. Maybe let's jump ahead to this sort of period in your career when you start to maybe recognize the applicability of the things you were thinking about. with regard to AI. You sort of mentioned this a little bit earlier, but how did that start to come together? And what was the process of that really formalizing into, hey, maybe I actually should start a company around this? So the first thought was like, I published a paper with that solution and received my tenureship and just be a professor my whole life. The second thought was like, there's a lot of academic papers out there. um right now i think we're facing that issue even crisis when people using the eye to publish papers and some very deep papers and very deep subject if you're not really an expert you cannot tell the difference like you don't know what's real what's not real anymore um my phd on archive there was like 500 papers a day so it's a lot of noise it's signal versus crisis

And we don't have tools to like actually identify what's real and what's relevant and how to find it. And I was like, if I publish my paper, it's just going to be one of those 500 papers a day. And like it might get lost and it might just live in this academic realm. And in industry, I have a chance to actually bring it to life and like actually work with real people who is going to use it, get real feedback and close that market gap. And market gap is huge. Because right now all AI is just language-based models and the world around us is not necessarily a language-based model. So I'm like, why don't I focus on closing this gap if I have this opportunity? And opportunity came, Universe provided. At the end of my PhD, I met an investor and he just like, okay, we... you have your team, so you have your thing. Let's just keep it going. I'm like, yeah, sure. Taking a step maybe back before you meet this investor, which I would love to hear about, but it sounded like you spent a bunch of time sort of analyzing LLMs and what they could and couldn't do. What were the frustrations or the limitations that you saw that sort of fit around your work so clearly? Obviously, I was studying the brains and I'm like, okay. Let's look at LLM. It's a bunch of neural networks and there's some layers and we're optimizing for having like correct ways for certain things. And like, can it extrapolate knowledge like real intelligence? The answer is no. LLMs are really good at operating facts in existing space. And sometimes people say, oh, it created something new, but you don't really, it's new for you, but you don't really know how new it is. It was there out in the internet you've never seen. Yes. or it can be just like there's some facts in some papers which were combined which is yeah it's new it's great people can do it that's how like literally science works for some part combining facts this one side of things and i was worried about like lms cannot create really fundamentally new things i also was worried about scalability of it and how easy it is to to

Keep up the same performance level as environment change. So back to Dimitris. Yeah. So LLMs to me really mimicking intelligence. And there's a whole ecosystem of different companies who are trying to advertise tools how to mimic intelligence even better. But reality is you just need to work with different architecture to reasoning. And this architecture needs to be inspired from your brain how we evolved. Like we have latent space. which basically keeps sort of idea of your tasks on the back of your mind. Work with finite size of neurons. You don't need the Gigafactory and, you know, GPUs and everything. So your brain operates on like 20 watts and you have ways to select the information like signal versus noise and decode it in the different forms. Like it can be language, it can be dance. It can be singing, it can be drawing. Language is just a small part of this world, although it's very hard. And I'm like, okay, I cannot just take an LLM and make it better to create something new. It's just incremental improvement, but it's still tied to the language. I need to create something which doesn't care about language, but it can speak language if it wants to. So it has to think... abstract way, just like your brain. It thinks in an abstract way, and then they have freedom. What language I'm going to speak to? What am I going to do? If I drive a car, I don't need language at all, right? And the architecture we built is exactly that. It thinks in an abstract space. It's a vector space. And you could do, so all the reasoning happens in that space. And then you can have a layer of LLMs if you want to, people speak to your model. Or you want to speak back to people, LLM just an interface. It's just a user interface out there. But for a body, you don't need even that, right? Sometimes you need to control the circuits. Like you put AI as a brain in some robot and robot is doing some acting. You don't need any language to communicate to the circuits. EBM reasoning model can speak directly to the circuits. You need to speak on a millisecond, microsecond scale. Do it, which we do.

Yeah, in this case, you don't need an LLM as a user interface. And yeah, so I was thinking about this, building architecture, having this on the back of my mind, half of my life, and it just came and that's it. Wow, amazing. This episode is brought to you by Persona. the B2B identity platform helping businesses verify users, fight fraud, and build trust. Fraudsters are already using AI to spoof faces, voices, and documents, so your defenses need to adapt just as fast. Persona helps secure some of the Internet's largest and most trusted platforms with identity verification. If you're building a product where trust matters, identity should be a priority. You've probably already experienced Persona without realizing it. Verifying your LinkedIn profile, signing up for Etsy, or renting a scooter with Lime. Trusted by leading companies like Square, Brex, and Twilio, Persona gives you the building blocks to create identity flows that adapt to your customers, risk tolerance, and locales you operate in. Whether you're verifying age, onboarding businesses, or automating KYC. It's fully configurable, so you can launch in days, not quarters. Want to see for yourself? Generalist listeners get a free year of the starter plan. Head to withpersona.com slash generalist and check it out. It is really fascinating to see, you know, on your website, you have just like, you know, an example of how the logical intelligence models work differently and can solve different problems compared to traditional LLMs. And it really kind of blew my mind for folks that, you know, maybe want to go check it out. I would recommend it. But you sort of generate a super hard Sudoku. And then simultaneously test how long it takes to solve that Sudoku for logical intelligence. And then, you know, Gemini, ChatGPT, you know, Opus, whatever you want to pick. And it is just fascinating to see how instant it is with your approach and how basically all of the other models either don't really get there ever or they get there incorrectly. And so that's sort of maybe the smallest dividend of how.

this sort of manifests differently. You know, obviously this is broadly applicable maybe at maturity, but there are probably sort of initial applications of this that make most sense. So I'd be curious how you think about that piece of it. Yeah, so where it makes sense are the areas which are mission critical areas. So somewhere you don't want to have mistakes and also which is not necessarily tied to language. So robotics, hardware is the future. In robotics, You cannot use LLMs, unfortunately, although many people try, just because it's very expensive. It's still playing the guessing game. You need really fast inference. Like, it's very hard to bring LLM to, like, microsecond scale or, like, the circuit level scale, I mean. The use cases we're targeting is pretty much robotics, chip design, creating formally verified chip design, code generation, formally verified code generation. So when I'm saying formally verified, it means it guarantees mathematical correctness of things. For example, everyone loves wipe coding. And wipe coding is like how it pushes the industry right now. It's optimizing the pipelines of people and so on. But it's still on people to debug. So we want to help people not to debug and be focused on being creative. Like create things instead of being focused on. like what kind of languages I'm going to use, you know, what kind of bugs I'm going to face, what kind of tests I'm going to do. And you want to deliver it at scale, meaning you need to stop Vibe coding. You need to move to Vibe code specifications. So that allows you to generate code, which is always correct. But still, you're going to be guiding the whole process. You're going to say, hey, generate me an autopilot. This is the hardware I have. the requirements for this car, like I wanted to follow direction, always listen to people. So you are in charge of the constraint as a human. And for me, it's a very big deal because we want to protect people in the AI-driven world. I want people always be in charge of what AI can be doing. So my biggest nightmare is if AI is doing something it was not meant to be doing. So the way to do this is...

To have these constraints provided by people, it can come in natural language, but then AI is doing things and it fulfills these constraints all the time. So it's not allowed to deviate from the tasks. So LLM can never do this because LLM hallucinate. So you need to work with different architecture, which can self-align, which can adopt its behavior, which can be precise when it needs to be precise. So for people, precision doesn't come naturally, right? We like, yes, if we want to build a bridge, we go to engineering school. But mathematics is not the natural part of our brain. We evolved on jumping trees and eating bananas, right? That's why if you feed your LLM with mathematics, it doesn't help really become your greater mathematician or something. Natural intelligence and my dream AI. is not precise by default but it has option to be precise it's as if in your brain there's a calculator you know when you need it so mission critical industry makes sense uh any kinds of robotics any kinds of manufacturer any kinds of chip design chip design is the area when it's needed the most people can use ai to put designs of the circuits on the wafers but they cannot guarantee correctness of this design and it's a very difficult Also, it can cost you millions of dollars if you make a mistake at this stage because it goes in production and then you learn it doesn't work. So all of this time and effort, it's going to slow you down, slow down your production. You're going to feel frustrated. So we're solving all of these problems. That's one thing. The second thing is there's just a lot of healthcare areas where robotics can be crucial. robotics for surgeries imagine if you let a lamp drive it somebody says oh you know the 20 of the time during brain surgery it can go to like the wrong area i'm so sorry the next word was the wrong word you can't have that so smart energy grades the literally the systems which power your entire town does not involve any language involves a giant data analysis in real time searching for patterns in real time making estimate forecast

predictions what's going to come next depending on many variables so this is very great use case for energy-based reasoning model and finally digital assets like people want to put ai in a stock exchange and you know same problem forecasting analysis of different kinds of data in real time also for methodology sorry i just you see the use cases are like so much of it But pharmacology involves analysis sometimes in real data for certain patients. You need to analyze your blood samples, having genetic background, having language part of it, because patients are going to speak to you and, you know, come up with real-time solutions for certain diseases. As a sort of point of context or clarification, why have you called it an energy-based model? Like, why is that the right sort of way to think about what it is you're doing? It's actually not. It should be called energy-based reasoning model with latent variables. Okay. But it's so long and it's such a new area. I don't know anyone except us and Jan's company who is working on this at the moment, but I'm sure there's going to be a lot more as we speak more and people learn about it. But energy, let me break down some words and maybe it can give you the big picture. Perfect. Yeah. So energy-based principle is not new. It's everywhere in physics. Examples would be you go, I don't know, from your office to your home, you want to pick the shortest path. You're minimizing your energy. As you're speaking to me on this podcast, you're not jumping because you want to minimize energy and focus. Energy minimization principle. The light travels the shortest path, right? Straight to your eye. So everything in nature wants to minimize energy. That's what we call the energy-based principle. There are LLMs, which utilize an energy-based principle for a certain navigation of certain, you know, networks, like layers and so on. So it's a huge term, very broad term. It's not making anything unique about us having this term. So where things come in unique is...

The latent variable. So what is latent variable? Again, inspiration came from our brain, which has this part of latent spaces called part of your brain, which keeps sort of mental image of the world. Example of the mental image of the world, like, you know, we know some rules about the data. Like my favorite example, like I'm a coffee addict. I could drink coffee all the time. If somebody knows this fact, this rule. And they see like, oh, there's a coffee cup and there's Eve. The rule must be Eve's going to drink the coffee. If somebody else bring me coffee, I'll take it. I never can say no to coffee. So it doesn't matter how many data points you provide, the rules are still the same. So those rules about the world collected by latent space of your brain and also by our model. So our model not just taking the data around itself. And data can be any form. It can be visual. It can be audio. It can be video. It can be language. It can be anything. It takes us data and it learns the rules about the data. And those rules go to its latent space. And the way we navigate it is we're using this energy-based principle. Yes. So it completes the picture. I can go very far with this. I'll stop. Okay. Okay. Perfect. If there's something that you think, hey, you should definitely explain this. But I thought that was really interesting. applications of of what you're building what sort of came to my mind is what is the the trade-off if there is one that that this type of model has to make versus an llm because it sounds like it has the ability to be much higher precision which you know obviously is is better and seems like it's more energy efficient and i imagine more cost efficient or maybe that's the trade-off very cost efficient um so To be smart, you don't need to be big as an AI model. There are some tasks we sell this time faster than big tech LLMs for tasks LLMs can solve. And we run it on one single H100 GPU. So it's the cheapest kind of GPU and it's only like one of them. And we have the range of parameters of the models. We have like 20 million. The highest we have at the moment is 200 million parameter.

contrast the big llm models are like billions and billions parameters we're building small models which allows you to put in circuits in your chip and your energy grid this is what big tech alarms will never be able to do they build one brain for all and all and this one brain is forced to be all possible roles a doctor and engineer and so on so a lot of issues with that because of llm extrapolation issues like it does not extrapolate knowledge, at least the current form of architectures. So you're building more specialized models. Is that... It's specialized, but it doesn't have to be. It's actually a very generalizing model. So because it doesn't play in a guessing game, it's very cheap. Because of its architecture, it sees all possible scenarios at the same time. So that demo on our website took us $4. And there was like 20,000 people using it. For the LLMs, it took like $15,000 in contrast to solve that 2%. It's like the cost deficiency is crazy. And that's how it should be, right? It's like if you make something which stinks, you're no longer playing a guessing game. You should know the answer straight ahead. The president of the Santa Fe Institute, David Krakauer, had like a really apt way of describing... intelligence, which is doing more with less. And most of these LLMs do more with more and sometimes not that much more with a lot more. It sounds like you've sort of found a way to, yeah, constrain, like not use nearly as orders of magnitude, less parameters and cost and energy, but find more out of it in these applications that as you're describing it, maybe have like Yeah, the ability to extrapolate and generalize much more. I think you've said that one of your models sort of shows credible signs of AGI. What was it that made you think that? That's not me. That's journalists. Oh, really? Okay. A journalist said that. I'm joking. So let's talk about AGI. Oh, this is the first part of the conversation where I saw you put your hand to your head in frustration.

you know to me what is agi is like the same what is consciousness there are different philosophy lines like oh this is what do we call agi and this is you're like everyone has separate like if you have your own version of agi nobody defines this form of agi and it changes over time so what was called agi by different people 10 years ago is probably not what we're gonna call it right now so before i speak agi i'll tell you what agi is for me so HAI should be just like natural intelligence, something which plans, something which is able to predict, produce new knowledge, be cheap and efficient, be adaptive to the environment. It should reason. It should not mimic any kind of reasoning, but also it should be compatible with all the tools we have, possibly. Like we have LLMs for the language, so you need to have your model. compatible with the language component because language is a big part of our world. So I'm sure there's going to be a lot of different forms of AI. And to me, AGI is having that ecosystem which sort of serves us as humanity in the safest possible way, in the most productive way. So we as people, like there's some collective notion of consciousness and there's some collective effort. We build cities. We have different professions. Each of us is good at something very specific. And that's how we bring this talent to the world. And we monetize it so we get something back. But also we give something to the world. So we create an ecosystem to serve us as humans. And I see that AGI to me is that ecosystem, but for the AI models to serve us as humans. So I see that Kona is really cheap. It's very efficient. It doesn't need any special hardware. So, like, we don't need to create special chip to run this architecture. It's adaptive. It's self-aligning. Self-alignment is a big part. Like, if your data changes, if your environment changes, you need to be able to recognize it like this and change your behavior. And your behavior always needs to be the subject of the constraints given by people. So, we do see that.

I already mentioned this part that self-alignment is a crucial part. So LLMs do not have self-alignment feature. LLMs are good at what you train it for. So if you train it on one specific task, you can't ask it to do something else. And there is a big hope and belief that if LLM is going to be bigger, it's suddenly going to change its behavior and suddenly becomes adaptive and planning and predicting the future, forecasting and so on. but haven't seen it yet. What is the most impressive thing Kona has done that maybe has blown your mind the most? Knowledge extrapolation. Did not expect that. Expected in a theoretical level, did not expect to see it as quickly as we see it now in experimental level. So the beauty of this energy-based reasoning model, because they're not attached to any language, you can build space for rules about your world like rules like if you if you're self-driving car for example there's going to be rules like how am i behaving around people how am i behaving around like town environment like the city you know sometimes the road is closed and this road i cannot take and they change my behavior also the weather which can change so you can have different sorts of rules sitting in different latent spaces and There's a beautiful mathematical way to force it to talk to each other of these latent spaces, but in a very, very fast way. When this idea came, we were like, I don't know. So it sounds beautiful. Just like supersymmetry. Let's build a Hadron Collider and test what's real and what's not. And it was real. And the model was so tiny. And I was expecting to see... some sort of change in complexity. What do I mean by that is sometimes different disordered system, when they small enough, they behave one way. And when they big enough, they start behaving different way. So I was thinking this behavior may come if the system is bigger enough. Like for example, if we grow the model to 8 billion parameter, maybe we'll see it.

We saw it right away. Like 16 million is the moment we saw it. 16 million parameters. It's so tiny. And it blew my mind. You have such an interesting team. You have founded Logical Intelligence with your husband. You also have a field medalist on the team. And then Jan LeCun is an advisor. How did that group come together? an advisor jan is a founding chair of our technical board so he is a founding chair oh okay well maybe jan is the right place to start then how does that work given that i think you were mentioning you know maybe it's just you and jan's own company that are sort of playing in this in this space with this approach well when you invent something relatively new People usually go to internet and read papers about it. When we created this, we could not just go read about it and see what we can predict, what's going to happen next, how it's going to scale. So we did not have this luxury. And this used to be a real scientific approach when you have to come up with a series of experiments to evaluate all the boundaries, all the constraints of your invention. For us, Jan was the only person to talk to about it because he's been in this field for a very long time. He knew this area in and out and he's been both in industry and academia side. So the moment that worked, we showed him and we're like, okay, let's scale it. So Jan is helping our team to scale the model and evaluate any... critical constraints uh we might face as we scale in it because again nobody's done this before but we have very deep understanding what's happening and what's going to happen next and every moment like we know what what we're doing right now but back then we didn't know and we had some guesses and predictions but now we like understand it and we know like now we solved it so

Jan is amazing. His knowledge is so deep. And because he's also a professor and he's also teaching, so there's a community of people who are also exposed to different kinds of energy-based architectures. So it's always great to engage with those communities. And I'm happy that Jan created this ecosystem. He's literally the father of this ecosystem. So we're honored that we work together. His company is focused on JEPAs, but they also doing a lot more things and I let them speak for themselves. But the beautiful part about our collaboration is our model compatible with Jan's model. So his JEPAs is like at the moment when we could see it's for robotics, it's selecting signal versus noise and they output. can become our input and we, so they're doing like a lower, lower reasoning planning and we're doing the higher reasoning planning. So our architecture is very compatible with each other. So I'm excited to see what we're going to create together next. So that's what about Jan. My husband, so I've been married for 14 years, literally half of my life. We sort of grew up together with my husband and we always talked about math and when it was legal, I got married. So I got married at 18. We have two kids. So mathematics and AIs and IBMs was always a part of our family. Yeah, so I'm glad we're doing this together. My husband is ICPC champion. He won this championship in 2009. And this is how we moved to the US because Neta, back then Facebook, just invited him. Yeah, I was helping a little bit recruiting people, like recruiting different talents from ICPC world back then, because I spoke multiple languages and that was useful. And Facebook was much smaller. Because of this ICPC exposure, they train through this competition, brilliant people who are forced to solve very hard problem in like five hour scale and also not just solve it, but also write the code and write algorithm and make sure it works.

So that's kind of what you see in the startup environment. And we obviously grew up, like my husband and I, we grew up in this environment. We did it ourselves. And we had a lot of childhood friends who just became the core of this company. So we have like eight HPC medals in the company at the moment. And I also brought Mike Friedman because the same subject was interested. He was interested in like how AI works. is there any similarities between brain and AI? And I met him during my PhD when he was a Google quantum AI. You mentioned that part of the story of this company and maybe one of the key steps in going from, hey, maybe I write a paper about this discovery versus turning it into a company was finding an investor and that sort of making it more official. Who was that first investor and how did it sort of change the trajectory potentially? There were three people, very good, very well connected people in Silicon Valley and did not find them. They found me. One of them found me. Wow, that's awesome. We met at a conference and started talking and yeah, he was pretty known in Silicon Valley. There was something that I saw that you cited on Twitter, which was the collection of Feynman letters. I think it's called Reasonable Deviations from the Norm or something like that, which is a really beautiful collection. I read a few of them in preparation for this. And one of them was interesting to me because he literally is talking about sort of versions of AI. And I think he sort of cites the idea that the sort of unbreakable challenge is to make a computer smarter. without it becoming much, much slower with its memory. I'm curious if that's been something that you've thought about as you've been building this or you've returned to that collection often? Definitely. Well, don't return often, but I read this book so many times at some point of my life. Also, not just for that reason, but also multiple reasons outside of that. But yeah, so...

Natural intelligence is able to produce new data and use this new data to navigate the world. That doesn't mean that you need so much data in your life. But it's not fair to compare it to people, though, because we evolved. There's years of evolution and millions of years for us. But for intelligent, the evolution is going to be different. But I'm a strong believer that you need to start with some data sets. very rich data, like not just the data, but also the rules about the data, which AI is able to work with. And that data set alone should be the foundation. And then it should be able to create new knowledge based on this data. So for example, people's analogy would be like you learning how to play piano and you start taking Bach pieces, but then you can move to Mozart. Like you're not trained on any Mozart pieces ahead of time, right? You just use the same rules. You know how the keyboard works. you know what to expect and you're kind of good to go. So you were able to create a new set of skill to play in Mozart. And then people started picking up guitar. Well, guitar is very far from piano from a technical standpoint, but the fundamentals of music are similar and you can extrapolate. So that notion of ability to extrapolate in the most cheapest possible way while being a small model was the key things for me. I think you mentioned somewhere that piano is your biggest love outside of mathematics, but you don't get the chance to practice as much anymore. Are you really studying my Twitter? It's a funny, it's like people's diaries in some way. You really get an insight beyond papers. No, yeah, it's a diary and I should be making it less of a diary because PR team has a lot of comments from my Twitter. I was just curious, like, you know, really what the role of music has been in your life and in the way that you come up with ideas, because I imagine, you know, you've obviously relied on a great deal of creativity to come up with this version of things. But I imagine, you know, you will need to keep fostering that sense of invention.

throughout the company's life. And yeah, I wonder how you find it today if it's not through piano, for instance. It's just the general principle. I believe for myself, for creativity is you need to be able to detach so you can come back to the problem and have sort of fresh ice looking at the problem. I also need to detach your mind and your mind is your biggest enemy. It's going to tell you all of this monkey talks and create doubts and concerns. So there are so many ways to shut it down. I mean, in a positive way. You can meditate, you can play piano. I have two children, so I spend time with them and spend time with friends. And yeah, playing piano if I can. Trying to learn some piano sheet music, like something complicated I've never done before. I always love just learning. Also reading a bunch of books if I can. But now obviously I have less and less time. But I also enjoy doing research myself. So I just enjoy going sometimes and reading new papers on different architectures. And what brings me a lot of joy is just to see like lots of emails from all over the world. Like more speak about this publicly. It resonates with a lot of people. And there's a lot of people who like, hey, I got inspired by this. I want to create my own architecture. So this is like things which make my day. I love to see just people. wanted to be creative because they like something and they share it with you. So I'm very grateful. And sometimes I engage with those people and one of them became our research intern. I always like to end the conversation with a couple of light thought experiments. One is if you had unlimited resources and no operational constraints, what is an experiment you would like to run? I would do the same thing. As you're doing now? Yeah. That's always a good sign. I'm not doing this to make money or something. And I was in academia, which is definitely not the place where you make money. I love this with my whole heart. And I love to create environments for people to reach their highest potential as researchers, as engineers, and so on.

It's like academia is a place when you combine both of these worlds together, but also industry is you can do the same, but at a much larger scale. So 100%, I would do the same. Okay, amazing. And then a final question. If you had the power to assign a book to everyone on Earth to read and know that they could understand it well, what would you want to assign to people? Well, I'm also a strong believer that... most of the issues around us we create ourselves using our mind so i'm a big fan of any some sort of um east philosophy books and techniques how can you navigate your mind when it becomes overwhelming so i don't have like a specific book in mind because there are so many of that but this is a direction i would recommend because if you ground yourself if you Feel good inside. Everything outside is going to be a manifestation of how good you feel inside. So if you're naturally happy, you're going to share your happiness. You share your creativity with others around yourself. So to take care of the world, you start to take care of yourself first. And it goes the other way, right? If you're angry at something, you're going to be angry at everyone else around you. So it's contagious. So I would recommend... that we work on our own self first. And it's a basis for creativity. It's a basis for being a valuable creative member of community, no matter where you are, like AI or medical school or industry, academia. It doesn't matter where you are. People are people. And yeah, so Let It Go from Hopkins is my favorite. And that's a sort of book inspired by Eastern philosophy? Yeah. Western view on Eastern philosophy and that Eastern philosophy come from Mahayana Buddhism. So that branch of Buddhism, which is like roughly 2000 years old, like the moment when they start having a ways to write things down instead of memorize it. So it was like a new branch of Buddhism. And there's also the same traditions shared in Hinduism. And I love how it sort of overlapped.

It has like psychology and it has a notion of spirituality and it explained in a language for people who don't really expose to either of those branches during like a form of writing. Amazing. Well, I certainly will check out that book and I have really enjoyed this conversation. So thank you so much, Eve. Thank you. I appreciate it. That's it. Thank you for listening to this episode of The Generalist Podcast. Please subscribe on Apple Podcasts, Spotify, or your preferred podcast app. Ratings and reviews help others discover these discussions, so if you enjoyed the conversation, I'd be grateful if you could take a moment to leave one. For all past episodes and more, visit us at thegeneralist.substack.com. See you next time as we continue to explore the future.