280 - Mike Bowers, Chief Architect at FairCom Corporation
59 minAudio
In this episode I talk with Mike Bowers, Chief Architect at Faircom, about ISAM - the bare-metal database layer that predates SQL and powers stock trading systems. We cover Faircom's pivot into industrial IoT, their JSON/SQL hybrid approach, and discuss AI, consciousness, and the symbol grounding problem. Links: FairCom Nonsense Monthly
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
SPEAKER_00Hey, it's Jason, host of the Code with Jason podcast. You're a developer. You like to listen to podcasts. You're listening to one right now. Maybe you like to read blogs and subscribe to email newsletters and stuff like that. Keep in touch. Email newsletters are a really nice way to keep on top of what's going on in the programming world. Except they're actually not. I don't know about you, but the last thing that I want to do after a long day of staring at the screen is sit there and stare at the screen some more.
SPEAKER_00That's why I started a different kind of newsletter. It's a snail mail programming newsletter. That's right. I send an actual envelope in the mail containing a paper newsletter that you can hold in your hands. You can read it on your living room couch, at your kitchen table, in your bed, or in someone else's bed. And when they say, What are you doing in my bed? You can say, I'm reading Jason's newsletter. What does it look like? You might wonder what you might find in this snail mail programming newsletter.
SPEAKER_00You can read about all kinds of programming topics like object-oriented programming, testing, DevOps, AI. Most of it's pretty technology agnostic. You can also read about other non-programming topics like philosophy, evolutionary theory, business, marketing, economics, psychology, music, cooking, history, geology, language, culture, robotics, and farming. The name of the newsletter is Nonsense Monthly.
SPEAKER_00Here's what some of my readers are saying about it. Helmut Kobler from Los Angeles says, Thanks much for sending the newsletter. I got it about a week ago and read it on my sofa. It was a totally different experience than reading it on my computer or iPad. It felt more relaxed, more meaningful, something special and out of the ordinary. I'm sure that's what you were going for, so just wanted to let you know that you succeeded.
SPEAKER_00Looking forward to more. Drew Bragg from Philadelphia says Nonsense Monthly is the only newsletter I deliberately set aside time to read. I read a lot of great newsletters, but there's just something about receiving a piece of mail, physically opening it, and sitting down to read it on paper that is just so awesome. Feels like a lost luxury. Chris Sonnier from Dickinson, Texas, says just finished reading my first nonsense monthly snail mail newsletter and truly enjoyed it.
SPEAKER_00Something about holding a physical piece of paper that just feels good. Thank you for this. Can't wait for the next one. Dear listener, if you would like to get letters in the mail from yours truly every month, you can go sign up at nonsense monthly dot com. That's nonsensemonthly dot com. I'll say it one more time nonsense monthly dot com. And now without further ado, here is today's episode.
SPEAKER_00Hey, today I'm here with Mike Bowers, Chief Architect at Faircom. Mike, welcome.
SPEAKER_02Thank you.
SPEAKER_00I'm glad to be here. So tell us about yourself.
SPEAKER_02So I've been um doing software development for a long time since I was 14 years old, and uh professionally since I was um in college. So that's that's way too long, over 40 years of programming. Um and I've gone through a lot of things in my career. I've gone, I started out doing uh front-end design um and then front-end development and then backend development. I focused for a good 20 years of my career on database technologies, and um, and that's where Faircom found me because I presented it, I was a thought, I am a thought leader in the database space and presented at lots of conferences on the NoSQL movement and um SQL and how to bring different kinds of databases together.
SPEAKER_02And then Faircom is a database company. So they recruited me to modernize um their ISAM database product, which we did. We made it turned it into a JSON database. At the same time, we found that the industrial IoT market um is very interested in JSON databases and integrating factories. And so we kind of pivoted, or I kind of pivoted at Paracom to leading the company into the industrial IoT space to take our very fast database and combine it with an MQTT broker, the Google V8 JavaScript engine and an app server.
SPEAKER_02And um so when you combine a database, a JSON database, a broker, an MQTT broker, app server, and the V8 engine, you have a very powerful integration story that can integrate messages and JSON APIs and SQL database calls, JSON database, and then we added industrial protocols that are very strange things like Modbus and Siemens S7 and OPCUA, a lot of protocols.
SPEAKER_02And uh over the last six years we've been doing that. We've developed an industrial IoT platform that can pretty much integrate an entire factory with point and click, which is amazing because I used to do that early in my career at Intel and at Motorola and um and agriculture and at Freightliner when it integrated factories. And it's a ton of code, it's very expensive. But today, using the Faircombe software, you can integrate a factory with point-click in a user interface and have the data flowing throughout the whole factory very easily.
SPEAKER_00Okay. Um so I have to admit there was a lot there that I didn't understand. So if we can kind of go back through it from the beginning, there's there's a lot that I'm curious about. Um okay, so Faircom is a database company, I think you said that. Yeah. So tell me about that, because it's like uh database company. We got Postgres QL. Like, what more could you want? Like, why do we need a database company?
SPEAKER_02Totally. Um, well, databases before SQL, before Postgres or before Oracle, databases were actually ISAM. It's a protocol IBM invented, it's and it stands for index sequential access method. But it the point was it's um very low, very um low in the stack. It's uh there's nothing between you and the data, which means you can get incredibly fast, way faster than anything else. So Faircom's customers um have tested every other database in the world because everybody always wants to say, is there something better out there?
SPEAKER_02Because Faircom's been around for 46 years doing this database, and and so customers, every new what has been around for 46 years? Faircom, the company, uh, and this Faircom technology. And so it's embedded in everything. Um you just don't know it. It's like when you make a phone call on Verizon, you're talking, um, it's logging everything and tracking everything in real time in the Faircom database. Every stock market transaction is tracked in the Faircom database, and that overnight, massive analytic jobs run on the Faircom database, and then the company that sells stock market analytics to all the investors in the world is their data for for that analysis from the Faircom database.
SPEAKER_02It's the only database fast enough to do the job because it's so bare metal, so low level. But you we have to write C code to do all that, and no one wants to write C code anymore.
SPEAKER_00Okay, so sorry, I want to go even more fundamental. Um you mentioned ISAM, that's the protocol that that this can can can you kind of say that again for me? ISAM is a protocol for what exactly?
SPEAKER_02So it's a way of storing data, it's the way you store data, you store raw bytes in records, and then you can index them, and you can read you can walk the records in index order very quickly. And so there's nothing between you and your data in a C program. So you literally take your raw C data, throw it in a record, index it, and then walk it in. You can index it with hundreds of indexes and walk it in index order incredibly fast.
SPEAKER_00Okay. And and let me let me try to uh hook that into my existing knowledge somehow. So I come from a world of relational databases. Um, the vast majority of the time I'm using PostgreSQL. Um and not everybody knows this, but um there are relational database products, but then behind that is relational theory, which is a product-independent um, I don't know, body of theory.
SPEAKER_00Um and all relational database products implement uh the relational model, although they all implement it uh uh uh not perfectly faithfully, and a lot of them implement it a bit different from the others, and so like from MySQL to PostgreSQL, you'll have some things that differ a little bit. Anyway, um that's that's what I understand. Uh I had never heard of ISAM before today.
SPEAKER_00And is ISAM kind of analogous to relational theory where it's kind of a technology independent um idea and and different products might implement it, or is it a different kind of idea?
SPEAKER_02So it predates relational theory, it's before all that, and it's very it's basically it's basically a low-level protocol to store data in records and and read them either straight out of the table directly or read them in index order. So that's that's it's really simple. And in fact, all the relational databases when they were created used ISAM as the underlying technology on which they're built.
SPEAKER_02So DB2, Oracle, um, Psybase, they all used ISAM under the hood because that is the quickest, fastest way to work with data. Then they added the relational theory on top. Faircom, we we continued whereas all the other database bidders hid ISAM inside um and then just expose the SQL. Faircom continued to expose the ISAM and added SQL. So the Faircom database is a SQL database, just like Postgres or Oracle or SQL Server.
SPEAKER_02Um but un but we also expose our lower level layer so that you when you need to get incredibly fast, way faster than SQL could ever go, you can go down to that layer and do it work at that level. And of course, when you want the simplicity and the power of SQL with a relational model, you have that too.
SPEAKER_00Interesting. Okay, so I I I'm gonna restate some things to check my understanding and maybe you can tell me if I have it right or not. Um so the relational model is again technology independent. Um it's in my understanding, the way I view it, um, it exists largely um for purposes of things like data integrity and data structuring and stuff like that.
SPEAKER_00It doesn't say anything about how to mechanically implement these things. I guess theoretically, you could implement a relational database any way you want, using any technology you want. You could implement a relational database using pen and paper, I think. Um as long as you have like a person doing all the right things, following the right instructions and stuff like that. Um, but to me, it sounds like ISAM is more the mechanical part of it.
SPEAKER_02Right, exactly. It's the lower level engine, so that when when EFCOD created the Redditional Theory and tried to move off of the hierarchical databases on the mainframes to go to something more flexible, the Oracle picked that up and several other vendors picked that up and tried to say, okay, how are we going to implement this? So they took the ISAM engine, which is which was the main the fastest data access layer on the market at the time, it still is. And then they built relational models and SQL on top of that.
SPEAKER_02So you're right, the ISAM is the low-level mechanical bits and bytes flowing through to disk into memory. And SQL is a higher logical layer that sits on top of all that. And what makes Faircom different is that we have the SQL. In fact, I'm on the ANSI, the ISO committee for international standardization of the SQL language. Um, and so very much I love SQL and I love relational theory. I'm a strong advocate for that. And uh Vercom went and built the full SQL Indian, but they kept the ISEM exposed.
SPEAKER_02So bring the only product on the market that you can actually do all the beautiful SQL things, but when you need to go fast, you can go right down to the bare metal and still be compatible with SQL. You can just bypass the layers. There's so many layers in SQL. You've got optimizers, you've got to parse the SQL statement. There are there's a half a dozen layers between you and the data that slows all the data access down. So when you need to get past all the SQL layers to get to the raw data to do very fast processing, VRCom lets you go there.
SPEAKER_00Hmm. Okay, so maybe let's talk about that part a little bit. Um SQL, I say SQL, not SQL. Um which I seem to be in the great minority for saying that, but I've I've said it for so many years, I'm not gonna change now. Um so that is kind of a uh layer of abstraction. Um, you know, some people might say SQL is is hard to understand. Um, I I guess I wouldn't argue with them if if they think think so, but in a sense, SQL is very easy to understand in the sense that it's much easier to understand than if you were to go way lower level.
SPEAKER_00Um SQL exists for humans. Um and so because it's a layer of abstraction created uh uh solely for humans, um, there needs to be something that takes our SQL statements and translates them into something that is executable by the lower layers in the database system so that it actually can retrieve the data or perform the command or whatever.
SPEAKER_00Do I kind of have that right?
SPEAKER_02Totally, that's exactly right. And um the one of the first things I did when I was hired by at by Faircom to be their chief architect was to go, we have the we have the SQL, we have this lower level engine that we expose where you can use an API, get get to the get to the you know, if you if you think a vehicle, uh SQL sort of like the vehicle, but there's an engine inside that vehicle, you know, and so most of the time you just your our interface is the steering wheel, the the pedals, and the gear shifter.
SPEAKER_02But what if what if you really needed to go down and be in the engine and tweak that engine to do things that the steering wheel couldn't do? Well, it'd kind of be crazy to drive around like that, but you know, sitting on the engine playing with the engine. But that's what you can do with Faircom. You can you can live with the sequel and stay behind the steering wheel, or you can get right down into that engine and and go right into the pistons and tune that thing and make the make it sing and perform like nothing else.
SPEAKER_00Interesting. May I offer another metaphor? Um here here's what I think, and tell me if if this metaphor fits or not. But most database management systems are a restaurant where you have to order off the menu, but with Faircom, you can actually go into the kitchen and mess with the the dish yourself.
SPEAKER_01I love that metaphor. That's great. That's perfect. Yeah.
SPEAKER_00Okay, interesting. And yeah, um, so you're talking about trading systems and stuff like that. Uh incidentally, I had Dave Farley on the show a few episodes ago, and we were talking about that very same topic um and how the performance needs are just insane for trading systems because I only have a vague understanding, but I think the idea is basically like it's a race and you have to win, and it doesn't matter by how much you win as long as you, you know, if if you're I I don't I don't even know what unit of time would be appropriate to use, but if you're a tiny amount of time behind and you optimize your system by even just like an insanely small amount, that's the difference between losing and winning.
SPEAKER_00So those tiny differences matter.
SPEAKER_02Absolutely. And that's why the the Paracom database is used in the in a lot of those trading systems. Um and and then when you get when you collect all that data throughout the day of all the stock tickers, at night the analytics have to be run on that data, and it takes a long time to run those analytics. So you need a very fast processing system to figure out all the analytics for the previous days to give it to the stock market analysts to do their job. And the only database that can keep up with those analytics is the Faircom database.
SPEAKER_02And that's why we're not allowed to say the name of the company, but if you buy a stock market analytics, you're gonna buy it from about a half a dozen firms. But they all those firms get it from one company, and this one company uses the Faircom database because it's the only one that can get the job done fast enough. But they do they write C code, they go right to the middle, they bypass the SQL engine, it goes and um to get the analytics processed very quickly.
SPEAKER_00Interesting. You know, I find it fascinating all these different bits of technology that the world depends on that most people have no idea about. I I had no idea. I've never heard, you know, before you, I've never heard of Faircom. Um, but it's this uh what do you call it a database management system? Do you call it something else?
SPEAKER_02It is, it is because with the SQL, we are really DBMS. But if you're just ISAM, you're lower level, and so it's not really a full database at that level, it's an engine. Um or like you said, the kitchen in the back of the restaurant. But if you got the full restaurant there, then it's a DBMS, yeah.
SPEAKER_00Got it. Okay. Um and you said that you you mentioned something to do with IoT. So how did how does that come into the picture?
SPEAKER_02Yeah, so um the factory floor um really cares about a couple of things. They want their data to move quickly because they they deal in real-time processing of data. When they're running a piece of equipment, they want to make sure it runs very quickly. And um that they don't want things slowing it down. It's not as fast as the stock market, but it needs to be fast. And it needs to, and it needs to real-time means that when something happens, you process it immediately. There's no lag time, you know.
SPEAKER_02Oh, I'll get to it tomorrow, or I'll get to it in five minutes, or even one, or even ten seconds. It has to be now. And so you have to have a very fast system that responds. So because our engine is so fast, uh we knew that we could create we could we could create a new technology in this space that no one else could compete with us because they can't be, they can't run as fast as we can at our low-level engine. And so what we do is we built um the the new pro there's several new protocols in in the manufacturing world that are really uh taking off.
SPEAKER_02One of them is called MQTT. It stands for message queue telemetry transport. Um it's just a fancy way of saying um Twitter for machines. So you you know, like Twitter, you you tweet up to it up to an address, you know, and to a handle, and then everyone who subscribed to that handle will get your message. And that's what MTTT does for machines. You publish a message to a topic, and everyone who subscribes to the topic will get the message. And that's really important in the manufacturing world because machines can then publish um telemetry.
SPEAKER_02And that's a that's an older word back in the NASA days, meaning data. So machines are publishing data about their processes and alerts and status messages. And they and then the software wants to subscribe to those alerts and status messages and data so they can do cool things with it. So um message queues have been used in manufacturing in the silicon industry from the beginning. And then when I worked in the silicon industry at Mitsubishi, we used message queues to automate all of our factories.
SPEAKER_02And and so I learned that I was early in my career, and I learned that technique from them and loved it. And so when when I came to FARICOM and we and we realized that there's a whole new market out here that needs high-speed database processing, but they don't know what databases are, but they really want messaging and they want protocols that are manufactured protocols to automatically gather data. We put it all together into a package where we lose our use our fast, low-level engine so that every message that comes in from MQTT or comes from a device, no matter how it comes in, is automatically stored in our database.
SPEAKER_02And since we're so fast at storing and retrieving, that overhead is low for us. But if you try to use Postgres or see any other SQL database, you'd be 10 times, 20 times slower than what we are. So our our competitors who try to use MQTT to do the same thing and save messages are way slower than us because they can't keep they can't compete. SQL can't keep up. Um and so we gives us a competitive edge. Plus, our databases lights out.
SPEAKER_02You don't need a DBA. You just run it and itself, it tunes itself, it heals itself, it keeps everything running fast. Whereas if you use Postgres, you've got to vacuum it all the time to tune it. You really need a DBA to keep that thing running well. Well, Factory 4, they can't they're not gonna hire a DBA to run a database. So they won't they're used to just taking a box and a hardware box and plugging it in, and it should just work. So that's where our product is really well suited as well, because we're lights out.
SPEAKER_00Interesting. Okay, so you use that term lights out. What does that mean?
SPEAKER_02Well, it means no DBA, no hands-on, no people having to keep it running. It's just it lives in a black box, it just works.
SPEAKER_00Okay, got it.
SPEAKER_02Yeah, it's just it's just a black box to them. They plug it in and it does magic for them. And as long as it works, they don't have to mess with it, they're happy. And they don't want IT guys coming into the factory and rebooting stuff and tuning stuff because it takes the factory down. And so there's a real divide in the factory world. They call it operational technology when you're dealing with factories. That's OT. And then there's IT information technologies, which is, you know, the IT department. And sometimes IT and OT get along well, but most of the time the OT guys say stay out of my factory.
SPEAKER_02You reboot my machines, you break my factory line, I have to have stuff working 24-7. Every minute I'm down is a million dollars. You can't come in here and reboot for 20 minutes because you're gonna cost us 20 million bucks. But you know, on the IT floor, it's like, oh yeah, we can reboot. We could do, you know, they just have a whole different mentality. And so our database is really well suited for that world, but uh the uh the factory world doesn't know what a database is, so they're not software developers. So what we did is we wrapped our database up with all this integration technology that's just automatic, put a user interface on it, they point click, and now the factory floor has something that I never had before a an industrial database to them, but it just works.
SPEAKER_02And they could they could get data from all these devices and publish all the IT protocols and get data from IT protocols and publish all the devices. So we create a bridge, a translation bridge from all these protocols so that data can flow freely in a factory without having to write code.
SPEAKER_00You know, I I really like this uh concept. Um, it reminds me a bit of the Macintosh computer, where it's like it it just works and it puts again. I I brought up the idea of a layer of abstraction, it puts a layer of abstraction between you and the things that you shouldn't have to care about. Um like, for example, even the physicality of it, like looking if computers are different these days, especially because everybody copied uh Apple.
SPEAKER_00Um but like you know, I remember when I was a kid in the 90s, if you look at a PC versus a Mac, you know, they look completely different. Um because the other manufacturers kind of they made the external shape uh the external shape was subordinate to the internal components. Uh and and they they made the shape just, you know, it's like okay, we have these rectangular components uh inside, and it's easy if we just have like these trays where we slot in these cards and stuff like that.
SPEAKER_00So the whole thing will be one big um, I guess the technical term is rectangular prism, um, and it's just a a box. Um, but it doesn't look very attractive. And then a Macintosh, you know, I'm thinking of those ones in the 90s um that were like multicolored, I think they called it like candy shell or something like that, where they were very bulbous and rounded. That doesn't make anything easier uh as far as the internal components go, but they wanted it to um, you know, what were they going for?
SPEAKER_00I think they wanted it to be the okay, the the target was the human user of the machine. They were catering to the not the needs, they were catering to the I don't know, in some way they were catering, catering to the user, the customer, instead of um uh um okay, their North Star was the customer. Their North Star wasn't their own convenience. That that's what I'm trying to say.
SPEAKER_00Yeah. And so the the reason that I say all that to bring it all back around and tie it together is um if you make this database management system that's self-healing and all that, it'll run 24-7 no matter what. Um, you know, why wouldn't a database do that? Well, uh a database management system wouldn't do that if the the producer of that system decided that that's not their problem.
SPEAKER_00It's well, okay, that would be a huge expense and effort for us to add all these self-healing properties and stuff like that. So we're not gonna worry about that. We're gonna let that be your problem. So I really like the idea of abstracting away all that stuff and saying, hey, you're a manufacturer, you shouldn't have to care about vacuuming the database and stuff like that. We're just gonna do the, I assume, huge amount of work that makes it so you don't even have to know about that stuff.
SPEAKER_02Exactly. Exactly. And we built our engine, so actually it's not a huge amount of work because the engine was built to do that all along. Our our original customers want embedded us and still do, they embed us in their product. So it just had to work. There were no DBAs. So we built our product from the beginning with that audience in mind. Whereas Oracle and Postgres and SQL Server and Psybase and all the others, they they assumed you would have a database administrator. It was designed for that all for the beginning.
SPEAKER_02And so and I've been in I've been in Oracle DBA, a SQL Server DBA, and um and uh NoSQL DBAs as well MongoDB, MarkLogic, Couchbase. And these guys they all assume. Mark Logic, not so much. Mark Logic had this idea more like a Mac, you know, just like Faircom, just run and work. They did all the automation themselves. But the other ones, you have to do a ton of cleanup and tuning and keep it alive. So my goal with uh when I came to Faircom was to well, first my goal was was not even this IoT thing.
SPEAKER_02We that was new. That came after I got here. But um when I first was hired, my goal is to bring JSON to the Faircom database and take that ISAM engine, which is so fast, and leverage that to create a JSON database like MongoDB and Couchbase that is super fast but transactional and works like SQL. And you would have SQL data, JSON data, and the ISAM all at once at the same time. So you could go to any level of the API, whether you're just doing simple JSON things like you would do in Couchbase or Mongo, or do SQL things like Oracle or SQL Server, or the ISAM like Faircom.
SPEAKER_02You can do them all at the same time on the same data, and you could that way you get the best of all stories. You get all the power of SQL, all the simplicity of JSON, and all the speed of ISAM. And you just you can write code to work in any layer you want to achieve anything you want to do. So we built that. That was the first thing I did at Peracom, was design this JSON database out of our product. So now we have that's also part of the core. And I brought that up now because you're I love what your analogy with the Mac versus the PC.
SPEAKER_02Because Apple said, we want things to be easy for the end user. We want the we want the consumer who doesn't care about big boxes. They want style, they want an accessory. They want something cool that just lives in their life, you know, and it's small and compact. It goes with them and and it's fun and it's it's an accessory and it just enhances your life as opposed to the PC world saying we want a machine, we want an engineer to have a machine that you can customize and get into the engine each week and all that.
SPEAKER_02Well, Faircon used to be very much like a PC. You have to get into that engine, go back in the kitchen and you know, and cook the meals instead of just order it. But uh the the new the cut the new customers today, the new new developers don't want to go in the kitchen and make the you know make it work. They just want to order the food and have the database serve it up and be done. So I I've added the JSON engine to the Faircom database to do that very thing. It's now I could easily I can generally say it's the easiest JSON database in the world.
SPEAKER_02It's easier than Mongo Couchbase. It's simpler, it's more fun to use. It actually is fun to use. Um the JSON makes things so easy and fun. And you've got all the power of SQL, even in the JSON. Um so now I've merged JSON and SQL together in a much better way than Couchbase did um with their nickel language. And so we've got a really cool product. Then we later move to the industrial IoT spaces and realize that market wants the same kind of data back. They just want to get the data flowing in their factories, they don't want to know, they don't want DBAs, they don't want engineers, they just want a point and click, and data should flow everywhere.
SPEAKER_00Um okay, so um I'm curious why did Faircom feel like it had a JSON database-shaped whole? What what prompted this endeavor?
SPEAKER_02Yeah, so uh part of the the NoSQL movement was a movement actually away from SQL to JSON. Um now not every NoSQL database is JSON. There's uh Cassandra went to a wide column model. Um but most of the data, the most successful ones, uh like Mongo and Couchbase, went to the JSON model. And I was and uh MarkLogic did that as well, and uh a lot of other ones that it never really stayed around, they did the same thing.
SPEAKER_02And so there's a JSON became is is an easier data format to work with than SQL data formats. So it's um very powerful, very simple, and human readable. So um I became a big fan of JSON about well, actually since 2000. Um I started working with JSON around 2000. And so and I I and I also worked with XML at the time, but I I love both of those, but JSON is even simpler than XML and it's really nice to work with.
SPEAKER_02So I I started playing with X JSON and XML in SQL databases since the since the 2000s. And um back then they didn't databases didn't have anything built in, so I was doing my own stuff with those technologies. And then um the the NoSQL movement came and MongoDB took the industry by storm. They're the fifth most popular database, uh went from nothing to the fifth most popular um in a very short period of time, in just a few years.
SPEAKER_02And they the answer, and I asked myself what cost it, like what shot them to the top so quickly? It was easy. It was just like the Mac versus PC. It was the the developer wants to just get data, and how do they want that data? Well, every language works best with JSON data. JSON comes from um the JavaScript language, it stands for JavaScript object notation, but the real part is not the JavaScript part, it's the fact that it's object notation. And JavaScript is a C family language, just like Java or C sharp or C or C.
SPEAKER_02And that that way of defining objects in the C object notation, basically, that started with the C language and could carry it all the way through to Java and C sharp, that became the most popular way for developers to think about data is these objects and object-oriented programming. Well, JSON captures that. And so JSON is object-oriented, and that's what developers use in all their code. They write object-oriented code and they want objects. So they want the database to give them objects.
SPEAKER_02And JSON is the most natural way to do that because it's human readable, you can debug it, you can see it going across the wire, you can see what it's coming in, and you can troubleshoot it so easily. And and then JSON maps to every is natural in every language. Every language works with JSON because all the all the rest services today use JSON. Um, so JSON's become the ubiquitous way to program. Well, why the the worst thing you want to do is take all that beautiful JSON code and objects that you have in your code and convert it to SQL, which has nothing to do with objects.
SPEAKER_02What if you can have a database that does objects flowed in and out of the database naturally and without any effort? And so that's what Mongo did, and it makes a huge difference. So what we did at Faircom is I took all those lessons learned, but I've mapped, but I know just like you you talked about earlier, SQL is incredibly powerful. The relational model is wonderful. I'm a big fan of the relational world, and and um and I know EFCOD's relational theory very well. I've studied, I've actually read the original theories and the the I'm a theoretical guy.
SPEAKER_02I got my PhD in music theory, so I like theory. So um excuse me. So I studied the relational theory and I thought, well, we want objects, we want JSON objects to be in a database, but how can we map them to tables and fields in tables? Because we want the power to join. EF Cod proved in his in his paper in 1979 that hierarchical hierarchical data uh has problems, and you have to break it out and flatten it out and do you and join it across tables and to solve the problems.
SPEAKER_02There's really no other way. Well, JSON is hierarchical. So are we going back to the old hierarchical database days? No. The answer is you want you want hierarchies, but you want them to be within a table, and you want them to represent an entity um like a person or a cuss or a product or a a purchase. You want uh JSON to be uh real uh real world things, and so you want the hierarchies to be limited to a real world entity, but you want those entities to be flat.
SPEAKER_02You want them to be in a or rather to be peers, you want purchases and invoices and people and customers and products all to be peers with each other, not nested sub-hierarchical database. And so that's SQL. So I merged the concept of limited hierarchies of JSON into the SQL model and combined the two transparently. So when you work in the Faircom database, you're working with SQL data and JSON data simultaneously without any resistance.
SPEAKER_02It's not JSON or SQL, it's JSON in SQL and SQL in JSON, naturally combined, invisible to you really. You don't even have to think about it. It just works. And and that is what I brought to Faircom because I worked on that for 20 years to create that model. And it's a it's a next generation of technology that makes working with databases easier than MOGO and easier than SQL with the benefits of both.
SPEAKER_00Okay, so I have a whimsical question that I want to ask you. Um, and it's it's only very tangentially related to any of this stuff, but I have a hunch that it overlaps more than zero with your intellectual interests. Um, so I've been fascinated with natural language processing forever. Um, never really dabbled too deeply in it until recently, and even recently, I haven't gone very deep into it.
SPEAKER_00Um and I've I've been studying the problem of how do you take words and and teach a computer what those words mean? Because I've talked about this a lot on the show. Um, LLMs don't have any sense of meaning. Um they can shuffle around these symbols, and turns out you can get really far by shuffling around symbols, and you can seem to be as smart as a person by um passing uh uh an aptitude test or something like that, but that's not really intelligence, that's just questions and answers.
SPEAKER_00It's it's kind of in a way just a sophisticated database. And I'm interested in the question of how do we actually connect the meaning. Um, and I came across something called the symbol grounding problem. Would you happen to have seen this before?
SPEAKER_02I haven't heard of it in that in those terms, so no.
SPEAKER_00Yeah, so it's called the symbol grounding problem. Um it occurred to me one day that okay, you want to teach computer uh the meaning of some word, like I don't know, fish or something like that. Um, it's like, what's a fish? Well, it's an animal that lives in the water. Okay, well, what's an animal and what's water? Um, but it creates a problem of infinite regress because every symbol is just defined in terms of other symbols, yeah.
SPEAKER_00And you never get the next layer deeper. Um, and there's there's some people who think that human thought is like language is thought, like they're those two of the same things. Um, but it's been kind of proven that that's not the case. Um, we we have this deeper nonverbal form of thought, and it's like you can know what a fish is without knowing the word for fish. Um, and so my question is like, for one, how does the human brain store that knowledge?
SPEAKER_00Um and then two, you know, m maybe maybe if we somehow knew the exact answer to how that information is stored, um, then we could just make a computer do the same thing. But also, maybe we don't need to. Maybe we can just come up with our own way, which m may or may not match the brain's way of representing information um and um connecting a word to an actual meaning.
SPEAKER_00Um, and something that I figured out, and I'm feeling more and more confident about this, is that in order to teach a computer language, um, you have to start with an understanding of physical space. So like up, down, left, right, forward, back, um, all that stuff, I think that's where you need to start. Because if you think about it, like all of our so much of our language is borrowed from um from uh space, time and space, from from the physical world, you know.
SPEAKER_00It's like, oh what what did we say um uh back then or whatever, you know? Uh that's just a metaphor. Um we're saying back, but it wasn't back, it was just like earlier in time. It wasn't literally backwards in space, but we use that metaphor. Um and so this is a question, partly at least, of data representation and storage. And so I I you know I'm not assuming that uh that your interests overlap with mine, but I have a hunch that maybe this question would interest you at least a little, given that it's a data storage question.
SPEAKER_02It does interest me a lot. And I love first, I love your very very first point because people don't understand machine learning and and then and the whole family of technologies that are artificial intelligence. But as you pointed out, machine learning is statistical probabilities with million with maybe millions of dimensions, especially large language models, have millions of dimensions. And uh these are just numbers that say if this if you have this string of input, this is the most likely string of output.
SPEAKER_02Uh and it's statistical, it's statistical um probabilities converting that. So if you have a whole, you write a whole paragraph and say, hey, rewrite this, statistically, people would rewrite it the way they give it back to you. And so it's almost machine learning is like a popularity contest. It's like exactly this is the most popular way that people want to see things. It's very useful. Don't get me wrong, I think it's fabulous, but there's no intelligence there, like you pointed out. There's no cognition, there's no brain thinking about anything.
SPEAKER_02Um and there's no way to create anything new, it's just statistically, this is what people do, and this is how it should work, with whether it's music, outputting music, or outputting um text or whatever. And then so in order to get cognition, you have to have uh, you know, the core thinking and what is thinking, you know, and that's and as you pointed out, I love your other point, was language is critical to thinking, but it's not the only way we think. And I know in music, when I when I do music, uh it's um when I write, I write music and I arrange music, and um I have cognition parts that I'm consciously thinking about, structure, chords, um all all the aspects of music, melodies, rhythm, you know, timbre, um, texture, all those things I'm working together, and my mind is actively thinking about all of that.
SPEAKER_02But then I turn off that and I listen. And there's not language and there is not thought, but there is there is well, there's not cognitive thought with language, but there's non-verbal thought, there's non-verbal understanding of the music. And then when I go to play it on the piano, to to like to get to play all of a sudden all the stuff I wrote on my computer where I thought of it cognitively, and then I listened to it non-cognitively, then I go to the piano and I play with my fingers, and my fingers say, no, no, no, no, no, that's not how it should be played.
SPEAKER_02You should play this. And also, my fingers will come up with something better because there's muscle memory. There's a part of my brain that knows kind of like machine learning. Probability is this plays better, and my fingers know how to do it. I can sit down at a piano and improvise and make up stuff. And I have part of my brain is thinking cognitively, part of my brain is thinking emotionally, and part of my brain is thinking muscularly how to do it all. And I and I bring it all together and make pieces up. But there's those are three aspects of thinking that are not, you know, one of them is words, but the other two are not.
SPEAKER_02One's emotion and one is musculature or muscle memory or kind of like machine learning. And there's probably a dozen more. Who knows how many things are in our brain and how they all work together. I don't I I'm no expert there, but I know those three things are working together because I'll change it when I play it. Then I go back up to the computer and I'll play that computer play it for me, and then I'll go, oh yeah, but I really like this other thing a little better. Then I tweak it again, and I go through about six or seven iterations of it. And when I'm done, all those different things work together.
SPEAKER_02My hands are happy, my emotions happy, my brain is happy, and I've got like the sound is perfect. And and so you know what it's a fun process, it takes a long time, but it's yeah, it is fun, and it does take a long time.
SPEAKER_00I I I compose music also. Um, and I I I encountered this idea in maybe a year ago that I think is one of the most important ideas in the history of thought, um, which is the idea of conjecture and criticism. And it has so many um, it it applies so broadly. Um, okay, so the way that science advances, the way that knowledge advances, is that first we come up with some conjecture uh of an explanation for some um phenomenon in nature, and then we subject that conjecture to criticism, and if it doesn't survive the criticism, then it goes away.
SPEAKER_00If it does survive the criticism, then it's tentatively accepted as our our best guess at the truth so far. Um, so that's one way in which it applies. Um I, you know, 25 years ago when I was like first learning music, um, it occurred to me at one point, I can't really control what comes out of me, but I I can only control what I choose to keep, you know. So like most of the songs that I come up with, or or the little riffs and stuff like that, most of it is terrible.
SPEAKER_00I don't like it. Um, but then every once in a while you're like noodling around and you come up with something you like, and it's like, okay, I'm gonna keep it. And again, that's that's conjecture and criticism. Um with politics, um, the question isn't okay, and and by the way, with music, the question isn't how can I make it so I only ever come up with good stuff? That's not realistic. The question is, how do I filter out all the bad stuff? Um, same with politics. The question isn't how do we make sure we only get good leaders in power, the question is how can we create a system where we can remove bad leaders when they inevitably do sometimes come into power.
SPEAKER_00Um and so I I think that's an important idea for AI also. Um like I I think that when um when we see an object uh and we recognize what that object is, um for this is a little bit of a guess, but like I think first we come up with some conjecture of like, oh, I think that's a fox that I that I see in the yard.
SPEAKER_00Um and then you like look more closely and you're like, yeah, or like I think that's a fox, oh no, that's that's a coyote or whatever. Um and so the reason I bring that up is because maybe um in order for the the this representation problem to be solved, we have to have an AI that can have a flexible idea of something and it recognizes an object, and it's like, okay, I think that's such and such.
SPEAKER_00You know, it cycles through a few guesses or something like that. I'm not sure, but it has to be somewhat fuzzy in order to be able to recognize things because obviously things are a bit different, you assume, from a different angle or whatever. Um yeah, somehow.
SPEAKER_02Yeah, and that's the you know, the machine learning world, that's the training that we do as humans. We train it, we say a human goes in and says, that's a coyote, that's not a fox. And so the machine, okay. Then it statistically says this particular set of categorization, you know, it's statistic, this is a statistical model, this particular variation is labeled coyote now. And then and then you go through more iterations in all that fuzzy area, and if you keep training it, eventually it will come up with a statistical model that will say, yes, that's a coyote, and it'll get it right 99% of the time.
SPEAKER_02But we still we still have this whole gap in the in this AI world of cognition, consciousness. Because the machine is just statistically telling you, you've trained me. Well, it doesn't even think, right? I think it's a person. It doesn't think, it just says, here's an input. Statistically, the output is coyote. You know, it there is no thought. There is no, well, but what if it were a fox? Or or you know, or or then, you know, maybe this is halfway between a fox and a coyote. Let me come up with my own label for this.
SPEAKER_02Well, I think let me uh, you know, that's a whole different thing.
SPEAKER_00I think this is what the crucial difference is. Um uh the the machine is going off of statistical analysis, whereas a human is maybe sometimes going off of statistical analysis, but we are going off of explanation. So, like, imagine, for example, if you saw like a um taxidermied fox, but it was like the head of a fox and the body of an elephant or something like that.
SPEAKER_01Oh, yeah.
SPEAKER_00And it's like show that to a machine learning algorithm, and you're like, what's that? It's like, well, I I have like 60% certainty it's an elephant, uh 20% certainty it's a fox, or something like that. Like it it wouldn't arrive at the explanation of like, oh, this is like some super weird taxidermied uh head on a body type thing, because it wouldn't have the explanation.
SPEAKER_02Yeah. And it wouldn't have the awareness, the consciousness to go, this is different. But I see what makes up the I see the components that made up this weird taxidermy thing, and I can explain it. Um that's where that's that's why I don't like the term artificial intelligence, because intelligence to me implies well, it depends on how you define the word intelligence, but if you're talking about cognition and awareness and consciousness, yeah, it's not there, there is none.
SPEAKER_00Um sorry, I didn't I think I'm I I hate to interrupt, but I think I'm making genuine progress in in my thoughts here. So if you see this elephant with a fox head, um, I think the reason why a person can recognize that for what it is is because of um creativity. So a lot of these thoughts that I've been sharing just now come from these two books, uh The Fabric of Reality by David Deutsch and Um The Beginning of Infinity by the same author.
SPEAKER_00Um and he was talking about the origins of creativity. Um and his uh uh guess for the origin of creativity is um, well, it's a long story, I guess, but it uh in static societies, um, you know, like some hunter-gatherer society that doesn't change for thousands of years, um you you want to conform and you want to behave the same way other people do. Um but it actually takes creativity to try to figure out how other people are behaving the way they are, and so you exercise your creativity in order to imitate and conform, ironically.
SPEAKER_00Ironically, it takes creativity to not be different. Um anyway, seeing an elephant with a fox head and recognizing it for a taxidermide uh monstrosity um requires creativity because you have to see it and be like, okay, let me like reverse engineer this and figure out how this could have been made. I know that there's you know, an elephant with a fox head would never occur in nature, so this must be some kind of man-made man-made construction.
SPEAKER_00Um, and it certainly can't be alive. Uh so it must be some kind of a uh, you know, somebody decapitated a fox and and put it on an elephant's body. And usually when that happens, it's some kind of you know taxidermy type thing. So that's my guess for what that is. Much different process from statistical analysis.
SPEAKER_02Yeah. Yeah. And there's there's a consciousness to it, a thought, you know. Uh everything you were saying was, well, this you're thinking about it. You're going, well, it can't be this, it can't be this. Um, that's not what machine learning does, right? There's no thinking. Um it there it's fun. This is a fun discussion because we eventually, who knows, uh, if you combine enough of the statistics together that a consciousness might emerge.
SPEAKER_02That's a theory that some people have. And so who knows?
SPEAKER_00Uh I can't see any reason why consciousness can't arise in a machine, because it already has. Humans are machines, and we have consciousness. So I don't see any reason in principle why consciousness can't arise again in a different machine. Um, whether the path there is statistics or something else. I'm skeptical about the statistical path.
SPEAKER_02Me too, me too. Yeah. Yeah.
SPEAKER_00Yeah.
SPEAKER_02This is this is I love this conversation. Of course they have a hard stop in two minutes. Well, actually, in one minute. So I can just do that.
SPEAKER_00Okay, well, I appreciate you you indulging me for at least a few minutes. Um, and and I really appreciate the database conversation. Um, if you're up for it sometime. Again, I would love to have another conversation, but before we go, is there any place um you want to send people to learn more about Faircom, about you, any of that stuff?
SPEAKER_02Oh, yeah, yeah. Come to faircom.com, faircom.com. Two comms in there. Faircom.com. And um, and you'll learn about our products and you'll learn about this unique combination of technologies that we have that can make a difference for you for you when you want to differentiate yourself from others. If you want to be just like everyone else, you know, use Postgres. But when you want to do something beyond and have fun doing it, give it a shot. I think you'll like it.
SPEAKER_00All right. Well, Mike, thanks so much for coming on the show. Thank you. I loved it.
In this episode I talk with Joel Hawksley, Staff Software Engineer at GitHub and creator of ViewComponent, about whether AI is making us dumber, why blocking code reviews struggle under a flood of AI-generated code, and...
In this episode I talk with John Athayde, designer-developer and co-author of The Rails View, about what architecture school taught him about software design. John tells the story of a user test at LivingSocial that...
In this episode I talk with Riccardo Carlesso, Google developer advocate and co-founder of Rubycon, a Ruby conference held in Rimini, Italy in May 2026. Riccardo explains how a joke about PyCon became the conference's...
In this episode I talk with Travis Dockter, organizer of Blastoff Rails in Albuquerque. When Sin City Ruby and RailsConf both ended, Travis decided to start his own conference. We discuss how cheaply you can run a...
In this episode I talk with Julien Danjou, CEO of Mergify, about merge queues: why PRs that pass CI separately can still break main together, and how testing changes in a queue keeps main green. We discuss how Mergify...