In this episode, Bryce and Conor finish their interview with Andrei Alexandrescu. Twitter ADSP: The Podcast Conor Hoekstra Bryce Adelstein Lelbach Website ADSP: The Podcast About the Guest: Andrei Alexandrescu specializes in all aspects of designing and implementing software systems, as well as Machine Learning applied to Natural Language Processing and Speech Recognition. He has authored three best-selling books (The D Programming Language, 2010; C++ Coding Standards, 2004; Modern C++ Design, 2001), and dozens of papers and articles in conference proceedings and trade magazines. Show Notes Date Recorded: 2022-02-15 Date Released: 2022-03-11 Andrei Alexandrescu on Twitter D Programming Language Category Theory for Programmers by Bartosz Milewski Iterators Must Go by Andrei Alexandrescu, BoostCon 2009 C++Now 2017: Ali Çehreli “Competitive Advantage with D” Fastware - Andrei Alexandrescu - NDC London 2017 CUDA C++ Programming Guide ADSP Episode 51: Efficiency vs Speed Intro Song Info Miss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons - Attribution 3.0 Unported - CC BY 3.0 Free Download / Stream: http://bit.ly/l-miss-you Music promoted by Audio Library https://youtu.be/iYYxnasvfx8
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
ConorWhat a percentage of the time was it de was it always D design, or would where sometimes was Bartaj given a little, you know, category theory?
Andrei AlexandrescuUh I should always try to sneak inside category theory. Always, but I learned nothing.
ConorWelcome to ADSP the podcast, episode 69, recorded on February 15th, 2022. My name is Connor, and today with my co-host Bryce, we finished part two of our two-part interview with Andre Alexandrezcu.
Andrei AlexandrescuOh, speaking of uh Bryce, you mentioned this, like I don't think I'm the best in every meeting or something like that, right? You you mentioned that. It's kind of funny. So I have this interview question. So when I interview people, I was just uh I I worked for Symmetry Investments, uh, this um uh fintech company, and you know I had this interview question. In a meeting, like let's let's say you're at work in a meeting, what do you want to be in terms of skill? Do you want to be the best, the worst, or someone in the middle? Right?
BryceYeah, well, it's it's actually interesting because I think I have two different answers. Um, it used to be that when when I was solely an individual contributor, my answer was I always want to be in the room with people that are smarter than me. Um, and usually if I'm having like a typical meeting with like multiple people, um, you know, um that is usually a meeting where like I want to be there with people that are going to educate me in some way. Um but since I've moved into more of a leadership role, um, and I've I've always sort of over the years, I've always had some amount, some number of people that I have mentored in some way, shape, or form, but I do a lot more of it these days.
BryceUm I have learned that it is incredible, like I think one of the highest value things that I do is have one-on-one meetings with um uh like the various members of the my team and the other teams that I work with, especially the um uh the less senior members, um, or the you know, the members that I'm I'm trying to encourage them to take on more responsibility and to grow into a into a bigger role. And I've started realizing that, you know, sometimes like I I can have like a 30 or an hour, a 30-minute or an hour-long meeting with somebody, and like I can say one thing, and that will completely change like what they're like how they're gonna operate for the for the next week, and like it'll lead to a much better energy.
Andrei AlexandrescuYeah, yeah. Awesome. Um, so it's it's you know, what would you answer, uh, Connor?
ConorI would always prefer to be the least intelligent person in the room because then like one of my biggest things that I'm after in life is like learning. I'm very curious, and I always want to be learning. And if you're the least intelligent, that doesn't mean you're unintelligent, it just means relative to the people in the room.
Andrei AlexandrescuRight, right.
ConorThat being said, like I always want to be at a place where like I have the context and the tribal knowledge because there's like there's you know, regardless of what your job title is, it's like those two different states where you're feeling like you're an imposter and people are assuming that you have a certain level of knowledge. But it's like it's not that you don't have that knowledge, it's that you can't contribute in it's like I always have this metaphor of when you're trying to learn something, especially a programming language, you start out and it's like this planet or something that you can't wrap your hands around, and then at a certain point you sort of feel like you can pom it like a basketball, and then at a certain point you feel like you can get your whole mind around it, and like languages like you know, lisps are super easy to like, you know, uh, you know, scheme.
ConorYou can learn in a day or two, and then you feel like you're a god, uh, you know, operating that that language. But C, I never feel like, you know, supposedly I'm an expert in the language, but like I never feel like I fully have my hands wrapped around it because it's there's it's just too large, it's changing too often.
Andrei AlexandrescuSo maybe maybe Gardner doesn't have his hands around it or her.
ConorYeah, well, I mean, I mean, famously, what does he give himself? A six or seven out of ten or something? Um, that there's some quote. And then we've we've had this conversation offline that like even though you may feel like a one or two out of ten, um, that doesn't make you not an expert, because like relative to you know, the C engineers at large. So I guess I guess my point here is less than being like the smartest or the least intelligent relative to the folks in the room, I always want to feel like I have like I'm not missing out on the context or the tribal knowledge or like the assumed knowledge because that's when you're really able to like ask the questions and like feel comfortable.
Andrei AlexandrescuYep, know what to ask, yeah.
ConorAnd like that, there's always like a certain period of time when you join a company, and that's like that's one of the hardest things. Like when I switched from my first company that I worked for four or five years at, you get to this place where you have all that knowledge and you're the person in the room that knows the questions to ask and the things to bring up. And then when you switch to a new company, you're giving up all of that tribal knowledge. Um, and in some companies, like some of it is more transferable if it's like you know, C standard C and you're going to another company. But in my first company, it was all just this uh very, very narrow sort of actuarial, you know, domain knowledge that it's just you know, all of that expertise just goes poof and you're not really bringing it.
ConorAnd it's hard to like go from a place where you're kind of you know the expert or one of the experts in the room and then being to the person that needs to go back to square, you know, not zero, but I I do follow the Chris Lattner philosophy though, that he's he's always you know trying to surround him with people that know way more about their top, you know, their domain than he does because then he can just leech off of them.
Andrei AlexandrescuI love these answers. Um, and you know, uh Bryce mentioned the whole mentoring uh aspect, and that's wonderful, and the whole like sharing, and you know, this is like really a nice thing, like this this one thing you can say that completely changes like you know Dostoevsky manner, it changes completely the life of the the you know the the person you're mentoring, and I think that's that's uh that's awesome. Um and uh Connor, you mentioned this, like I want to, you know, I want to have be somewhere in the middle, kind of have uh the tribal knowledge, but also have people to learn from.
Andrei AlexandrescuWell, you folks, you you would be shocked at how many folks walk into that interview and ask them that this question, and they answer, I want to be the best in every meeting. And uh, you know, I I you know it's there's no in a way there's no wrong answer to this question. Uh but I think uh they wouldn't realize just how boring that life would be. It definitely would mean they're in the wrong employment, they're in the wrong place, because you don't want to be in a place where you're the best at everything and have nobody to learn from anything, you know.
Andrei AlexandrescuSo definitely it's um it's not a good uh it's not a good place to be in the long term. So you know that uh also harkens back to the whole uh discussion of humility and uh you know an unnecessary quality of uh of a programmer. So good stuff, you folks. Um hey, I want to discuss politics.
ConorAre you up to here we go, here we go, folks. This is where our PG13 podcast is gonna have an explicit rating for uh henceforth.
Andrei AlexandrescuYeah, take your kids to sleep upstairs, and you know, close the door and let's talk politics. So, you know, I I'm not you know, I'm not here to kind of ask you what you know who you voted for or whatever. And um I'm gonna I'm gonna say I'm desperately trying to uh stay centrist. But centrist being in a center seems to be nowadays, nobody believes you. Like if you talk to someone on either side, they're gonna assume you're on the bad side and you know that kind of stuff. Um but I I just I do I don't want to discuss politics per se as much as the impact of politics on uh on the new uh generation of programmers because I have this feeling that uh there may be some uh crosstalk, some influence.
Andrei AlexandrescuAnd here's my take. It is my opinion that in the last um few years, let's say, um, and not only in the in the States but globally, there's been um an increasing um relativization of the truth. An increasing, you know, actually and the whole like the alternative facts, like this, the fact that this phrase was even was even uttered on like in public, the the the sheer fact that uh somebody with political acumen mentioned there's alternate there's facts and there's alternative facts, and the sheer fact that this phrase got got even said um is a huge deal for for sciences, for everything that's hard science, everything that is programming, and everything that's in engineering.
Andrei AlexandrescuAnd I wonder, somebody who grows up in such an environment in which you know the truth is uh pretty much you can you can you can work it out. You can work out your own truth if you don't if you don't like the the you know whatever the real facts indicate. Um I fear that there's gonna be a problem with like in you know five years from now, and all of these kids uh who actually missed a lot of school, and that's you know yet another issue, right? They missed a lot of school for you know for a variety of reasons uh related to COVID, right?
Andrei AlexandrescuMissed a lot of school, missed a lot of hard science preparation, and grew in this environment where actually uh truth is uh is not an absolute um you know it's not an absolute reference. And how do you get to program a computer where actually if you if one bit is out of place, it's kind of the goes it's goes burst, right? There's no absolutely no nothing, there's no telling what's gonna happen if you one bit is in the wrong place, right? So, you know, I just wanted to ask you about the what's your take about this?
BryceWell, I think it's an interesting question. I I think that um yeah, I definitely think the the current generation that's had some amount of like their schooling where they've been like dur during the pandemic, like there's gonna be we're gonna see that five, ten years from now. But what one thing I think one interesting thing has changed since when Connor and I were in school, which is and mm mm maybe it's even not the case for Connor, but when I was in uh like school before college, like all my schooling before college, there was never any corset like programming courses.
BryceIt was not an option. Like I went to some I went to school in Connecticut, which is a very wealthy part of the United States. Um I went to a private middle school that was like a science-focused middle school. I went to a magnet school that was a science-focused um uh uh high school, but no coding. Whereas and and I every year I run the C now student volunteer program, and I started noticing more and more over the years uh that people had um coding experience younger and younger in the classroom.
BryceUm and I think a lot of programmers of Oconnor and I's age and uh and older um uh were either self-taught or they they started um programming because uh you know a parent had a computer at home. Um but I think the programmers that are younger than us, more and more of them had exposure at a younger and younger age um uh in some form of more structured you know education. And I I wonder whether that's gonna you know how that will change um the field.
BryceAnd I wonder, I think that might even be more impactful than you know, the the the pandemic experience, although obviously the pandemic experience is pretty impactful for everybody. Yeah, I don't know. What what do you think, Connor?
ConorSo the question is how is like the relative truthiness of society gonna impact like software engineers? I mean, I don't know. I'm not really like a philosopher. I think that the polarized society that we live like, you know, there's sort of articles that'll come out and say that like we're missing the fact that like we live in the best sort of time in history. Like if you look at crime rates and you look at you know education and et cetera, just in general, like quality of life metrics that are measured by the WHO and NIH or I don't know, whatever the organizations are, that in general we've been on an uptrend in terms of like the average quality of living across the globe.
ConorBut due to whatever social networks, you know, Twitter, Facebook, etc., and the polarization of politics and whatnot, it sometimes doesn't seem like that. And I guess I just like I am very lucky and I think privileged that I grew up in a country and in a family that like taught critical thinking, and that at a certain like my dad was a journalist, and you know, we learned at some point that like whenever you consume anything, you need to know who wrote it, you know, what it was funded by.
ConorAnd uh these days, like I think that's super important that you know when you read something or consume something, it's it's good to know. Like, you know, it starts off like in you know in history that like when was it written? That seems like a super trivial thing, but a lot of times you don't do people look at the C article? Was it written in 2003 or was it written in you know 2018? That's gonna heavily influence the best practices that you're you're reading. And anyways, I just I don't think I have anything really important to say. It's just that like I I hope that you know across the globe we teach youth and just everyone to not do your own research or find your own facts, but just like know where stuff is coming from and like what the agenda is behind it, because these days, whether it's BuzzFeed and just trying to suck you in to read as you know, many top top ten things, or you know, you won't believe what happened next, and just know that like the goal of that website is just to keep you keep your eyes glued to the page page as long as possible, is just like know the context and think critically about that stuff.
ConorI will say, in general, I do think everyone should be trying to be more welcoming. We should be trying to build communities and spaces where everyone feels welcome. Like if you don't understand where someone's coming from, you don't need to understand. You just need to want to be a decent person and like build a space where no matter how someone identifies or you know what the background is that everyone feels welcome, and I don't know. I think that's that's something that gets lost in the the politics war.
Andrei AlexandrescuUh yeah, exactly. So this kind of community building and and stuff goes against the whole polarization tendency that uh that we've been having as of late. So I'm just you know, I'm I'm just a bit um preoccupied about this uh this matter, you know, um and the whole like critical thinking, which is essential nowadays, but uh now it's it's it became bastardized by you know the the whole do your research kind of thing is like yeah you can find anything on the internet if you you know anything you want on the internet, uh support for anything you're you may maybe thinking of.
Andrei AlexandrescuSo the whole do your research is is uh is uh you know is a clever um twist on actually know the source of uh of your information. And you know, it's it's kind of a bummer that uh things like that are happening. And you know, I'm I'm just a bit worried that um uh programming, which is this uh absolutely the ultimate um deterministic, you know, the ultimate deterministic um métier, uh job to have and kind of attitude to have.
Andrei AlexandrescuUh I wonder how somebody who's growing up in this environment would be inclined to do uh to take uh take on programming. I hope I hope of course uh there's gonna be a uh there's gonna be a the taunt of the current situation, but uh right now I'm I'm I'm just a bit worried that um uh the political climate is uh really unfavorable to learning programs, just to put it like in a in a in a kind of uh direct way, something that is uh rather subtle.
BryceThat's fascinating. I would have never never thought of that. But you know, I think you may not be you may you may be right. Um you know, it it and I and I think potentially potentially not just not just programming, but also you know, just the you know STEM fields in general.
Andrei AlexandrescuExactly. Anything anything that's uh kind of hard science. For example, like uh I I remember there's this article there's a no there's a percentage in the in uh in an article that was kind of a bad number. I forgot, it was um 17, I forgot it was a number that was like a year, like the year of I forgot, it was a bad year, and it appeared as a percent, uh you know, 17 point something, and it became a year that slavery, something bad happened that year.
Andrei AlexandrescuI forgot the details, but essentially they had to they sent an excuse saying, Oh, we're sorry the percentage came to be this offensive number. A number should not be offensive, folks. A number is a number, and that's the the end of it. Like, yeah, maybe it's a coincidence, but you shouldn't apologize for well, we kind of divided like uh the how many whatever by how many whatever and it came to this percentage number, and uh, oh we're so sorry, it came to a bad number. There shouldn't be bad numbers and that kind of stuff. There should we shouldn't ban numbers.
Andrei AlexandrescuSo, anyway. So uh what else is up, Connor?
BryceWell, well, well but say so I I got one more thing on the on the on on that last topic. So so you know it I think it is true that that that programming is one of the more deterministic fields, but amusingly, in my experience, computer science research and especially sort of HPC academia um tends to lack the um the rigor in in treat dealing with data and statistics that other fields um have.
BryceLike if you go if you go if you go read a lot of.
Andrei AlexandrescuRight, I swear you never you never read an article on medicine then, because medicine like terrible at statistics, they just don't do statistics well at all.
BryceBut but at least they have like they report like sample sizes, right? Like I've read so many CS papers where there's like a performance graph and there's like no indication of like the sample sizes or like no discussion of of uh you know the statistical treatment of the data at all, and it just drives me crazy whenever whenever I see bench.
Andrei AlexandrescuI agree. I agree. Some some some stats are bad. But again, I gotta say, there are there are fields that also like uh in finance, the math is sometimes like really like real bad.
BryceMaybe this is like a grass the grass is always greener thing where like we think it's bad here, but it's actually just bad everywhere.
Andrei AlexandrescuYep, yep, it may as well.
BryceYeah. Alright, so cut so Connor, I thought, I thought you wanted to get some some some some stories. Yeah, you want to drive this somewhere.
Andrei AlexandrescuYeah.
ConorWhat are the odds that we could get uh podcast panel with Eric, you, uh Walter, and Bartaj? And just like we wouldn't even we wouldn't even, I mean, we'd introduce I don't even know. Will we introduce? I think we would just sit there and be like, go.
Andrei AlexandrescuYeah, actually, panels are like uh yeah, that they're fun, and um you'll never get out of things to say, like people just you know, it's gonna talk forever. Whenever I've been in a panel, we started with the notion that oh, what are we gonna say for one hour in this panel? And it ended like, oh guys, it's like two hours now, so we should go. So it always was like that. So a panel would be fun. So I you know, just to uh mention a bit of uh what Eric uh you know was reminiscing about it was um we had like some um uh infamous uh in Bryce's words, uh meetings um at uh a coffee shop in Kirkland, which uh has since um closed.
Andrei AlexandrescuUh and it was um essentially it was we were with meet, we talk shop, and um we would design the deep programming language. That was that was it. And it these meetings would last for literally like 10 hours. We were like uh again infamous among the folks at the that coffee shop because we we had this table, we'd always go at the same table and we'd always like uh talk loudly and everything and whatnot. We'd be very enthusiastic about things, and probably you know, the folks at the coffee shop would you know would be happy with the sales or whatever because we would drink coffee non-stop and occasionally eat there and stuff.
Andrei AlexandrescuUh but um during those meetings, a lot of the D-language uh has been designed, and um, you know, a lot of uh features that um I think are very interesting were uh were designed in those uh during those uh those outings.
BryceYou would have you would have 10-hour meetings at this call, like on weekdays, on weekends.
ConorWho are at these 10-hour meetings?
Andrei AlexandrescuIt was uh Saturdays and or Sundays, every weekend for months. Wow. Yeah, yeah. So who was this? Uh Walter, Bartosz, Eric, myself, Brad Roberts, and occasionally, yeah, and uh there's um uh David Held, um, I think he's uh with Expedia now. So uh it was a motley crew and uh a nice gang, and uh we'd had a lot of fun. And sometimes the meetings would go through like we'd we'd eat dinner, so you know we'd meet in the morning for coffee, and it goes and goes and goes, it's like oh it's dinner time, we should eat now, so we'd go have dinner.
Andrei AlexandrescuSo um I remember a lot of um a lot of uh the modern features were designed and improved, and you know, notably things like the you know the constant system, uh which is uh interesting because it's transitive. So in C, when you say const uh on a pointer, it's const applies to the pointer, but not to the data that the pointer points to. So it's not it doesn't go all the way, right? So in uh indeed, it's actually a rabbit hole. So if you if you put const on something, it goes all the way through by following pointers and pointers to pointers and pointers to pointers to pointers, etc.
Andrei AlexandrescuSo it's uh it's really uh kind of um a transitive, right? So there are interesting consequences to that and that kind of stuff. And uh that feature was designed during those meetings. Uh we would uh uh it took it took us a while. Uh the downside was that there was little formalization, so there's like little record, there's no records of those meetings having occurred. Then there's like uh there's a lot of um you know design by excitement, if you wish, uh as opposed to a rigorous process.
ConorDamn. What a percentage of the time was it was it always D design, or would where sometimes was Bartaj given a little you know category theory?
Andrei AlexandrescuUh Bartash would always try to sneak in some category theory. Always, but I learned nothing, so I I can't speak to that. Maybe Bartash could maybe his perception is that he always talked about that, but my perception is he always tried to talk about that without much uh success. But you know, the clearly the vast majority was uh was the on the design of the D language. That was definitely uh the lion's share of uh of the time.
ConorInteresting. So that's because that's the thing, is I don't think Eric ever mentioned not or mentioned obviously the D language came up, but he never said that you know he w helped design parts or oh he did.
Andrei AlexandrescuHe did, but you know, maybe his perception is different because like that elephant, right? So there's these discussions by this table, and you would discuss shop, and you maybe you discuss things like you know, how do you do templates or how do you you know how do you do generate code and how do you do this or how do you do that? And to him, maybe he was uh thinking of uh talking shop in general, speaking of generalities, or maybe speaking of how C does it, but to Walter it was, oh, I'm gonna, you know, I'm gonna um take this experience into the D language. So for for Walter, clearly it was about the D language, for Eric it was about more general things, for Bartosz was about category theory, you know, and that kind of stuff.
BryceDo you remember Andre giving I think a keynote at or a talk at C now about ranges and D?
Andrei AlexandrescuYeah, was that the uh infamous uh iterators must go?
BryceYeah, yeah.
Andrei AlexandrescuYeah, that that that should have been it. 2009, I think.
BryceSo wait, which is it? It wouldn't have been 2009. It would have been.
ConorI think you're thinking of Ali.
BryceNo, no, no, it was an Andre talk. It was an Andre talk, I think. Yeah.
Andrei AlexandrescuWell, it it does like this um uh this talk of that uh had the title Iterators Must Go, which discussed ranges versus iterators and made the argument that ranges have uh have the advantages. Um and you know I I as I mentioned in the Nvidia meeting, uh this was clickbait. I mean it was uh I used clickbait before it was cool, right? So iterators must go, it was a bit of an exaggeration, so clearly, you know, there's a lot of good about iterators. Um, but the talk was mainly about what if you used a range and not the iterator as the lowest level abstraction possible.
Andrei AlexandrescuSo you had the range, assume you have like ranges in C, but you never want to use iterators. And how far can you go? It turns out you can go as far as you want. So that that was the gist of the talk. It turns out ranges are enough for uh expressive uh if expressive and wise wise to uh to design a large template library. That should be the talk you're referring to, Bryce, right?
BryceI'm not sure. I'll have to find it and we'll talk about it the next time. But maybe it wasn't you. I thought it was you, but that was like 10 years ago. So who knows? Who knows how well I remember things.
ConorYeah, there's a bunch of uh I don't actually remember all the talks because I've I mean all the names of the talks because I've seen so many of them. Um did you I can't remember if you gave a talk by the same name of your hypothetical book, which I'm not actually sure if it was a joke or yeah, yeah, fastware. Um is that actually is that a book that's ever gonna It's not a book, and you know you know why?
Andrei AlexandrescuI'll tell you exactly why. Because I figured there's in in this day and age, there should be no fastware without some parallel programming CUDA style. There cannot be. You can't you can't say I'm gonna do fastware on the CPU. Now, you know, I you know, you two know why, but I'm gonna explain it for the for the sake of uh your listeners. Uh nowadays, if you look at any computer, even the laptop I'm facing right now, or you know, desktop computer, even a phone, the vast majority of the computing power is not in the CPU.
Andrei AlexandrescuIt's not in there, it's like it's 10% of the power is there. How can I write a book about 10% of the power? Right? And claim that's fastware, that's what you need to, you know, it's gotta be so, in a way, the uh the third reason and the most um uh the most dark of all reasons I joined the Nvidia for was to learn CUDA and parallel programming and how to use the GPU for computing and then to kind of have enough uh understanding and material for writing fastware the way the way it should be written.
Andrei AlexandrescuAnd Bryce, I'm not sure if you even remember in 2019. I you and I met in the hallways at CPPCon, and I discussed fastware with you as a possible co-author, and you know that's still something that is uh could be in the books. I mean, it's uh it would be great to work together on this this stuff. So um uh fast for is I have I have ideas for 10% of fastware because that's that's how important the CPU is.
BryceThis book's gonna be like your your life. You you you literally you took a job to learn for this book.
Andrei AlexandrescuThat I'm not kidding, and this is actually not an exaggeration. So definitely fast for it needs to be written. A book on how to write fast software because we're getting to the point where you know the molecules are not gonna get smaller, yeah. You know, the those crystals in the silicon are not getting smaller, the light is not getting faster, and we gotta make do with what the hell we have, and that's what we have. And we need to solve all of all of those good problems that we discussed in the beginning, the self-driving and the climate and all that good stuff, we should solve with the the means we have.
Andrei AlexandrescuGo ahead, Bryce.
BryceWell, what one of the reasons why I like the title fastware is because um Connor and I got into got into this discussion on uh earlier episodes of the podcast about speed versus efficiency. And you know, fast really sort of fast is vague enough that it it it captures what you want. Like it meets it meets its its requirements in terms of performance. Uh and the uh the weird, you know, the weird unintuitive thing about parallel programming is that what is efficient is not often uh uh the fastest thing to do.
Andrei AlexandrescuYeah, well why don't you give can you give a simple example for listeners? Because I think this uh this is uh uh exactly as you said, it's not intuitive, it's not an intuitive topic.
BryceUm for for a lot of algorithms, uh it is like the way that you paralyze the algorithm might re repli might do more work than it needs to. Yeah, um but that's necessary to allow it to be parallelized. Um like the uh um a lot of the parallel versions of scan algorithms um are like inefficient. They they do more evaluations than the serial versions do. But it doesn't it doesn't matter if it's if it's the difference between happening in parallel versus happening in serial.
BryceUm but yeah, exactly.
Andrei AlexandrescuSo I I think I think that's a very uh very important point. Um for example, like in first approximation, um faster is going to be more power efficient because you complete the the work faster. But uh there's uh for example, like the simplest example that somebody without uh Kuda experience could uh could master is like there's um speculation in a traditional CPU, right? There's speculation, and uh if you do a lot of speculation, it doesn't turn out to be what you wanted, you'd throw it, you throw the results away, but you do more computation, right?
Andrei AlexandrescuUh but what you're saying is actually the whole algorithm is redesigned in a way that uh does more work, but that work is to set up more parallelism and you still finish faster, but you do you do consume a bit more power.
BryceYeah.
Andrei AlexandrescuSo yeah, so uh these this I'm I'm glad we got to this uh this point.
BryceWell, it's I I think most computing tends to fall into like one of two different end goals. Um, either one you're trying to do something in the most power efficient way possible, or two, you're trying to get um uh an answer as quickly as possible. You know, minimize your time.
Andrei AlexandrescuYou gotta break to not go over the pedestrian.
BryceYes, yes. Yes, land the plane.
Andrei AlexandrescuYes, land the airplane.
ConorThanks for listening. We hope you enjoyed and have a great day.
In this episode, Conor and Bryce chat with Zach Laine about C++26 Reflection vs CRTP, AI, kids & more. Link to Episode 313 on Website Discuss this episode, leave a comment, or ask a question (on GitHub) Socials ADSP:...
In this episode, Conor and Bryce chat with Zach Laine about the C++26 contracts fiasco. Link to Episode 312 on Website Discuss this episode, leave a comment, or ask a question (on GitHub) Socials ADSP: The Podcast:...
In this episode, Conor and Bryce talk with Zach Laine about his career and the career changes he has made. Link to Episode 311 on Website Discuss this episode, leave a comment, or ask a question (on GitHub) Socials...
In this episode, Conor and Bryce talk about Bryce's next chapter and where he is leaving NVIDIA for. Link to Episode 310 on Website Discuss this episode, leave a comment, or ask a question (on GitHub) Socials ADSP: The...
In this episode, Conor and Ben chat with Jason Turner about default construction in C++. Link to Episode 309 on Website Discuss this episode, leave a comment, or ask a question (on GitHub) Socials ADSP: The Podcast:...