Send us Fan Mail Data Centre News & GPUs - Episode 2 Andy Davis and Ben Baldieri are back with the second episode of Data Centre News & GPUs, breaking down the biggest stories from the past month. In this episode, they discuss: NVIDIA GTC - What were the key takeaways? Microsoft - Separating fact from fiction in the latest rumors New data centre developments - The most important announcements Data centre events - Why are they bigger than ever? Predictions - What happens next?! …and much more. Tune in for expert analysis and insights on the latest trends shaping the world of data centres, AI, and GPUs. If you want to donate to Stephen Beard and Si Lau you can do so here - Fundraiser for Alexandra Robson by Stephen Beard: 7 Emirates Run 4 Autism: Stephen & Si's 640km ultra-marathon Support the show The Inside Data Centre Podcast is recorded in partnership with DataX Connect, a specialist data centre recruitment company based in the UK. They operate on a global scale to place passionate individuals at the heart of leading data centre companies. To learn more about Andy Davis and the rest of the DataX team, click here: DataX Connect
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
Transcript
From the show. Tap a time to play from there.
SPEAKER_00Next, it's the installed data center podcast. It is your host, Andy David.
SPEAKER_02Welcome to the Inside Data Center Podcast. We are back again, joined by Ben Vallieri for the second edition of Data Center News and GPUs. Afternoon, Ben. Good afternoon, Andy. Yeah, we've uh it's been a little while since the last one, isn't it? What's happened in the past couple of months? Exactly. I know. We said we do one a month. We're on about one every six weeks at the moment, which is uh make making it difficult to catch up with the news, but there you go. But you know, you've been out at um GTC and obviously we've been busy travelling around. So but still, good to get it in.
SPEAKER_02We're still stuck with the name, Data Center News and GPUs. Haven't had any suggestions for better ones, so that's what we're uh what we're going with now. We're gonna give you another whistle stop run through of some of the biggest news or the most traction news that we've had, um whether it's GPU or or data center related. So now we've started this, Ben. Do you want to start? Ben's fresh off a plane from the US, so there you go.
SPEAKER_01Yeah, the uh the joys of a Heathrow fire. Um I think the the biggest one has got to be GTC, um, to be honest. The GTC was super interesting. Um, I was out there for the week. The keynote, I mean, aside from feeling like we're in a bit of a cult, to be honest, because when you're queuing at half past seven in the morning for a 20,000-person stadium and you're a long way at the back of the queue, and then it's sold out and people are being turned away to see a tech CEO speak. I mean, it's it's a little bit culty, but on the other hand, super, super interesting based on the content.
SPEAKER_01And two things really stood out to me from it. One being there was no mention of training anywhere in the keynote, no mention of model training at all. Um, the focus was almost entirely on inference, um, and this arbitrary measure that Jensen seems to have introduced for the AI factory concept, which is tokens per second per megawatt, which I think is quite an interesting um nod as to where NVIDIA seems to be trying to guide the market, um, which from where I'm sat and from the massive amount of financial modelling work that have done over the course of the past six months, months or so, makes perfect sense because training, you're constrained really, in terms of how much revenue you can make.
SPEAKER_01It's a race to the bottom. Someone is always going to be able to undercut you on GPU per hour charges, but inference, where you've got the Xerox model, where it's copies basically, you deploy the infrastructure, you get your customers to come in, um, and their charges are coming out of OpEx, the cash flow profiles are fundamentally different. So, from a hardware owner standpoint, really interesting that that's where things are going. From a business standpoint as well, and then actually creating enterprise value with all of this wonderful training that has been done and these models that are now reaching these lofty heights by various benchmarks.
SPEAKER_01Inference is where the value is going to be created. Now, what that value creation looks like, I think that's still the question that needs to be asked. But it seems like that's where the industry is going to be going probably pretty quickly over the course of the past over the past next 12 months or so. Um, which, as you know, how this industry moves, right? It's like dog years, 12 months is going to be seven years. Um, so we'll see where we end up.
SPEAKER_02Yeah, yeah. I watched the Jensen keynote. Obviously, I wasn't, I wasn't there, I wasn't in the queue, but yeah, he he kept talking about it being an inflection point, didn't he, for AI and trillion dollar data center industry, et cetera, et cetera. And then since then you've seen quite a lot of shifts in um the hyperscalers kind of strategy, I guess, is for want of putting it a better way. So there's definitely a a period of um thought going on at the moment as to what's next, what do we do next? You know, what I think someone said the other day, you don't want to build a data center that is totally useless because that's kind of where they're getting to now.
SPEAKER_02So I think inflection point is a good way to look at it. And like you say, moving away from training and moving into the actual can we make money out of AI, I suppose, is is where most people are looking at it now. Like, where's the money? Where's the cash? Where's the return of investment? Because it's a big investment.
SPEAKER_01Yeah, absolutely. And I think that Deep Seek has been really interesting in that regard. Um, because obviously the market reaction was everything's fallen apart, um, that's it, it's the end of days. And then from what was said in the keynote, because Deep Seek and the reasoning models that have proliferated off the back of it due to the fact that DeepSeek open source an awful lot of their work, reasoning models chew through a huge amount of tokens, um, which again, from a hardware owner's perspective, is super interesting.
SPEAKER_01Um, I think the statistic that Jensen used was it requires like a hundred times more compute than expected, um, which is great from both the data center standpoint and also from a compute deployment standpoint, because we're gonna need a hell of a lot more capacity. But again, that then feeds into it's all well and good needing the capacity, but what is that capacity going to be used for? So I think use cases um are gonna be the uh the most important thing going forward, especially the second part of the keynote. Um if you are having to deploy 600 kilowatt racks or above, right?
SPEAKER_01Which from a data center standpoint sounds like a bit of a headache. Um, I'm sure I'm sure you'll have some perspective there.
SPEAKER_02Yeah, I think it's crazy. The the rack side of it, from a non-technical, it's just crazy where it's going and where it can get to. And I think it's one of the biggest challenges, it's what density, where does it end? You know, what is the density we're we're building for? And I think that is why we've seen a lot of this, as I say, like fluctuation in the markets and a bit of uncertainty. And you can totally understand why if you're investing tens and tens of billions of dollars into this industry in a period of such uncertainty, it's it is a big gamble. And at some point, the money behind it does have to say, hang on a minute, like you know, are we doing the right thing here?
SPEAKER_02They might pause and go again, but they need to re-evaluate and ensure they're doing the right thing. And you you've kind of got to re-evaluate every every couple of weeks at the moment, and that's again that that is a challenge. And you know, NVIDIA are one of others as well, aren't they? So there's there's all this research going on into the background, and yeah, it's a it's a crazy time. And I I liked the bit on the the humanoid, the the robots as well. Like, you know, that was cool. And I think when you start talking about data and capacity and demands in that in that area, you you're in another world.
SPEAKER_02And I think, yeah, I know that's not here now, but that's coming. And every year he does a keynote as a better robot. So I don't think it'll be long until those uh those robots are walking among us. And if they're not already, you know, who knows? They may be already.
SPEAKER_01Yeah, exactly. I mean, I think the other interesting piece there to that point too. One robotics is the the I mean, no one knows what that's going to look like. But I mean, if you've spent enough time reading sci-fi, you've got probably got a pretty good understanding of what's going on.
SPEAKER_02Didn't he say it'll be yeah, didn't he say it'll be the biggest industry ever? Something along those lines.
SPEAKER_01Yeah, right. Like everything that is everything that moves could be potentially automated, and everything that moves could therefore, by extension, potentially require some sort of thinking per se, right? Which means that it might be a model, it might be whatever the next iteration of AI is, and that's probably going to need some compute of some sort. Um, I think the other interesting thing though was that there was no real mention of the hyperscalers in like a partnership context, right? Because if you look back at previous keynotes, there was generally a nod towards like partnerships with Meta or partnership with AWS or Azure or something along those lines.
SPEAKER_01But those guys are making their own chips now, right? That's eating into NVIDIA's market share. Um Lepton AI was a purchase that NVIDIA is apparently considering that cropped up recently, and Lepton offers GPUs per hour, right? Which is kind of cloud service. So wouldn't be surprised based on what was not said and the relative degree of complexity that is going to be, I mean, that is required to deploy a 600 kilowatt rack, right?
SPEAKER_01But wouldn't be surprised if we start seeing NVIDIA going a little bit more into the cloud side as well. Because I mean it makes sense, right? If your competitors are building chips, why not compete with them at their game too?
SPEAKER_02Yeah, exactly. It is a it is a battle for for business at the end of the day, I think. You have to remember that. And it's similar on the on my side, the biggest news was was the TD Cowan and Microsoft's news of cancelling leases, which ties in again with the moving away from partnerships because it was all linked to the allegedly it was linked to the Open AI partnership, which now we believe OpenAI are going to look to build, develop their own infrastructure, which again makes sense. You know, if you want to own the infrastructure, it's probably the right way to do it. Whether that's true or not, we'll have to we'll have to wait and see.
SPEAKER_02But yeah, Microsoft cancelling um a number of leases. I think this last week it was two gigawatt across the US and Europe. Previously, we saw projects start re-evaluation of strategy, and we know there's a strategy review happening here, but again, it ties into that. What is the strategy? And I don't mean with Microsoft, I mean generally, like what do we do going forward here? How how do we capitalise on this? Are we moving away from training? You know, are these data centers being built for the right purposes?
SPEAKER_02Are they in the right places for for what they require? I'm sure there's a big review going on somewhere with a lot a lot more intelligent people than myself looking into it and trying to work out where best to spend this capex. I never see it as a as an industry challenge, I just see it as a another re-evaluation point where everyone's kind of like, oh no, you know, but what do we do? We've just announced$100 billion of CapEx for 2025. Are we spending$100 billion in the right place? And I think we will see that probably across this year.
SPEAKER_02I think we'll continue to see it with um some of the other hyperscalers as well. Won't just be uh Microsoft that are that are reviewing where and when to spend.
SPEAKER_01Oh yeah, definitely. And I I think to the um the Microsoft point with OpenAI, um OpenAI have also just um announced a partnership with or a very large deal with Courtweave, right? Who've also just very recently gone public too. And I think that amounted to like$12 billion or something, which is absolutely astronomical. Um that is kind of from my perspective and from what I'm seeing with other people, contingent on OpenAI being able to successfully close their next funding round, which apparently they're very close to doing with SoftBank it being like a 40 billion round or something absurd like that.
SPEAKER_01But then that's also contingent on OpenAI being able to transition to a fully full profit model as well, right? And whether or not they're going to be able to do that from a legal challenge standpoint kind of remains to be seen. Um, and then also the two gigawatts of cancellations I've read this morning that while Microsoft has pulled back on those, apparently those same sites were scooped up by Meta and Google very, very quickly. So I think this kind of taps into what we were speaking about in the the first one that we did of all of those six weeks ago, right?
SPEAKER_01In that I think there's a little bit of brinkmanship going on, in that I think things probably started a little bit before people really wanted them to, but you can't not do it in case your competitors have something that you want, right? It's better to have something and give it up and pay a little bit of money for it, right? As opposed to need something that you can't get because your competition's already got hold of it.
SPEAKER_02Yeah, totally, definitely seeing it. And yeah, I've had I've had similar as well, which again is why I don't ever see the I I I laugh when I post uh these kind of announcements because you get the panic stations from the from everybody. You know, don't read too much into it, is what I always say to people, you know, like do your research, understand the market, talk to people, and you can actually gauge what is actually really happening. You'll never see what's really happening in the public, but you know, pick the phone up, have conversations, and you'll and you'll quickly you'll quickly see what's out there.
SPEAKER_01Ask people questions and they tend to tell you the answers, right?
SPEAKER_02That's it. Especially in this industry. Can't you can't tell anyone anything, but you can tell anyone everything. It's uh look at it. Um I also I quickly scanned through some of the projects that broke as well in uh in the last few weeks. And again, you know, when you look at investment, you're continuing to see this wave of hundred-acre sites, multi-billion dollar investments, new funds raising. It's still happening regularly, regularly. So um we had a£1 billion data center and technology part in Anglesey and Wales, which I think I raised a lot of eyebrows with regards to who's the customer for that one.
SPEAKER_02You know, it's a it's an interesting location. UAE obviously continued to invest significantly, 30 to 50 billion euro AI data center in France, big, big range there. Um Stone Shield, 500 megawatt in in Spain, Azora, 2 billion development in Zaragoza against Spain, Evrock, 96 megawatt in France. QTS obviously got approval for the big site in the north northeast of England, uh, which is approximately 10 billion dollar investment. And it goes on and on.
SPEAKER_02So I think you're continuing to see the scale of investments. Um, one thing I'm also starting to see now, and or have more conversations with, is actually in the um whether you call it edge or colo or metro edge, whatever you want to call it, but there's certainly a lot of investment now starting to look back at the smaller edge data centers, so five to twenty megawatt city-based. I think an area that's been forgotten because you're seeing all these big numbers, but actually is a massive, massive market.
SPEAKER_02And I think somebody, some company at some point will take huge advantage of that and you'll see um you'll see somebody do very well out of it while everyone else has got their eyes on the half a gigawatt sites wherever they may be.
SPEAKER_01Yeah, right. And also like the the absurdity of calling a five to twenty megawatt data center small is kind of funny as well, right?
SPEAKER_02I I don't even know what edge is anymore. Like I know I used to I remember recording podcasts like three years ago, and I'd ask anyone that said they were at edge what edge means to them, and you've got a different definition every single time. And I'm still at that point. I don't know what small is, I don't know what edge is, I don't even know what big is anymore. It's like what what actually how do we scale any of this? It's it's like when people say, What does hyperscale mean? Hyperscale is a definition, means like continuing to grow or something along those lines. But but actually, we don't ever have any sort of market for these words that we use all the time.
SPEAKER_02It's just but there you go, yeah. The smaller data centers than the bigger ones, there's definitely a huge uh a huge market for that as you start to join the dots of these major campuses across whatever countries they're in and continents as well.
SPEAKER_01Yeah, yeah, and I I think also like the France is an interesting, very, very interesting area at the moment, also from a neo-cloud GPU as a service standpoint. Um, one other announcement um to add to your list as well. E and I, G42, um, one gigawatt in Italy as well. So that I mean the fact that it's like, right, we're gonna have a gigawatt here, we're gonna have a gigawatt there, as opposed to an 100 megawatt or a 200 megawatt, I think that's probably a pretty good indication of the direction of travel. But I think France is interesting in that regard specifically, because you've got the the G42 and the AMD deal with Data One, I think it was.
SPEAKER_01Yeah, they are um, which is massive in and of itself. But then at the same time, same week, this is off the back of the um the AI summit in Paris, Fluid Stack announcing a massive, massive partnership with um Mistral to develop a huge amount of infrastructure in France as well. Same with Cesurs as well, another gigawatt facility. Um and then ENI, not ENI, sorry, EDF, opening up, I think, two gigawatts of land parcels uh close to various nuclear power generation facilities around the country as well.
SPEAKER_01Um France is interesting because if you look at the the energy mix of France relative to every single other European country, aside from the Nordics, they're really the only ones who can support the kinds of developments at the speed that they need to happen right now. Why is that? They've got a huge amount of nuclear power generation capacity. Um, and I think we'll probably see increasing discussion around the need to develop more of that fast in non-traditional markets for nuclear, to be honest, because I mean France has shown that it can work, right?
SPEAKER_01They wouldn't be getting these deals if it wasn't viable. Um, I wouldn't be surprised if we see some projects rushed through well, relatively speaking, rushed for nuclear. So we're probably still, what, five, ten years out, to be honest. But I think that's where things are gonna go.
SPEAKER_02Yeah, telly house ended last week as well. I think a billion euro investment in France, include and it I think it was a uh 90, I might be wrong on this, but around 96 megawatt in Marseille was part of that. So yeah, exactly. One of the smaller edge facilities in Marseille. But Marseille's an interesting again, France is interesting. Marseille, a lot of development coming up there. Um, it's uh you know, connected very well. Obviously, Paris is a big, big challenge for a number of reasons. A talent is one of the worst places to to recruit for.
SPEAKER_02Um, I can vouch for that with with definite certainty. Um, we always try our best, but it's difficult. Um, but yeah, southern France, yeah, good, good areas, a lot of a lot of development. The other um campus or development that I find quite interesting is old Kevin O'Leary's Wonder Valley in Alberta in Canada. I don't know if anyone's seen the video. It reminds me of a Centre Parks video. Um, every time I watch it, I I see the deers running around in the background. I think it's it's like me back at Centre Parks, similar price to a week in centre parks as well, 70 billion dollars to anyone, anyone that's ever been in the UK.
SPEAKER_02But it's an interesting development. I think he um I think there was a video probably a few weeks ago of him needs to raise the first 10 billion or something for that development. But he's um interesting character, he's quite um you know, like for those that that don't know who he is, he's he's kind of similar to Dragon's Den type type character, um, very public, big investor. Um, whether it'll happen or not, I think is uh is up for debate, but it's it's worth a look. Wonder Valley, it's cool. If anyone hasn't seen it, yeah, go and go and watch the video. And if you've been centre parts, you'll know exactly what I mean.
SPEAKER_02But if he does do it, I'm definitely going because it's uh it looks cool.
SPEAKER_01Oh, yeah, it looks super interesting. And what's the total power capacities for seven and a half gigs? I was gonna say what's stuck in my head. Yeah, seven gigs in my ridiculous. Um, but then like to that point, it's in Canada, right? And they're gonna be targeting US customers, and that's potentially a difficult proposition right now, given uh the ongoing geopolitical struggles, I think would be the uh the most delicate way to put uh a description of the relationship between the US and Canada right now.
SPEAKER_01Um I think it's super interesting. I think Canada's a really, really interesting proposition at the moment because of the amount of power and the amount of energy that they have available. Um it's just if things kind of carry on as they are, who's the off take? Because that's a hyperscale facility. That has to be a hyperscale facility. Um, but all of the hyperscalers are American. How do you square that circle, right?
SPEAKER_02Exactly. And you are seeing you know, geopolitical uh is coming into strategy now, 100% um definitely seeing it. Another point I thought of while you were talking is actually, which again, you'll be quite aligned, haven't written it down, but the move away from the likes of Crusoe and Applied and that moving away from the Bitcoin into the into AI infrastructure. I think you've seen um obviously it's been happening for a while. You know, I've been working with funds that have been doing this for a good few years, but um you've seen a few more public announcements now of we are no longer, you know, in the Bitcoin world, we are now an AI infrastructure developer.
SPEAKER_02So that's quite an interesting shift as you start to, especially with the AI, and if we are moving away from learning, etc., where does all that fit in? Because a lot of these are huge scale facilities, but in fairly remote locations. So it's going to be interesting to see where that market goes. But in the US, you're seeing it now. There's a very, very clear shift from we're a bit above to we're definitely sitting on the AI side of the fence now.
SPEAKER_01Yeah, and I mean, I think that it's an interesting move that makes sense, really, because if you look at what Bitcoin mining is, it's massive amounts of compute deployment incredibly quickly. Pretty good experience if you're looking at what's going on in the AI space now, what's required. Those facilities tend to have massive power capacity available. Um depending on where the where the mining is taking place, that does tend to influence how socially, geopolitically, morally, whatever you want to call it acceptable Bitcoin mining is seen to be.
SPEAKER_01Um, I think that perceptions will change because there's some really interesting work going on in the Bitcoin mining space around deployment in support of. Renewable energy, for example, like microgrids, for example, and Daniel Batten of C4 Capital does some really, really interesting work in that space. Um, but I think the shift away from Bitcoin mining into specific AI compute, GPU compute, AI infrastructure makes sense for a couple of reasons.
SPEAKER_01One, as I said before, these companies have the experience in doing it, like um core weave, for example, core scientific. It's that's what they were doing first. Now they've gone public with Core Weav, right? Um Bitdigital has also spanned off a new entity recently, white fiber, again for the same kind of reason. And there's also probably a pretty compelling argument that the reason that's being done is from an exit multiple standpoint. If you've got any Bitcoin mining on your balance sheet, you're going to be probably capped at maybe a 5x EBITDA multiple.
SPEAKER_01If you are AI infrastructure, that's significantly higher, like 15x plus, right? So it's significantly more valuable as a business, even though it's basically just servers doing math, right? What's the fundamental difference in terms of the activity that is being done? It's not really that different. It's hardware using huge amounts of power in a big shed somewhere with a huge amount of power available to it that's going to be difficult to cool depending on how much is in there. The output is slightly different. Um, depending on who you ask, you could probably make a pretty compelling argument that Bitcoin mining is creating more value at the moment than all of the training.
SPEAKER_01Um, but I think that's probably a trend that we'll see accelerate because I mean, even if the companies don't shift into hosting and deploying the infrastructure themselves, they've got the PPAs, they've got the facilities, they've got the power available to them. And that is the one thing that AI as a whole is going to need going forward. So going back to the keynote, first thing that Jensen said, we're a power-constrained industry. It's not compute anymore, it's power availability. And if you've got 600 kilowatt racks coming in 2027, realistically, we could probably see a meg not long after that, maybe two meg, not too long after that.
SPEAKER_01That's a lot of power. Um, where's it going to come from? Who's already got access to it? The miners have got a lot of it right now in the short term.
SPEAKER_02Yeah, and I and I regularly get asked, what's the what's the current price for powered land? You know, like what is the what is the value of, let's say, or whatever the whatever the power is, but you know, powered land is is certainly going to increase in value, I would say, over the over the coming years, and they'll probably come a point where, yeah, is it better to develop it or flip it? And and I guess there'll be the conversations that the the people in those positions will have. The other thing I wanted to talk about was um just events, but data centre world London.
SPEAKER_02I don't know, did you go or not?
SPEAKER_01Yeah, we were on the stand. Um, so Pete and I, um Panchayah Limited, we were exhibiting with PMY. Um so yeah, we were there. It was uh interesting event. I just wanted slightly different. I just wonder how busy it was. That was all I like. I just couldn't believe the first day was mad. Like absolutely manic. Um it was non-stop. Like we got onto the sand shortly before nine o'clock, started talking at about half past nine, and then didn't finish talking until about half past four. So really, really solid footfall.
SPEAKER_01Um, in terms of demographics and the types of conversations that were being had, last year felt a little bit more like people were there and they were ready to deploy, right? So they were instead of tire kicking, it was more of right, we're we've got a project, we've got a pilot project, we want to understand this pilot project, maybe we want to deploy some hardware, maybe we want to continue the conversation afterwards. Um, and that was also more general, so it wasn't just AI last year. Um, there was a bit around visualization, there was a bit around render.
SPEAKER_01Um, this year, pretty much only AI, but also a little bit more hesitation around what's going on, how best to do things, um which makes sense given current market conditions and the speed with which everything is moving, but otherwise, really, really good event.
SPEAKER_02Um I was just thinking when I was there of yeah, exactly. I was just thinking when I was there of I don't know how many years I've been going to that event, and that's why I use it as a comparator because I've been going for let's say 10 years. I've no idea how many years I've been going, but every year it just gets busier and busier and busier, and I think it it's a good way to just understand what's happened to the industry, isn't it? And I don't mean how many stands are there, I just mean how many people like in general are actually there.
SPEAKER_02I'm sure the event organizers will give us stats around you know, there's more stands or more football or whatever, or more registrations, but it's just the the amount of the mass of people. I was you'd kind of walk to walk into the XL and you'd get collared 25 times within about a hundred metres of people that you know, and then you go into the event and it just gets getting more and more and more. And I think this industry is is mainstream now, isn't it? There's no there's no hiding away anymore.
SPEAKER_01Yeah, right. Yeah, it's yeah, I mean, seeing data centers being I say that as someone as if I'm like someone who understands how this industry works, right? I've been in here for about a year, to be honest. Um, but public conversation around it is something that does seem to have picked up, even in just the past 12 months, right? So I'm sure you've seen the the long tail of the growth and how we've kind of ended up in this position, but it does seem like things have really accelerated over the course of the past year. Now, coming from the crypto industry, the fact that everyone is talking about it now does make me a little bit worried because that tends to imply that there's a top signal and everything's about to fall apart.
SPEAKER_01But hey, maybe this time is different.
SPEAKER_02Yeah, exactly. You just don't know. But I do I just found it yeah, really I was a couple of colleagues there and I was just saying, you know, how how busy it is now. And we held a data center marketing club event the night before the actual thing. And even that, you know, we had I don't know how many people like just did it off the cuff, like 60 to 100 people turn up and talk about marketing. And it's just crazy now you you can get all these people in a room from just little silos within the industry all all trying to understand where we're at and what's happening because the change is so quick, and I think that's um that's what it is.
SPEAKER_02It it changes before your eyes, but you don't really see it, you don't notice it until you're at these points where you're like, I was here last year and it wasn't this busy, or I wasn't having this many conversations last year. And I I just find it find it fascinating when you go to the major events. And I know I've I know people that have been obviously I went to Kickstar this year, it was the busiest year they've ever had. I'm sure MIPIM was crazy. I didn't go, but I'm sure it was crazy. Obviously, Europe, DTC, you've got Data Center Nation in Milan, I think, this week, which I'm sure will be a busy event because Milan is off the scale with regards to investments.
SPEAKER_02You've got all the platform events that are coming up, you've got Data Cloud Can, who I know are planning for a record event. It just goes on and on and on. And then you add in the US as well. You know, I haven't been out to the US for a while, but you add in all the events out there. DCD New York was last week, spoke to a couple of people who just said it was the busiest it's ever been. So it's just um just getting busier and busier and busier. And I think it's um it's important that we we you know remain in the industry and focused on what we're doing because there is so much noise now, so much happening outside.
SPEAKER_01Yeah, yeah, massively. So and I think the increased public attention is good on the one hand, right? Because it means that people are talking about it and more people are aware of the problems, right? So power availability, for example, right? That's now a very much mainstream conversation, especially in the UK. Um, but then on the other hand, it does make it more difficult to try and keep up with what's actually going on, right? As opposed to having to filter through secondhand, third hand sources of information to try and figure out, right, what's the announcement, what was the announcement of the announcement, what act what's actually important, what isn't important, what's some really clever PR that doesn't actually mean anything.
SPEAKER_01Um, and that's difficult at the best of times. Now it's feels more challenging than it was.
SPEAKER_02Yeah, no, totally. Trying to write a weekly newsletter. Yeah, right.
SPEAKER_01What do you what do you put in it? What do you choose?
SPEAKER_02Exactly. It's very enjoyable, and you know, I'm not complaining by any stretch of um both of us talking for Ben, but I'm sure he's as amazed by the success of his as I am of mine and love the fact that it adds so much value. But yeah, it gets diff more difficult every every say few months to kind of collate all that information because there's so much noise now and news is repeated, regurgitated, you know, people will release a press release three or four times in a year, which I'm sure a lot of people don't even see, but it happens quite a lot. And I have to go back and check have I have I said this before?
SPEAKER_02Is this a deja vu moment, or or have I actually written this before? And a lot of the time you have written it before, so yeah, it's uh difficult. So if any of the PR companies out there could um plot try and keep it aligned, you know, do it do a better job, we'd be uh much appreciated.
SPEAKER_01Make our lives a little bit easier.
SPEAKER_02Yeah, exactly. Feel free to send us any press releases because it means we don't have to uh don't have to dig around for it. Yeah, legit. No, yeah, I'm definitely serious. Yeah, yeah. I'd both file email addresses to the show notes. Um the other thing I wanted to shout out was um shout out to Stephen Beard and C Lau, who are of night Frank, I don't know if everyone would have seen this, but they've just run 600 kilometres in 10 days. Seven UAU states um for autism awareness. Um Stephen's child um you know has has autism, and Steve's trying to raise a million dollars for an app to you know help parents and and children that are in a similar situation.
SPEAKER_02So I want to shout out like ridiculous achievement. I think um sometimes these things go under the radar. Um so I just wanted to give it a shout out. I'll put a GoFundMe in the show notes of this episode. So if you can support, please support. And if you can't, you know, just um give it a repost and share a bit of awareness for for what they've done because it's ridiculous to be honest. You know, I couldn't even run 600 kilometres in 10 years, they've done it in 10 days.
SPEAKER_01Yeah, I mean, ultramarathons are a different kind of experience. Um, yeah, I did see that actually. Um what an achievement, especially in that part of the world as well. Like from a weather standpoint, it's not necessarily conducive to a pleasant experience, and running that kind of distance isn't pleasant. Um, I've done what I've done before, I've done 80 kilometers or something over the course of two days, uh, and that sucked.
SPEAKER_01So 600 over the course of what, 10? Fair play, fair play to them.
SPEAKER_02Yeah, exactly. And again, like always give causes a shout-out. I know Data Centre Cycling Club have got the event coming up where they cycle to CAN every year, which I think, or I feel like they're doing it before or after this year, but you'll find the website Data Centre Cycling Club, go and have a look, six days of cycling. But there's a lot of good causes out there in the industry, a lot of great people doing great things for for causes that are outside of the industry, not related to the industry, but they're by people in the industry. So, you know, if anyone's if anyone's seeing anything or doing anything, I'll tell you what, if anyone's doing anything, come on this with me and Ben.
SPEAKER_02We'll give you, we'll give you the uh we'll give you five minutes to have a little little chat about what you're doing. So I um I'd love to give a shout out to anything like that. Anything else, Ben? I know we think we've just covered six weeks of news in the covered quite a bit, haven't we?
SPEAKER_01I think so. I think what'll be interesting, I think, to hear from your side. Obviously, for me, with things like the 600 kilowatt racks that are on the horizon with the the Rubin Ultras, right? Two things, well, two other things that stood out. One, Jensen's comments in the keynote around Hopper being dead, right? Don't buy Hopper, um, and then branding himself as the chief revenue destroyer. Um that doesn't sound like a particularly easy place to be if you've just placed a very large order for what is now effectively being termed as dead kit, that doesn't make life particularly easy.
SPEAKER_01What was the reaction that you saw from 600 kilowatts plus racks being legitimately positioned as what's coming next? Like what's the what's the reaction being from outside of the rack? Um how does one cope with it?
SPEAKER_02I think people have been talking about it for a while, not specifically obviously the 600 kilowatt announcement, but the density and the challenge that that creates. I think um the the people I always try and talk about, the CTOs of this world who are you know involved in the the technical and the design and you know the future proofing of these facilities are in a very, very difficult spot. And I think it's I would say there's there's not I didn't have any specific like calls around it going, oh you know, Andy, have you heard the things untrue?
SPEAKER_02Because I think everybody kind of knew that it's going in that direction. It's just a case of how how high and you know, where does it end, I guess, is the challenge. And ensuring that your developments and your data centers are designed for a point in the future and not for today. It's absolutely pointless designing a data center for whatever kit you have today. I think that's the biggest challenge. And and I think that's why we're seeing that, like I said earlier, that uh analysis of CapEx.
SPEAKER_02I don't think it's like we don't need capacity anymore. I think it's more what on earth do we need our facility to look like? Where do we need capacity? What you know, who is going to be the customer? I think they're all the questions they're asking. There'll be some there'll be some casualties, I would say, of data centers that have been recently launched with a certain infrastructure slash kit inside them, and how long is that actually fit for purpose?
SPEAKER_02I think that'll I'm talking reading between lines, no one said anything to me, but I think that will cause some people some problems, would be my my view. But yeah, the the density, scale, everything has been the conversation for ages. Yeah, most of the podcasts I talk to, when I talk to anybody that's technical, that's where you end up. But no one knows the answer, do they? Jensen's obviously going to say whatever he's doing is the right thing to do, right? Yeah, and I get that as well, and I think a lot of people see that. It's um that's why I said earlier, Jensen's one off some, but um, yeah, it's it's fascinating where it's going.
SPEAKER_02I I personally don't think anybody really knows. And I I I think I did a post on LinkedIn not long ago basically saying that you know anyone who gives you the answer probably doesn't know the answer. Because I I just don't think there is one. You can have assumptions and you can have direction, you can have education and guesses and viewpoints. If there's a definitive answer, we'd all be lumping our money somewhere, wouldn't we? And you've only got to look at the financial markets. If like there's a lot of uncertainty with regards to which stock's gonna go, which one's gonna win, who's gonna do best out of this.
SPEAKER_02And you know, capital normally gives you the um the greatest barometer of direction, I think. Follow the follow the money, as they say.
SPEAKER_01Yeah, except when it's deep seek, because then apparently the market gets it wrong. Right to quote Jensen, that's not me, that's not my perspective. To quote Jensen, then the market gets it wrong. And that's when you get into the geopolitical market, though, isn't it?
SPEAKER_02It's like again, we don't know. We just don't know. You have to just look at it and go make a deck, well, I'll make an educated decision myself. But I understand that politically they're gonna say something. Yeah. That's all I can say on that.
SPEAKER_01Yeah. Okay, so follow-on question then. If the the power is going in one direction, the rack density is going in one direction, occasionally you'll see like an announcement, new data center facility, 10 to 15 megawatts of power, 45,000 square foot facility, right? If you've got 600 kilowatt racks that they're rated for and they'll have probably 50% more power draw in the burn-in phase, that is 10 racks in a 45,000 square foot facility. What do you do with the rest of that space? Because that to me as an outsider who's trying to come in and understand how things are working, that just doesn't seem like the way to build things anymore.
SPEAKER_01It just doesn't seem to make sense.
SPEAKER_02No, I agreed. And again, I had a conversation with someone, a genuine conversation with someone not long ago about five-side football pictures and go-kart tracks. Right. No, and I and it wasn't, you know, it wasn't a joke. It was a genuine, like, you know, what there's gonna be so much empty space, I think, um, and obviously a limitation of power, which means you can't just say, okay, we'll just put more racks in it, because you haven't got the power to switch them on, for one of putting it in a more simple term. So I'd I I'm with you on this, and I think that is part of the challenges with where to put your money and how to build.
SPEAKER_02I think it's um you can obviously identify those sites that have significant power availability and kind of build your first phase, knowing that you've got, say, another three, four hundred meg available to you when you need it, but you might not need the building, you might just need the power. But for the legacy data centers, which is probably the ones that you're more we're more talking about, the ones that are there and they're already, you know, 100,000 square metres or whatever they might be, I don't know.
SPEAKER_02It will they reduce the size of it and offset part of the land? I I genuinely have no idea. Like, I'm serious with the five-side football pictures. I think it's uh, you know, it's a definite possibility. I think there is one somewhere with a go-kart track in it. I might have made that up. I'm pretty sure there is a data center somewhere. That's fantastic.
SPEAKER_01If there, if there isn't one, that sounds like an opportunity.
SPEAKER_02Yeah, but it I don't know. And I and it is a conversation that happens. I you know, I talk to people about, and again, like, is that I think that's a period we're in. I genuinely do. Yeah, when Jensen says an inflection point, I think the industry's at an inflection point as well. It's not just AI that's at an inflection point. It's like, what do we do? I wish I knew the answer, but yeah, again, yeah, there's there's probably someone listening that's got a better educated guess of where it'll go than I have, but I I do believe that nobody has a degree of certainty in their in their viewpoint.
SPEAKER_01Yeah, yeah, and I think like the the reduction in footprint size does kind of rest on the assumption that ultimately NVIDIA's way of doing things right now is the right way to do things, and the only way to do things right, which is more power, more rack density, um, more powerful hardware off the back of it, and with some of the emerging semiconductor manufacturers, they are showing that there is potentially a different way of doing things. Now, how much success they end up having, um, that kind of remains to be seen because with the the Kudo ecosystem, I mean NVIDIA's got a pretty compelling competitive advantage there, right?
SPEAKER_01Um, coupled with the fact that they've open sourced a load of the new software off the back of GTC2, like Dynamo, for example, for orchestrating large-scale clusters for inference workloads. But then if you look at what's also happened in the semiconductor space recently, I think the most interesting one is Furiosa AI. So if anyone's not familiar, they're a South Korean semiconductor manufacturer focused specifically on inference hardware, and they rejected, or apparently rejected, an$800 million bid from Meta to buy them out recently.
SPEAKER_01Um that's quite interesting because I mean that's backing yourself to a pretty significant degree. I think saying no to 800 mil fair play, if it was said. Um but if that's the right business decision, what do they see in the future? And their cards are interesting because they're 150 watt cards, and a server gets potentially double the token throughput for say Lava 3.1, um, than the AMD hardware, again, at a significantly lower price point, right? So for power-constrained markets or older facilities, for example, um, that's potentially an interesting solution.
SPEAKER_01Now, the emerging semiconductors, I mean, even AMD to a certain extent, they're kind of struggling to gain market share at the moment. But then when we do see larger scale adoption, I think the market's going to be very, very large, right? And there's it's a new market at the end of the day. Uh, and there's always space for new players and new solutions in new markets. And at the end, like the massive amount of floor space and the power constraints is a problem to be solved, right?
SPEAKER_01So whoever can solve that particular problem, that's potentially something quite interesting. So I think uh if you do have a 45,000 square foot facility and you're worried about only having 10 racks in that, I wouldn't worry too much. There's probably something else that we just don't know about yet that's gonna appear out of nowhere and provide you with a solution, hopefully.
SPEAKER_02Yeah, something will change the game, it always does. And yeah, gives us something to talk about anyway, doesn't it? If it wasn't for that, we wouldn't be talking now. So appreciate all this uncertainty. It gives us something to chat about. I think that's all. Um, all I was gonna say is obviously this is the second episode we're done. We are gonna do it. Try and get to once a month, hopefully. But if not, we'll stick at six weeks. We're doing our best. Um, if anyone wants to come on that's listening, and you've got if any news breaks in the next month or six weeks, depending on when we record and you want to come on and talk about it, please do.
SPEAKER_02I'm I'm I'm all up for getting some other opinions um of what's happening in the market. We'll always give you our opinion and what we're seeing. But if anybody else wants to join us, you know, please do. And like I said earlier, if anyone's doing anything um a bit different, you know, in the industry, charitable or events or whatever it might be, you know, happy to happy to give you a plug and if it if it helps raise some money for somebody, all the better. We better get on. We've got newsletters to write.
SPEAKER_01Got newsletters to write, yeah, right.
SPEAKER_02It's only Monday when we're recording it. Probably release this on Friday. So hopefully our uh our newsletters won't be far away by the time by the time you hear this. But I'll put the GoFundMe in the show notes. Um, obviously, if you need myself or Ben, we're pretty easy to find. Just come and find us. But thanks for your time. Ben, good to catch up again. Now you're back in the UK.
SPEAKER_01Likewise, Andy. Yep. One final question for you. Um, hopefully for in a month's time, predictions. Based on what you're seeing right now and where there's a little bit of interest, um, what do you reckon we might end up potentially be talking about next month?
SPEAKER_02Prediction time. Uh, you could have given me a heads up on this one. I think we're gonna see a bit more of this uncertainty with CapEx, would be my I think we might see a few more, whether it's analysts or news articles that break about projects being, let's say, delayed or re-evaluated, I would guess in April. It's April Fool's Day tomorrow. So from April, I would say my that'll be my prediction. What about you?
unknownCool.
SPEAKER_01I think more discussion around sovereign AI. I think that's going to become more of a talking point that's gonna slowly work its way into the mainstream a little bit more.
SPEAKER_02Um there you go. We'll record the next episode when both of those predictions come true. So it might be in four weeks, it might see it again in two years. But anyway, thanks for listening, everyone. We'll do it again in uh in the next month or so.
Send us Fan Mail In the third and final episode of our special series recorded live at The Xcelerated Compute Show 2026 in London, Andy Davis and co-host Rory Flashman from Spa Communications explore what the UK needs...
Send us Fan Mail In this episode of the Inside Data Centre Podcast, Andy Davis is joined by Oli Monks, Head of Talent at AVK, and Sophie Parker, Head of People Development & Talent Acquisition at Pure Data Centres...
Send us Fan Mail In this episode of the Critical Careers podcast, Lizzy McDowell is joined by Andy Davis from DataX Connect and Sarah Davenport from Capstone Recruitment for a conversation about the value gap, and why...
Send us Fan Mail In the second episode of our special series recorded live at The Xcelerated Compute Show 2026 in London, Andy Davis is once again joined by co-host Rory Flashman from Spa Communications to explore what...
Send us Fan Mail In the first episode of a new special series recorded live at The Xcelerated Compute Show 2026 at the Business Design Centre in London, Andy Davis is joined once again by co-host Rory Flashman from Spa...