0:11ChrisHello, friends, and welcome back to your weekly Linux talk show. My name is Chris.
0:15WesMy name is Wes.
0:16BrentAnd my name is Brent.
0:18ChrisHello, gentlemen. Well, coming up on the episode this week, the kernel release that deprecates our childhood has landed. There's a lot to like. There's one thing that really stings, but 7.3 is looking like such a banger. I'm not sure if I'm even going to care. We'll tell you more about that. Then, how sync things saved the day this week. Plus, we have some great boosts and picks that you're going to love. and a lot more. So before we get into all of that, let's say time-appropriate greetings to that virtual lug. Hello, my room.
0:46MumbleHey, Chris. Hello, Brent.
0:49ChrisHello, and hello up there in the quiet listening. Nice to see you up there. You guys looking good up there. Handsome as ever. Go say good morning to our friends over at Define Networking as well. Define.net slash unplugged. Go meet Manage Nebula. Decentralized VPN built on the open-source Nebula platform that we love and use. Nebula is so awesome. Oh, I'm so, so grateful for Nebula, especially as I have been having issues with other mesh networks. It really is so superior and simple in its way and in its design too, yet extremely secure.
1:20ChrisAnd I love that I have my own lighthouse, so I completely control the infrastructure. I own everything. But like friends and family, I can hook them up with Define Networking's managed Nebula. They automatically provision a lighthouse now for people, but you can also run your own. It's really great. It's a great company. It's a great product. It's open source, independently audited, and it's built with modern encryption. So go get started. Up to 100 hosts, absolutely free. No credit card required. Go to defined.net slash unplugged. Redefine your VPN experience. See why I love it. Own your infrastructure. Defined.net slash unplugged.
1:52ChrisThank you to Defined for sponsoring the Unplugged program. Well, with the release of Linux 7.2, it is the end of AppleTalk and it is the end of our sticker. We'll have to remove it from the store this week. So if you want to get your commemorate sticker, now's the time. It's like we're making a coin for AppleTalk, but it's a sticker. I'll not dwell on this. The audience knows how I feel about this.
2:17WesBut get them while you can.
2:18ChrisAlso, we wanted to make a mention of the passing of a longtime Samba contributor, Steve French. He passed away recently after dealing with an illness. He's been around forever. He's been contributing since 2002. He worked at Microsoft. He worked at IBM. He's worked in Azure. He worked on my favorite project, KSMBD. And so he had to step down for health reasons this week, and then he did pass away.
2:44WesOur condolences.
2:45ChrisYeah, really. A longtime contributor. So our thoughts are with his family. And they do have a new maintainer stepping up for CIFS. So there will be. And I guess this individual has a history with NTFS, the rewrite.
3:00WesYeah, we have Paulo Alcantara and someone we've mentioned multiple times on the show, Namjai Jian. Those folks are now co-maintaining CIFS, CIFS, which is Namjai's third file system, the NTFS rewrite, ex-fat, and now this.
3:17ChrisSo it sounds like it's in pretty good hands.
3:19WesIt does indeed.
3:20ChrisBut we did want to note, because, you know, it's part of the community. And I think it's worth observing, and our thoughts are with the family. out there, and it is good to see the project continue to get support as well.
3:30WesThis is how open source gets made.
3:32ChrisMm-hmm. Mm-hmm. All right. Well, then, let's get into Linux, speaking of the kernel, Linux 7.2. So just as we finished up the live stream, I think Linus probably got done listening to the show, clearly. And then decided to release.
3:47WesOh, better get some work done.
3:48ChrisYeah. Pushed out Linux 7.2. I don't think he wants to push it out before the show's over because he doesn't want to be distracted. I understand that.
3:54WesIt might distract us, too.
3:56ChrisAnd this was classified as a very busy kernel cycle release due to increased patch and reporting churn due to AI-assisted development. We do have a quote from Linus. You want to take it?
4:06WesWell, this last week of the release was, once again, bigger than I would have wished for. But hey, with the whole quote-unquote new normal thing, if I delayed releases for that reason, we'd probably never have a release at all. There are a number of fairly late reverts. The DRM scheduling reverts stand out, but there's a few other ones in here too. It may not be pretty, but it's the correct way to deal with, oh, that code wasn't ready and caused problems. People will be trying that again later. But while the DRM reverts stand out and are some of the bigger patches in here,
4:37Westhere's a lot of small fixes all over, mostly in drivers, but networking remained fairly active this last week, too. And then there are a few random patches to architecture files and the perf core. With this, the merge window for 7.3 obviously opens tomorrow, and I already have 40 pending pull requests. I appreciate all the timely people. You know who you are.
4:55ChrisYeah, we'll get into 7.3 here in just a moment. You know, when Linus calls out a subsystem, it's probably worth paying attention. When he calls out networking specifically, it's probably worth paying attention. So I think we'll get to that. But the thing that you and I have been watching, And, Something that I think we talked about before on the show, so we'll just give a brief mention, is there's been some real improvements to, quote-unquote, schedulers. CPU schedulers, GPU schedulers.
5:21WesThe scheduling system, all kinds of stuff.
5:23ChrisScheduling got a big work, a lot of work in 7.2. So we have a now more cache-aware CPU scheduler.
5:31WesYeah. This is a pretty big deal. And it's almost surprising in a way that we haven't had it already, right? Like, caches are a huge part of CPU and computer performance, of course. And these days, especially on systems with, like, multiple dies, right, it's not just one giant CPU, right? It's, like, multiple CPUs, each with their own last-level cache right next to them. And so understanding, like, where is a process or a thread running, and then what caches is it near, and then what data is in those caches can be a big deal.
6:02WesSo if you think about something like a database, right, maybe you're doing a query where you have a lot of working memory that is, the whole point is you want a query optimizer that can parallelize things, right? So you're not waiting on trying to seriously do stuff. So maybe you have a list of things you're trying to look up. Well, both subqueries are going to need to be accessing that data, right? So if one of the subquery threads is running on a different CPU core, suddenly it's got to do the inter-core communication to go get the data from the other cache. So you don't really want to do that. So now the goal is upgrade the scheduling system so that it can figure out, like it starts tracking stuff in a multiple
6:35Wesway. So one is just obviously sort of threads of the same thing, right? But it can figure out when things that are running need to share the same cache and then try to schedule them on the same cores appropriately.
6:45ChrisWoo! That's a nice one.
6:48WesThere's multiple steps to it. They're learning a lot, or they're taking advantage of a lot of neat stuff that happens. Like the hardware actually has cache monitoring stuff built in. So then the first level is basic structural stuff. It understands what the system has and the basic schedule threads together. But then it can actually go check to see what the layout the hardware tells it is doing in real time. And it can even go sample the misses to figure out like, oh, we tried to hit something in the cache, but that's actually on the other system.
7:17ChrisReally?
7:17WesWe might need to start considering if this continues actually moving it to the other core.
7:22BrentWow.
7:23WesNow you don't want to do that too much, right? Because then you could just be bouncing around all the time. That could be a problem. So it's a delicate balance, as is everything in scheduling. But this is a huge upgrade for just it being really smart. Now, it will matter more on, you know, big systems with lots of CPU cores and that kind of thing. So you might not see as much of an impact on your single-core laptop or whatever.
7:44ChrisYeah.
7:45WesBut it's a big upgrade for our friend, the Colonel.
7:47ChrisLinus had made a comment that it may not be pretty, but it's the correct way to deal with, oh, that code wasn't ready and caused problems. People will probably try that again later. Is he referring to the GPU scheduler stuff that got reverted?
8:00WesYes.
8:00ChrisYeah, okay.
8:01Wes7.2 was meant to switch the DRM scheduler from first in, first out to a new CFS-style FAIR policy. So we already have this on the CPU side. This was bringing it over to the GPU side. But then an RX 9070 XT owner hit a sustained 100% GPU load.
8:20ChrisUh-oh.
8:21WesYeah, games dropped to 10 FPS. The Wayland session froze. Had to reboot to recover. And then here's the part that maybe wasn't as good of an idea. When this happened, it wasn't just that the default was swapped. It was the only schedule. The other stuff was ripped out, and all you were left with was fair. So the first in, first out, and the RR policy, those weren't there. There was no runtime escape hatch. So five days before the release, someone from Egalia shipped a 20-patch revert, smoke-tested on a Steam Deck, and it ships first in, first out.
8:53WesAs the defaults again, sort of unrips things out, but now it still adds fare as an opt-in experiment. So instead of doing a big change to making this default, now we're still in sort of test mode.
9:05ChrisAll right. That makes sense. Thank you. Thank you.
9:08WesWhat is nice, though, is the reporter, AB, tested some of the fixes himself. This is a very active collaboration process, including, quote, the patch Claude gave me.
9:21ChrisAlso, I think MongoDB users will be happy to hear this. There was some work in Linux's memory management. The multi-gen LRU memory reclaim system has been cleaned up. And as a result, kernel developers have reported performance improvements approaching, so, you know, results will vary, but approaching 30% in some MongoDB workloads, along with fewer unexpected out-of-memory situations.
9:43WesOoh, I like that one. You know, some of us have a lot of tabs, and it gets dicey.
9:51ChrisI, my, my bet is not everybody's going to see that 30%, but heck, even a 10% is pretty great. Just by a better memory reclaim. And Brent, I know you're going to love to see this one. Faster, leaner swap in Linux now.
10:06BrentDelicious.
10:08ChrisAre you guys still using the swap file?
10:10WesWell, I have one. I don't know that it gets used a ton.
10:14ChrisThat's what I mean, really, is are you actually, uh, like when you install your Linux box, are you deploying a swap file? Not are you actively using it necessarily, but... I mean, any system that runs for a really long time generally swaps a few things out.
10:26WesYeah. Yeah, I have 3.7 gigs used, 12 gigs free in MySwap right now.
10:32BrentMySwap is zero currently, which is, I think, a little unusual, but I use it heavily for hibernation. Like, sometimes when I'm traveling with a laptop and stuff, I want to maintain, as much battery power as possible depending on what I'm doing. Maybe I'm going on a train at some point of the trip or something like that, And so having hibernate available for me is quite valuable. So that's the main reason I have it.
10:52ChrisYeah. That's one of the reasons I have one too. Uh, I also find it better for crash debugging and also, um, Some of my systems only have 16 gigs of rewrite, so I do actually get the swap out. So it's good to see that there is ongoing rewrite of the swap table infrastructure in Linux 7.2. The improvements reduce the amount of static metadata Linux needs to keep around for swap and improves how that metadata itself is managed.
11:16WesNice. Yeah, one example here. A system with a 1TB swap device can save roughly 512 MB of RAM just from the reduced metadata overhead. Which is, you know, nice. It'll add up over time.
11:30ChrisThat's a massive savings with how expensive RAM is right now. That's no joke. So again, a system with one terabyte swap device, which is a pretty big swap device. will save roughly 512 megabytes of RAM just from the reduced metadata overhead. Does anybody out there in the audience have a terabyte swap device? Boost.Jupyter Broadcasting.
11:50BrentYeah, right.
11:50ChrisYou've got to tell them. And why?
11:52BrentHow'd you get there?
11:52ChrisMm-hmm, mm-hmm, mm-hmm. All right, we've got a couple other items. There's one I really want to talk about. Is there a couple before we get to the file system stuff that you want to talk about? I know we have faster pipes.
12:06WesYeah, we do have faster pipes. We covered a bit about this in 6.7.2. There was basically going to be improvements to make piping things between processes faster, kind of all around, especially on the right path. And now we have a few numbers under memory pressure in particular. Throughput is up 21 to 48% and right latency is down 17 to 33%.
12:28ChrisWhoa, this is a, yeah.
12:30WesYeah, and I mean like pipes and, you know, FIFOs are used all over the place.
12:35ChrisYeah, yeah.
12:36BrentI find it so crazy how, you know, Linux isn't just a baby anymore, and yet we're getting insane numbers of performance upgrades in seemingly every single version. It's just bonkers.
12:49ChrisIt really is like, I wonder, like, was this all just there for the taking all along? And you just, you work through it, I suppose. Brent, I'd like to see you test this next one somehow. USB 4.0 stream. So in 7.2, you now, two machines can send raw streams of data directly over USB 4.0 or a Thunderbolt cable.
13:05BrentWell, who needs Ethernet anymore, I say?
13:08ChrisWell, it is actually pretty fast. It is quite fast, actually.
13:11WesIt's neat, too, because before, you know, you could obviously do this and then, like, stand up your own little local network or whatever and set up IPs and, you know, get it going. You could do it. But this, you just get, like, a slash dev slash TB stream zero device. And you can just cat and read to write or DD or whatever, and it just shoots it across the USB cable.
13:28ChrisIt's going to be so fast. That's going to be, you know, because you don't have the overhead of the protocol of Ethernet.
13:32BrentNice. Oh, my goodness.
13:34WesAnd it can also still coexist with normal Thunderbolt networking. So it's not like it's the only thing you can do on the cable.
13:40ChrisOkay. All right. Well, while we're talking about performance, I think the thing that I'm probably the most excited about because it'll have the biggest practical impact for all of us is ButterFS is getting faster in this release. ButterFS is getting faster. We talked about large folios in the last episode.
13:58WesThey're enabled by default now. Yeah. There's also experimental support for huge folios up to 2 megs.
14:04ChrisBut I think the big wins come from better direct I.O. performance, faster sequential writes, and a new interface that exposes the raw checksums to user space, so that way you can build tooling around that and all of that.
14:14WesYeah, including things like perhaps deduplication, Brad. Oh, hello.
14:18ChrisSo, you know, this is the beginning of an API, right? This is the beginning of an API. But the direct I.O. performance and the sequential writes are resulting in real performance improvements for ButterFS. Amazing. I think we'll probably see Laravel benchmark that pretty soon, and I'm going to keep an eye out for that. So I think that's probably the thing in 7.2 I'm the most excited about. So people upgrading soon on rolling releases, you know, do they? I don't know. You probably have to do something to upgrade your ButterFS format. I don't know. But it's something to keep an eye on. Something I'll probably play with, and I'll update you.
14:46BrentThere's one here I'm excited about, inline storage encryption. There's a new device mapper target called DMInlineCrypt. And it's designed to take advantage of hardware that can perform inline block device encryption rather than doing all of that encryption through the traditional DM crypt path. Based partly on work that happened in Android, of all things, and could eventually become a useful alternative to DMCrypt on hardware with dedicated encryption support. You know how I like that encryption. You make sense on it.
15:17WesOn mobile, you probably do have the opportunity to have custom stuff and not as much CPU as you might want.
15:23ChrisAnd they have been tested in the fire. Android did not start super strong in this area, and they've made a lot of progress.
15:28WesAnd, hey, look, it turns out that having Linux on your phone actually pays dividends that the whole kernel could use, proving out the entire model that we've been saying all along.
15:36ChrisIt's also worth pointing out, not that you guys don't know this, but it's worth just reminding us all that these tools like this, if they're being actively supported and contributed to by a large, well-financed group of people, it's probably something to consider just because you want tools in this category that are being actively supported and maintained. Um, there's a few other things in here, but the one that really jumped out to me is faster proc. Like when we're talking about, this is really the performance kernel.
16:01WesYeah, it really is, right?
16:02ChrisThis is silly, but like, what? Faster slash proc? What?
16:05BrentI didn't know that was an issue.
16:07ChrisYeah.
16:08WesProc exposes a whole bunch of metadata and info about like the running kernel and all that. And there's, um, there's a bunch of programs, especially command line programs that want to go read that stuff to actually go. Right. Cause it's a way that you don't have to have use this calls to try to get the same information. you can get it right out of the file system. It's super handy. It's standard Unix. Yeah, right? So there's a bunch of stuff that uses it. And so if you make that faster, you make all those things faster.
16:33ChrisYeah, absolutely. It's like Brent said. It's like we're just seeing these optimizations in areas after all these years.
16:39BrentBut who thinks Steven go down there and be like, huh, what can I do here?
16:42ChrisA clanker? I don't know. Maybe a clanker? I don't know. Some autist, I don't know. Maybe like somebody who's really passionate?
16:48WesI don't know. I've got a few Pats and such rock I can tell you guys about.
16:51BrentThere you go.
16:52ChrisUh-huh, uh-huh.
16:54WesWell, we should probably mention we now have the safer open at command because we have a sticker based on it.
17:00ChrisRight.
17:00WesOr we only open it if it's a regular file.
17:02ChrisThat's right. Only regular files here. Only regular files.
17:06WesAnd this has shown up in a few different vulnerabilities. This prevents an application from unexpectedly being redirected to something like a pipe or a device node when what you want is like a text file.
17:16ChrisYeah. I think that's a good thing to call out. There's so many things we could get into here with this. It's like this kernel isn't a headliner banger feature. This is the kernel feature. It's all these things from like CPU schedulers to GPU schedulers to file systems to drivers and networking that have seen improvements. Or just new little features like the fact that if you had Thunderbolt or USB 4, you can now plug machines directly into them. Like that just kind of got a little bit better. So it's, I mean, 7.2 is a really good release.
17:47ChrisIs there any word if there's LTS talk around this one?
17:50WesI don't know. That's a good question. I've seen discussion around a few possibilities from this one, or maybe 7.3 or 7.4, perhaps.
17:59ChrisWell, 7.3 would be a wild one to make an LTS.
18:02WesThere's a lot going on.
18:03ChrisLet's just talk about this really quick, because it's an early development. The merge window just opened last Sunday, obviously. But there's a lot more scheduler work in here. A lot more scheduler work.
18:13WesYeah. Right now, there's some focus, particularly on how scheduling interacts with C groups, because, of course, the control group mechanism is involved in maintaining a lot of access to different resources, which impacts how you want to schedule things. So instead of having to traverse a bunch of hierarchical run queues, it's moving to a single run queue with new methods for distributing C group weights. there's also a new c group mode knob um you can do smp up max concur tasks uh
18:44Wesconcurs the new default and this is basically a mode you can choose so that you pick how, how much cpu weight right like how much your share of the cpu is going to be gets but divided between the different okay that seems great, especially if you care a lot about you know scheduling things and especially c groups are used a lot in our buddy containers.
19:02ChrisYes in our friend.
19:04WesYeah the hierarchical version had a lot of long-standing oddities, including how nice, you know, the nice command priorities got handled across groups. So that might improve from some of this work, too.
19:14ChrisOh, okay.
19:15WesYeah. Early testing on an old Sandy Bridge machine paired with an RX 580 showed enough improvement that the work has been pitched partly as a win for gaming on lower-end hardware.
19:24BrentNice.
19:25WesSo you might not start thinking about gaming on lower-end hardware, but that's where it ends up with the kernel sometimes.
19:29ChrisWell, I mean, a lot of those handheld devices, those little built, you know, purpose-built, run on Linux. Makes sense. Hmm. Okay. Now this next one, I can't even believe. So I'm going to say it out loud, but I still don't believe it. Okay. In Linux 7.3, in speaking of schedulers, there appears to be up to a 90%, I'm going to say that figure again, around 90% reduction in a nasty source of x86 scheduling latency.
20:00ChrisHere's what strikes me about this. Number one, 90% is a big number. Number two, x86 is a big platform. This isn't ARM. This isn't like some sort of maybe risk chip that nobody's using. This is x86. What? A 90% reduction in a nasty source of scheduling latency? Now, I realize this must be an edge case here or something, right? Because this is massive.
20:23WesYeah, and part of it is just sort of how we've been doing things. So, like, back to, you know, you have multiple cores and you have multiple caches. And one of those things is the page cache, right? Sort of like how do you have the files, what you've copied off the disk to memory for working with. Well, those different page caches can get out of sync. And so you need to maintain coherence across all of these things. So you do what's called a TLB shootdown, which is where the one that figures out that something needs to be invalidated sends out interprocessor interrupts to all the other cores to say like, hey, you got to take this out of your cache
20:55Wesand go get it fresh because it's no longer valid. Well, the calling CPU can wind up sitting with preemption disabled while waiting for the remote CPUs to finish that operation. And so ByteDance actually observed weights causing up to 16 milliseconds of scheduling latency on a 16-core system just from this. So Linux 7.3 changes that mechanism so CPUs can now be preempted while waiting in these situations. And in ByteDance further testing, the P99 maximum preemption-disabled interval fell to roughly 1.5 milliseconds, which the patch series described as producing
21:30Wesas much as a 90% latency reduction. So there's your 90% in the affected workload. With one particular workload, which may not be yours, but it is aimed in particular at latency-sensitive and real-time style workloads, which you know Linux is doing more and more of. And it removes an architectural source of scheduler stalls that can affect ordinary machines, too.
21:51ChrisSo you heard Wes there, too. He mentioned this is patchwork from ByteDance, and this is now merged for Linux 7.3 after 10 rounds of patch reviews. But I don't think this is the only set of patches that ByteDance has committed recently. It seems like their contribution to the kernel is kicking up. And is ByteDance... Are they the TikTok company?
22:12WesYeah.
22:12ChrisRight? The TikTok company? What?
22:16WesI mean, you know, we've said it in the cliche way of, right, like, I don't know, meta runs Linux servers or whatever. But I think there's a real component where, like, if you're trying to do media distribution at scale, you really push what computers can do.
22:29ChrisYeah.
22:29WesAnd that means you might need to interface with the kernel. Whether you like the content or not is up to you.
22:34ChrisSo this is the world we live in now. And, I mean, that's a serious contribution. That's a real contribution. Something we've talked about on and off for a little while now, but really seems like it's coming together in Linux 7.3, is this subscheduler idea.
22:48WesSo cool.
22:49ChrisSo cool. So I think this could be one of the more consequential long-term changes because you're going to see vendors take advantage of this. Network vendors, hardware vendors. So they have now, I guess, like a subscheduler system where you can build your own subscheduler for Linux.
23:07WesYeah. Yeah, so you have a root scheduler, and that can now give a C-group subtree, back to the C-groups, to another scheduler, including with revocable access to individual CPUs so you can control what it's scheduling over. So in practical terms, you could imagine different scheduling policies for a few different workloads on the same machine, right? So maybe you're trying to do latency-sensitive audio capturing, but you've also got a background job doing some transcription in bulk, right?
23:31ChrisOr syncing, or whatever you just have running.
23:33WesOr you're trying to do games, but you've got containers that are running that are doing image processing at the same time.
23:38ChrisAs one does.
23:39WesOr I could see this a lot, right? You might have, you're running a web server, right? And you might want a particular scheduler for your database that's different from how you want to run it for the Nginx reverse proxy.
23:47ChrisOr, you know, to bring it to the desktop, my kid, right? Constantly, he's got the Discord going with like 15 people in the call. He's got the game going. He's got OBS recording and streaming to the call. And, you know, and then you want the game to perform well at the same time. And like that, that seriously taxes the system when you're doing all those things. So you could see a world where there's a SteamOS scheduler, subscheduler.
24:10WesAnd this sort of scales with how much investment you want to put, right? Like with this SketchX stuff, that of course is built on being able to write like BPF programs that can do scheduling, which is furthermore means you can take a standard Linux kernel. You don't have to build your own modular. You don't have to do potentially dangerous and, you know, require lots of testing changes on general scheduler algorithm changes. You get to implement your own, just, you know, adding it in from user space and then get that attached to particular programs and workloads that you need to run.
24:39ChrisYeah.
24:40WesThat's powerful.
24:41ChrisWhat other OS is doing that? All right. So, Brent, you know, how much would you pay? We told you you're going to get performance updates to ButterFS and Linux 7.2.
24:50BrentDelicious.
24:51ChrisBut how much would you pay for a whole other round of large performance wins in ButterFS and Linux 7.3? Because, buddy, I'm going to give it to you for the price of free.
25:01BrentYeah.
25:02ChrisAnother round of ButterFS optimizations will be coming in Linux 7.3, and some of them are kind of a big deal. I mean, I'm sure you went through this, Wes, but DirectIO, again, gets some attention. ButterFS can now use IOMAP to bounce buffers instead of failing back to a buffered I.O. Don't know what that means at all, but it seems good.
25:24WesYeah, well, it's, you know, buffered I.O. has buffers, right?
25:27ChrisI mean, I know that. I know what a buffer is.
25:29WesWell, and so, and DirectIO is unbuffered, right? And so now it's basically a setup where in some situations, direct IO didn't really work. You had to fall back to using the slower buffered stuff. Now, in that same situation, Butterfest is internally using an IO map bounce buffer of its own that lets it stay on the more direct IO path.
25:47ChrisBut gives like direct IO a little buff if it needs it?
25:49WesI think so.
25:50ChrisHuh. Okay, thank you. All right. See, now I get it.
25:53WesAnd that's why the case that was sort of the study for this reportedly goes from roughly 50% of theoretical throughput up to about 90%.
26:02BrentWhat?
26:02ChrisI'm sorry?
26:03BrentThat's massive again.
26:05WesSo a 45% increase.
26:06BrentAre they using the same math that we're using?
26:10ChrisThis is really something. I mean, just in the next couple releases, there are so many performance wins.
26:15WesYeah, really. I mean, there's more removing an unnecessary one Jiffy delay in a non-SSD logging path. That's like a 5x throughput improvement in one test. And then another is interesting. it replaces the use of an x-array data structure with a local least recently used lru list for inhibited extent buffers that one's a 3x improvement.
26:36ChrisAll right i mean it's funny that a three it says three to five x by the way but it's funny that a 3x improvement seems kind of tame at this point i know just so great still, ah i mean like where you at butter fs haters time to update time to update, All right, there's several other things in here we could talk about.
26:55WesYeah, how do you like the name FailFS?
26:59ChrisI love it.
27:00BrentSeems like one of our challenges is coming up.
27:02ChrisI feel an episode already. I hear the name, and I'm already picturing the episode.
27:06WesYeah, it's great, right? So you know what you love about file systems? They let you open and write to files and do stuff with files, right?
27:11ChrisDefinitely, very handy.
27:12WesYeah, well, FailFS is a file system where every possible operation fails.
27:16BrentWhat?
27:16WesOkay.
27:18ChrisAll right, all right, cool.
27:19WesSo what's cool about this is it's a security idea, right? So what you do is you open a file and you get a file descriptor, which is basically like a handle to the file, right? And after that, like you've done the security checks, the kernel scene, if you have permissions, all of that stuff has already happened. And then you have a handle you can use to read and write from the file. What FailFS lets you do for a security system perspective is you can, if you know all of the files that something needs to access, you pre-open them and then you launch something and you give it a FailFS file system. And that means there's no way to ever escape its sandbox. All it can ever use
27:52Wesis whatever FDs you pass it when you spawn it. So it's an idea to pre-restrict it. So it's not in a true root. It's not stuck in some folder. It's not in a weird mount. It's just the only file system it knows about is not the root file system at all. It's fail.fs.
28:06ChrisThat's so funny. It's such a funny way to solve the problem.
28:11WesIt's interesting because it builds on a few, I think in 6.7.2 maybe, we talked about null FS, which was something cleaning up sort of early pivot routes, switch routes stuff, where you had like a, just a super minimal file system that can be the root of the whole tree of file systems.
28:24ChrisRight.
28:25WesSo fail FS is kind of a similar, like not really quite a, it's like more of an abstract file system, but they play important roles in the kernel.
28:31ChrisThat's a good one.
28:33BrentWe've been talking about file systems a lot this year because there's been a lot of really great news. And I've got to say, FailFS seems like the easiest, file system to implement. You just make a lot of mistakes for every single implementation of a file.
28:46ChrisEasy testing.
28:47BrentExactly.
28:48WesIn this case, if you don't implement a bug, it's itself a bug.
28:51ChrisI see BPF is getting some new fancy BPF-MT-MISC. Is this a mount?
29:00WesNo. Okay, so it's bin format MISC, which is maybe you're familiar. their bin format is what lets you basically register different types of binary files. Like you can do this with an app image, right? Or you could do it with, a wine or you do it with like a jar file to launch a Java application. And so this is where the kernel looks at the magic bytes at the start of a file. That helps it determine what that is. And then you can register executions or run times for that.
29:25ChrisFor BPF.
29:26WesWell, so there's two pieces. There's actually a NixOS angle here. Oh. Uh-huh, yeah. So right now it's all fixed, right? And maybe you know with NixOS, you have to embed the dynamic library interpreter, the LD, in basically it has to hard code that in all of the binaries it produces. And this is where the patch elf stuff comes in and all that kind of stuff. And it means you can't really relocate that stuff. It needs this fixed, hard-coded path. What's coming in 7.3 is a bunch of that's being made more dynamic. And in particular, you could implement an algorithm that was like,
29:58Weshey, wherever I am, go look up in like dot dot lib from me and just find the interpreter right there.
30:04ChrisOh, that would be really nice.
30:05WesSo then you could start shipping the interpreter that you need to run sort of hermetically sealed in with the rest of your NixOS closure.
30:10ChrisOh, boy.
30:11WesAnd then, so that's one level of dynamic stuff. And then on top of that, you're now also going to be able to attach BPF programs to do that role of figuring out what interpreter to run.
30:23ChrisSo you could make your own interpreter?
30:24WesYeah, you can have your own interpreter and you can choose very dynamically at runtime which interpreter is selected.
30:31ChrisWow. Dang.
30:33WesIt's pretty early and like this is going to be this is like the kernel opens the features. It doesn't actually add the stuff you do. So this will be downstream dependent on distros and users and stuff to actually register the interpreters and like write them and all of that. But I certainly expect we'll see an XOS at least.
30:47ChrisThis is the stuff that makes the Linux kernel the king.
30:50BrentOh, yeah.
30:51ChrisIt is the king. And the other kernels, they can't even with this stuff. It's really something. I suppose in order for the king to maintain its reign, it must shed some older projects from time to time. And in the upcoming Linux 7.3, not 7.2, those were just released, but 7.3, which is coming out in October, 32-bit ARM support has been deprecated.
31:10BrentWhoa.
31:12ChrisYeah. So I believe it will survive through 7.3, but it's officially deprecated, which doesn't mean it's gone, but it means it's now marked deprecated. So there's that.
31:20WesOne thing we maybe should mention, too, is, which I don't know if it will be fixed in 7.3 or not, but presumably it would be, there's a NTFS vulnerability going around right now. Essentially, not the newer NTFS, but the older Paragon NTFS, this seems to be live now. Essentially, you can set basically a version of Unix security model permissions, you know, CHMOD stuff on NTFS files. And that includes the set UID bit. And the old driver in a lot of configurations for desktops will mount,
31:54Weswill like auto mount an NTFS thumb drive with that set.
31:58BrentOh, no.
31:59WesYeah, so you can have a specially crafted NTFS thumb drive that gets you root just by plugging it in.
32:04BrentWell, I mean, that could be handy sometimes.
32:07ChrisYou know, that's really something. But I think the largest change, maybe, it's not a feature that's being added to Linux 7.3. A third to a half of the patches look like they are AI-generated low-priority fixes that are queued up in Linus' next-next patch set. And going through that, they say, quote, we are completely overwhelmed.
32:30WesYeah, these are the networking maintainers.
32:32ChrisYeah, the networking maintainers say we're completely overwhelmed. Their counter move is AI reviewing AI with meta-funding a multi-model review for every networking patch. But the practical result seems to be really just a lot of trimming from the kernel of older network drivers that are not really maintained because they're getting poked at by clankers. And so they have a whole AI reviewing, AI submissions process now, thanks to just a ton of compute contributed by Meta.
32:57WesYeah, they describe it as managing patchwork, automating common process complaints, editing commit messages, and maybe applying patches, which already got reviewed by tags from people we trust. So they're experimenting actively.
33:08ChrisYeah, I suppose they have to with the volume they're going to get, right? Because the Linux kernel has to be the one everybody thinks of when they all of a sudden I can build software. I'm going to go to the Linux kernel, right? A lot of people think that, but it's interesting. that 7.2 was widely impacted by AI-assisted development and 7.3 is both in contributions and again in pull requests and things like that. So it's essentially continuing to escalate. And so they're responding by adding more compute on their side. I think that's going to be a story worth following.
33:36WesWe also saw Andrew Morton talking about using Gemini to not write the code, but write some of his memory management subsystem patch summaries this cycle.
33:44ChrisLook at that.
33:54BrentWell, for years, we've had the project of, well, thinking about first, and then also just tightening up our production infrastructure behind the shows. Big dreams. Some of it's actually happening recently. And Chris, Dropbox has been a big part of that, but I know we've had issues with cloud syncing in the last several years. And nobody's excited about cloud stuff anymore, and you're making some changes. What did you replace?
34:20ChrisWell, so, you know, I'm a fan of SyncThing. I want to be clear, I've used it for years. When it first launched, I started using it. I was initially with BitTorrent Sync, and I was sad when that went away, but I happily Those were the days. It was. It was great. But SyncThing has served me well. And I've mostly used it for, like, back-end large file transfer media, stuff like that. And I've held on to Dropbox because we got this sweet 15-terabyte deal.
34:45BrentYeah, yeah, yeah.
34:46ChrisIt's crazy cheap. And how do you say no to 15 terabytes these days? But I hate Dropbox client. I don't really like Dropbox the company. So I kind of compensated and got by for a while by using the Mistral open source sync client that was really lightweight. You could run it headless. You could declaratively configure it. And it gave me Dropbox like back in the OG days of Dropbox again. And it just ran headless in the background and synced my damn files.
35:15WesThat's all you want.
35:15ChrisAnd used their storage, right? And that worked well for a couple of years. And then Mistral announced that they're shutting down. And I thought, okay, I'm going to have to migrate soon.
35:25WesRight. So either you have to go back to the standard clients or...
35:29ChrisAnd then, as sort of like to really poke me to get going, I don't know, like an old machine joined the Dropbox. I have my suspicions. Yeah. All of the files got a sync conflict in my Dropbox. No.
35:41WesThat doesn't sound good.
35:42ChrisA little bug in how the exclusion folders work with Mistral, and it started syncing to all my systems. Like, you know, terabytes of data. Terabytes of data. So all my hard drives started filling up, and I realized it. So at first I shut down the sync client on my workstation upstairs because I'm sitting there. And then it dawns on me, every other computer is also doing this same thing right now.
36:03BrentOh, my goodness.
36:05ChrisSo then it's like a mad dash before it fills up their hard.
36:07BrentDrive right.
36:09ChrisOr whatever it.
36:09BrentMight been there been there.
36:11ChrisYeah yeah that's a nightmare you've been looking at sync stuff this or the last couple of weeks too.
36:16BrentYeah i uh i guess a similar problem actually i've been, trusting cloud syncing less and thought geez with these new mesh networks certainly there's something better we could do right and not have to rely about it with a always on uh system in the in the cloud. So you pushed me towards sync thing. I've complained for years that I can never wrap my head around, it how it works and how to configure it and stuff like that but somehow on my third try around i got over that and it's actually quite simple.
36:48ChrisI think that i don't know what the issue was well the biggest head shift right is um like with next cloud sync or dropbox sync it's user login and then you have these folders and you sync these folders down, and with sync thing there's no user right i mean you can pass protect the dashboard but it's these keys that you exchange and then they discover themselves and they sync and you share these keys and that's how you set it up, which is actually great because it's accountless which means anybody that has sync thing can just grab that you can share that key with them and they can
37:19Chrissync they don't have to go create an account anywhere, but it's a total flip of the traditional file sync model where you have an account you log in and it just syncs down your files but like i think both you and i have found recently that next cloud isn't working for us that might have been the direction i would have gone on for these files because I do really like having a web interface. I think that's really nice.
37:37BrentYeah, I share a bunch of stuff with other people too.
37:40ChrisYeah, sharing is also a big one.
37:42BrentYeah, it's a tricky one. The other thing that got me with SyncThing, I think, was the configs for each client. You have to kind of put your head into different perspectives when you're configuring stuff. And also there's this concept of like, I forget what they call it now, maybe Wes, you'll remember, but of like the quote unquote cloud, but it's really just the amalgamation of all the files of all of the devices into this one like virtual file system almost that you can think of it that way.
38:12BrentAnd you get to pick and choose which folders you bring down into this particular, device. So it's interesting, very powerful when you start learning the config.
38:22ChrisIt just sort of slips into the background too. It does have a web UI. There are some desktop clients, but it just sort of slips into the background. So you're not really thinking about it. It's just like you just have these files that persist across all your machines. And it just sort of does it.
38:35WesIt's best when it's at the layer of infrastructure magic.
38:38ChrisSo I had this problem happening, right, where all my systems are getting blasted with files to the point where it was going to affect production. So I shut it all down and figured I got to redo this. And I wanted to replace it at that point with SyncThing. I just felt like it's been the most reliable. and it was probably my safest bet now that I'm also not using Nextcloud. Sort of the way to go.
38:59WesThat's a big change though, right? Because you kind of get, it's a very different architecture. And in particular, if you don't have a cloud relay, you're going to need a way for these things to talk to each other.
39:11ChrisThat is a thing. That is a thing. I will say, I think, at first I thought it was going to be a downgrade because of that. Because I don't have a web UI, I thought this is not going to be as functional. But what I realized is that with SyncThing, because it has an API, There's actually a lot more visibility into it than I have with Dropbox. So with sync thing, I can see which peers are connected, what folders are caught up, what's still outstanding in the sync. And I can see, does this particular host have that file or not?
39:44ChrisAnd I can expose that in a way that an agent can read or a script can check or Prometheus endpoint can monitor. And so then it starts to become a lot more like kind of like this black box of sync and like this production monitor thing. which is even better than i had with dropbox so then it becomes like oh i'm not just replacing dropbox i'm like improving the functionality here so i leaned in on that, i i really i wanted to lean in on making sure my hermes agents, could understand where files were at and where they're needed to be reviewed because it's something my hermes agents can do because i put this on that system
40:17Chrisas well they can write a file to a folder for them and then they know when the workstation i'm at has receive that file. That's really powerful.
40:25BrentYeah, yeah, yeah.
40:26WesEspecially when you want, you really need to be, you know, the number of times where we've tried to sync something at the studio and we've assumed that it synced and then we discover later after we've left the studio that in fact it did not fully sync or like one file out of the seven we needed wasn't there or whatever.
40:38ChrisYeah.
40:39WesYou just don't want that. Yeah.
40:40ChrisIt's come up. I mean, it's come up recently too and, you know, you need to be able to change these things. You need to be able to make it flexible too and all of that and Dropbox didn't really meet that requirement. It didn't really do it for me. So that part feels like a huge upgrade now. So I think the trickier part, really, was all of the systems are different. I mean, I have my NIC systems, but then my Aurora host here is running, you know, UBlue, SilverBlue. The soundboard machine over here is an old Mac, you know, so that's a totally different system. So that part...
41:11WesSo it's not one platform that you have to build across.
41:13ChrisYeah.
41:14WesYou got to make this work across a disparate set of platforms with different hardware.
41:17ChrisYeah.
41:17BrentDid that mean you also had, like, like disparate folder structures across those systems as well like how did you.
41:24ChrisImplement this in a way that was quote-unquote smooth yes it was you know like especially like on the mac oh, yeah like slash users slash username like the whole path is totally different but then on some of my systems i have those scary raids and so i put the sinks on the scary raid several of them and then and then like the laptops they're just in the home folder because i don't have more than one hard drive and a laptop usually usually so it's just in my home folder so like literally And then you have my Hermes agent's host, which stores that in a completely different location too. So literally all my hosts.
41:58WesThat guy's probably the only one who knows where all the paths are.
42:00ChrisWell, that's the thing. So I focused on the main folders that I use, not all of them, just the main ones I use today. And then I had the agent figure out where they all need to go and which systems we could just hot swap and take over the existing Dropbox location.
42:16WesNice, right. Because you were working from like a unified pre-model mostly.
42:19ChrisWhy sync everything again if I don't have to?
42:21WesYeah.
42:22ChrisBut that could also go very wrong on some systems. So on some systems, I had to make the call not to do that. And I had to create a new folder pattern.
42:28WesStart from scratch.
42:29ChrisYeah, yeah, yeah.
42:30WesOkay, well, that sounds like maybe you ran into some issues. Some of this sounds like you've handled it. You've obviously been using the same thing for years. But I'm wondering, did anything go wrong? Did you have any scary moments? What was the process like?
42:43ChrisI think the scariest moment was I forgot to include the Mac. I don't think about the Mac.
42:50WesBut you need a lot of soundboard files.
42:52ChrisThat's the soundboard files. Yeah, exactly. said i was like oh right but what is really fantastic with this setup is everything's documented all the endpoints i mean the clanker can even connect in and read the database yeah so it is really straightforward for for just you go in there and say deploy it on a new host, and it uh i have some guidance in there like it caught okay well this folder is your backups folder that's 20 gigabytes do you want to sync that to the soundboard machine i do not i do not want to sync that so that was kind of nice so i kind of i have,
43:23Chrisi'm really only dealing with 10 folders that i actively use and i'm considering just keeping everything else on dropbox removing all the dropbox clients and then using our clone to mount it when i do need something from the archive, because i'm paying such a cheap price it's like 50 a year or something for 15 i got like this grandfather deal it's a cloud backup i mean so nuts for 15 terabytes of cloud backup So our clone could be a good way to interface with that.
43:48BrentCan I get access?
43:48ChrisSo the Mac was tricky. Yeah, right?
43:51BrentYeah.
43:51ChrisThe Mac was the scary part because I almost completely forgot it. I just totally blanked it out.
43:57BrentDid it, was it smooth for you going cross-platform?
44:01ChrisIt wasn't too bad. Yeah, I mean, you know, the nice thing is you got Homebrew on the Mac. You can use that. I think Aurora. So Aurora is a, like I said, it's a silver blue, uBluehost, and I went Podman. I just did a Podman container on that, a rootless Podman container. And I don't think Syncthing cares.
44:18WesAnd then I assume it's just riding back on the back of your existing mesh infrastructure.
44:22ChrisRight?
44:22WesSo a container plus mesh, and there you go.
44:26ChrisIt's really good. I'm really liking it. I find it to be such an upgrade, and I thought it was going to be a downgrade. Screw that Dropbox.
44:33BrentAre you using Dropbox and sync thing looking at the same folders? Because I would assume that's going to cause you some issues.
44:43ChrisYeah, yeah, yeah, yeah. No, I had to be careful about that. But it took me a second to realize I had to shut it down on one of my hosts.
44:50BrentThat's all it takes.
44:50ChrisBut when I scrambled, I didn't just stop this thing. I'm like, all right, disable the service, rebuild. This thing's gone. I did not want. So I just removed the client. So I don't have to worry about that except for I think it was the Mac. In fact, I think Dropbox is actually running right now. I even disabled it from starting, and it still starts. I hate macOS so much. so yeah it's still this it's it's such a pain in the butt and i don't think about the mac so the mac is an issue for sure i'm just gonna uninstall it after
45:21Christhe show off of here and i don't know i don't really need to access the archive from from this thing one you know what i realized.
45:28WesI think i got our clone on the mac.
45:29ChrisWe could put linux on this i've been waiting to replace this with a linux box right an actual but we could just put linux on this because it's an intel mac.
45:38WesYeah.
45:39BrentThere's the whole soundboard thing. Isn't that the reason?
45:42ChrisYeah, we have to, no, we have to build a soundboard.
45:44WesBut we need to do that anyway.
45:45ChrisWe have to do that anyway.
45:45BrentWe've been saying it for like, what, 10 years?
45:47ChrisWell, like, what's the point of starting the project if you don't have any hardware to run it on?
45:50BrentFair enough, fair enough. Well, let's do that after the show.
45:53ChrisRight, right.
45:55BrentHmm.
45:57ChrisSo that's been an issue. You know, but being able to run it in Podman worked out great. And then it's just installed natively on the Nix systems.
46:05BrentSo are you managing your configs through Nix as well?
46:08ChrisYeah, for those hosts. Yeah.
46:10BrentYeah, for all those hosts.
46:11ChrisEverything.
46:11BrentThat's how I started doing it. It's so nice. I even...
46:14ChrisIt is very nice.
46:15BrentYeah.
46:15WesAnd it's positive pressure to use NixOS for more and more things.
46:19BrentI would... One recommendation, if you're going to throw, like, a mobile device in the mix, which I don't know if you want to at this point, but I found it really nice to have the clanker just, like, make a config file for the Android system and just suck it in.
46:35ChrisYou can import it?
46:36BrentYeah, you can import them pretty nicely. And that keeps you from like having to thumb all the config options and stuff on the phone. So that would be one of my recommendations if you get there.
46:46WesI wonder, presumably you could also maybe get some port forwards going on your Android and have it API.
46:52ChrisYou're right. Or just it'd be on the mesh too.
46:54WesYeah, right.
46:55ChrisYeah. So I think, if you do dabble in the clankers, I really want to make a strong recommendation that if you need to solve a sync problem, you look at sync thing. because my favorite part of this is I built a wrapper called Hermes sync thing. And so the agents are not doing like raw credential passes over the network and like looking things up in the LLM every single time. So the agents aren't using like the raw credentials and connecting to the API without instruction every single time.
47:25ChrisAnd the LLM is just kind of figuring out how to do it every time when I want to check on the status of stuff. I've created this little wrapper and this wrapper, automatically has all the presets to go see if all the hosts is connected, if the folders are caught up, what might be outstanding from any individual hosts. You know, like, for example, what does Aurora still need before we can go on air? Because we've got to get the clip synced up.
47:44WesI like that.
47:45ChrisAnd I can ask it, did this file reach this host? And all the clinker is doing in the background is calling this Hermes sync thing.
47:52WesAnd that's a wrapper that just has the endpoints you want.
47:55ChrisYes, predefined setup. And so it's not, and the advantage there, it isn't creating the workflow every single time. So you're saving tokens, you're reducing the impact of hallucination because it's fairly straightforward.
48:06WesYou can do like a multi-stage, right? So it's like you have a skill describing this, how to work with it, and telling it how to use your wrapper. And then the wrapper can embed all of the implicit knowledge of like how to get those core tasks done.
48:16ChrisAnd the wrapper can query the destination machine's own sync thing database.
48:21WesNice.
48:22ChrisAnd see, okay, is it present? Is it valid? Is it synced? Was it ignored? Was it not deleted? Whatever. So like you get beyond just proof of delivery, you can get proof of removal and all of that. And it's just using the wrapper every single time, which I could go down on the command line and run myself if I wanted to. But the nice thing is, is when you do something like that in that wrapper is you can use a free model, a cheaper model. It doesn't have to be like a big, you know, frontier class model. It can be an open source, even eventually self-hosted model, but it can execute these little queries for me and tell me if everything synced.
48:51WesThere's no debugging, there's no code writing, it's just column tools.
48:54ChrisYeah, it's pretty great.
48:56WesSo I was going to ask if you were going to try and come up with a web interface replacement, but it sounds like for the most part, this is good enough.
49:03ChrisYeah, I still toyed with the idea of putting some sort of web file manager in front of the sync thing directly.
49:09WesJust for like upload-download or something like that.
49:10ChrisYeah, or this one-off machine.
49:12WesRight.
49:12ChrisOr mobile, that could be another way to do it on mobile. I don't know what sort of state of the art there is. Like, I don't think it's PHP file manager anymore. So if anybody has recommendations for that, I would definitely like them. Because I do think that could be useful, but I don't think it's as necessary as this. It's been pretty nice.
49:31WesSo are you done? I mean, is there anything left that you need to build in this thing besides the web interface? Are you happy with the deployment? Is it on all your machines?
49:39ChrisYeah, everything's deployed. It's gotten really nice. You know, I think the trick was is deploying from one central machine and just having it reach out over SSH and just blast it onto everything with their various esoteric setups. I think the missing piece still, like I mentioned might be the R clone mount.
49:56WesRight.
49:57ChrisAnd just coming up with a better way to take advantage of that 15 terabytes while I have it. Not sure. But I think there's, that's the work still to be done. There's no errors. Everything seems to be sinking. And then I do have a couple like this machine. I got to go clean up Dropbox on. Same thing is just, it feels like this, a sleeper of a project that we don't talk about, that we take for granted.
50:17BrentI think it's just assumed that we've all implemented it. Like that's the feeling I get is that it's been around forever. It's been really stable for a long time. It's just kind of, it's like SSH. It's just there when you need it. But for anybody who hasn't tried it, you have any suggestions or tips or pitfalls to avoid or anything like that?
50:41ChrisAnd if you have SyncThing, do yourself a favor. Seriously, listen to Chris's hot tip here. Download OpenCode. Use the free aux model that's in there. Use any of the free models. Point it at your URL for your SyncThing and have it tell you what this API can do. Because this is where it really exceeds what Dropbox can do for you. And it becomes a complete system that you have observability over that doesn't have a cloud, doesn't have any big tech login. And I think so many times we deploy things like Home Assistant,
51:15ChrisPlex, Jellyfin, and SyncThing. And then a lot of us, and I'm definitely guilty of this for a long time, just ignore that there is this beautiful API that allows us to do everything we could do through the UI with our Clanker or OpenCode or whatever through this API. And so you can start writing little scripts or automations or check on the sync status of things.
51:37WesThink of the poor developers who implemented these APIs. They want you to call them.
51:41ChrisThey do.
51:41WesDon't let them atrophy just there on the side.
51:43ChrisTake advantage of those APIs. Because I stopped thinking of sync thing as just this thing I self-host and it moves my files. And now a full system I can manage.
51:52WesIt's a sync architecture.
51:53ChrisIt's a framework.
51:54BrentNice.
51:56ChrisThat's what it is. That's what it is. And it's way better than any stuff you could get with the commercial stuff. And really it's taking advantage of that API to its fullest.
52:03WesAnd you can craft it to fit in with whatever you need it to be.
52:14BrentWell, as usual, we got a little feedback this week. Alex sends in a little note. Hey, Chris, Wes, and Brent.
52:20ChrisI'm Alex.
52:21BrentI'm Alex. That's A-L-E-K-S for, you know, that's a much cooler way to do it. I'm Alex.
52:27ChrisAlex with a K? I don't know, an X is pretty cool, dude.
52:31BrentWell, that's true.
52:33ChrisX is pretty cool. K is different. I like it because it's unique.
52:37BrentYeah, yeah, yeah.
52:39ChrisI mean, it's pretty rare to get an X in your name.
52:42BrentSo Alex with a K says, I'm a solar developer working on Local Comet, an open source Windows-first local AI app built with Llama CPP, Tori, and Rust.
52:56ChrisAll right. Oh, you don't know.
53:00BrentIt gives people a simple desktop way to run local models with more privacy and control without depending on a cloud service. I'm actively developing it and would be grateful if you'd consider mentioning this on this here podcast and sends a little repository.
53:19ChrisWell, this is right up our alley.
53:20WesYeah, we got Python, TypeScripts, Felt, and yes, Rust. Neat, a private local first Windows AI assistant.
53:28ChrisYeah, and you don't see Windows getting a lot of love in this camera.
53:30WesThat's what I was going to say. I'm not about to go make myself an EXE, but it's clearly out there. And the people, I mean, if we're going to be using these models to help us with our sync thing, I mean, as we already talked about on the show, do you want to be touching Windows or do you want your model to do it?
53:45ChrisI mean, honestly, why not, right? And then there's probably somebody out there listening to this show that has WSL and has all this running and then they use Windows MCP and all of that. But if you're just getting started, something like Local Comet could actually probably help you get WSL up and going. I mean, I don't know what these things can do on a Windows platform, but it is really nice to see it.
54:05WesAnd maybe it's an easy way, like if you have a Windows gaming machine that does have a GPU, then maybe it's an easy way to go experiment with some local models too.
54:11ChrisYeah, I bet a lot of Windows, you know, that's a great point.
54:13WesDon't lock them away in the Windows world. You can still get to play with the fun tech.
54:16ChrisThey've invested in those GPUs after all, right?
54:18WesThat's right.
54:18ChrisSo they might as well use them. Yeah. Local Comet. So there you go. We'll put a link to that in the show notes. If you got a Windows box with a Goopoo and you want to play around with it, you'll find it at linuxunplugged.com slash 681. Oh, our first boost comes from the one, the only Greg, the lawyer. He was in our mumble room for a little bit earlier today. He's often on the live streams and frequently a big supporter of the show. And he comes in with a baller boost of 33,333 Satoshis.
54:55ChrisAnd Greg says, inspired by the release of Oma Archie Atra or Quattro, I have been clanking my own Nix OS Senate.
55:02BrentWait, wait, wait. I got to stop you there. clanking as a.
55:06ChrisVerb i've.
55:07BrentNot seen till now i like it.
55:10ChrisI do like it uh i've converted from kde to hyperland and quickshell nice making my own desktop so much more fun oh, this is i love seeing reports like this greg um we are entering a new era of customization on linux, and uh hyperland is just so far it's so right i'll speaking of oma archie and hyperland um an oma archie foundation of types, was launched with eight million dollars of backing by jack dorsey the ceo of dell and many others whoa and um one of their first expenses as a foundation
55:42Chrisif you can call that i'm not sure, is they're backing vaxery the hyperland developer for the next three to five years.
55:47WesOh that's that's.
55:48ChrisIncredible that's huge yeah at least the next couple years i mean i don't know how much vaxery is going to take as a paycheck but um that's massive so he can focus on the hyperland desktop which i think is going to be really good.
55:58WesA quick shell i was looking like quite the yes toolkit kit as well so i put a show note a link in the show notes to a great lwn write-up of that recently.
56:07ChrisVery good thank you greg appreciate hearing from you appreciate the support too.
56:11WesTomato boots in with 22 222 sats, Catching up with the missed episodes from this summer. Loved the backwards episode. And how it broke your brains. Regarding virtual machines in the kernel, I'll just lean into my recent NetBSD trolling here and point out that kernel already has a Lua VM in it. It's honestly pretty fun.
56:32ChrisThat is fun. That does sound fun.
56:34WesGreat show on entropy and the cold card mess. I tried looking into their firmware before moving my BTC to it and found the whole thing overly complicated and confusing, so I decided I didn't trust it.
56:43ChrisNice dodge.
56:44WesDespite having bought one, my coins are still on a Sparrow-created wallet on an offline machine.
56:48ChrisYep, turned out to be a better call.
56:49WesWish I'd shared my discomfort publicly, and I hope all the JB listeners got their coins out in time. Especially in this new era of clanker-assisted hacking, those of us in free software who have the expertise to autocode should really speak up if something smells funny.
57:00ChrisYeah, there's something to think about there.
57:02BrentThat's a great point.
57:03ChrisDefinitely worth checking your own stuff, too. And at least checking the stuff you're going to use, even if you don't go file a clanker report. Although, if you find something serious, you probably should consider it. Yeah. Thank you, sir. Appreciate that boost.
57:14BrentTurt Ferguson also sent in a row of McDuck's 22,222 sets. I enjoy the peek into the future of IT defense, but you did not answer a key question that I have. Do you think AI security tools are actually useful for regular Linux admins yet, or are they still too unreliable to trust?
57:38ChrisI think that depends, maybe, because you experimented with a meta model that did hallucinate some of the reporting, which maybe would be like, okay, that's an example of when you can't fully trust.
57:48WesYeah, I think it's kind of like a lot of things, you know, defense in depth. So you probably want to have, that's where you like a diversity of models or harnesses or processes so that you do have some way to have a, like, you know, grounding is very important here. And so if you have a way that you can actually do some fact checks or you have a council of several models, each doing it with different unrelated contexts, things like that to try to be able to figure out when that's happening.
58:13ChrisI think the biggest barrier right now to getting actually good results out of these tools would be paying the cost for the higher-end uncensored models that you've got to pay kind of per token for. So that's the gating factor right now, right? For them to do anything more advanced, really, I think.
58:30WesAnd that, yeah, that kind of pattern, too. You can have a grunt model and then another model that sort of checks on things, does its due diligence, and has a little more intelligence but doesn't have to do all of the original work. Nathan from Brissy Boosin, 4,102 cents. Come on, Lions. Hat trick time.
58:53ChrisYeah, that probably works. You're getting a few people thinking about it. That puts it in a good direction, I think. All right. Thank you, Nathan. Appreciate you. Right, you want to take Monty there?
59:03BrentYeah, Monty sent in a row of ducks.
59:06ChrisAh.
59:08BrentAs for the Frigate system overview, I have been running Frigate for several years, and I haven't touched the config in a very long while. So very interested in some of the newer features, including how to drain your own detections.
59:24ChrisYeah. And Friggin has recently added more detection capabilities in the freer stuff. That's something I'll play around with, you know, and maybe we'll do an updated segment. I'll dig into that. One of the things I have recently done is I've expanded beyond person identification to animal identification. Because again, keep an eye out for coyotes and yeah, the birds and stuff like that. And that's been interesting. So, all right. Thank you, Monty. That's good feedback.
59:45WesQuick interruption.
59:46ChrisYes, sir.
59:46WesI think you'll love this. You should go pull up our live chat. Our Matrix.
59:50BrentI'm going over there right now.
59:51WesBecause check out what Greg the lawyer just did.
59:54ChrisWhile I was listening about SingThing, I clanked a QuickShell SingThing widget for my system.
59:59BrentThat's so great.
1:00:01ChrisI clanked it, he says.
1:00:03WesAnd look at this lovely little widget, right? It shows devices connected. It's got some folders there. Web UI rescan, refresh stop buttons.
1:00:09ChrisQuickShell is so cool.
1:00:11WesAnd clearly it is quick.
1:00:12ChrisYeah. And it's not going to break with Hyperland desktop update, which is nice, too. So you can build that and it's going to work for a while. Well done, Greg. That's why you dropped out of the mumble room. You had to go work on that. Plank that up. I'll take Thomas. Thomas English comes in with 16,345 Satoshis. What are the best methods to get my agent to do my entire NixOS setup for me? Because I am clueless.
1:00:42ChrisI've only ever Vive slopped Linux servers together, but going to take the plunge and smash out this Windows box. NixOS for me. Any tips for a sailor that can't swim? I've never seen a line of code in my life. Agent first NixOS setup. What say you? I'm going to paste in your YoloPie and close my eyes.
1:01:00BrentOh, my goodness.
1:01:00ChrisI'm going to paste it into YoloPie.
1:01:01WesIt's like a prompt request via Boost.
1:01:04BrentIt sure is.
1:01:06ChrisI mean, you could, I mean, I don't know if you'd want to have it, you could point a clinker at Hypervibe.
1:01:11WesI was going to say, and we've had some, the whole collection of listeners who have shared in past show notes. So you could perhaps the first prompt is go get it to harvest some links from that.
1:01:20BrentYeah.
1:01:20WesAnd then from there, it could go build out a config for you.
1:01:22ChrisI think that's a good starting spot. I would, I'd start probably in a web chat with one of the free models to just sort of build out a plan. talk about, you know, kind of ramble about your intentions, build out a plan, link it to Hypervibe. I think there's a re-spin of Fedora that looks really good. You can even point it at Oma Archie and see if there's some, you know, design tips you want to pull from there and application ideas because it can look at all that stuff and sort of build you a master list. And then you could have it from there, produce a master prompt that you then put into the final clanker on your machine that does the work.
1:01:53ChrisAnd you probably get pretty good results with that.
1:01:56WesYeah. And, you know, the main kind of things too is once you get like the installing Nix OS part It can be just pretty much like installing a normal, any old Linux distribution. It's just getting the, once you have it running and you have a way for a clinker to control it, then you're off to the races.
1:02:12ChrisYou are. You are indeed.
1:02:14BrentI think I would recommend a very different approach, actually. I think you should definitely use a clinker to help you. But point it at some of the documentation and then just have it almost like interview you about what you want the system to do. what kind of things you want in it, and have it explain what it's doing. I think the long-term benefit of understanding what's happening under the hood for NixOS is really good, even though you don't have to worry about the implementation details, like all the syntax and stuff like that. It's really good to understand what's possible.
1:02:48BrentAnd I think starting with some of the documentation, or at least projects that are well-regarded, is a good way to go.
1:02:55ChrisTwo more tips. When it's done or when you're at a stopping point, have it create like an agents MD that explains your system so that the next fresh LM context, when it starts up, it kind of knows your system. So a basic layout of where your config's at, where your preferences are, the desktop choices, the things you prefer the clanker do, you put all that into like an agents MD or some sort of description file about your system. And then when you start a new session, you have a point at that. So that way it's not rediscovering your next config where it's at every single time and all of that.
1:03:23WesIt knows the rebuild command. It knows all the, yeah.
1:03:25ChrisYeah, so I think that's probably maybe the most important tip is just have it build one of those. And like, yeah, the other thing that would maybe be good for you to consider is, second tip, you could ask it to document in a human reviewable format decisions that are being made and just kind of it could append and update a markdown file or a text file for you that you could review at the end. You could have another LLM review, something you could have it also produce two documents if you want. You could have it produce a technical document for an LLM with no context,
1:03:57Chrisa fresh LLM session with no context, a technical document that explains everything, a fresh LLM with no context needs to get started and work from the beginning to modify, change, upgrade, anything to my system. And then a second document that's for a human audience that needs to understand the decisions that are made and the design choices that were made. And it will just continue to update both of those documents for you as it works in that session.
1:04:17WesAs long as you maintain the consistency and it sees that every session.
1:04:20ChrisSo remember that.
1:04:21WesYeah, a devlog is one word you can use for some of those concepts.
1:04:24ChrisOoh, okay.
1:04:24BrentI have two more quick tips that I think are good for someone starting out. If you are... comfortable enough to install things, uh, like in open code, having an MCP, uh, is really helpful here. So there's MCP dash Nix OS, which is a really great program just to help like query what's even available in Nix OS. And it saves a lot of time and mistakes and just like querying the internet. So, uh, I would recommend that. And then if you are up for it,
1:04:55Brentwriting yourself just a little skill for NixOS with like, common patterns that you particularly like once you get down the road is really really helpful or at least has been for me.
1:05:06ChrisYeah and if it's not obvious what they might be they will become obvious to you as you use it they will become.
1:05:11WesObvious if you keep having to tell it the same thing yeah.
1:05:13ChrisThere you go if you tell it three times.
1:05:15BrentThen you should put it in a skill.
1:05:17ChrisMoon Knight comes in with two thank you very much for the boost good luck let us know how it goes Moon Knight comes in with a boost to 2500 sats and he says to all the new Fiat boosters you now have boost power, nice i like that that's true thank you moon and i thanks for the sound clip too.
1:05:36WesUh pabby boosts in with 7108 sats, time travel.
1:05:44ChrisBoost episode 671 love hearing from the time travelers.
1:05:48WesThanks for the ulanzi smart pixel watch tip i've been looking for one to integrate into Home Assistant since I'm not getting around to building the Autrix kit I've had for years. Also, on 1.5 speed, Forescan sure sounded a lot like Forescan, which had me quite confused for the segment. Had to look at the show notes.
1:06:05ChrisYeah, not a great name.
1:06:06BrentIt's the Ford scanner.
1:06:07WesBut, you know, that is the risk you take with the 1.6X.
1:06:11ChrisI think it's, what could else, yeah, that's right. What else could, what did they do? Ford would come after them if they put the D in there. They can't put the D in there, so they just had to go with Forescan.
1:06:18WesForescan? No, that doesn't help.
1:06:20ChrisYeah, it doesn't work either. yeah it doesn't work thank you though appreciate it pappy.
1:06:24BrentWell zach attack sent in 6 000 sets, Loved the episode on hacking yourself. I did dislike the episode where everything was in reverse, though. Need to still watch your Clanker Therapy video? Yes, that's linked at every episode recently, right at the top of the links. For now.
1:06:45ChrisFor now. Almost done linking that, too.
1:06:47BrentSomething you could take a look at is Rockbox. I'm running it on a SureFans F20 for podcast and music. It has better audio than the phone and increased privacy, too.
1:06:59ChrisThat's true. I haven't heard of Rockbox in a hundred years. That's really cool.
1:07:02BrentThis sounds vaguely familiar. Is that a piece of software you can throw on some MP3 devices? I believe so.
1:07:10WesYeah.
1:07:10ChrisYeah.
1:07:11BrentI think I might've tried to play with this a long time ago. Long, long time. It's still around. There you go.
1:07:16ChrisZach, thanks for the memories. Appreciate that. Appreciate that. Thank you very much. Sir, I'm here with a row of ducks. It's pretty fitting. Thanks for breaking our brains with the reverse episode. I was about to blame my podcast app, But how dare you skip the hello, friends, and welcome back intro. Anyways, here's some value for the show.
1:07:33WesThanks.
1:07:34ChrisHey, if it got a boost, maybe it was worth it after all. But I think we're done doing that. I think we're done doing that.
1:07:41WesOur pal Magnolia, ma'am, comes in with a double row at ducks.
1:07:44ChrisHey-oh.
1:07:45WesTwo of the same message, but it says, just going off of the title here on 680 Go Hack Yourself, but I just got started with syncing myself after a Git workflow of mine failed. Can't wait to see what the show's about. Ah, that must have been to the pending.
1:07:58ChrisYeah, the live one.
1:07:59BrentLive boost.
1:08:00ChrisWell done. Well done. Boosting one before we even started the show, man. Well done. Yeah, let us know how it goes with your sync thing set up. That should be very interesting. Blackhost comes in with a fiat boost of $1,000? What? What?
1:08:21BrentWow. What?
1:08:24ChrisWhat? When did that get in there?
1:08:28WesI don't know. I'm just seeing it.
1:08:31ChrisWhen did that come in?
1:08:32Wes10, 21 a.m. this morning.
1:08:33ChrisWow, we were already on the air.
1:08:35WesThat is crazy.
1:08:36ChrisWow, Blackhost. Thank you. That's really, that's...
1:08:43BrentI got to pick up my jaw here this week. Yeah, thank you.
1:08:46ChrisNo ads placeholder.
1:08:47WesThank you, Blackhost. That's so sweet.
1:08:48ChrisThat is really amazing. Wow. Wow, wow, wow. Really do appreciate that, and it definitely will make a difference. Thank you.
1:08:56WesDavid from Burlington comes in with $10 fiat Hey.
1:08:59ChrisYou know what? We have a boost sound for that now, right? Should we roll it up? Let's try it What do you think? You ready? See if it feels good, That's not bad It's not bad Hey folks.
1:09:11WesIt occurred to me that while y'all have extensive tech backgrounds I don't know if I've ever heard where it all came from Oh boy Can you guys give a quick summary of your past work history?
1:09:21ChrisOh boy, Oh, boy.
1:09:24BrentIt's basically a virus that infected all of us.
1:09:28ChrisCould we do like some special on that? Or is that worth it?
1:09:32WesLike in a members we put in the show? I don't know.
1:09:34ChrisI don't know.
1:09:35WesWe'll have to think about that. Thank you for asking, though.
1:09:37ChrisYeah.
1:09:38WesAnd for the support.
1:09:39ChrisThe reason why we don't have time to do it now is because we're old. And so there's a lot to it.
1:09:44WesWe only remember so much.
1:09:45ChrisI remember before Linux. I was alive. Yeah. So, yeah, that's a great, that could be a great topic. We haven't really recapped that in a long time. I suppose some people have some questions on that. Thank you, David. From Burlington? My Burlington?
1:09:57WesYeah, which Burlington?
1:09:57BrentThere's one in Ontario.
1:09:58WesMaybe a zip code boost in there.
1:09:59ChrisYeah. I'm not getting beers with them then. But all right, we have some member boosts that we'd like to get to. Our buddy Anonymous is back. Do you guys really use Firefox? You talk about a record number of tabs. Have we mentioned that? I don't know that. But I don't believe it. I've used it on and off for years, and I keep having to bail back to Chrome. I'm trying again, but after a day, too, it just hangs on me. I have to kill all Firefox. I got 90 gigs of RAM, a 22-core Xeon, 50 tabs really shouldn't hang.
1:10:27BrentWow.
1:10:29WesI never have it hang. And it's probably open the entire time my laptop is online.
1:10:33ChrisI have in the past had issues, but it's been years.
1:10:37WesYeah, interesting.
1:10:38BrentFor the question of if we, you know, do we actually use Firefox, I'd say it's my permanent first choice. I mostly only use Chromium when something goes wrong and the website's not built for Firefox or for the show because I need multiple browsers. And I would say I probably have the most tabs and windows open out of all of us, probably out of you guys combined. So there's that. But I only really used to have issues on low-end hardware where I didn't have enough RAM.
1:11:09BrentBut never experienced the slowness or anything like that unless I was filling up the RAM. So not sure what your issue is. Hopefully you can figure it out.
1:11:21ChrisI love this. On my home desktop, I do a boot, Garuda, and Arch for daily driver and Windows 11 for occasional work applications that, well, I couldn't port to wine. My 15-year-old plays video games, Minecraft, Steam on Garuda. Yesterday, my six-year-old came up to me while I was working and said, Dad, can you boot into Linux? Windows is boring.
1:11:37BrentThat's amazing. Nice.
1:11:39WesAw.
1:11:40ChrisHe says, with all of the success with the reverse episode, how about a randomness episode? You could do the segments in random order.
1:11:46BrentWhoa.
1:11:47ChrisGood luck.
1:11:48BrentYeah, that won't be harder at all.
1:11:49WesCurse on the show. I don't know. You really want to melt our brains.
1:11:52ChrisIt'd be fun, too, if we just literally rolled a dice or something and we didn't even know it just totally ran out. There's something to that.
1:11:58WesOr each MP3 that gets generated is a unique order.
1:12:01ChrisDifferent order. Boy, if we could pull that off.
1:12:03BrentWhy do we do this to ourselves? Dynamic segments.
1:12:08WesAnton member boosts in. For the Web Boost anonymous username issue, the quickest fix might be a small confirmation pop-up when the username field is left blank or default and the user clicks the member boost or checkout button. the pop-up could confirm that they meant to send it anonymously.
1:12:23ChrisI don't love a pop-up, but that is not a bad idea.
1:12:27WesThank you for thinking there, Anton.
1:12:29BrentWell, Jimmy's here with a free members boost, which you could do at boost.jupiterbroadcasting.com if you're so interested. How do you reconcile the privacy considerations of AI? It can be amazingly helpful, of course, but they get a lot of sensitive personal info. That's what's holding me back. A local model would fix that, but of course the VRAM required for good models is quite prohibitive. How can you be running graphene, but pumping configs into the AI machine?
1:12:59ChrisI guess it, I mean, do you consider Nix configs to be confidential information?
1:13:03WesI generally don't.
1:13:04ChrisNo, I don't either.
1:13:05WesEspecially for something I might consider putting on.
1:13:07ChrisI post them on GitHub, yeah.
1:13:08BrentYou guys don't keep your bank account information in your Nix OS config?
1:13:11WesNot anymore.
1:13:13ChrisNo, now I don't know. Declarative banking. So, like, if I were putting in personal information, I suppose that would be one thing.
1:13:24WesYeah, you know, health stuff, addresses, account number, you know. So there can be ways you want to have concerns about that. And some information will leak, right, if you ask it questions about how do I set up X thing or I'm trying to solve this problem. But the question is what risks – how does that fit into your model of – Right.
1:13:41ChrisIn my model, while that is a risk, it's actually less of a risk than like, you know, data brokers that are monitoring all of my transactions or, you know, government surveillance or Google surveillance. or, you know, like those are actually more prevalent in my day-to-day life that I already live with. I actually wouldn't mind if they did train on my Nix configs and they got better at it. So in a way, I kind of want them to, I don't think the models I'm using are using my data for training, but if they wanted to become better at Nix,
1:14:13ChrisI really would not have any problem with that.
1:14:15WesI think of it too as sort of like a controller agency thing. Like for me, I mean, yes, the Graphene OS sort of privacy stuff, is great, but i really like that it makes me actually feel like i control the android phone that's it and that's where it's like with the ai i might make mistakes or whatever um or be lazy but it's ultimately my choice of like do i engage with it what do i put into that prompt before i hit enter and stock android didn't really feel like that.
1:14:39BrentI have uh hmm yeah various categories like you say chris um nix west configs, totally good to send those out i think they're, not private really at all. Um, but I do hesitate on some topics. Like there's a couple topics that I have that like accounting automations and stuff that I have sitting in the queue for when I feel like, there's some great option for like privacy, local AI stuff. So I can't wait. But the other thing I would say is, um, there are a couple of things you could do about that.
1:15:13BrentLike I, I don't trust myself completely to to keep myself safe so i put a couple layers like there's uh an mcp that you can add i'm trying to see it here that i've added to my open code just to like pull out um secrets and bank out and credit card numbers so it just goes through and, sees if you've accidentally you know put anything like that in there and so there's a couple things you can do just for peace of mind maybe before.
1:15:41ChrisIt hits the model.
1:15:42BrentYeah uh.
1:15:43ChrisWes has talked about also like at the injector level if you have an injector sitting between your client and the cloud service you can have something that's, looks like it's the it looks like the api to the client but it's actually sitting between the cloud model and the client and it's looking for sensitive information yeah.
1:16:00WesWe've talked about a few of these uh key g proxies another one there's a few options out there now and you could also consider this is a lot more technical setup but if you do uh entertain something like renting a cloud GPU and then running your own self-hosted models, that has a lot of nice privacy implications too.
1:16:14ChrisAnd maybe if you only need it for certain batch work or you want to build a certain thing and you're not going on day-to-day stuff, you're not running an agent or something like that, you're just using it for that type of work, a rented GPU with a self-hosted model, well, then you've got full control. You've got out of it. So that's a good question. Thank you, Jimmy. Pabby comes in with a free time travel member boost. So great. This is now possible, Pabby writes. Thank you, Pabby, and I love the time travel boost. But you've got to say what episode you're at when you time travel. Otherwise, we don't know from what time you're at.
1:16:45WesDigital Jolt comes in with a member boost.
1:16:48ChrisAll right.
1:16:49WesI'm a bit late, but just wanted to say I really enjoyed the Reverso episode. It took me a minute to remember that you'd mentioned it a few weeks ago, but I smiled every time I heard one of the jingles appear in the wrong place.
1:17:00ChrisGood.
1:17:00WesAll right.
1:17:00ChrisI'm glad.
1:17:01WesLove that.
1:17:02BrentWell, Paul member boosted in. Where are you on the ad block is privacy topic. I don't like giving money to corporate overlords. This is the main thing holding me back from YouTube Premium right now, for instance. I prefer to support a few selected creators. My willingness to spend money is limited, leaving many creators out.
1:17:25ChrisYeah, that's a tricky one because the ad blocking, at least in the browser, it's not just about ads. It's also about performance and readability, obnoxiousness with the pop-ups. So there's other things now that are also a factor there. So it's not just like a statement on trying to get the content for free. And I do tend to agree. I think I kind of align with you, Paul. Like I think Pharaonics is a great membership. LWN in our space is a great membership. We try to make the Jupiter signal and unplugged core contribution a,
1:17:57Chrisyou know, really as much high signal as we can worth it membership. But I have over the years decided because I have a family that watches YouTube, I did subscribe for YouTube premium to avoid that. and the YouTube experience is notably better.
1:18:11WesFor sure.
1:18:11ChrisWhen you sit down on an account that doesn't have it, I cannot believe how much ads they're slamming in there now. And I just don't want my kids seeing all that.
1:18:18WesAs for the sort of, is it piracy or not? I think it's one of those, like, you know, it's sort of a spectrum. The world exists where both people are dependent on ads and, one, local control of what your computer does is important. And, you know, ad blockers are a known technology that exists. So I think it is true that choosing that perhaps has a moral dimension, but... The idea that, you know, you only need to make one choice for every single creator doesn't seem right to me either.
1:18:44ChrisYeah, it is a nuanced problem.
1:18:47BrentI think for me, this is a really good one. I think about this all the time. I've kind of landed on ad blocking everything because I feel like very naively, actually, I feel like we could find a better way to fund things instead of using ads. So if they're not making money on ads, maybe they can find a better way. but I'm sure it would just be more draconian.
1:19:12ChrisThe problem is it's always kind of eventually a race to the bottom. You always have to add more ads. It's just the way it goes.
1:19:18BrentYeah. I would say one option is, let's say you're using Adblock Plus or something like that, you could disable it on websites that you want to get the revenue.
1:19:29ChrisI do that on Photopea.
1:19:32BrentYeah.
1:19:34ChrisThey ask, and I think it's worth it. Photopea, they deserve my ad revenue. That's another one I should probably...
1:19:38WesIt does give you a chance to find out, too, like how far did they go? Are these like horrible ads or is it a reasonable sort of ad placement that isn't actually that bad in practice?
1:19:45ChrisGood question.
1:19:46BrentThe last thing I would add is like the internet is completely unusable without it. So there's that, right?
1:19:51ChrisYeah, it's bad. All right. I'll wrap us up. Senior Smile comes in with a free member boost. Papa John was correct. I forgot to put my username last time. I said a USD boost referencing my previous anonymous boost about K8s. But you read them in reverse order. Oh, sorry.
1:20:05BrentWe didn't catch that.
1:20:05WesWe don't always get that right.
1:20:07ChrisYeah. Sorry, Senior Smile. And then Bearded Zero wraps us up. I enjoyed the backwards episode, and I got to say, I think doing the boost and feedback may have been a good option. It lets it bring the feedback into the show and kind of feels like a bookend for the last episode. Just a thought. I also felt it was kind of nice to warm up with the feedback and the boost. And I think if I were going to always do the show in the order that felt the best, that might be the order I'd do it in. But if you think about it, you see that, you know, it's like if you're new to the show and it takes us 30 minutes or whatever to get to the actual content.
1:20:39WesNot everyone loves that.
1:20:39ChrisNot a good impression. But I liked it too, Bearded Zero. I liked it too. Thank you, everybody, and everybody who boosted below the 2,000 sat cutoff and all of that. We really appreciate you. We really had a banger. So we had 124,000 sat sent in. But then when you bring in that fiat boost, I mean, we should take a moment again. I mean, that was really something. That was really something. And $1,000 came into the show today from one single contributor, and we needed it. It has been tight behind the scenes. It was.
1:21:09BrentThat works out to be 1.29 million Satoshis.
1:21:14ChrisWow. Look at you doing the math.
1:21:16BrentNo, it wasn't me. It was hybrid sarcasm. Thank you, hybrid sarcasm in the chat.
1:21:20ChrisI mean, that's got to put Blackhost on the leaderboard for the year.
1:21:23BrentI mean, there you go.
1:21:24ChrisRight there.
1:21:24WesYeah, maybe we'll have to do like a Boosties preview sometime soon.
1:21:27ChrisYeah. So when you bring it all together and you take the fiat boost and you convert them to the current Satoshi value and you just smash it all to one line item, we had 16 of your stream stats. That's 27,485 Satoshis. When you combine it all together, it gives us, I mean, a very impressive grand total of 1,458,305 Satoshis.
1:21:49WesThat's crazy.
1:21:50BrentWhat?
1:22:03ChrisIf you'd like to support the show, you can become a member, put it on autopilot. You get the bootleg or the ad-free version of the show, and you get a free boost every single week. Or support us one-off. Like a particular show, want to get your thought on here, just support us. Go to boost.jupiterbroadcasting.com. You can send a boost with Fiat or Sats. It's crazy. Wow! All right. And thank you, everyone, who supported the show. We really appreciate it all. With that, it's time for some screaming picks.
1:22:34ChrisAll right. Buckle up, boys, because this week we're talking about SSH Clipboard, and this could change your life. A peer-to-peer Clipboard sync server over SSH. Copy anything on one machine, paste it on another. A picture, a block of code, it doesn't matter. You copy here, you paste there. Rich text content doesn't matter. It keeps the native formats intact. Native formats, not just text, preserving images, rich content, things like screenshots, something you might want to put into a ticket maybe. You want to take it from one machine and put it on the other.
1:23:07ChrisMaybe you've got a clanker that's working on something and doesn't have to save it to the file system anymore. It can actually just put it right in your freaking clipboard. Or... Or if you put it on multiple machines, the Clanker could put it on the machine's clipboard you tell it to.
1:23:19WesYou're saying I should be using this instead of netcatting things around.
1:23:21ChrisThis is actually an option to reduce your netcat dependency.
1:23:25WesIt looks pretty new, huh?
1:23:27ChrisIt is very new, I should mention.
1:23:28WesFrom Justin Schroeder and Andrew Boyer, the contributors so far.
1:23:32ChrisYeah, yeah, yeah. It is very new. It is very new.
1:23:35WesBut I think there's been several attempts at various tools like these over the years. I think when I was first getting into Linux, I remember trying to roll something myself. It's nice to see something that looks like a structured, well-thought-out approach.
1:23:45ChrisYeah, I went through it. I dug through it, and I was very impressed. It's early days, but very, very, very impressed with what they've done so far. And, of course, if you've got SSH keys set up, just you reuse those, so it handles all of that for you. It's cross-platforms. You can move stuff between Mac and Linux. You can reuse the copy-paste mechanism there.
1:24:04WesIt won't break your other clipboard managers. That's good. Right, it's using Rust and Ratatouille, which is just turning out to be such a great library.
1:24:12BrentYes.
1:24:12ChrisI think it'll be packaged in multiple ways right now. Like, they're kind of the recommended path is NPM. I did look into it. You could probably package this in NIC. It's pretty straightforward. So it is very doable. And it is MIT licensed. MIT licensed.
1:24:28WesWell, that has been Blackhost Pick of the Week.
1:24:30ChrisYeah. Brought to you by Blackhost. I had another one.
1:24:37WesOh, a sneaky pic, you didn't even put it in the dog.
1:24:40ChrisI didn't put it in the dog, so I don't remember what it was.
1:24:41WesThough. So you're saying you have a pic for next week?
1:24:47BrentIt's in his clipboard.
1:24:47WesIt's been a long time since we've done it.
1:24:49ChrisYeah, you should have set it up. It probably is in my clipboard. Oh my god, that's hilarious.
1:24:54WesIt's been a while since we've had a single pic pic.
1:24:56ChrisI know. Well, that is a banger of a pic. I just can't remember what my other pic was. I can't remember what it was.
1:25:02BrentIt's probably a single pic.
1:25:07ChrisNo, I was pretty proud of it. It's funny that I can't remember it now. That's what I get for editing a text editor first. So we'll sneak it in the next episode. And if you've got a banger pick, you can always let us know too. We love it when we feature an audience pick. We'll put it in the feedback or we might even put it in the main pick segment. So you can boost.jupiterbroadcasting.com that or go to linuxunplugged.com slash contact for that. All right. Well, that wraps us up. Links to everything we talked about today over at the website, linuxunplugged.com slash 681 or jupiterbroadcasting.com for the links. and all the shows. And if you want to just, you know, chew away at some extra stuff,
1:25:39Chrisyou want to know what we talked about, anything like that, tell them, Wes. Tell them about these fancy metadatas that we got.
1:25:43WesYeah, well, the first level is Cloud Chapters. Yeah, that's right, a JSON file with all the information about where our segments are and what they are. And you know what? If you look in that, you get custom Drew-made chapters.
1:25:55ChrisThey're great.
1:25:56WesUsing all that editor cleverness.
1:25:57ChrisThey are great.
1:25:58WesBut if you need more details, check out the VTT file, or if you must, the SRT file. We have subtitles, transcripts, right? Available in the RSS feed itself. And if you want to see our ugly mugs, there might even be an MP4.
1:26:12ChrisThere could be with screencast stuff and all that of what we're talking about. I'll just say again, thank you to Blackhost. You know, it strikes me. I was thinking about it this week, like all four of us, the three of us here on the show and also Drew, you know, we really have shaped our lives around the show. It's that level of dedication. It really drives our life. It's the defining clock and heartbeat of our day-to-day life. And so when you see support by folks, like we saw this week, it really does validate putting that kind of effort and energy and building a life around the show to make it possible. So that way we're here every single week going on like, what, 13 or something years?
1:26:44WesCrazy.
1:26:44ChrisNot missing a beat. So we really do appreciate the support. Thank you, everybody. Like I said, links at the website. And of course, we'd love it if you joined us live. Make it a live vibe on a Sunday. Get past the Sunday blues by making it a Tuesday on a Sunday over at jblive.tv in your local time at jupyterbroadcasting.com slash calendar or stream live in your podcasting 2.0 app of choice. And, of course, the Mumble Room's going. We've got details on the website. The Mumble Room gets a low latency, high quality Opus stream.
1:27:16ChrisIt's pretty nice. Shout out to our members for making the show possible and keeping us going. Everybody who supports us at boost.jupyterbroadcasting.com. But that's it for this week's episode. Thank you so much for joining us, and we'll see you back here next Tuesday, as in Sunday.