Justin Garrison
Appearances
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
You're going to go... point the iPhone 25 at this ground spots and like get this image back. It's going to transmit down. You see like a terabyte a day out of this. Like you're just taking pictures constantly. And then you process that a little bit more and then send them either raw data or whatever it is that they're looking for. Right. Like that's the general pipeline here.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
What was the benefit there of not making the satellite a dumb client and putting intelligence in the satellite and on the ground? Cause it feels like you could put that either place and you, you chose the hardest decision to put it in both places. Like there has to be value that you're getting out of doing that process before.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I mean, if you're just sending a terabyte, like, I don't know, was that just a big antenna with a satellite dish up there? Just like beaming down death rays of pictures. Yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How do you debug that? Like, is that only like you have a dev box on your desk and you're saying like, oh, I think this is what's happening, right? Like at some point when you debug something, you just have to kind of poke at it. But I can't imagine like that latency, you have a 90 minute window. I don't know how long that window lasts, but you're like, oh, I got a shell for 89 seconds.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Like I got to jump on the box and like poke at something.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I can only imagine the like constant TMUX session. That's like, oh, it's coming back around. Let me connect to it again. Hold on. That's just amazing.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Oh, and then your SSH hangs and you're like, dang.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
That is exactly what I would hope to be.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
There's so many challenges in this. What would you say is like one of the things that stood out to you as like something you didn't expect? Because I mean, you're going into this knowing this is going to be a hard thing to do. There's a lot of variables and things at play. What is something that surprised you about shipping software into Orbit that you're like, wow, I didn't see that one coming?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I wonder what the culture was like in the 60s. Right. When it's like we are landing on the moon because that like they had to move faster. Like my grandfather actually worked on the Apollo missions, which is just like his pictures were absolutely amazing. And it was I never got to hear stories from him of like what the culture was like.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
But I can only imagine that like at some point you're just like, no, this has to happen this decade. Right. Yep.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
someone's you know so someone said we're going to the moon and the fact that like so many people and so much funding and money was in place to do that and now on the opposite side where it's like no one told you to do this like no one told you this is the the thing we have to do and and so the initiatives are very different of like hey we see where we can add value to people that's
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
maybe had to drive their truck for two days to go see this pipeline or something like that. Like, Hey, I got you in an hour and a half and you're going to get your images and they're gonna be processed and we'll see all that stuff that maybe you couldn't see before. And that's just pretty amazing to be able to add that value that quickly.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
What's the lifespan? We're talking like servers are like seven years, right? Like I can buy a server, put it in a rack and I hold it for seven years. You launch a spaceship and how, not a space, I don't know a technical term. It's obviously a satellite because there's no propulsion or anything. What is the lifespan of those first three satellites that you launch?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Like Starlink, do you have satellite-to-satellite communication to help with that 90-minute delay? And will five satellites reduce that for you significantly?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
All right, thank you so much, Andrew Gunther, for being on the show today. And today we're talking all about shipping in space. And so welcome to the show. And my first question is, when you have some code that's running in space on a rocket ship, and if it's a class that maybe is undeclared, is that an unidentified flying object?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
would that be like the outro net?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Who's the jerks in space? Is Starlink, is that, they just litter everywhere and we can't see around them? Is there some other, these people don't have another country that's like, well, they're not working with FCC, so they just threw. If you can't answer it, that's fine, but I'm curious now, is there space beef between satellite vendors now?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How close is really close? Like, I think a space is like is like you're hundreds of miles away. But no, this is really close is probably close enough that somebody called, right?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
But what's the heads up for that? Is that like you have 10 orbits and then you're done? Or is this like, hey, like 90 minutes?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I can just imagine you're like wiggling the camera, like trying to focus back and forth to like get out of the way. Like maybe we can move something.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I literally was up last night and I thought of that. Like I woke up and I was like, that's the joke. And I'm like, oh, I'm such a dad. Anyway.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
But every time they're like, the call options have changed. Yeah, yeah, yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So your satellite is forever. Norad always thinks your satellite is now.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Clerical, that was good. That was a pun. Yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So anyway, bad jokes aside, Andrew, tell us about yourself and what you were doing at Orbital Sidekick.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah. PCAP file, read it in and like parse the spinning, spinning those PCAPs.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Andrew, thank you so much for coming on the show. This conversation has been a rocket of a ride. I had to get one in. It's all right. And I learned so much. Justin, you're killing me. Where, where can people find you to, to ask more questions or, I mean, I know orbital sidekick.com is the website for the company, but I know you're available or at least somewhat social online.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Where should people reach out and find you?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So today on the show, we have Anita Zhang from Meta. And Anita, you are a engineer D, manager D is your title. Is that correct? Yep. I think that's fabulous as a Linux user and a long time restarter of services. Tell us about what you're responsible for at Meta.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So you're the kernel of Meta's infrastructure?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
One layer above that. So describe the infrastructure, describe the Sforces. I've been following what Facebook and Meta have been doing for a long time as a Red Hat user at other places and seeing the upstream contributions. But I know many people to this podcast may not know what that infrastructure looks like and what you actually do.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I don't know anything off the shelf that's going to do a million hosts.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And what does that look like for what you're doing on the fleet level? You're provisioning the OS or have some tooling to provision the OS. And from talks that you've given that I've watched, you had a great talk at scale, by the way. If anyone wants to see that talk, it's on the scale websites. But you're doing upgrades.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
If I want to upgrade a million hosts, I was like, hey, I need to roll out a new version of the operating system. that's going to take a little while. There's a lot of process and there's a lot of risk there, right? Because like you could be causing other things to fail. So how do you do that in a safe way and at that size?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Describe Fedora ELN. Like why is that different than what you're running?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Basically like the Rawhide equivalent of like, hey, this is a rolling kind of new thing. Yeah. But eventually that gets cut down. How does that relate? Or I'm actually really curious, like CentOS Stream, right? When they moved to this rolling release style of distribution, how did that affect how you're doing those releases and doing upgrades for those hosts?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Because you have to at some point say like, this is the thing we're rolling out, but the OS keeps going.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
The repo syncing, I had a project at Animation where we had RHEL that we would sync all the repos internally. It all sits on NFS. And then we mount everything to NFS to pull in repos. And I forget, it was like a Jenkins tree of syncing jobs that would all run to register a system and pull down. It was like 300 or something repos that we would sync every night.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And I'm like, OK, let's fetch all the files now. Oh, yeah. And then squirrel those away somewhere on a drive and then host them so that everyone else can can sync to it and then have it roll out to the testing fleet.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
It's a lot of data and it's a lot of stuff that just have to, as packages get removed from upstream and you're using them in places, I'm assuming you have some isolation there because as far as I know, most of your workloads are containerized on the Twine, on TW shared as the base infrastructure, right?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Is that an update for the base container layer or whatever they're building on top of?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Can you describe TW Shared for the audience as well? Because that's one of the things that I think is really fascinating that you have your own container scheduler. And as far as I know, all those containers are running directly with system D, right? Like you're not having like a shim of like an agent. I mean, you have agents, but go ahead and describe it.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And that's systemd inside the container?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How does that work with the sidecar? I would assume, I've never really actually done this side, like systemd inside the container running on systemd. So if I log into a host, not the container, I see just services all the way down. They just look like standard systemd units. They're just isolated from each other. Is that right?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And that was the question I actually had. It was like, I assumed that JournalD would handle the unit logging, but you say there's a sidecar that I'm assuming is like getting that logs out to JournalD on the host or at least some way so that you don't lose those logs inside the container.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
That's cool. At that point, it's just native system D, really. We're just using every feature of system D to isolate and run those jobs. And then you have an overarching scheduler, resource allocator, all that stuff.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
One of the things that I found super interesting in the white paper was host profiles, where different workloads, you basically virtually allocate clusters, I guess, for lack of better, entitlements is what you call them, for like, hey, this job gets this set of hosts, and then you can dynamically switch those hosts to needing different kernel parameters, file systems, huge pages.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And you have a resource allocator that does that, as far as I understood. How does that affect what you're doing? You have a set of host profiles. You say, hey, you can pick from a menu. And then we know how to switch between them. How does that typically work?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And hopefully not physical fires. I mean, these are spaceships and rockets.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How does that affect you as the OS team? Like, is there anything that you're doing specifically for that?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, they had them at scale and I was very jealous because they're cool. And this is an audio podcast, so no one knows what we're talking about. But basically, it's a bunch of little small tuxes inside the hood of the hoodie.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
That's something you have to wait for it though, right? Like you're like, we're going to write this internally. We're going to hope this gets upstreamed. And then we have to either wait for the release to consume it, or we're just going to keep running it. But then if upstream needs changes, you have to kind of like merge back to it.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How does release frequently and a million hosts go together? Because you mentioned that it takes about a year to basically roll out an update to every host. But if you're pushing out updates to the OS every month, then you have 12 different stages of things that are going through release. And that makes it really hard to debug and predict, oh, what version are you on?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Did we fix that bug somewhere else? How do you manage that?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
You mentioned an AI fleet. From what I've heard, Zuckerberg talk about is like, Meta has more GPUs than anyone else in the world, basically. How do you manage that? Not only are how the drivers installed, because Linux and NVIDIA aren't always known to be the best friends, but then how do you isolate those things and roll out those changes?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Under TW Shared, do they just show up as a host profile? Or is that like, do I get an entitlement that says I need GPUs for this type of workload?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Okay, that's interesting. One thing I found fascinating about some of the talks you've given and information is the fact that Meta is still notably an on-prem company. You have your own data centers, you have your own regions, you have machines, and it doesn't seem like you try to hide that from people. You don't try to abstract it away.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
At least I haven't ever seen a reference to like, it's our internal cloud. No, it's like it's a pool of machines and people run stuff on the machines. And the...
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
software and the applications running on top of it are very much like a this is this is just like system b unit you're just running it containerized what other types of services do you have internally that people need i mean i saw references to things like sharding for like hey we need just fast disk places and we need some storage and databases externally but like what are the pieces that you find that are like common infrastructure for people to use
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Right, how those shards, making sure enough of the data replicas are available.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Typical DBAs. What would you say are some of the challenges you're facing right now on the OS team or just in general in the infrastructure?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And you mentioned that as far as moving more things out of something, traditional configuration management like Chef and moving it into more of a host native binary that can manage things, I don't want to say more flexibly, but I guess more predictively. I think you mentioned that where it's just like, yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
You also mentioned in the, again, referencing the paper, because I just recently read it. All of your hosts are the same size, right? It's all one CPU socket. And I think it was like 64 gigs of RAM or something like that.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Okay. So the majority of TW shared is like, we have one size and you're just like, everyone fit into this one size and we will see how we can make that work. Right. Cause you, you can control the workloads or at least help them optimize in certain ways to say, cause like not all AI jobs or big data jobs are going to fit inside of that envelope.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So yeah, it's more of like a, a bin packing approach and saying like, Hey, maybe we do have some large hosts for, especially for, I'm assuming for the jobs that do need like, Hey, I don't fit in 64 gigs of Ram and I don't, you know, local NVMe isn't fast enough for whatever reason, or it's going to cause the job to run longer.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, I suppose once you have any sort of specialized compute or interface, whether that's network, some fabric adapters, you always have snowflakes in some way. It was like, hey, this is different than the general compute stuff.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How has that affected your global optimization around things? So I know, again, the paper was old now. It's like 2020, I think, is when it was published, which is probably looking at 2019, 2018 data. But in general, it was something like 18% overall total cost optimization because of moving to single size hosts, because you're just like, hey, our power draw was less overall globally.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And something like, I think it was the web tier was like 11%. I should have had it up in front of me. 11% more performance by switching to host profiles and allowing them to customize the host. Have you had things like that over the past four years with these either optimizations in specialized computes that have allowed you to even gain more global optimization?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Because a million hosts, like a 10% gain in efficiency or lower power requirements is huge. That's like megawatts of savings.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
That's fascinating.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Have you been enabling that through like FPGAs that you allow people to program inside the fleet? Or how does that like, how do you come out of like, hey, we have an ASIC now and it does some specialized computing task for us?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And at some point they have like, here's a chip, go install it for us. And you need, here's a driver for it, right? Like they need to give that to you as a host team.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, I really want to see an org chart now. I was like, there's so many of these teams that just keep popping up of like, oh yeah, no, we have a team that does that.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And you've been there for a little while now, right?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
What are you looking forward to working on in the next year? Are there big projects or big initiatives that you would like to tackle or even things in the open source or like things that you want to give back and make sure other people know about?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
That was one of my best claims of fame at Disney+, was I disabled rsyslog. I was like, no, we don't have it. It was just journald. I was like, we're just doing journald now. And it saved us so much just like I-O throughput on the disks and everything. And there was a lot of problems with it, too. Maybe we weren't ready to do that. But I was like, no, we can't ship Disney+, until rsyslog's off.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
It was great. It was a great feeling one day where I'm like, I don't need this anymore. I don't need our syslog.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Is that for resizing the like container, like the C group and saying like you, how much memory they have available or is that something different?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Interesting. It's a little like, get back in line. You don't get that memory.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Have you been doing anything with immutable file systems or read-only, or AB switching hosts? Fedora has Silverblue. I use a distro called Bluefin, which is built on top of that, which does AB switching for upgrades to do reboots every time. It sounds like you're doing rolling updates, so you would still be writing packages to disk instead of flipping between partitions.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And I was asking that because leading into you saying you want more systemd stuff, and I'm curious if you're trying to use things like systemd system extensions or sysx or whatever it's called that are like layering different things on top of systemd, which is typically for an immutable file system, but still allow changes to happen.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I'm just thinking of Nvidia drivers now. And I'm like, oh, like that's the worst, like trying to like on a Linux embedded system. Well, how are you?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah. It's one of those things that looks really interesting, especially if you try to move more into immutable file system layers. Like, hey, I still need to configure this. And how do I do that in a composable, immutable way?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Well, Anita, this has been great. I'm just nerding out because I'm trying to learn all of the things that I've done in the past and still doing in the future.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I think it's great that Meta is not only doing this at just a core level of just like, hey, we just have SystemD and things running in that, but also giving back upstream with the SystemD builds and all the stuff that you've been publishing, not only white papers, which Autumn and I were reading, and talks, but also just the open source work. So I think that's fascinating.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
because that's a whole other topic.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I find it fascinating because Meta is one of the few places that doesn't sell the things that they talk deeply technically about, where it's like a lot of Amazon and Google and Microsoft are like, hey, we built this amazing thing. Now go buy it from us. And at Meta, it's like, no, we're solving our own problem and we're just giving it back to you.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah. Yeah. I've been running Llama. I haven't done Llama 3 yet though, but it's on my list of things to play with. Awesome.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Anita, thank you so much. And we'll reach out, I'm sure, in the future with more things, maybe in the future, talk about eBPFs and ASICs and more work that you're doing on the OS layer, because that's just a fun thing and seeing how it grows.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Thank you so much, Gina Hoiska, for joining us on the show today. And can you tell us about yourself and how you got started with creating Octoprint?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
That's one of those success stories of open source and crowdfunding, right? Because that's not a common thing for it's like, oh, one person started a project and now you can actually make your living off of this hobby or originally hobby sort of thing. And that's really awesome just to hear that it's the community around it has come together to be able to support such a cool project.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
What printer was even available 2012? That's like the CNC cupcake machine.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, no one even knew what to do there.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So in 10 years of Octoprint, how many printers do you support? It seems like it grows every time I check it out.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, I switched off from an Ender Pro to a Bamboo, and the Bamboo is pretty much self-contained. Closed source. Yeah, closed source. And it was like... I had such a hard time because I had so many printers in the past that I always wanted them to be open source and I wanted them to work certain ways. And I always spent more time fiddling with them than using them and printing.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And so I saw recommendations for the bamboo and I'm like, I'm going to try it. I'm going to go with this one. I know it's closed source. They have a whole ecosystem of stuff. And I think the problem is going to be when, when things break and I can't fix a problem or I can't troubleshoot and find, you know, Find a community around like, hey, how does this work?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
It's all just going to be like, oh, well, here's a janky fix we have that shows you how to do something.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Now back to Octoprint for a bit. I saw you had a release last week. What does that release process look like? Because you have this huge system that supports all of these printers and you have these plugins and all of these features. How do you actually go about releasing and testing that to say like this is a new release of OctoPrint?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah. Long-term support has a different meaning when it's flying around the world. Yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Well, that's what I've been doing. No, this sounds fascinating. I didn't even know you could have an SD card on one end. It's connected to the USB on the other side, and you can switch it back and forth.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Does it have pictures?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I need to find that so we can add it.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How many core maintainers are on OctoPrint? Is it just you? It's just me. What software were you writing before OctoPrint?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
There you go. So you went Java to Python, basically.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And you said you've been crowdfunded for eight years now. Yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I do find it interesting that the commercialized spin wasn't even an option for you there. You could have tried to raise money and say, this is going to be a product. I'm going to make a new business out of it. And you have this open core model, paid plugins, whatever you want to do. So many companies do that.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
And that's how they get started because it was a side project or it was something they're interested in. And for you, it was like, I either abandon it or I do it all community. And that's awesome.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Now, I don't know if you can go into details, but where does your funding come from? Is that from like recurring businesses that say, hey, we want to pay for you to... No, that's mostly users.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Do you know how many installs you have, or roughly how many?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
First of all, that's really cool when I think about like 30 people, three satellites, right? Like 10 people per satellite in space, you're going to have a couple more. And like, that's like the opposite scaling of what I think of for like running systems where it's like one sysadmin can do a hundred machines. It's like, but like a spaceship, like it's literally a satellite.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, I was gonna say 150,000 opted in. Yeah, that is that is usually a very small percentage of people that are like, yes, I will let you get this information. That's awesome.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Right. Well, yeah. So if you estimate 10 times more, that's 1.5 million. I could see that. That's totally not even out of realm.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
It takes so much time and process. What does that actually look like for you of... We're going to make another, you know, satellites. It's going to go out next year. Like how, what is that lead time for like your, what you're writing today? What, what decisions you're making about around libraries and code? And then like, how do you get feedback for that?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Enterprise Java helping people? I don't know. Sorry, Autumn, no shade.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
A lot of stuff does. When you mix those two words of enterprise and Java, I don't have any good memories.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Well, that's just because your variable names aren't sentence long, right?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
So where do you want to bring Octoprint from here? Like, what's the next thing that you would like to do? What is the next sort of like big, like, it's not just, you know, more printers are fine. I mean, I still think that you have influenced that standard of communication by having this early project so long that was be able to, you know, talk to all these printers. You have this plugin system.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
What's the next thing you want to do? What's the next cool thing that you're like, I would love if Octoprint could do this.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How do you make sure that like that thing that you think is going to be accurate next year gives you any kind of feedback loop?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Only after it breaks.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah, they need to.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
You talked about some things you'd want to make changes in the future. Looking back of more than 10 years of building this project, what do you wish you would have done differently?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
How do you... Because a lot of that comes from just learning, either scaling the projects and needs to change over time, or you didn't know how it worked back then and you just learned a new way of doing it now. How would you go back in time and teach yourself, oh, you should do it this way instead? Is there a way?
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
The curse of knowledge.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Yeah. That, that is the real wisdom of this podcast right now is like, people say like, don't push on Friday. And you're like, no, no, don't push after Wednesday. Like if you're, if you're pushing on Thursday or Friday, you're just asking for it.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Someone else to try and then call you. And that is like, they need a day.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
It's like test with users.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Or they have like some crazy workflow where you're just like, what? Like, would you do what? Like, oh yeah, no, I drop to the web console every time and I type my commands manually in JavaScript. You're like,
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
It's only the weird use cases.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Well, not always, right? I mean, you can spend the whole week automating something that you do once a year. And in this case, you're like, oh no, this, this taste went from a day to an hour is a good use of automation. Yeah.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
This has been a fantastic conversation and thank you so much for coming and sharing all about OctoPrint and what you do for anyone that's listening. If you're not familiar, if you have a 3d printer, go check it out, run it on a Raspberry Pi three, donate to the project. Cause this is one of those successful open source projects that has been around for a while. I'm, I was a user for a long time.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
I am also a donator. So I, you know, Encourage everyone else to go out there. And it's great having an integrated GitHub sponsorships and all those things that you have for the project make it really easy. Just say like, oh yeah, here's $10, here's a recurring buck or two.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
All those things go a long way to help promote the work and really promote the idea behind successful open source that can be community run and community funded is an awesome success story.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
possible. Thank you so much, Gina.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
The attack surface is a little different than what a typical server might have.
The Changelog: Software Development, Open Source
Flavors of Ship It! (Interview)
Fundamentally, a customer comes to you and says, I need you to look at something on the ground. You're not running customer code in space, right? They're giving you a job to say, like, coordinates, please send me this data, right?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
It had good properties, but it was not good for somebody who watched the original.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I love it. Okay, so they mean it when they say code breaks. Fix it faster with Sentry. More than 100,000 growing teams use Sentry to find problems fast, and you can too. Learn more at Sentry.io. That's S-E-N-T-R-Y.io. And use our code CHANGELOG. Get $100 off the team plan. That's almost four months free for you to try out Sentry. Once again, Sentry.io.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Yes, in my opinion, it was good. I'll answer that easily. I think the cinematography was phenomenal. The soundtrack was phenomenal. I think the acting was continuous from where it began to where it ended up. There was a lot of throwbacks and cuts between that connected. So they did a pretty good job, in my opinion. It was a solid movie. We'll count it. We'll say we thought of one. Oh, Dune.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Oh, yeah. Dune is good.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
That one was kind of easy, though, honestly, don't you think? Kind of easy. We didn't say. I mean, it was so bad. It was so bad. It was so, like, cheeky bad. A lot of people like it, though, don't they? But I will agree. It definitely is a good. And the sequel. Mad Max Fury Road. Now we're on a roll here.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Oh, just that a part two was good. And you know, I think part two is actually potentially better than part one.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
You know, there was a lot of good stuff in there. Part two of the same, of the new movie. Right, of the reboot. Part one was a lot of character development and buildup and backstory. I never saw the second half.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I did not read the books. I'm sorry. You're not proper nerds. No. I want to read the books. There's just so many of them. It's a lot. It's too much. I want to be the kind of person that read the books. I believe that Brett Cannon said.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
So I guess one thing for you, Jared, is the director of Dune Part 1 and 2 is also the director of Blade Runner 2049.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Oh, Arrival's good. Enemy, which stands out to my brain, but I'm not sure why.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I'm not sure I would meet somebody to get it. You wouldn't use your money? No, I mean, I would buy it. I would, I would buy it from like eBay or something like that. I'm not sure if I would like meet locally to, to get it.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I am with you on the Put Em In Plex part. You know, I feel like if it's not full res on Plex, it's not a movie. How about 480i for two bucks? You can go for that.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
If that's all it has. Yeah. If that's like the max resolution available, then sure.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Jared and I grew up in the era when you would watch, what was the movie? Give me a second.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I do not strap. We grew up in the era when you could watch Boys in the Hood, 1991. When you could watch it? Yeah, you could still watch it today, but we grew up when it came out. Oh, yeah. Right? It was 91. 91. Heck yeah. And so I learned strap probably from that movie there. I was wondering where he was going with that.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Right. Yeah, that would be nice. Time travel. I would definitely time travel to do that kind of stuff.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
pod here yeah I mean eventually we have to rename it but I want to I do want to throw one more thing in there just to close a loop I love it close it for us okay close the loop on 1995 I'm gonna just name some movies because these are the ones yeah okay okay Toy Story yeah the original Braveheart yeah amazing seven yeah wow The Usual Suspects yeah Apollo 13 nice Casino yes Heat Jumanji Okay.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Die Hard with a Vengeance. And Goldeneye. Vengeance was all right. Goldeneye was pretty good.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Oh, what? Jurassic Park? Assuming no hallucination, that's accurate. Who's hallucinating?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
You were thinking of The Lost World then because in 1995 The Lost World comes out, I think as a book though. Yeah. And you read books, so.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I don't read books. I'm just saying. I read a lot of my fiction just, you know, not by reading it.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Right. Well, he did write Twister the year after 1995. Now we're stretching. Just to close one more loop.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Apparently it did.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Okay, friends, I'm here in the breaks with Annie Sexton over at Fly. Annie, you know we use Fly here at ChangeLog. We love Fly. It is such an awesome platform and we love building on it. But for those who don't know much about Fly, what's special about building on Fly?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
So we use Tigress here at Changelog. Are they built on top of Fly? Is this one of those examples of being able to build on Fly?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
very cool thanks annie so fly has everything you need over 3 million applications including ours here at changelog multiple applications have launched on fly boosted by global anycast load balancing zero configuration private networking hardware isolation instant wireguard vpn connections push button deployments that scale to thousands of instances it's all there for you right now
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Deploy your app in five minutes. Go to fly.io. Again, fly.io. And by our friends over at Paragon, useparagon.com. Check them out. Ship every SaaS integration your users need. With more than 100 plus pre-built connectors, you can add dozens of integrations to your app quickly and reliably. with their embedded iPaaS for developers. And I'm here with co-founder and CEO, Brandon Fu.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
So Brandon, talk to me about the friction developers feel with integrations, SSO, dealing with rate limits, retries, auth, all the things.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Okay. Paragon is built for product management. It's built for engineering. It's built for everybody. Ship hundreds of native integrations into your SaaS application in days. Or build your own custom connector with any API. Learn more at useparagon.com slash changelog. Again, useparagon.com slash changelog. That's U-S-E-P-A-R-A-G-O-N dot com slash changelog.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Like, oh, we're actually friends now. Okay. It's a different style of communication on the same device. It's like a DM in Twitter or X is still an app on your phone.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
You always have to ask yourself, can I keep doing this? Whenever you're really in any position where you feel like strain, I suppose. I think so. Definitely during the pandemic. You know, there was a lot of pressure on a lot of sides of our lives. So I would say during the pandemic for sure. You know, can I keep going at this clip? Can I keep, is this what I'm doing today sustainable?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Or Slack, yeah. And then suddenly it's like literally in messages if you're an iPhone user, like I am. Like this is where my mom texts me. This is something real.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
And if it isn't, how long do I need to keep doing it to get to the next lily pad?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Yeah. I mean, I think that's kind of what life is, right? No matter what, you're just like looking for that next lily pad. That's my analogy at least, right? Like you want to be a frog above water. Sure. If you go underwater, you got crocs under there. You got things under there that can get you. Yeah, that's going pretty well.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Yeah, I think that's spot on to try to do your best to maintain equilibrium until the next lily pad appears. Sure. Because it could be, you know, too far of a leap and you can land in the water.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
sure laundromats what was your other one laundromats storage businesses they say those just are less likely to fail they're recession proof things like that yeah they're more like investments than they are like yeah same thing with like you can translate storage units to like mailbox storage people don't want to change their address there's stress and change they don't change
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
They hold off for at least one more year, and that might happen two years or three years. And by then, you've got enough recurring on that person that you're, as a business owner, you're kind of protected or insulated a little bit. There's lots of studies on those boring businesses. Laundromats is something that a lot of towns need. You don't know it until you know it, really.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I mean, you've got a lot of people who are in between things and just need a place to wash their stuff. It's like, hey, I need to go to a laundromat and, you know, a high quality one could do a good job.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
What's up, friends? I'm here with Kyle Carberry, CTO at Coder.com. So, Kyle, I've known Coder as the IDE in the cloud, and over time, you've iterated to become a fully open source cloud development environment, a CDE. How do you explain what Coder is and what it does?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Okay, so what are teams coming to you for? Who's coming to you?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Let's laser focus in on the platform engineer. It is that team's job to provide the best infrastructure, the best platform for their given applications, for their teams. What are some signs or signals for platform engineers to think about when it might be time to consider a cloud development environment like Coder.com?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Well, it might be time to consider a cloud development environment. And open source is awesome. And Coder is fully open source. You can go to Coder.com, get a demo or try it right now or even start a 30-day trial of Coder Enterprise. Once again, Coder.com. That's C-O-D-E-R.com. Coder.com. I'm curious, though.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
This idea of influencers on tap, I'm just on your homepage, so I'm just leveraging your headline.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
What was appealing about that to go from the, as you said, the big cloud jobs, this identity even to be like, wow, I can. Yeah. And then I can too.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Like the idea is good and I'm capable.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Yeah. A 403 number, I believe. Is that what it was? 407.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Is that the Florida as well?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
All over the place. By the airport, by Universal. I think it was called Westlake or Westgate. Maybe Westgate. Does that ring a bell? West something. Near Full Sail for a little bit too. Yeah. So all over.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Didn't the conference do that, though, where they generated some people? Yeah. Like, last year, wasn't it? What was that conference? They generated women speakers, right? It was women speakers, but it was the same idea, but it was, in that case, trying to slight the gender skew, so to speak. Yeah. But it was still the same premise.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Like, let me generate somebody to seem credible so that we seem credible.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Right. And they almost got away with it.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
That's cool. I think we need more of this, honestly. I think that it is a challenge for brands. I feel bad for some of the brands out there. They want to have the ability. They don't know how to do it internally. Maybe they don't even have the resources to staff up or employ that person or persons.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
And sometimes you need somebody inside the company that can think holistically and say, well, this exists, but I've got to put the work in. I've got to go out and interview all these different places. I've got to ask them for proposals. I've got to essentially learn as much as I can about every potential channel or content source.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I hate to label people as these just widgets kind of thing, but that's the truth. We're in that regard as well. We get reached out to from folks. And for us, it's really about... Can we help them? And what is their, who are they trying to reach? Do we actually talk to the people they're trying to reach? Is their message clear? Are they in a mature state where that we can even apply help?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
They need help, but maybe they need to change in order for our help to be. Yes.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
adequate you know like we can only give you attention we can't give you the guarantee like just one thing i can't guarantee this article goes somewhere you still have to do the work being you the brand your landing page your marketing your product who you are your actual literal brand not just your logo has to be where it needs to be to capture not just simply get pointed to yes
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Hey friends, I'm here with Dave Rosenthal, CTO of Sentry. So Dave, I know lots of developers know about Sentry, know about the platform, because hey, we use Sentry and we love Sentry. And I know tracing is one of the next big frontiers for Sentry. Why add tracing to the platform? Why tracing and why now?
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
That's a good call to action.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
It was a good call to action. Yeah. I was with you too, Jared, though, on this idea that the fact that AI exists in this slop mannerism, it elevates the actual human. And I think the for now is potentially key. Sure. The human in me wants to believe that a human-to-human relationship will always be more valuable than a human-to-machine relationship, although I've seen the movie Her.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
And I've seen how twisted people can get at some point in life. And you don't know you're twisted because you don't have perspective. You just live in a modern world and modern world is however modern world is. And so acceptability is skewed based on societal acceptability, not just simply morals. Although there's always that outlier or outliers that direct, you know, back to the moralistic ways.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Yeah. But I'm happy because that you still require, you can have AI give you a plan. You can have AI give you a list. You can have AI give you slop and or tons of stuff to edit down. And I think for now, you can't have AI give you the humanity to initiate, engage, and be the human in the world.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
You still need someone to not just be like, oh, this is how you market, but more like this is how you connect the dots. And the dots are the problem sets with the people with the problem.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
with understanding the pain and, and not just simply coming at it straight, but more like from a different angle that only humans can do because we think so multifaceted that we see a problem differently than it's not just like, Oh, here's, here's problem. Here's solution connect.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
It's so much more unique than that in the way that you hear somebody's story or a brand story and where they're at and how to get them truly connected with an audience to make that authentic connection. It's such a, such a magic art to do. And it's such, it's so hard to do, but for some it's easy, but it's still so hard even when it's easy.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I've been long LinkedIn for a very long time.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I've been diehard collecting friends, but really only people I know. So I've been hardcore about knowing somebody or having met somebody or want to be truly connected to them in some way, shape or form, like truly networking. And I don't mean that in that like I'm being posh or, you know, anything like that whatsoever.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Just more like I wanted to be about people that I was trying to connect with in some way, shape or form or met literally face to face or virtually in meetings and stuff like that.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
not really this like hey i want to follow you now they do have the follow mechanism but literally connecting that was what i was trying to do there so i feel like all my connections are pretty proper connections not just like you know randos on the internet that i'm a fan of right yeah or vice versa i like the thing where you can deny a connection and say i don't know this person that's right that's right it just feels like the right thing to do doesn't it it does i don't know
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
It takes all kinds. I don't mess around with tornadoes, man. I've seen the movie, both of them. Both of them. You see the new one? Trailers, at least, of the new one. Teasers.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
He got close enough to that.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Let us know. Yeah. It's got good reviews. Yeah. I feel like it's many of them. Twisters. Yeah, they pluralized it.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
I can concur on that with Wonka.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Yeah. I try to explain it to my kids. I'm like, it's not that that one was better. It was weird. I'm not sure I wanted more of the weird, but I didn't want a complete opposite story.
The Changelog: Software Development, Open Source
Starbucks DVD peddlers (Friends)
Like the origin story does not connect.