Meredith Whittaker
Appearances
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Good morning, Linus. Good morning, Tim. Linus, what watch? Ten watch. Such much? You'll get along beautifully in America.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It is the world's most widely used truly private messaging application. I always have to put the full sentence in there. A very special messaging application.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I mean, there are many. So I was not working on MLAB by that point. Because there's a part of this story that I didn't cover, which is around 2014, 2015. We started seeing really interesting artifacts in the data, which showed essentially that at particular interconnection points between particular telcos, We were seeing drastic drops in performance.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And what we were able to do was look at every intersection of telco one and telco two, we see this drop. Intersections of telco three and telco two don't see this drop. And so what we're able to do is say there's actually a business feud there.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
going on and the interconnection point is the locus of that feud and using trace route data we were able to say like look these aren't so it's not just that they're sharing a path in some other you know region of the network that's slowing it down they're actively throttling they're actively throttling and what that we put together a report on that and you know kind of this is where i was sort of
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I think kind of sideloading myself into some academic research work. I was like, okay, how do we do this? How, you know, method document, our methodology document sort of, you know, everything was open. So we pulled that together and it, um, it showed, I don't know if you remember, there was a sort of Comcast cogent Netflix. Netflix was shoving all its graphics through cogent.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
What we had done is expose that and exposing that it exposed the principle of that you have to, if you wanted to ensure net neutrality, you have to take the interconnection points and the interconnection agreements into account. And that led Obama to add interconnection to the reclassification under Title II of these, you know, which kind of moved toward net neutrality that was then nullified.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But, you know, that was kind of the swan song, let's say, for my MLAB time, because, of course, that was a huge deal, right? Like, that's where the business model rubber hits the road. Yeah.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We build against the grain, to put it in kind of flowery language. We go out of our way to build for privacy and to get as close to collecting no data at all as possible, which, as you and I assume many in your audience know, is a lot more work.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
and you know i'll just shorthand it like that bought me a lot of capital at google and with that i was you know i was already interested in a lot of things m lab was sort of humming along and like it had grown from a hypothesis project to like a global thing that was working and and doing stuff um and i had started getting agitated by ai and a lot of these privacy and security concerns being part of the community that you were part of you know kind of thinking around like
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
tech alternatives and getting less comfortable with the business model um and from there i always had like eight different projects going on but i went on to found to co-found the ai now institute which was really trying to bring the conversation on what we called machine learning back then but like ai was like a flashier term like bring it down to the ground a little bit and stop talking about super intelligence and start talking about you know political economy and
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
What are these technologies? How are they being deployed? How do you oversee them? Who uses them? On whom? And what are the social and political dynamics of that?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It was at NYU and it moved out of NYU for reasons of that being easier. Okay. And cheaper because they take like 40% those universities. Okay. Word to the wise, your money.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
for a reason right i mean an nyu institute that's yeah i mean it works something to have yeah i think co-founded uh i mean it was the work was really good and this was again like you know kind of gaining the capital at google cementing a reputation being able to get to a level where i had a budget and then you know part of what i was always trying to do is how how much can i pull out of google and get into the hands of people doing work that i think is cool like how do we
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
like, carve tributaries in the massive river of this huge, rich company and, like, get it out.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, beginnings are sometimes hard to date. It was born out of a request from the Obama administration to be the host of one of his AI summits. I don't remember exactly the contours there, but it was in 2016. Mm-hmm. And so it started as like – like the idea then was like let's do this and let's do it big.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like let's make this the most polished, flashiest, like hard to ignore kind of spectacle using all the tools we can get from like hiring an events agency, doing good press, all of that. But let's also make this the one that is the most –
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
engaged with these political topics that's actually forcing the debate in that direction and kind of you know making it face these questions that are much more grounded and you know hopefully much more healthy for our you know position on ai so it was it was very successful and and from there we got you know offers of funding and a lot of encouragement and the work just kept kept going
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, encrypting is part of that, but then you need to make sure the encryption works. And then encryption of message content isn't going to solve all of your problems because you also have metadata. You also have libraries you're pulling in. You have core services you're working with.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. To answer this question, I'm going to be like drawing on a lot of the research and the historical work, kind of the work I've done since then. Because when this dawned in my life, like when it started being a thing, I was very I had basically that same question. Like, what is this stuff? Why is it? Why is it kind of at Google? You would see a shift toward a new paradigm or a new trend here.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
by the incentives that were structured into the OKRs, the quarterly goals, that kind of, you know, there'd be all these training modules that would pop up and it's like, make your software engineer into an AI developer, you know, and you'd be like, there's an incentive here.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, they were, that was deep mind era. Okay, okay, good. Sorry. I think they were, they were ahead. It was them and Meta for a long time.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
No, but they're chaotic. It's a kind of court in decline so that, you know, actually where the actually the business model part has never been their strong suit beyond search to be real, you know, like cloud is like the best technology presented confusingly with 18 versions, all deprecated, right? Like that's, but this, the, the AI stuff was, so if you look at the,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
If you look at the sort of recent history, which is something I've spent a lot of time on, I spend a lot of time on because I think that gives us a really different picture than the Elon Musk narrative or the kind of popular narrative. There's a very important paper that was published in 2012 that introduced the AlexNet algorithm. And this was Jeff Hinton and his students.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So there's a lot of ingenuity required to actually create a system that is rejecting the normative assumptions of the tech industry today, which is that we all want to collect a ton of data. And we all want to monetize that data. We want to sell you ads with that data. We want to sell that to different customers as a data broker. We want to train AI models with that data.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, if you claim that your technology is everything, then you can get a prize in anything.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And it was Ilya Stutskever and then Alex, and I'm sorry, Alex, I am not grabbing your last name from the ether right now, but nonetheless, this was a paper that kind of
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
pulled together key ingredients that became the foundation of the ai ai boom now so this is deep learning algorithms which is the paradigm we're still in it doesn't matter you know there's architectural sort of rejiggering but nonetheless it's deep learning um huge amounts of data so the what i've called the derivatives of this surveillance business model he found all the cats on youtube
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I mean, yeah, that was Jeff Dean, I think. And then, you know, powerful compute. Right. And they they showed that sort of using gaming chips and a lot of data, you could beat the benchmark. So do much score much better against standard evaluations than past models and thus sort of catalyze the industrial model. like industry interest in AI. And why were they interested?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I think this is a key point because these optimist-seeking algorithms are really good at curating news feeds. They're really good at figuring out algorithms, right? And so I don't think it's an accident that
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Jeff was immediately hired at Google that, you know, Yann LeCun, who wrote the sort of deep learning algorithms that became the sort of seed of this current moment in AI, wrote them in the late 80s, was immediately hired at Meta. And it was the platform companies with a real investment in, you know, squeezing more ad dollars out of the data, sort of, you know, better serving, all of that, that
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
you know, were first to AI. And this is, you know, Google with DeepMind, you see Meta and Google being kind of the leaders in this, you know, as measured by different evaluation standards, like the measurement question here is actually really
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
interesting, kind of troubling until this generative moment where I think that the chat GPT Microsoft products kind of shifted people's perception of AI and what it can do and just like rearrange the leaderboard. But the paradigm is still the same. And the paradigm is still that AI is applying old algorithms on top of the sort of
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
massive platform monopoly business model, availing itself of huge amounts of data, which is produced via this surveillance business model, and really powerful compute that was designed, built up, I would say, consolidated in the hands of these platform companies. via the imperatives of the surveillance business model, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Most of the infrastructure in the tech ecosystem now assumes that as a given. And then we have to rewrite things too.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And large compute, right? For both training and inference.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I don't... I mean, I think... This is almost a perpetual motion machine, right? Like every quarter you have to report progress. You have to report growth. The logic is metastasis, right? And so you're trying to squeeze more out of what you have and you're trying to get more of what you have so you can squeeze more, right? There's also these sort of laws of scale. Remember big data?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We used to call it that. And so I don't actually know the answer to your question, but I think it... Like, which came first? But, well, I mean, the business model came first, right? Like, you had to have the ingredients to know what they did together.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I think it was, you know, deep learning and AI has sort of languished in the backwater, you know, with some interesting experiments through the 2000s. because its history is always promising too much and disappointing since the mid-50s when it was invented. And I think the goal was really to sort of supercharge their existing business model
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It's an influence. It's trying to get, you know, is it trying to get you to buy something? Is it trying to get you to like something? Is it trying to get you to believe something? Is it trying to get you to vote a certain way? Right. And I think that, you know. The term advertisement is usefully deconstructed when we start to think about the connection between all of those.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. Well, I'm going to just flip that to be a little bit rhetorical and say those assumptions negate the human right to private, intimate communication. And we are trying to rebuild a tech ecosystem that actually honors those.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
with your with your you know making use of the influence and the knowledge you have yeah i think is that the workout i mean that's there's a it's all interlinked and kind of periodizing your own consciousness is hard but i think you know i'm pretty earnest and i like i also don't come from that world i don't come from that class so there are often places where i just didn't
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I would take things sincerely or be really committed and then only realize two-thirds of the way through, whatever it was, like, oh, no one else really cares about this. They're just networking or whatever it was. So I think there was an element there where when I was doing MLab, I was like, I really want to win net neutrality. And then we won net neutrality.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But just at that point, I was realizing this is not actually the battle anymore. Google has a bigger network than Comcast. That's not the gatekeeper shit. Right. Like, but it was, you know, that was a sincere thing. And then I was like, okay, well I can make, move money to all these, you know, cool privacy hacker projects. That's, you know, that was sincere.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then I got into AI and I was like, okay, well, and I think this is, this is something that did shift for me. I think I used to have a lot, lot more faith in, In the power of ideas to influence real change. Right. And I still think, you know, I spend a lot of time and kind of thinking through discourses. How do we shape them? Like, how do we.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
How do we kindly walk people into understanding things that, you know, they may have an interest in not understanding or they may have been, you know, misinformed about or what have you. But I began, you know, I began around the time I was looking at AI and sort of making all these cases that everyone loved, right? Like I was out there giving talks that were terrifying.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
completely against the google party line and i was getting like applauses i was getting promoted like i was like this is a this is a perfect job um and then you know like i was i envied you not only once i'm the house troll Um, but then there was like, I was getting more influence. So I was becoming known outside and inside.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I was like the person you'd call into your team when it was like, Oh, we want to implement this. And I, you know, is there an ethical way to do it? Um, and you would say, no, I would, I would be like, my, my dear friends, let us sit down. Um, and then I was getting, I don't know, like that was, that was sort of my life. And I was, you know, we were, we,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
kind of took the AI Now Institute and really did a lot to reshape the debate. Like I was very focused on that discursive intervention and how do we begin to talk about AI in a more realistic way? And that was working outside of Google, but it wasn't really influencing core decisions at Google. And that was kind of the
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
the thing i kept hitting up against more and more strongly until i got a signal message in uh late 2017 from moxie or no no i mean i probably did get one from moxie at that time but not this one was not that one um it was from a friend of mine at google who said yo there's a really disturbing project that is hidden that i'm very close to
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And you should know about it because you're the AI person who cares about this and you have standing at the company around it. And this was the secretive contract that Google signed with the Department of Defense. to build AI drone targeting and surveillance systems for the drone war.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And of course, like I was politicized post 9-11, post Snowden, like this was, you know, the drone war and the signature strike and all of that were really core in kind of my, you know, things that I ideologically rejected and, you know, felt like we needed to disarm, not supercharge.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
um and i had like a you know like a righteous anger i was just like fuck this because you're there running around you know trying to shape the discourse on ai yeah and making them look good right and because they get to like they get to be like look we platform such heterodox voices we're surely benevolent right and then i'm like okay and then you're inking this deal
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
with the DoD behind the scenes for technology that one we know doesn't sort of work for the purpose, right? Like, you know, it's not going to better identify
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
a worthy target of death or whatever the fuck it's, you know, it's not, you know, we know this is bullshit, but like, and you know, this is a multinational company, like more than half the employees are outside the U S there is an issue with yoking yourself to, you know, not that you have one nation's government, not that many tech companies care that much about that.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then there was just the, you know, what is the structural danger, which is deeply acute and, of a massive surveillance company with more data than the world has ever seen, more compromise than you can imagine, like, yoking their fortunes and a key dependency to the U.S. military, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Um, I don't have one of those stories where I'm like an Atari. I was four. I'm a hacker. I didn't care about tech, Quatech. I wasn't. You remember back in school, there were two kinds of nerds. There were the math nerds and the book nerds.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And, you know, we know from Snowden that that's already, like, you know, seen as, you know, as long as it's a corporation gathering it, it's not, you know.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
They were, they were. And that was, we marshaled that actually.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
They quietly – like the lawyers removed that from the Google manifesto. It was slowly fading. Yeah, it was like – they were like, just don't open that closet. Which motto?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Don't be as bad as – Yeah, like lay off. Lay off the evil. Yeah.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
yeah so i mean and this was there were like a lot of old school people there at that time who really did drink the kool-aid and so it was you know i just put my energy into organizing against that and that was when i turned toward labor organizing and and thinking through traditional methods and approaches to combating that type of corporate power or you know kind of industrial power and um
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And that was the on-ramp to the walkout. So the walkout was like a big, that was like a rupture, like a manifestation. It got a lot of press and it was the biggest labor action in tech, according to the paper.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I think it was November 11th, 2018. And everyone walked out for 20 minutes at 11, 11 a.m. in their local time. So we called it Rolling Thunder. And it started in the Singapore office as I was going to bed in New York. And I was seeing the photos. And this was chaos. I hadn't slept in days. There's so many meetings. There's so many tears. It's hard to organize something like that.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I remember going to bed and seeing the images from Singapore with like, you know, a few hundred people, Singapore, like hit my Instagram. And I was like, oh shit, this is going to be big. And then I woke up New York time at like 5am to go to our location in New York and like prep it, make sure the cops let us be there, whatever.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then I just remember seeing like, there's this little park near the New York office. And then it just like, grew outside the park and then no one could get into the park. And then I was looking at my home and there's my phone and there's live helicopter feeds and we don't have bullhorns because I'm one of the speakers. There's like speakers standing on chairs to address the crowd.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then this, this guy, like some, you know, there's this sort of type, I don't know if in Germany you have this type, but they're like, kind of like, the leftist at every protest, and some guy had found out about it and came in, and I just remember this man I'd never seen handing me a bullhorn from below, and I picked it up.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like a megaphone, yeah, yeah, yeah. And then it was... And then we... walked over to a Mexican restaurant and sat at the table and had a press operation that we were running. And what was cool was everyone organizing that was kind of a professional. Most of them were femme. And most of them had jobs at Google that were organizing the company.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So organizing their comms, being an administrator for 13 different directors. This particular type of hyper-competence at coordinating activity across a number of people who you may not have direct power over.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I was a book nerd. But in the story we tell now, because nerddom has been overlapped with monetary success and sort of a career in math and science, I think we forget about the book nerds. But hello, I'm here to remind you.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I mean, let's just say, yeah, yes. Um, you know, you can, like somebody who can write an email and get someone to respond to that email by doing a thing is kind of a witch. Yeah.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And it was all these like these preternaturally competent femmes just turning that energy toward organizing across the company, which was building on this sort of base of like meetings and locals and all of this sort of work that we'd done to kind of form a discursive environment inside Google where we're like weekly meetings to discuss the news, what Google could do, what campaigns we could do.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
20,000 was the number estimated from the sky photos and the local reports. We had like local leads at every office who we sent them zip files of like the kit for the, you know, handing out the flyers, the talking points, how to treat media, all of that.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
they all had that and then they organized their local and then they had sort of reporting back in from press, reporting back into the kind of central organizers around numbers. And then we were issuing the press releases. But then, you know, there's employees of Google and then there's contractors of Google, which more than double employees.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So, you know, that number is, and then there's people who couldn't participate, but were really supportive because they have, you know, they need their health insurance or they'll die or they are on a visa. And so it wasn't, I think there was a huge amount of support. I know that we were able to get Google to drop their military contract because there was enough support.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And there was, you know, there was like a spreadsheet of people who are quitting conscientious objectors. We had, you know, like every week at the all town meeting, there was a table we would set up with like banners and something like we would had questions. Like it was a very, it was a very like rigorous campaign. And it kind of laid the,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And that's who I was. And so I studied literature and rhetoric at Berkeley, which I just thought were, I mean, they're still beguiling. Like being able to read and write is pretty fundamental for anything. And then I was poor. So I took a job at Google because they were the first ones to offer me a job. And then I got very fascinated with what on earth was going on.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I think it built some muscle that people are definitely using now, even if they don't call it organizing. It's like, how do we marshal the resources from this?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I think Google does still love me, but it doesn't love itself enough to admit it. Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Which party do you want to go to? Let's be real.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And there's a talk that. What is Frank Rieger and Rupert.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I don't. Yeah. That's my American. You'll do beautifully.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. But I, I apologize for not getting that right. Yeah. Did this talk, you know, we lost the war. I think it was 1994. No, 2004. Yes. I did the same thing. And, and,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
there weren't not everyone i think was equating the growth and monetary success of the u.s based tech industry with sort of you know values of social progress i mean i think we can yeah yes it was liberal and then we can get back to a critique of liberalism and and what have you but it was i think there were people who were looking at the infrastructure who were looking at its capabilities who were looking at the gap between the promises and the
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
of what this tech did and calling that out. And I feel like when I entered into this kind of privacy security hacker development scene, There was a lot of that skepticism there around Google. That educated me a lot. There was a lot of skepticism around surveillance. I immediately recognized, yes, we need privacy because it doesn't matter if these people are good or benevolent.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
What we're doing is setting up an infrastructure that could be turned over at any moment to another regime. Logically, all of that made sense. But I don't feel that until the Snowden revelations, any of that was anywhere near in the nervous system of a kind of tech consciousness.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And a lot of the work I spent, I have spent in the 1990s trying to get, you know, sift through the crypto wars and sift through, you know, what happened with, you know, tech regulation to set up these surveillance giants and to permit this monopoly platform business model.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
has kind of looked at that gap between the rhetoric of like, you know, liberal rights preserving, you know, open free tech, and what was actually being built, right. And one of the things if you look at there's a there's a scholar named Katarina Reiter, who who I would really suggest I can, for show notes, I can send some of these links.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
July 10th, 2006. So I graduated Berkeley and I needed rent money and I put my resume on monster.com, which is a precursor to LinkedIn. And they reached out and then I talked to my friend Michelangelo because at the time... You still needed an invite to join Gmail, as I recall.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But she did her dissertation looking at, you know, some of the negotiations in the crypto wars. And what you begin to see is that, yeah, we, you know, and this is a thesis sort of I build on top of in some of my work. Yeah, we won liberalized encryption, right? By 1999, in the US, it was
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Finally legal to build, share, implement strong crypto systems without approval from the government, without some threshold that made them useless. Right. But the agreement there was basically, yeah, you can have encryption, but we're going to permit mass surveillance by companies.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And so you don't actually... You can just get the... We're going to permit... We're going to endorse the advertising business model. We're going to endorse... And I can actually... I can start this point over, actually.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I, you know, I can't say that there was a conspiracy. What I can say is that Katarina's work shows that, you know, there was clear, like, Microsoft saying, like, liberalize encryption. Don't worry. We're not going to encrypt all the data. We need it, right? You know, just come to us, you know, quietly, and we'll give it to you.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So instead of key escrow, instead of fighting over a backdoor, instead of doing this in sort of the public domain where we're kind of losing the fight on technical and other grounds... allow companies free reign to surveil because that allows us to implement this ad-supported business model. And then the data agreements can happen behind the scene.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Now, I've completely compressed a very complex history into basically a meme. But I think the purpose is there is that there was always that gap between these sort of rhetoric and what was actually going on. And I think the I don't know, like there's like a kind of internet people, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
This type maybe misunderstood exactly like how this, you know, who would have power over this technology, right? Like encryption is liberalized, but it's not going to be applied to protect personal communication. It's applied to protect transactions, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It's not, you know, like the people who get to choose whether or not it's used aren't us in terms of, you know, actually this sort of mass infrastructure in terms of the tech ecosystem that's being built. Right, you know, through regulatory decisions made by the Clinton administration.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I was like, hey, Michelangelo, can you get me an invite so I can make a Gmail address so I can appeal to this recruiter? And now my spam-filled Gmail address dates from that moment. So I was hired as something called a customer operations associate. And I didn't know what that was. No one knows what that is. It's just a bunch of words. But it sounded I was like, that's a business job.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. Well, I tried. It's just that my friend group didn't overlap exactly with those couple of thousand nerds. So what am I going to do, right? And I think this is the network effect. This is why it's actually very difficult to do that. And this is why if one of those actors that controls these infrastructures doesn't make the choice for us... it's really difficult to make that choice.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It used to be Axolotl. And then it was when Signal was launched, which was the Redbone, TechSecure protocol.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
these ideas, right? I remember a project where we wanted to use them as a key store for other services and sort of, you know, you'd always have these really exciting conversations with the security guys and then it wouldn't go anywhere because then, you know, the other guys would get involved.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So Signal existed before the WhatsApp integration.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And the WhatsApp integration was driven by Brian and Jan, who are the co-founders. And my understanding there is that they were rushing to get that done before the Facebook integration to make sure that they weren't selling something that would violate their principles. Um, and I know Moxie was working on that. I remember that, that period of time.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Um, and that, you know, Facebook or, you know, then Facebook bought it and I don't know the term, you know, the deals there exactly, but, um, it, you know, remains using signals protocol there, you know, and, uh, and, but that, that it, you know, it certainly was a post Snowden moment, right? You saw Android, uh,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And iOS implementing full disk encryption, you saw Google encrypting, adding HTTPS for its networks. And I think a lot of this was just like, we need to distance ourselves from bad government spying by adding encryption that proves that we're not actually sort of part of the problem, that they have just sort of...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It sounds like a business title. I had no idea. It was a basically a customer support person who wrote technical documentation, who are kind of user documentation, some technical documentation and answered questions. inquiries about Google's free products. And I was doing that for rightly, which was an acquisition that Google made that then they rebuilt to become Google Docs.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
The bad government has attacked us as taxpaying corporations, taken this data that we really want to protect, but God, how could we have known? And so now we're encrypting things and that's ultimately good, right? But it's... It was a way of not looking at the full story of like, why is that there to begin with? And, you know, what else is not being encrypted? What other data is being given over?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And why do you have the choice to do that to begin with instead of a more socially beneficial democratic process of determining how we're comfortable with technology entering our lives?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
For the gentle listener, I was kind of joking because that rhetoric around being attacked and being like, you know, like, oh my gosh, was like very much the mood at that time. I was at Google when Snowden dropped and I remember just things popped off and I actually had to get, I got on a plane.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I don't know, you all probably have a memory similar to me of like when the Guardian stories with the Verizon, like the Glenn Greenwald stories. It was night in New York. It was probably morning the next day you guys saw it. I remember sitting on my couch and being like, holy fuck.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And realizing just how big that was because it was the kind of thing we'd been talking about, speculating about in the rooms that you and I were in, Linus. And then it was like, oh, receipts, shit. And there was a lot of unclarity.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There was, you know, that prism slide where it was like, is Google just giving them full access that, you know, people were rioting inside, you know, security engineers were threatening to quit. And then that morning I got on a plane to Tordev. And so, yeah, in Berlin, actually.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I mean, I give you all a pass because you did tell us all along.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And this is at a time when the entire The business of Google was just search. So search was all on the main campus. It was where the money came from. And then there was this dinky little building where everything else, like Gmail, Blogger, Rightly, whatever, Reader, all of them sat and they were kind of experimental projects. And that was called apps.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I mean, I love Signal and I'm really… Yeah, it's the only cool tech company in my view. And I think sort of boiling down like what is Signal in one word is a little – I'll start somewhere and we'll end another place because I think it's actually – it's a number of things and kind of represents even more. Signal started – Back, you know, the late 2000s, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And we can, you know, we can date it to whenever, right? Signal as the integrated app was 2013, but, you know, Red Phone, Text Secure predated that. And this is, you know, there's no iPhone. Jabber, like, is the competition, right? It's like web client-based chat. There's no, you know, people aren't carrying smartphones. There isn't, WhatsApp doesn't exist. iMessage doesn't exist.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You have a very, very different marketplace.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, yeah. I mean, I remember using, like, I don't remember, like, send text messages sometimes, but they were expensive on my BlackBerry, maybe. But we're talking about a drastically different tech ecosystem. And this is particularly important in the context of messaging and communications apps. Because, of course, you need a network effect for those to work.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
No one buys the first telephone, right? Because you can't use one telephone. Your friend has to have a telephone. And all your friends have to have an app if you're going to use it, right? Particularly, it takes two to encrypt. You know, group encryption, it takes everyone in the group. And if everyone isn't using...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
your app for communication, it's very difficult in a saturated marketplace where you have a WhatsApp, where you have iMessage, where you have these normative models that people go to just to have their regular communication to sort of introduce a new app for communication. secure messaging or insecure messaging, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Because people don't switch outside of the network unless their friends switch outside the network and there's a collective action problem there and an inertia problem there and all of that, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So when I think about, there's many things that are very precious about Signal, but the fact that Moxie carried it on his back for that decade and was actually able to keep it going and surviving without selling out, without selling data,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And actually creating something that is now able to scale to hundreds of millions of people means that Signal actually has a position in this ecosystem that makes it useful to people. That means that it's actually providing encrypted communication to people. people all over the globe because their friends are using it, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And my contention here, and I'm willing to discuss this, I don't think we can recreate Signal, right? You could shift because it has that user base, right? You can introduce a new app, but how do you get people to use it without an OEM, without an existing installed user base, without some way of kind of making it useful to people.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Because again, it's, you know, one telegram telephone or, you know, a couple thousand hackers who all use PGP, but they can't talk to their dad on PGP, right? They can't talk to anyone outside of themselves on PGP. So, you know, Signal has both sort of kept this, this form that is very heterodox in tech. It's a nonprofit. So, you know, it Yeah, absolutely. The diametric opposite is the norm.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
uh did you ever have exposure to actual customers or did you just write documentation i well they would email in like i only did this for a second because i kind of figured out i wanted to do other things and that's part of the story um there's a part of the story actually so i i did answer like
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
That's really, really important, irrespective about the flaws of the nonprofit model more generally. So it's achieved this pretty rare, like it's the only thing like it in the ecosystem. And I think it also serves as a model for how we could think about building tech differently. Like how do we disarm technology?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
deconstruct the massive centralized power of a handful of platform companies that basically control most of the infrastructure and information ecosystem in our world and our jurisdiction in the US?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And how do we build other models that may be interoperable, that are more open, that are more rights preserving, and that aren't subject to the pressures of and incentives of the surveillance business model?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
inquiries sometimes and there were like auto responses like hot keys you'd use and this like really janky ticketing system and this is back like we didn't have laptops there was no such thing as a smartphone like our desktops were chained to the desk and when you went home you went home and if you needed to do something now you had to check out this like clunky Lenovo or something I don't remember exactly but it was you know I remember I was like okay I get rewarded in my job based on how many tickets I close and
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. No, I, I like this question cause I'm going to, I'm, I want to clarify our position. Um, which is a, there's a little bit of nuance. Um, I don't oppose interoperability in principle. If the interoperability mandate of the DSA were... Interoperability needs to be an option, and it has to happen at this rigorous security bar.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You have to make sure that you're implementing metadata security, sealed sender. Basically, you're adopting the signal...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
privacy and security bar as the conditions for interoperability that would be really cool right and i think that's the issue here i mean and and i want to put an asterisk here for a moment saying like there are a lot of other complexities around policy like you know how do you how do you take in a you know, who deals with a law enforcement request, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Even if you have no data to give them, you can't just ignore that. Who, you know, like if a user has a complaint, who do they write in? What is like, you know, if you're interoperating with a platform for communication that also has a social media arm, there's a totally different regulatory environment for like, you know, telegram or WhatsApp with channels than for a signal.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
How does that sort of, you know, work in terms, you know, there are, so I want to say this isn't simple and there's a whole can of worms. There's a massive can of worms as the EU often opens. But the, you know, like the conditions of interoperability are actually really, you know, they're really political here. Right. So in order to interoperate with WhatsApp and,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Am I going to be giving Signal user data to Meta? Well, that would violate the entire premise of what I'm spending my life's energy doing and Signal, right? Is Meta going to decide to cut off the account of one of our users? Who gets to decide that? Are they collecting other data because they aren't implementing some of our libraries or whatever?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And so I think that's where the rubber meets the road. And we have to have a duty of care to the people who rely on Signal. That is, we're absolutely not going to compromise you that way. Because we know, you know, if we're going to be very real about it, there's a woman living in jail right now in the U.S.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
because Metta turned over her Facebook messages between her and her daughter that documented them obtaining reproductive care in the state of Nebraska after the Dobbs decision. Like, that's the stakes of this conversation, even when we're talking about the technical details of interoperability, right? Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Access to life-saving health care that more than half the population may need.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We will continue to advocate for a path that raises that bar, meets or exceeds signals bar. And if it succeeds, I'm like, yeah, I want to I want to talk about that. But, you know, that's those are the conditions under which we would interoperate. So we're not you know, we don't take a stand against it. You know, we just say like, look, this is these are the complexities and this is.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Signal stands with the people who rely on Signal, not with a sort of vision for some muddy middle where we're all interoperating, but we've sort of sold people out and made them susceptible to what we describe with meta.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But I don't know the engineers who have to close these tickets because I'm reporting bugs. Right. And I need them to fix the bugs I'm reporting. And if they don't fix the bugs and I'm not getting reward. And I was like, this is really silly. So I went over to the apps building because I was sitting in another building and I like met the engineering team. I was like, hey.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Is this mean or median people? Yeah. I mean, I don't think most people don't understand this at all because they like got laundry to do and this isn't their area. Right. I think some of the politicians I've talked to seem to get it, but it's not.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I think that, you know, there's an inertia governing this process that means it's not clear how far these points have absorbed into the bedrock, so to speak. So I don't – I would also – I'd want to be cautious as an American. I'm based here for now, but I also don't have as – I would say my instinct on the general understanding of people in the EU is not what I would rely on.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
One meta observation, having been here for a bit of duration now is, and I've thought this before, but it's interesting to think of Europe as one thing. When you go to different countries and meet different people and you're like, wow, this is not one thing.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It is in the US, yeah. I mean, you know, it's big and it's… But there is a common theme somehow.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It's split in an interesting way. Because on one part, if you go to kind of the startup ecosystem, the VC ecosystem, like that world, there's a lot of smart people and cool people doing cool things. And there's sometimes a bit of magical thinking that I see, which is really like... If we wish hard enough, if we're able to figure it out, we're going to be able to create competitors to the U.S.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I'm that person who keeps sending you these emails that are annoying you. And I was able to convince one of them to go out to Costco, which is this big warehouse store, kind of a Walmart-y store in the US, and put a giant couch on his personal credit card and bring it into the apps building so I could sit with them.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
incumbents, right? And we're going to have our own thing. Own search engine.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Which often just – sometimes I'm just like, okay, that's a money play, right? Like you get enough in your Series A, Series B, and then you'll get acquired and no one will do anything with it or you'll get rich or whatever. You may not necessarily believe that. Like markets float on hype and –
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So, OK, but it is there is this thread where it's it's almost a willful misunderstanding of the reality of incumbent platforms, of the history that, you know, accrued that type of power to U.S. companies and of the dependencies that Europe and most of the rest of the world have on these companies. Like three, the three cloud companies based in the U.S. have 70, 70 percent of the global market.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You have five major social media platforms.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, yeah. AWS, Azure, GCP. And then, you know, I think the other percentage are made up by U.S. companies as well. And then there's some Chinese companies. And then you have five platforms that effectively shape our global information ecosystem, like our perception of reality. The four biggest jurisdictions in the U.S., right? Yeah.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I'm going to remember four of them because there's always like a last in a list. So TikTok is a non-US one, right? And that's the one they all freaked out about recently. Because it's non-US? Well, yeah. I mean, I think so flatly, yes. Facebook, Instagram, X, and then... It's not Twitch, but anyway, there's another one on that. YouTube. And then there's Twitch, too.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
For all intents and purposes, that's a huge amount of concentrated power that, again, relies on network effects, relies on economies of scale, relies on all kinds of global infrastructure. It's trillions of dollars that can't just be interrupted by investment. This is a social media company. Social media and platform companies, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, Telegram doesn't, I think, run most of their own infrastructure. They don't have a cloud business model. And they also don't really have a business model. It seems like they have this crypto play, but it's not clear how that money moves. There's a lot of UAE investments.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And what is it difficult? Where is this... Where's the normative shape of the tech industry coming from? If the cloud companies all of a sudden decided to cut off half their APIs and change their infrastructure, there's most startups in the entire world, including organizations like Signal, Telegram, whoever's riding on top.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
you know all their engineers pagers go off they gotta you know respond to that right it's it's not it's unidirectional that way right if you know if sanctions go up you know say uh let's do a like a wild dictator gets elected in the u.s and decides that these you know europe is now sanctioned right and then amazon can't do business with europe right like what happens like this is data in the u.s that would never happen yeah
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Because if I sat with them, then I could vibe with them, and then they would be much more likely to fix my bugs. And so all my bugs started getting fixed. But then my manager got really upset because it was like, yeah, obviously I had breached the hierarchy. And I was like, oh, kind of. And so this meeting appeared on my calendar that was basically about me being insubordinate.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I make things up as a creative person. Remember, I come from literature and rhetoric. Just stories in your head. Yeah. And then you see the social media platforms, which we do know that there is a...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
you know, a far right that is, has really focused some intelligence and attention on building alternative media ecosystems across those platforms and kind of using the affordances of surveillance advertising driven media platforms to shape the Consciousness.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And that's probably what the Europeans... It's like $500 million European sovereign AI fund. And then you're like, but that's half a training run.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Which is disturbing because it's like, okay, well, that's a lot of money also. Let's not be flip about it. And it could be going to really good things. It could be supporting interesting open projects. It could be supporting interoperable alternatives or smaller clouds for more heterodox news, open source projects. There's really cool stuff that is languishing without that money.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I think it's, you know, where is that money going? Well, if you're talking about going into AI, it's going to one of those three cloud companies, right? It's renting infrastructure from Microsoft, Amazon, or Google for model development or for deployment, which is inference, right? Like an inference is really expensive.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like you don't just train once you then, once you use a model, using it as way, way more expensive than normal information retrieval. And so you're also, you know, like it's just this massive computationally expensive thing.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And, you know, you're not creating European sovereignty, you're creating a feeling of being, I don't know, like, not behind, which like, you know, and feeling of not being ashamed by being technologically...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There's the other side, which is I often find a much more sophisticated and clear-eyed view of these problems, right? Like having this discussion about that concentrated power in the hands of infrastructure and media ecosystem way easier in Europe. I mean, people feel it, right? They see it. And there's been a history of pushing back against the encroachment of U.S.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
tech, both effectively and often very ineffectively, that I really enjoy. And particularly in Germany, there's a very high sensitivity to privacy, very often clear-eyed view.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
on some of these debates, which doesn't always translate into policy, but there's at least... I find the intellectual environment around this stuff, when you talk to people who are knowledgeable and have thought about it, to be very... teach me a lot and be really sophisticated.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But I'm also like I didn't come from that class. I had no I was like, what the fuck did I do wrong? I don't know. And I was like, oh, God, I like I did something. And then the day before I think that meeting was going to happen, this email hit kind of we had this all.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. I mean, there's, you know, both threads. You see kind of, you know, two wolves inside European politics. You know, the one wanting its own tech industry and the one wanting to make sure that they're not subject to a sort of U.S. tech colonialism. And I think you get, you know, some weird laws. You saw the AI Act, which went on forever and then, you know, kind of had this last minute effect.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Last-minute brinksmanship around whether foundation models, these big LLMs that are now the trendy kind, should be included or not. And you often see bold regulatory attempts that then get kind of shaped in odd ways. Yeah. Trying to have it both ways, right? Like, how do we regulate the Americans away and get our own, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But how do we do that in a way that is reflected in principles, not in, you know, actually declaring that as an intent? And I think that is, you know, I think you're seeing a huge amount of money be spent by the U.S. companies in Brussels right now, which is also influencing things in interesting ways.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then this is something I'm theorizing a lot in my intellectual work, and I think is really important. You also see what I'm calling the politics of intellectual shame be really pervasive in this conversation. And this is not just Europe. This is across the board. I mean that there is a real...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
a real fear among a lot of people who are in decision-making positions, politicians or academics or whoever, and not even in decision-making positions, but it matters when it's them, of being stupid about tech. of being behind the ball on tech. And this plays right into patriarchal dynamics, like men hate when someone else knows something more than them, and particularly if that's a small woman.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
org like some group i don't know it was like the group to the consumer operations team and one of the engineering directors and apps must have had like a beer or something during one of the many many many drinking parties that happened during the day at google in that era and sent some email that was like meredith's couch is a model for collaboration
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
generally and i don't i don't want to gender this like in such a schematic but there is a there is a there's an ego that is like can be very very fragile here and i the way i put it before is it kind of turns uncertain men into yes men like they don't want to ask the dumb question they don't want to be like what's an llm what's a server like how does that work and that type of insecurity the fear of being behind the fear of being called like you know
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
technically unsophisticated or hampering progress or putting your finger on the scales of science look the nobels how could you stand in the way of all this progress right i think really gives the upper hand to the companies and those who have an interest in creating products and you know growth and domination via these technologies because people really don't want to challenge them because you know challenging their dominance or or their plans you
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
gets conflated with somehow being anti-science or being stupid about tech or not being smart enough to have a position on a topic. And I think that's something because I kind of came up through Google asking every dumb question in the book because I didn't come from that world, right? So I had to ask like... how does a computer work? Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I'm like, I'm like, can someone diagram what a function is? I don't know any of this stuff. Right. Um, but I kind of, I think I have a sensitivity to that. Cause I also, I remember feeling it. I remember people being mean about it.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like if I didn't, you know, like back in the day when I was trying to learn this stuff and I think that, you know, a discourse that collapses scientific progress into kind of the success of a handful of tech companies is praise on that type of insecurity and has created an environment in which people have no idea what AI is and are still professing boldly on how to regulate it.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I should be clear. I don't think that what I was describing and the politics of intellectual shame are not unique to Europe, but I think are in Europe as well. And particularly folks who feel like, you know, the Americans beat us. We got to get ahead. Right. I think, you know.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Where I see the European position being most, let's say, under-informed or perhaps just in some cases pernicious is in the chat controls regulation and the desire, the apex of magical thinking, which is let's rename a backdoor client-side scanning and then let's mandate...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Scanning everyone's private messages, comparing what's in those messages against some database of permissible or impermissible content, and then taking action on those in the name of protecting children, which is the justification during this instantiation of the crypto wars.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I see this as an ongoing power struggle, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, between... This is not a misunderstanding. I think a lot of the people pushing for this understand that backdoors are dangerous and understand that the pretext is flimsy. But that asymmetric power constitutes itself in part through information asymmetry.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And there's a deep discomfort that dates back to 1976, when Diffie-Hellman were trying to publish their paper, introducing public cryptography, and the US government was trying to suppress it, trying to say, don't publish this, right? And then, you know, but databases weren't quite big enough, networks weren't quite big enough or ubiquitous enough for it to matter matter.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But they were already looking at like, oh, shit, we don't want this in the public. Right. And then you go through the 90s and there's, you know, the Clipper chip and key escrow. And you have Stuart Baker writing in Wired magazine like PGP is just for terrorists. We have proof. It's, you know, no, no. He was PGP is for pedophiles. Right. Which really echoes what we're hearing now. Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like who even has a computer in 1994? I believe when this op ed is written. And then we have post 9-11, and then it's like, actually, PGP is for terrorists, right? And encryption is for terrorists. All the while, our dependency on digital infrastructures for communications is growing and growing and growing. Our dependency on digital infrastructures generally is growing.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then that meeting just like disappeared. And I was like, well, shit, I need another job because I just burned someone who's going to figure out how to get back at me. And that's where my street sense comes in. So I... took a bike around campus for a couple of months and like asked every VP during their office hours, which is the thing they used to have, like, Hey, I want another job.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And the need for encryption to protect commerce becomes existential to the internet industry. And then what do you do about communications, right? And I think... I think this has been an anxiety that is pervasive among those who, you know, law enforcement, governments, whoever, who feel that they need to constitute their power via information asymmetry.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And any encryption that protects people, not just commerce, is a threat to that, right? And so what I don't see is that we're going to win an argument, right? Or that we're going to win this via strength of argument. I do think we can fight. And I think we're in a position now where we're seeing chat controls. I believe Hungary just tried to raise it and didn't get the support.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There was the Belgian proposal a few months ago, also didn't get the support at the last minute. And we just had the Dutch law enforcement authorities writing a memo to the government there saying, yo, don't support this. You're talking about a very dangerous backdoor that would undermine Dutch cybersecurity, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
At the same time, we have reporting in the Wall Street Journal that provides a receipt for what all of us should have suspected all along is that
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
back doors that were inserted in the u.s telecommunications infrastructure for government intercept have been hacked by you know chinese intelligence and maybe others right so we're you know i think at this moment we have a lot of there's a yeah the facts are on our side and
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And the fact that the facts are on the side is permeating into these discussions and making it harder and harder for them to push it forward in the European Commission.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Exactly. And that's why I think we're not going to win. There's going to be another pretext if we win this one, right? There's going to be another angle if we win this one. We just have to keep building our muscle to sustain this fight probably forever. Because I don't think the will to power is going away. I think they're just going to keep trying to rearrange the reasoning.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, in terms of political discussions, it helps that we're right. You know, like we bring in, there's a huge amount of evidence that a lot of people haven't seen in these political discussions. I think we're on the, you know, our side has been on the back foot for a while.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There has been just in civil society, there's been a cutting funding to privacy advocacy has happened, you know, since around 2000. You know, there's sort of a history here. I think kind of there's a move toward tech accountability happened out of the after the 2016 election. You know, there's the Cambridge Analytica scandal. There's all of this.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I would just drop in and be like, hi, you don't know me. I'd like a job. And then I got a job doing basically standards work, like trying to push document interop standards. And so I like started in standards and then standards parlays into measurement pretty quickly. Cause measurement is ultimately the methodological standard. Um, And co-founded MLab.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And it's like, OK, we're going to you know, we need to hold tech accountable. And then there are, you know, a number of the way to hold tech accountable is to. you know, attack the business model is my view, but there aren't that many pieces of legislation or proposals that actually do that.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Many of them sort of use the wrapping and the language of accountability, but are actually just expanding surveillance, right? It's like, we're going to hold them accountable. So we need a database. So we need to, you know, we need to know who's logging into websites so we can find the bad guy. We need to know what's in your
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You know, you're messaging so that we can make sure that these tech companies aren't allowing crime on their platforms, etc., etc. So it was basically a hijacking of this, you know, in many cases, kind of righteous moment where people recognize that this business model was pretty harmful to fulfill the wishes that have been pervasive since well before then.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
at the same time that we're seeing privacy advocacy and a lot of those, you know, a lot of the things Linus, you and I had been doing for a long time, receiving less and less support and sort of, you know, out of the limelight. And so I think it was in that environment that things like check controls, that things like the online safety bill and other,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
paradigmatic examples of this client-side scanning to save children meme grew up. And then one of the reasons I was, there are many, many reasons I decided to move from being on the board of Signal to full-time at Signal. One of them was that I saw this And I was like, I realized there weren't that many people fighting it.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And that one of the things that I could bring was a staunch willingness to fight it.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Open up my laptop. Obviously, it's not just me. Nothing like this is a singular thing. We work with a pretty broad coalition of folks. I'm sure many of your friends, many listeners perhaps are part of that. Signal doesn't have
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
a policy arm it's a very kind of lean targeted pretty senior organization uh but we do work with people around the globe you know edry and the eu you know a number of other organizations to keep tabs on what's happening we also are in a a good position you know we're We're a nonprofit. We have a we are very committed to kind of rigorous communication.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So we don't you know, we don't have a history of hyper marketing. We don't do hyper marketing now. Right. And so we're very careful to, you know, when we make a claim, when we make a statement, we're backing that with citations. It's accurate. You know, we're really marshalling kind of the technical knowledge and prowess that we have.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
to, you know, I almost think of it as like clarifying the record, right? There's, you know, if there's a report that says client-side scanning is actually safe, we know it's not safe. Okay, well, there's an academic coalition that has written this letter. Signal can write a letter. We can, you know, begin to put a
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Given the dynamics I just outlined, and then I do media, I do public speaking, I think a lot about how to tell this story in a way that isn't boring or alienating for regular people, particularly because the story on the other side is so arresting. It's like we have to save children from abuse. Yeah. And that every one of us, it like hits you in the heart, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then that became the nucleus around which the research group I founded existed. And then I just that was the that was when the fresh air of sort of these political and social complexities started hitting my technical work. And I was like, oh, standardization is power. Oh, creating data means you own the narrative. Oh, yeah. shit, none of this is neutral. All of this is contingent.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like you, you know, like myself, right? Like my amygdala is activated. I, you know, suddenly I just want to do something. I want to help, you know, what, give me the thing to do. How do we do that? Right. And then sitting across from that and being like, well, let me, let me tell you about a one-way function, right? Like you can't, that's not, that's not going to work. Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And so like, how do you, How do you enter into that debate in a way that isn't dismissing the very grim and real problem that is being evoked and make it clear that the solution to that problem that is being presented will not solve that problem, one, and two, will cause drastically worse problems for many people around the world? And that's the task at hand right now.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, the infeasibility, the danger of the approach, a lot of evidence around the infeasibility of the approach that is either kind of willfully ignored or just not understood, and then figuring out how we explain that without Being either accidentally or genuinely callous about the concerns that have brought people to the table, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, how about funding social services? How about, you know, what do you do? And I mean, like, if we're going to go there, we're going to go there. Prince Andrew's walking around, right? Jimmy Savile's walking around. You know, like what are the infrastructures in place to make sure that when children are going through this, they're believed, they're protected.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You know, what happens when it's your priest? What happens when it's your teacher? What happens when it's your brother, right? Like these are the questions that are really hard to look in the face because they implicate social pathologies and interpersonal relationships and power dynamics that are really, really difficult and often...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
you know, relate to emotionally challenging factors outside of that, right? Or people's past experiences or what have you, right? So you're going right into kind of, you know, very traumatic subjects. But I don't think we can have that conversation without having a real conversation, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then, you know, when you begin to pull back the layers there, you say, oh, well, the UK has been pushing for client-side scanning, right? as a remediation to child abuse. But the UK government in 2023 funded social services at 7% of the amount recommended. So the roofs on the schools in the UK are collapsing. There isn't support for this.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And then if you look at, and I don't have public numbers to share, but I've had a number of personal conversations. Okay, well, how many law enforcement people, how many people are tasked with actually sort of pursuing the criminality that may be reported via online imagery? In some cases, it's two. In one case, it's two in one country, two people. Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So like you're not actually like if you begin to map this, what you see is a story that does not add up. And you see like like what you know, and this is where I get enraged because I'm like, you are fucking trading on children's pain to get your back door, whatever the fuck you want.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I started seeing the balance sheet. I started seeing the capital that was involved in running infrastructure. And I remember around the time I met you, minus like maybe over a decade ago.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
pretending that you're solving it so taking up the space for actual solutions that could actually like help real children who are suffering now and turning no attention to every glaring problem in this massive list which is you know pretty obvious you know even for me and you know like like and i'm not an expert here i've just sort of you know sifted through this so i think you know that's the that's the dynamic we're walking into
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. Yeah. Well, sorry, we use the prefix online, so that's not our... And I think it's also, like, there's something... People gravitate to the abstraction, right? If this is online child abuse, then we don't have to deal with it in our real lives. It becomes an abstraction that we can almost blame on the same platforms that have been so unaccountable.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We can blame it as an internet phenomenon, not a phenomenon in like, oh wait, our church doesn't have the infrastructure to actually deal with this in a humane way, right? And I think that's a dynamic that we're also seeing here.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, aging is weird. But I remember I used to have these sort of smuggled balance sheets I took out of Google, like printed out, which showed how much the... uplink bandwidth and the infrastructure and power costs you were for MLAB. And I would be showing this to all these civil society funders being like, you can't be funding 250 K. It costs $40 million a year in bandwidth just to do MLAB.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I'm a brave person, Linus. But to be serious, I think... This is one of the places where more public education is necessary because Telegram is actually, you said the other end of the internet, it is very, very, very different from Signal. So Telegram is a social media platform. It allows mass broadcast to millions of people. You can go viral on Telegram.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You can find strangers on Telegram via directories. There's a near me feature that will geolocate things happening near you. All sorts of things that are not private, are not secure, are regulated completely differently from private and secure communications like Signal, which is solely a private and secure interpersonal communications app.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Signal stories don't go viral, right? They go to your, you know, it's if I sent all the people in my contact list one by one, a photo of something.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
They're so cute, Linus. I wish, I wish, like, it's, you know.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I'm sorry. Well, you're all missing my stories is all I'm saying, and they are pretty good.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, have you activated them to check? But we do let you deactivate them forever and never bother you about them, which is part of the way that I think we maintain our reputation for not being shitty is we try to literally not be shitty. Yeah, thanks. Right? And when we're designing... Signal, we're actually very, very careful not to be a social media platform.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We think about that in the design phase so everything we do can be as encrypted as possible so that we don't know anything about you or as close to zero about the people who use Signal as possible. And what we do know is we can say, yes, this phone number did sign up for a Signal account. We know when that phone number signed up for a Signal account. And we know last time they accessed it. Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But we would like to even not know that if it were possible. On the other hand, Telegram is a social media platform which retains huge amounts of data, has a duty under law to cooperate in turning over that data, and has search functions, has directories so you can find new things. So it's a very different beast. And I think, one, because Durov has been very
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I'm trying for a diplomatic word, has made statements that are not supported by fact around Telegram being private and secure and kind of taken on this yeoman's defender of free speech and privacy position. People often think Telegram is private and secure because it has a DM's feature, right? But Signal is just private and secure. So the TLDR on that is...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There's really no danger for a signal here because we are very, very far away from Telegram. And we have set ourselves up so that one, such cooperation isn't required. And two, such cooperation is not possible because we literally like you could put a gun to my head. I don't have that data. Whereas Telegram has servers and servers and servers full of that data.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I have no idea. I mean, this is like... Didn't he send you like a telegram message? I haven't checked.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. I mean, this is like overlaid the French legal system. I am not a lawyer, especially not in France. some of the vagaries of their legal system in which, you know, any judge can open an investigation and the basis for the charges will not be known until, you know, trial.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like you guys don't understand the economics of this because we're still in the era of like civic tech and it's all we need is a good idea. Right. And I think I was really lucky to get sensitized to the political economy and
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And we're looking at years and years until then with me not speaking French well at all with like weird translation, you know, like, so I, I want to stay away from speculating there, but what it looks like based on the charges that were released in the press release is that it was, you with requests for data and then kind of a handful of other charges added on that aren't as severe as those.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You can go to signal.org slash bigbrother and every request that we have been forced to comply with because we fight them and have unsealed are posted there showing exactly how close to no data we are able to turn over And showing, and I think this is interesting for some of your listeners, probably you see what they are, what the law enforcement agencies in these requests are requesting.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And it's often huge lists, right? Like massive amounts of data, which gives you a sense of just how much data like surveillance, like a telegram or, you know, another platform is commonly able to provide that signal is not.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, it's a PDF of the request. It's not a transparency report. It's transparency.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You know, although it's just the ones that we can unseal. So we do have to go.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There's no gag order on me being able to say. And there are some, but we fight. That's the fight to unseal it. And what I don't recall the answer for right now is whether we're in one of those fights right now or not. But I'd have to check with my friends at the ACLU.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And the fact that we're talking about infrastructure, capital, network effects, economies of scale and not some kind of brilliant idea that just ephemerally transformed our world and that our side just needs to wait to have one of those to get our turn.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Only. Yeah. And we are thinking about in the future, maybe having a paid tier for some features, something like backups, encrypted backups, which we're building right now. Could we charge people for media storage or other expensive features? But that would be in addition to donations and squarely within the nonprofit structure that keeps us safe from pressure to surveil.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We pay very well. And we are... I mean, it's a really cool mission, right? So imagine the jobs in tech are kind of depressing in many cases. Not everyone wants to go optimize an ad server and then Signal...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You know, signal you can work for core infrastructure for dissent and human rights work and journalism around the world that, you know, without which a lot of those things would be deeply imperiled. Like it's it's a real cool thing to get to do and support. And we pay well.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It's the original Silicon Valley dream.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I don't, I would never presume to speak to the consciousness of another person without there. But I think, yeah, I am very happy. I think a lot of the people who are at Signal are very happy. And it's, I think it's also like we're kind of part of a project. And this is, you know, that shows that what we have in tech, what's built in the tech industry is not inevitable. Yeah.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There's a series of choices, a series of incentives, a business model that has shaped tech into the form we have now. But it does not have to be that way. Right. Like we can rewrite the stack. We can build alternatives. Nonprofits can work. Right. We need capital. We need will. We need talent. We need all of those things. But the thing we have now is not inevitable.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I think, you know, I think of Signal as like a keystone species in the ecosystem, kind of like, you know, like setting the bar, kind of regulating the rest, right? Like, you know, you can have privacy. You can have, you know, the right to private communications. You can subsist outside of this paradigm. And I think the future I want is that it's not just Signal, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
There are many, many other organizations and efforts sort of doing it differently, rejecting that paradigm, drawing in capital there and away from the other place and beginning to marshal.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
the type of political will that is often very shallow, like the 500 million AI fund, but marshal it for something that is actually substantive and is actually making the kind of change to the tech ecosystem that I think we need to have a livable world.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, well, I mean, we build a communications app, but we rely on telecom networks. We rely on server infrastructure. We rely on core libraries.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I do think that there's a model there. I think I'm interested right now in researching hybrid structures and tandem structures. Are there sort of for-profit structures Areas of tech that aren't, you know, driven by kind of, you know, like surveillance?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Are there ways you could fund nonprofits, fund some of this core infrastructure, these, you know, libraries and other things that have been languishing for decades? You know, how do you sort of revitalize that? And then are there, you know, are they ways to build truly independent infrastructure outside of the, you know? three companies, five platforms model.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I think it's just clearly critically dangerous at this point.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I think my answer to that is that that future will rely on laying an independent infrastructural bedrock and actually transforming some of the way we govern and think about digital technology generally, including being really attentive to things like how is data created? Who gets to decide what data we use to reflect our complex lives and realities? Who gets to decide
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It was a project. It was Derek Slater, Vince Cerf, Stephen Stewart, some Sasha Meinrath at Open Tech Institute,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
how patterns in that data are made sense of, what analysis is done to that data, and then what we do with the sense we make of it, right? What decisions we make, right? And so, you know, we do all that, we transform what AI is and what it means. Because no longer, you're no longer just scraping all the detritus off the stupid web.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
which was deposited or created via this surveillance business model, packaging that in an LLM and calling that intelligence, right? You're actually having to grapple with the epistemic process by which data becomes a proxy for reality. And that proxy shapes our lives and institutions. And so I think AI itself, right now we're talking about these massive models, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
This laws of scale, this sort of like big,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
american guy dream of the you know the largest in the world um but ai is a you know it's a very slippery term it's not a technical term of art it can apply to many many different things and there are small models there are sort of you know heterodox approaches there are expert systems which they're now trying to bolt onto the side of generative systems because like wait probabilistic answers aren't true so we need to bolt truth back on and we're kind of repeating a lot of the
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
you know, a lot of the, a lot of the history of AI kind of speed running it in a search for a business model.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So my answer there is that like a lot of the things that need to be done to, you know, simply disarm and draw down the centralized power of these, you know, surveillance and infrastructure companies are the same things that would need to be done to redefine in a sense, what AI is and our relationship to how truth, how, you know,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
decisions, how, you know, I don't want to use the word truth actually, but like how information is made via analyzing data and who gets to control that. And I think, you know, my sensitivity to data in that answer comes directly from my measurement experience, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Like where you, you know, one upgrade to the Linux kernel across our server fleet fundamentally changed the kind of data we were able to create. like, how it populated the schema and, like, meant that that data wasn't necessarily fungible with the data collected on the older version of the kernel, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, some old internet guys and me. Let's say the elders of the internet.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And in order to solve that problem, I had to get a guy to go sit with the kernel maintainers for, like, two years to, like, make sure that the update wasn't going to, like, fuck up the way we got TCP DOMs, basically. So, like, that, you know, that's... And that's...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
then think about social data then think about data that reflects like who gets access to resources then think about all of the other things and um i think i think it's actually an exciting idea to think on like you know how do we how do we create systems where we're much more attentive to that and recognize that there is a you know it really matters how those choices are made how those you know how data is created who gets a say in it and who gets a say in how it's used
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And the lady with the couch. And the conceit there, which felt really simple to me at the time, is everyone is buzzing about net neutrality. And I was a Kool-Aid drinker. I still think the value underlying that kind of mythology, let's say, like, yes, we should, you know, we should not have one gatekeeper deciding, you know, which news source, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I think it's definitely time for smaller speed boats. And I want to index on that word improvement. Because if we scratch the surface on some of these large models, some of which are generative, you begin to realize that a lot of the claims to improvement and accuracy are based on...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
really narrow benchmarks and evaluations right that don't reflect the performance of these models and that's how germans optimize their diesel engines we have exactly um so it's you know there are things that gen ai models can do i don't see them realistically going away but i do see the struggle for a market fit that can produce the kinds of returns necessary to prop up
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
a massively energy intensive, massively infrastructurally intensive, extraordinarily capital intensive... Mm-hmm. Industry, right? Like, so you have, you know, billions of dollars for a training run, just huge amounts of energy and effort needed to create a model. But like, okay, who's going to keep paying for a chatbot that's wrong? Right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
You know, and so I think like, there is a struggle for market fit. I think you see this with things like Microsoft Recall, where they, you know, push to implement this, you know, I don't know. Yeah. Microsoft Recall was supposed to ship with Windows 11.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah. And we won that little thing. But it's, you know, it's an AI system whose value proposition is that it will remember everything you were doing on your device for the last N months. That's a nice value proposition. I get it for you. I don't, I obviously don't use it right. But like, and how does it remember is really the key here.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It remembers because it's taking screenshots of your device every five seconds, you know, creating a library of those screenshots and accessing those as the data on which it, you know, is able to claim intelligent memory.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And I don't need to know that I was doom scrolling. That's not a proud moment of memory for me. And to me, what that says, that's not a very useful purpose. It's probably going to be marketed to enterprises for worker surveillance, is my guess. But it shows that Microsoft is really trying to find a market for this, right? Because they clearly circumvented their QA process.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
They clearly circumvented their security evaluation. There was a lot of things that clearly didn't happen. and didn't happen at a company that is actively, yeah. And they need, you know, they invested, you know, they have open AI, they're invested a huge amount in Azure. They're building out infrastructure everywhere.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
All of them are, but Microsoft is kind of, you know, Microsoft is yoked to open AI. So they're, they took the leader position for a second. Um, and I think, I think given also that Microsoft is really trying to regain some, like a good reputation in the security world, it,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It's indicative of how desperate that rush to market fit and the AI exceptionalism that is driving it is that they just mess that up so egregiously. And I can hear some hacker in a Microsoft hallway being like, I don't fucking know. I just left that meeting. Because you can kind of sense how those things happen.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
This is, you know, this is old school common sense. It goes back to Western Union, who there's a little, you know, in the US would refuse to carry telegrams from political candidates the company didn't support, right? So there's like real, there's a real like bedrock precedent here. And I was like, yeah, of course, we need net neutrality. But, you know, neutrality itself is a really wafty sort of
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Well, I mean, the question to dig into is useful to whom? Because hype is useful to investors, right? You know, yada, yada.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Yeah, I mean, one use I think about a lot that is definitely, I'm sure, useful to intelligence services is, you know, I'm sure we all assume that POTS telephony data is being collected in mass by every intelligence service who can and has been for many, many, many years.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And that data was probably not that useful for a long time because, you know, you're going to have to know you're going to have to have a human review it or, you know, something. Well, it's probably a lot more useful now that you can quickly transcribe that with AI and sort of synthesize and search using these generative systems. Right.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So that's one example where I think it's probably almost certainly very, very useful and changes the calculus on like how dangerous this surveillance business model is as well. But who is that useful to? It's not me and you.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I refuse to plant my hope in delusion. Okay, thanks. And I am probably one of the more optimistic people you'll meet.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So fun. Always so fun. Thank you for having me. It's been a really, really delightful conversation with you all.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It's a loose concept that needs to be augured in some type of benchmark against which we can assess. You need to quantify it. And then you just flung into the abyss of philosophy the second you try to do that. But we started and it was... I would say it was not necessarily built to succeed.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It was built as a sort of hypothesis project where we stood up three servers that hosted open source measurement clients. And the thing that we were doing was putting...
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Servers that were all kind of configured the same that gave each client a dedicated slice of resources and then way over-provisioned the uplink between the server and the switch so that we could all, for all intents and purposes, guarantee that any artifacts that were detected through the measurement methodology, like some TCP RTT or something,
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
were not interfered with by our infrastructure and weren't suffering for bandwidth, right?
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
We immediately DDoS the servers. We're like, oh, shoot, because Vint Cerf put a blog post out and he's a big name. And then it was like this job of years and years of getting servers in different interconnection points because we wanted to measure across consumers. We're not just measuring to a server.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Exactly, and we need to cross interconnection points to do that because that's where you begin to see... interesting business relationships and kind of feuds. And it was just, it was very, it taught me about like how difficult and contingent and ultimately subjective creating data is. And the process, the political process of then sort of defending that data is, as a reliable proxy for reality.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Cause I would be at the federal communications commission and I had like Comcast across from me being like, no, we want to measure it, you know, multi-threaded TCP, you know, burst single threaded because you get a, you know, let's just say higher number that way it's more forgiving. And we would be sort of defending the methodology of our tests and the openness principles.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
So it was open source code. The database architecture was open. I don't remember all the server architecture, everything. Old school.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
Let's just say book nerds read and network stuff is written down.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
I'm like, no one told me I was allowed to not read it and still have an opinion.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
It is. I mean, it's a catalyst into today for my work.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
And we actually talked to them at Signal. They'll detect signal blocking. And I believe... So one of the things MLab did was provide... backend infrastructure for projects like Uniprobe. And I don't actually know what that relationship is today.
Logbuch:Netzpolitik
LNP504 The politics of intellectual shame
But, you know, so academics and hackers and developers could write a test or, you know, kind of a measurement methodology, deploy a client to consumers, like you test from your laptop or whatever. And then we would be the ones paying for the bandwidth and infrastructure that would allow that to scale.