Menu
Sign In Pricing Add Podcast
Podcast Image

Hidden Brain

What Your Online Self Reveals About You

Mon, 16 Dec 2024

Description

Every day, we leave small traces of ourselves online. And we might not realize what these traces say about us. This week, computational social scientist Sandra Matz explores how understanding what we actually do online –  not just what we think we do – can help us improve our lives. Looking for a last-minute holiday gift for a fellow Hidden Brain fan? You can now give a gift subscription to Hidden Brain+!  

Audio
Transcription

0.189 - 24.21 Shankar Vedantam

This is Hidden Brain. I'm Shankar Vedantam. I have a question for you. How well do you know yourself? Chances are, you'll tell me you know yourself very well. All of us like to believe this. We feel like we know ourselves better than anyone else does. Every day we make choices based on this knowledge we have of ourselves.

0
💬 0

24.951 - 41.584 Shankar Vedantam

We decide how to spend our money, who to vote for, where to go for dinner, based on what we know of our predilections and preferences. But our knowledge of ourselves is not always accurate. A host of biases and self-deceptions keep us from seeing ourselves clearly.

0
💬 0

43.533 - 58.564 Shankar Vedantam

When you ask people how smart they are, or how ethical they are, or how good-looking they are, for example, majorities say they are above average, which, of course, is mathematically impossible. But it isn't just about vanity.

0
💬 0

59.225 - 80.196 Shankar Vedantam

How many times have you gone to a restaurant you've been to before and ordered the same dish you ordered last time, only to remember after you started eating it that you didn't like it the last time? Or think about your last romantic entanglement that ended in disaster. By the time it ended, did you wonder how your past self could have gotten involved with someone so unsuitable?

0
💬 0

83.398 - 99.291 Shankar Vedantam

Over the last few decades, researchers in a variety of disciplines have discovered there is a much better way to understand people than to ask them questions. When you ask people what books they like to read, people will tell you about the novels and biographies they think they ought to like.

0
💬 0

100.908 - 115.907 Shankar Vedantam

If you ask them what movies they want to watch, they will tell you about the movies they aspirationally want to watch. But if instead you look at the books that people actually read or the movies they actually watch, it usually paints a different picture of their preferences.

0
💬 0

119.44 - 156.771 Shankar Vedantam

This week on Hidden Brain, how understanding what we do instead of listening to what we say can help us make better financial choices, improve our physical and mental health, and maybe even bridge our political divides. Philosophers tell us the highest wisdom is to know ourselves. They say this precisely because knowing ourselves is difficult, not easy.

0
💬 0

157.611 - 173.757 Shankar Vedantam

It requires self-reflection, self-awareness, and a healthy dose of humility. At Columbia University, psychologist Sandra Matz studies how one aspect of our behavior can reveal surprising truths about who we are. Sandra Matz, welcome to Hidden Brains.

0
💬 0

174.158 - 175.178 Sandra Matz

Thank you so much for having me.

0
💬 0

176.379 - 184.462 Shankar Vedantam

Sandra, you grew up in a small village in Germany which had two restaurants and no shops. Can you paint me a picture of the place where you grew up?

0
💬 0

185.683 - 200.689 Sandra Matz

Yes, happily. It's a village of 500 people in the very southwest corner of Germany. As you said, there's two restaurants, no shops, one church, I should say. That's very important to the people living there. And it was really like a small community.

0
💬 0

201.914 - 207.337 Shankar Vedantam

So one day I understand that your doorbell rang and it was a neighbor reporting a missing rabbit?

0
💬 0

208.377 - 230.048 Sandra Matz

Yeah. I must have been, I think, eight, nine years old. And I had this pet rabbit or bunny called Schnuffel. And he was living outside. We had built him this house outside, my dad and I. And one day the neighbor comes and says that they found him in their garden, feasting on their vegetables and salad. And so they tried to

0
💬 0

230.328 - 251.071 Sandra Matz

catch him already but unsuccessfully and so they were trying to get more manpower so now my entire family is up their entire family is up we're trying to get him and I don't know if you've ever had a bunny or let alone try to catch one they're really fast So they zigzag around and it's almost impossible to catch them. So we must have looked like clowns running around.

0
💬 0

251.711 - 267.517 Sandra Matz

And that certainly didn't go unnoticed. So very soon into our hunt, I think the entire street really was involved. So we had someone was managing the traffic because the bunny would just kind of run from one side of the street to the next. And then we had like, it really felt like a command center.

0
💬 0

267.557 - 280.769 Sandra Matz

So people were strategizing about whether we should set up a trap for the rabbit or whether we should just try to lure him in with a treat. Eventually we caught him, but it was certainly an adventure for the entire neighborhood.

0
💬 0

281.33 - 285.056 Shankar Vedantam

How was the rabbit eventually recaptured? Was it a dramatic moment?

0
💬 0

285.655 - 306.483 Sandra Matz

It was a dramatic moment. So it was actually one of my neighbors who leaped and caught him on the back leg. And I just remembered the rabbits screaming. I didn't even know that rabbits could scream that loudly. And then all the kids were crying because the rabbit was screaming. And so I think the adults were just happy that we got him. But it was certainly a dramatic capture.

0
💬 0

306.503 - 324.851 Shankar Vedantam

I'm getting a sense that this was a village where everyone knew everyone's business. Very much so. Very much so. So when you were 15, Sandra, you loved riding around the village with your boyfriend on a motorcycle. What was this bike like and where would you go?

0
💬 0

326.692 - 349.429 Sandra Matz

Yeah, so it was, I still remember it. It was like a red Suzuki Bandit. And it was, I thought it was beautiful. So I was 15, he was a bit older. And we would just take it from one village to the next through the hills and up and down the serpentines. And I loved riding it, but I was usually in the back. So at some point I think I got really tired of being in the back.

0
💬 0

350.33 - 369.364 Sandra Matz

And I knew that I would have to wait for another three years, because in Germany you get your license at 18 at the earliest. So I kind of try to sneakily convince him to let me just try. I found this abandoned airfield and I just told him, let me just kind of ride for a few meters. You're going to get the bike back. It's all going to be good.

0
💬 0

369.384 - 395.635 Sandra Matz

He was a bit skeptical at first, but then agreed to let me try. So we start and I don't know exactly what happened. I think we must have kind of moved to the grass and I was trying to pull the bike back. But suddenly I think I just turn on the gas. And the bike rises. My boyfriend falls off the back and I just speed away. So I have no idea what I'm doing now.

0
💬 0

395.675 - 412.299 Sandra Matz

Suddenly I'm alone on the bike without any sense of like how to handle it. I'm trying kind of going left and right and left and right. And at some point I essentially crash on the side. Luckily it was still going slowly, but there was my first experience riding the bike myself.

0
💬 0

416.781 - 423.35 Shankar Vedantam

Sandra and her boyfriend weren't hurt, but Sandra had to spend a year's worth of tutoring money to get the bike repaired.

0
💬 0

424.571 - 446.521 Sandra Matz

But in a way that wasn't the worst part. For me, the worst part was that I would say the minute we dropped the bike at the shop, everybody knew. So people knew about me asking my boyfriend to drive the bike, me crashing the bike, which was even worse. Otherwise, it could have potentially been a cool story, but certainly wasn't. So everybody knew what had happened.

0
💬 0

447.241 - 450.303 Sandra Matz

And just I was punished for weeks after with people asking me about it.

0
💬 0

451.249 - 455.012 Shankar Vedantam

When you say you were punished, how so? What was the reaction of your neighbors and friends?

0
💬 0

456.192 - 474.064 Sandra Matz

Very, I mean, very different. So some neighbors actually just went back to their own childhood and they were like, oh, that's like such a brave and fun thing to do. And they just recounted their own childhood offenses. Others were like, how could you ever do this? We thought that you were actually one of the good kids on the block.

0
💬 0

474.224 - 479.647 Sandra Matz

So, but it was just one conversation after the other that was all about me crashing the bike.

0
💬 0

479.667 - 483.926 Shankar Vedantam

Yeah. Was there anything good that came from all this surveillance, Sandra?

0
💬 0

484.827 - 505.036 Sandra Matz

Certainly. I mean, I think that maybe not the bike surveillance. I think this one was a hard one. But generally speaking, the fact that my neighbors knew everything about my business also meant that there was a community that I felt safe in. So it was a community of people who knew me, who tried to help when I was looking for advice. And I've never quite experienced anything like it ever since.

0
💬 0

506.451 - 511.393 Shankar Vedantam

Was there a time when you in fact got very useful advice from these people because in fact they knew you quite well?

0
💬 0

512.406 - 536.362 Sandra Matz

I think so. I mean, some of them were just trying to interfere with my life, but some of the advice I got was incredibly helpful. So one of the ones that I still remember is that when I was finishing high school, I was thinking about doing a gap year. It sounded like a dream to me. I was like, well, you can travel the world, you can take a year off, don't rush into university.

0
💬 0

536.462 - 559.324 Sandra Matz

But I remember being quite torn because not many of my friends were considering it. And I was, very ambitious, I would say at the time. So I was like, well, maybe it's just a waste of my time to spend a year traveling. I could start university, get a job. And luckily, a lot of my neighbors told me like, look, you seem like someone who's been always craving to leave this village to see some

0
💬 0

560.345 - 574.055 Sandra Matz

some of the world. Why don't you do it? Like you can work for many, many years after you should really consider it. They helped me even find a job to scrape together the money. So I think that was one of the times that I felt very much supported.

0
💬 0

575.216 - 578.619 Shankar Vedantam

And in some ways, it sounds like they knew you almost better than you knew yourself.

0
💬 0

579.74 - 586.905 Sandra Matz

In some ways, I would say so. Because I think it was a slightly less biased and maybe self-critical version of myself.

0
💬 0

591.205 - 606.134 Shankar Vedantam

Sandra's experience with the nosy neighbors in her village is what life has been like for most humans through most of human history. We've typically lived in small groups, and people in those groups have known everything there is to know about us. Today, many of us live in a different kind of village.

0
💬 0

606.854 - 645.469 Shankar Vedantam

It's a global village where anonymous entities, rather than our actual neighbors, have eyes on us. Not all of them have our best interests at heart. When we come back, what our digital footprints reveal about us and how this information can be used both to help us and to harm us. You're listening to Hidden Brain. I'm Shankar Vedantam. This is Hidden Brain. I'm Shankar Vedantam.

0
💬 0

647.102 - 666.279 Shankar Vedantam

Every day, as we go about our lives, we reveal aspects of ourselves to the world. If you visit a local bakery a lot, it's probably because you like pastries and baked goods. If you spend time in parks, it's because you value nature and recreation. Someone who rarely ventures outside their home except to go to work might be introverted.

0
💬 0

667.614 - 688.502 Shankar Vedantam

At Columbia University, computational social scientist Sandra Matz studies how the things we say and do reveal things about our thoughts, preferences, and personalities. Sandra, I want to talk about the clues we unintentionally leave behind us as we go about our lives. Let's start in the physical world.

0
💬 0

688.982 - 696.185 Shankar Vedantam

Many years ago, you were on a date and things were going well and you ended up at your date's apartment. Tell me what you did as soon as you got to his place.

0
💬 0

697.526 - 720.489 Sandra Matz

Yeah, it's a funny story because I remember entering the apartment and you know, you meet someone for the first time, you have no idea who they are. And I entered the apartment and it's pristine. It's first of all, it has this huge library, which I loved and had books in Hebrew and English and French. So I was like, oh man, this is a bookworm. I love it already.

0
💬 0

721.61 - 739.439 Sandra Matz

Walked to the kitchen, it's sparkling clean, which I cannot say of my own kitchen. So I was highly impressed in the sense that everything had its place. The knives were perfectly organized. I got some glasses for us and they were perfect. No marks, no watermarks anywhere.

0
💬 0

740.56 - 756.063 Sandra Matz

And I just kind of started building this image of like who the person living in this apartment, the guy I was dating at the time, who he was. And it just felt like he was this curious, book-loving person with almost like an OCD sense of order.

0
💬 0

756.083 - 766.765 Shankar Vedantam

So you weren't wearing a hat and carrying around a magnifying glass, but it feels vaguely Sherlock Holmes-ian to me what you were doing in that apartment.

0
💬 0

767.563 - 780.393 Sandra Matz

It does feel like Sherlock Holmes. And I think we do this all the time, right? We meet someone new. We look for clues of who that person is. Could be their apartment. Could be what they're wearing. Could be what they're saying. It's really we're kind of trying to piece the puzzle pieces together in a way.

0
💬 0

781.113 - 782.254 Shankar Vedantam

How did things go with this date?

0
💬 0

783.435 - 788.199 Sandra Matz

Well, it worked out really nicely. He's now my husband and we have a 10-month-old.

0
💬 0

790.441 - 797.246 Shankar Vedantam

I'm wondering whether your impressions of your husband, your first impressions of him when you were dating, did they turn out to be accurate, Sandra?

0
💬 0

798.718 - 814.163 Sandra Matz

Very accurate. So I think he I would say he's probably the most curious person I know. He loves podcasts, loves reading, loves to learn everything about the world. And he also I have to say is a little bit OCD in a good way.

0
💬 0

818.135 - 830.488 Shankar Vedantam

So the psychologist Sam Gosling has shown that people, in fact, are remarkably accurate at judging the personality of strangers when given the chance to snoop around their offices or bedrooms. Tell me about this work, Sandra.

0
💬 0

831.158 - 849.622 Sandra Matz

Yeah, so this is actually work that inspired all of my research in the digital space. So Sam Gosling was one of the first people to try and figure out how good are strangers at judging our personality if they just take a look at our bedrooms and our offices. And he distinguished between these two types of cues that you can find.

0
💬 0

849.662 - 852.803 Sandra Matz

So he said, well, some of the cues that you find in someone's office or bedroom

0
💬 0

853.343 - 882.101 Sandra Matz

are the intentional identity claims that we that we put there right so we put up a poster um of lady gaga because that's the signal that we want to send to the world of well we're into music and this is the type of music that we like and but then there's also all of these other cues that we don't really think about right so the socks are disorganized the bed isn't made um it's the opposite of my husband it's just like probably a little bit more disorganized so what sam gosling really showed is that if you combine all of these things

0
💬 0

882.481 - 885.344 Sandra Matz

you get a pretty good sense of who the person living in these places is.

0
💬 0

886.906 - 900.159 Shankar Vedantam

So you say there are parallels between what happened in your village or your behavior when you visited your date's place and what happens to us online. It's as if your village neighbors now have access to your Facebook messages and credit card purchases?

0
💬 0

901.107 - 920.238 Sandra Matz

Yeah, so in a way, right, so I could take a look at your office or your bedroom, or I could see what my neighbors are doing. But on some level, I think we all now live in this, what I think of as a digital village. And so we all leave these traces, these digital traces all the time. That could be anything from, The stuff that you post on social media.

0
💬 0

920.298 - 936.866 Sandra Matz

So again, relatively explicit identity claims to the data that is captured by your smartphone. So GPS records, where do you go? Your credit card, what do you buy? And the same way that we could put the pieces together from someone's bedroom, we can also do that in someone's digital space.

0
💬 0

938.047 - 952.445 Shankar Vedantam

You say it takes shockingly little information to get an extremely granular picture about people, even in a big town like New York City. Now, there are millions of transactions that take place every day in New York. Finding any one person might seem like you're looking for a needle in a haystack.

0
💬 0

953.274 - 969.843 Sandra Matz

Yeah, it's actually one of my favorite studies that was coming out of MIT. And what they showed is that it's very easy to identify someone based on your spending records or your GPS records. So you can imagine, as you said, there's millions of people in New York.

0
💬 0

970.904 - 982.391 Sandra Matz

And even if we, say, got access to all of their credit card spending, anonymized it so we don't have names, we don't have any personal identifiers, it's very easy to reverse engineer the data. You can imagine that, let's say, you

0
💬 0

983.311 - 1003.189 Sandra Matz

go and get a matcha latte at Starbucks on 72nd Street in New York at 7.20 a.m., then you have lunch in a certain place, and maybe you take a cab downtown at night, there's at some point only so many people who have exactly that same signature. So you can almost think of it as a fingerprint that is made up of your data.

0
💬 0

1007.475 - 1021.902 Shankar Vedantam

I want to talk about some of the ways you and others have found that our digital footprints can reveal deep truths about our lives. In 2019, you ran a study that predicted people's income based on an extremely unlikely source. Tell me what you found Sandra.

0
💬 0

1022.625 - 1041.014 Sandra Matz

Yeah, so that's in a way that the most interesting part of this entire field of research is like, yeah, we can identify you as a person, we can know that it's Shankar based on your data. But for me, the more interesting part is actually that we can dive into your psychology. So we can take a look at what's going on inside your mind.

0
💬 0

1041.414 - 1059.966 Sandra Matz

And so the study that we did when we try to predict someone's income was essentially relying on their Facebook data. So what is it that people talk about and post on social media? And I think there were some really interesting, sometimes quite uncomfortable truth that we discovered.

0
💬 0

1060.046 - 1067.712 Sandra Matz

But overall, the bottom line was that just by looking at what you talk about on Facebook, we can have a pretty good sense of your socioeconomic status.

0
💬 0

1068.72 - 1078.773 Shankar Vedantam

I'm puzzled by how that would be the case. I mean, what does my posting about a movie that I've watched or a vacation that I've taken, how do you tell what my income is based on those postings, Sandra?

0
💬 0

1079.827 - 1098.251 Sandra Matz

Yeah. So when you, when you start opening the black box, um, what you see is some of them are like, some of the cues are relatively obvious. So you can imagine that people with a lot of money, they talk about the vacations that they're going to take. They talk about expensive luxury brands, um, a lot more often than people who are struggling to, to make, um, ends meet.

0
💬 0

1098.771 - 1114.716 Sandra Matz

But there's also these more subtle cues that I found, um, even more interesting, which is for example, that lower income people, um, they talk more about themselves and they talk more about the present. than higher income people. And in the beginning, you might be wondering, why might this be the case?

0
💬 0

1114.957 - 1130.824 Sandra Matz

And I think it's just that it's really damn hard to think of anything else other than how you make the present work if you're struggling to make enough money to put food on the table. So those are all these little, I think, secrets about what's going on inside our mind that we can uncover in the data.

0
💬 0

1131.601 - 1143.907 Shankar Vedantam

What's fascinating about that, of course, is that most of us are not thinking, are my posts describing something that's happening in the present or something that is about the future, for example, but that difference, in fact, can reveal something about us.

0
💬 0

1144.507 - 1159.62 Sandra Matz

Yeah. And I think that's the distinction between identity claims and behavioral residue that I think is so interesting, right? So again, you might post about this luxury vacation, and it's a very clear signal to the world that you're having a great time and you can afford going on this vacation.

0
💬 0

1159.68 - 1166.647 Sandra Matz

But then all of these more subtle ones where you talk about yourself, you're more focused on the present, that's certainly something that we don't necessarily intend to reveal.

0
💬 0

1167.508 - 1172.053 Shankar Vedantam

You used an interesting phrase just now, behavioral residue. What do you mean by that, Sandra?

0
💬 0

1172.728 - 1192.941 Sandra Matz

Yeah, so behavioral residue are all of the traces that we essentially inadvertently leave as we go about our life. In the offline context, you could imagine, again, that's like the bin overflowing, that's your socks not being organized, that's the bed not being made. And in the digital world, it's all of the traces that we generate without really thinking about it.

0
💬 0

1193.101 - 1208.433 Sandra Matz

So that could be your smartphone, for example, captures your GPS records pretty much continuously 24-7. And you're not intentionally sitting down to create a record of where you went and what you did there. But still, those traces exist.

0
💬 0

1209.413 - 1221.183 Shankar Vedantam

Let's look at some of the ways in which these behavioral residues can tell us important things about our lives and the lives of other people. The researcher Yo-Yo Wu once looked at what you could learn about a person from their Facebook likes.

0
💬 0

1222.165 - 1243.957 Sandra Matz

Yeah, that was really, so the research by Youyou Wu, I would say was one of the pivotal studies in this field because it showed just how accurate the predictions that we can make about someone's psychology really are based on relatively little data. So she was studying the Facebook pages that people follow. So let's say CNN has a Facebook page, you can like it.

0
💬 0

1244.637 - 1261.969 Sandra Matz

And what she showed is that just by looking at your Facebook pages, an algorithm can actually predict your personality more accurately. than our co-workers could, than our friends could, than our family members could. And mind you, those are people who know you pretty well, right? Those are your parents, those are your siblings, those are your kids.

0
💬 0

1262.009 - 1277.121 Sandra Matz

They've spent a substantial amount of time with you. And it was slightly inferior to the judgments and the predictions of your significant other. Now, this was a study that was done in 2015. It was only based on Facebook likes. So you could imagine that if we get access to

0
💬 0

1277.748 - 1285.992 Sandra Matz

all of your digital traces and apply slightly more sophisticated machine learning that we could probably outperform even your significant other.

0
💬 0

1287.693 - 1304.422 Shankar Vedantam

So the study found that after observing just 10 likes from someone's Facebook profile, the model was able to judge a user's personality better than their work colleagues. After 65 likes, it knew users better than someone's friends. And after 120 likes, better than family members. I mean, that's astonishing, Sandra.

0
💬 0

1305.086 - 1325.323 Sandra Matz

Yeah. And I think what is astonishing to me, and I think a point that is important, those models aren't perfect, right? So I think any prediction always has a certain amount of error. And what we're talking about are averages. So on averages, these models are really accurate, as you just said, with a comparison. However, we still make mistakes at the individual level.

0
💬 0

1325.363 - 1341.769 Sandra Matz

So one of the things when we kind of make these comparisons and predictions that I want to highlight is that don't take it as a truth, right? It's a prediction. It's a probability. It's pretty damn accurate on average, but we're still going to make mistakes at the individual level.

0
💬 0

1343.482 - 1362.804 Shankar Vedantam

I'm also assuming that when you have intersecting lines of evidence, so this study was looking at Facebook likes, but if you were able to combine that, for example, with people's credit card purchases, if you were able to combine that with their Twitter feeds, if you were able to combine that with what they're saying about themselves, you're gradually producing a more and more accurate profile of who the person is.

0
💬 0

1363.533 - 1387.567 Sandra Matz

Yeah, I think of it as like this puzzle that we're putting together of a person. So you get a piece here that's their social media and then you get another piece that's their credit card spending and another piece that's their smartphone sensing data. And gradually you kind of see this person behind the data emerge. And what I think is fascinating about this combining data sources is essentially

0
💬 0

1388.887 - 1408.684 Sandra Matz

A lot of people always say when I talk about social media that, well, isn't it just like this curated identity of who we are? It's just like who we want to be. We all like matcha lattes and amazing vacations. We're never sad. So it's just like the self-idealized version of who we really are. That's true for some of these identity claims, right? Social media.

0
💬 0

1409.244 - 1424.129 Sandra Matz

But if you wanted to, let's say you wanted to pretend that you're more organized and conscientious than you do really are, maybe you can do this on Facebook for a couple of weeks. It's really, really difficult to do this across all data sources and across like months and months and months.

0
💬 0

1430.393 - 1451.788 Shankar Vedantam

I'm wondering if you can talk a moment about how these sort of in some ways mindless algorithms are painting a picture of us that's more accurate than our friends and neighbors and coworkers. And some of that is because our friends and neighbors and coworkers are bringing their own perceptions and their own biases to the equation as they're evaluating us.

0
💬 0

1452.557 - 1469.264 Sandra Matz

Yeah, so I think part of it might be bias, right? One of the things that we're limited by as humans is we have only a sliver of experience and we have our own perspective on the world. And that's influencing every judgment that we make about other people. Now, we also have a lot less data to work with, right?

0
💬 0

1469.304 - 1485.25 Sandra Matz

If you look at the prediction of models that we build, they are looking at millions and millions and millions of data points. all integrating them at the same time, there's just no way that we have access to millions of millions of friendships that allow us to then judge someone's personality based on their behavior.

0
💬 0

1485.27 - 1498.014 Shankar Vedantam

Yeah. I mean, in some ways, this is like Sherlock Holmes on steroids is what these machines are doing, right? Because they're actually picking up huge amounts of data, far more than most of us are actually able to observe in the physical world.

0
💬 0

1498.295 - 1502.076 Sandra Matz

Yeah. Let's imagine it's like Sherlock Holmes with a million Watsons. Yeah.

0
💬 0

1507.958 - 1517.855 Shankar Vedantam

So even our search history, what we're looking for online, can say a lot about us. Talk about this, that in some ways what we search for online can paint a very powerful picture of who we are.

0
💬 0

1518.513 - 1541.244 Sandra Matz

Yeah. So Google searches, if you think about that, Google is probably the closest confidant that we have, right? We ask Google questions that we don't even dare to ask our closest friends, our partners. So on some level, it's not surprising that whatever we search for on Google actually reveals a lot of what's going on inside. And that could

0
💬 0

1541.644 - 1564.228 Sandra Matz

be anything from mental health to truth about society that we might not want to see. So one of a close friend, Seth Stevens Davidovich, and what he did is he looked at search data. So all of the searches that people make, and he was trying to uncover some of the relationships between what we search for and really kind of truths about society. So that could be anything from

0
💬 0

1565.353 - 1585.215 Sandra Matz

What do people search for when they search for sex? Do people look for abortions more often than we actually see in the official data? Do people search for racist jokes more often than people would admit in public? So I think Google is really the source that captures what's going on inside our mind and stuff that we don't want to share with anyone else.

0
💬 0

1586.371 - 1599.476 Shankar Vedantam

So we had Seth Stevens-Davidowitz on Hidden Brain some years ago, and one of the things he mentioned was that there was this negative correlation between racist searches on the internet and the likelihood that people would vote for Barack Obama.

0
💬 0

1599.977 - 1610.281 Shankar Vedantam

So in both the 2008 and 2012 presidential elections, places with higher rates of Google searches using racist terms were less likely to vote for Barack Obama.

0
💬 0

1611.465 - 1625.729 Sandra Matz

Yeah, that's right. And I think, again, if you look at the official polls, nobody wants to admit that. So those are correlations that you don't necessarily see showing up in survey data, but you do see them show up in these more hidden cues.

0
💬 0

1629.871 - 1641.254 Shankar Vedantam

In another study, Sandra, you looked at the relationship between social media updates and voting, but you were not looking at explicit data, like people saying they were going to vote for a particular politician. What were you looking for and what did you find?

0
💬 0

1642.202 - 1663.177 Sandra Matz

Yeah, so this was a study that we did where we looked at what's driving populist voting. And what we were particularly interested in is affect. So to what extent is this negative affect, and not just like the more aggressive negative affect like anger, which you oftentimes see talked about in the media, but also the more subtle ones like sadness and depression.

0
💬 0

1663.657 - 1681.005 Sandra Matz

To what extent are those emotions as they show up on social media linked to people voting for populist candidates? So one of the elections that we looked into was Brexit in the UK. So people voting to leave the European Union or the 2016 US presidential election.

0
💬 0

1681.345 - 1691.889 Sandra Matz

And what you find consistently is that in areas where there's a lot of this negative affect showing up on social media, people are also more likely to vote for these populist candidates and causes.

0
💬 0

1693.15 - 1710.17 Shankar Vedantam

And again, what's interesting here is that it's like the mismatched socks in the drawer, right? It's not a signal that people are actually thinking will say something about their political preferences. If I'm feeling upset or sad or my affect in general is negative, I don't think it's going to reveal something about my political preferences, but in fact it does.

0
💬 0

1710.629 - 1723.356 Sandra Matz

Yeah. And you have all of these predictive models, right? So you have all of these predictive models trying to project what is the outcome of an election. None of them really consider tone or emotional valence based on social media.

0
💬 0

1724.281 - 1737.911 Shankar Vedantam

You know, I'm reminded of that analysis that found in the 2016 presidential election that Donald Trump won three quarters of all counties that had a Cracker Barrel restaurant, but only 22% of counties that had a Whole Foods store.

0
💬 0

1737.971 - 1746.518 Shankar Vedantam

Now, most people are not thinking about politics when they're shopping for groceries or dining out, but it turns out that our shopping and dining habits can reveal powerful things about us.

0
💬 0

1747.984 - 1763.911 Sandra Matz

Yeah, so sometimes I think it's like the behaviors that you show, right? Shopping and Whole Foods is probably a proxy for some of the more psychological variables. That could be anything from openness, which we know is associated with being liberal, could be associated with socioeconomic status.

0
💬 0

1764.391 - 1779.357 Sandra Matz

And the same way that negative emotions, for example, is associated oftentimes with a desire for change. And in that sense, it's not necessarily surprising that those people who feel currently bad about themselves are Want to vote for a candidate that promises change?

0
💬 0

1787.999 - 1827.757 Shankar Vedantam

Most of us spend a great deal of time every day in front of various devices. We scroll and tap and like and listen. We search for answers to our most personal questions and post updates to our social media feeds. When we come back, how all this data can help us improve our lives. You're listening to Hidden Brain. I'm Shankar Vedantam. This is Hidden Brain. I'm Shankar Vedantam.

0
💬 0

1828.888 - 1848.448 Shankar Vedantam

You wake up in the morning and reach for your phone. You open Instagram and leave a comment on a friend's vacation pictures. You sneeze and run a Google search about allergies. On the way to work you buy a muffin at a local cafe using your credit card. Every day we leave dozens of tiny traces of ourselves in the digital world.

0
💬 0

1849.454 - 1870.724 Shankar Vedantam

At Columbia University, Sandra Matz calls the accumulation of these traces our digital footprints. She is the author of Mindmasters, the data-driven science of predicting and changing human behavior. Sandra, you say that the traces we leave online not only paint a picture of who we are, they show marketers and political campaigns how to influence us.

0
💬 0

1871.465 - 1882.551 Shankar Vedantam

Now, we've all heard a lot about the problems of digital surveillance, but fewer people know how these tools can be used for good. Let's start with the work you've done showing how psychological targeting can help people save more money.

0
💬 0

1883.72 - 1903.393 Sandra Matz

So the idea here was that if we could make saving more appealing to people to make it more personally relevant, could we help them put that money, the extra money to the side? So we teamed up with Save a Life, which is a fintech company in the US. They are trying to help low income families save for a rainy day.

0
💬 0

1903.473 - 1927.768 Sandra Matz

So the people that we work with were people with very low levels of savings, so less than $100. And our goal was to get them to add an additional $100 to their savings account over the course of four weeks. So we teamed up with the creative team of Save a Life and we essentially asked them, well, come up with with saving messages that try to encourage, say, people who are very agreeable.

0
💬 0

1927.828 - 1938.873 Sandra Matz

So people who care about other people who care about their social relationships and maybe tell them that if you manage to put some money to the side right now, this is a great way of making sure that your loved ones are protected.

0
💬 0

1939.373 - 1954.587 Sandra Matz

Now, if you're talking to someone who is much more competitive and critical, which is the other side of the same personality trait, maybe you want to highlight how just putting this money to the side gets them ahead of the game. So we kind of came up with this different type of messaging for all of the big five personality traits.

0
💬 0

1954.967 - 1976.852 Sandra Matz

And then we just sent out the messages over the course of four weeks. And we looked at how many people eventually managed to save an additional $100. What did you find? So what we find is that essentially if we target people with the messages that were tailored to their personality, about 11% of the entire sample managed to put $100 to the site.

0
💬 0

1976.892 - 1994.268 Sandra Matz

Now that's certainly far from perfect, but ideally we'd want this to be closer to 100%. But if you think about it, it means that someone is doubling their savings over the course of four weeks. And what's more important is that it was also much better than the existing messaging that Save a Life had been using up to this point.

0
💬 0

1994.308 - 2003.215 Sandra Matz

So they had been trying to perfect their messaging over a couple of years, and we were still 60% better than the gold standard that they were using at the time.

0
💬 0

2004.056 - 2018.788 Shankar Vedantam

So just to underscore the principle here, what you're doing is you're basically saying we can tell what people's personalities are by the digital footprints they're leaving behind. And if we can tailor messages in some ways to match people's personalities, those messages are far more likely to break through.

0
💬 0

2019.364 - 2037.538 Sandra Matz

Exactly. And you can think of it as essentially this is what we do all the time in our offline relationships. Pretty much any type of conversation that you have is to some extent tailored. You don't talk about the same things or in the same way to a friend or to your kid or to your boss.

0
💬 0

2037.939 - 2046.105 Sandra Matz

So we're trying to replicate this at scale and just say, OK, what is it that you might care about and how can we make saving more appealing to you?

0
💬 0

2051.405 - 2059.891 Shankar Vedantam

Our digital footprints can also reveal insights about our mental health. You and a colleague have studied whether there's a connection between depression and a person's location data.

0
💬 0

2060.68 - 2085.549 Sandra Matz

Yeah, so this is essentially research that we did with GPS records. So again, your phone tracks your GPS records pretty much 24 seven. And what we were interested in is whether we could tell whether someone might be suffering from depression or not, just based on these GPS records alone. Now, if you look at the content of some of these traces that we observed, they actually make a lot of sense.

0
💬 0

2085.849 - 2101.954 Sandra Matz

What we found, for example, is that if you don't leave your house as much anymore as you typically did, or there's much less physical activity, you don't travel to as many places as you used to, those are all small indicators that there might be something going on.

0
💬 0

2102.175 - 2111.078 Sandra Matz

It's certainly not a diagnostic tool, but it means that maybe we could be raising a red flag and say, hey, might be nothing, but why don't you check in with some support?

0
💬 0

2112.461 - 2126.828 Shankar Vedantam

And I suppose, you know, there's always going to be noise in the data. So someone may have lost their phone inside their sofa cushions. And so the phone basically sits at home for three weeks. It doesn't mean that they are depressed and they haven't left their home in three weeks. It just means that the phone was lost.

0
💬 0

2127.129 - 2135.833 Shankar Vedantam

But I think what you're really saying, Sandra, is that in aggregate, this data, in fact, are telling us valuable things. And at a minimum, they're basically raising a flag that warrants further investigation.

0
💬 0

2135.993 - 2160.847 Sandra Matz

yeah so i don't think it's a deterministic diagnostic tool but it could be incredibly helpful for people for example who know already that they're suffering from depression right so it's like one of these mental health challenges that just pop up time and again and it's really difficult to find your way out of the valley so once you enter the full-fledged depression it's really hard to come back and so if we can get these early indicators of well

0
💬 0

2161.287 - 2173.765 Sandra Matz

maybe it's nothing but here's like a warning system that might alert you to well again there's like these changes in your behavior you're deviating from your typical routine why don't you reach out to someone and see if there's something to it

0
💬 0

2177.901 - 2191.441 Shankar Vedantam

I mean, this is really no different than basically saying, let me measure your resting heart rate or your cholesterol levels. And over time, if I have enough data, it might paint me a picture of saying, you know, you're heading down a bad path. You might want to change your lifestyle.

0
💬 0

2192.332 - 2212.903 Sandra Matz

Yeah. And you can do this in real time. And technically what you could also do if you're really thinking about this as a support system for the person is not just alert the user, but maybe I can give you the opportunity to name two people, loved ones, someone that you want to know that you're having a hard time, even if you're not in a position to tell them.

0
💬 0

2218.624 - 2231.111 Shankar Vedantam

So our digital footprints not only reveal things about our past, they can also predict things we might do in the future. You once tried to predict dropout rates among college students by studying their digital footprints. How did you do this, Sandra?

0
💬 0

2231.769 - 2252.504 Sandra Matz

Yeah, so this is actually one of the projects that I personally care a lot about because there's still so many students dropping out with enormous debt that they never recover. So what we were trying to do is to see if we could predict early on, once people joined university in the first semester, whether we could see if they might be struggling integrating into the system, right?

0
💬 0

2252.565 - 2271.432 Sandra Matz

Maybe they're not finding the information that they should be finding. Maybe they're not embedded in the cohort as much as other people, and they're somewhat on the fringes, not really connecting to the community as much. So we kind of, again, teamed up with a company called Ready Education. They had like a sense of what are the activities that students attending?

0
💬 0

2271.793 - 2288.822 Sandra Matz

Are they talking to other students? Are they part of groups? Are they sending messages? Are they receiving messages? So we looked at all of these data traces. And again, once you combine all of them, you actually have a relatively decent sense of whether someone might be struggling and whether they might drop out at the end of the semester.

0
💬 0

2289.775 - 2292.398 Shankar Vedantam

And, of course, when you put it this way, it seems to make sense now.

0
💬 0

2292.618 - 2309.997 Shankar Vedantam

If I know, for example, that a student doesn't have many friends and is not exchanging messages and, in fact, is a little bit isolated and is not spending time hanging out with other students, it's not unreasonable now to say maybe the student doesn't feel like he or she belongs at university and is at higher risk of dropping out.

0
💬 0

2310.509 - 2330.602 Sandra Matz

Yeah, and for me, what I love most about this is essentially it creates a path to help students. And at the very bare minimum, what it allows administrators to do is identify at risk students, right? So if you see that there's some students who have a higher likelihood of dropping out, maybe you allocate more resources to helping them.

0
💬 0

2331.183 - 2352.339 Sandra Matz

Now, for me, the even more interesting part is that we also get a sense of what is predicting dropout for each individual student. So it could be that I, for example, when I started university as a first-generation student, my problem was that I simply didn't know where all of the information was sitting. I didn't know how to get the literature. I didn't know where to search for information.

0
💬 0

2352.739 - 2371.672 Sandra Matz

And so for me, if that was the prediction that the algorithm had made, administrators could have gone in and said, here's the information that you need. You can pop it up on my app. You can send it in my email. Just make sure that I see what I need to see. Now, there could be other people who know exactly. I know that most of my friends, when I started, knew exactly what they were looking for.

0
💬 0

2372.112 - 2390.919 Sandra Matz

But some of them probably had a harder time integrating with the community and finding the friends and making these connections. So for those people, if we see that that's what's happening based on the algorithm, it's a totally different intervention. So then we're trying to see if we can get you involved in events more. Is there a way to ask other people to connect?

0
💬 0

2391.739 - 2399.341 Sandra Matz

So the moment that you understand why someone is predicted to be a dropout, you can also adjust the approaches that you use to help them.

0
💬 0

2399.942 - 2406.103 Shankar Vedantam

In other words, instead of a one size fits all approach, now you can actually say the individual person gets his or her own approach.

0
💬 0

2406.583 - 2415.466 Sandra Matz

Exactly. It's the same as targeted advertising, right? So we kind of try and figure out what each person needs at a given point in time. Same for student dropout.

0
💬 0

2421.832 - 2430.531 Shankar Vedantam

Sandra, you say that these digital tracking tools are increasingly being used not just to identify health issues, but to actually intervene. How so?

0
💬 0

2431.772 - 2452.885 Sandra Matz

Yeah, so there's really two things that the data has to offer. And I think of it as tracking and treating. So on some level, just all of the data that we generate says a lot about our physical activity, our physical health, but also about our mental health, right? Again, we talked about GPS records that say something about whether you might be suffering from depression.

0
💬 0

2453.286 - 2469.278 Sandra Matz

There's a lot that we can learn about your mental health from what you post on social media, right? So this is the tracking part. But then what I think is really interesting, and it's currently being developed, so I think we're really early stages, is more of the treatment part.

0
💬 0

2469.799 - 2486.313 Sandra Matz

So can I use your footprints to not only surface, let's say, the most relevant interventions to you, the same way that Amazon recommends products and the same way that Netflix recommends movies, can actually an algorithm who knows you based on your data recommend the best treatment for you suffering from depression?

0
💬 0

2492.267 - 2502.012 Shankar Vedantam

You tell the story of a woman named Chukora Ali who was in a car accident that left her severely injured. She spiraled into depression. Tell me her story and what happened to her.

0
💬 0

2502.892 - 2521.782 Sandra Matz

Yeah, so this is a really tragic story of a woman who got into an accident, got severely injured, lost the bakery that she was running. She was self-employed, which also meant that she couldn't afford a car anymore, couldn't really provide for her family. And you can imagine that all of this takes a pretty big toll on someone's mental health.

0
💬 0

2522.282 - 2550.104 Sandra Matz

now with no car no money there's no way that you can either find a therapist let alone drive to a therapist for like your weekly session so what she did is she started using um an app that's called wiser which is really trying to interact with you give you advice ask questions about how you're feeling um gives these little prompts and little challenges maybe you go out to nature and maybe you try and meditate for a little bit and i think the way that she tells the story

0
💬 0

2550.704 - 2564.192 Sandra Matz

is that it was very weird in the beginning talking to a bot about your mental health struggles, but at some point you adjust and you get used to it. And from using it once in a while, I think she started using it multiple times a day.

0
💬 0

2565.533 - 2568.535 Shankar Vedantam

What was the effect of using this bot on her mental health, Sandra?

0
💬 0

2569.335 - 2583.132 Sandra Matz

So in her case, I think it significantly improved her mental health. It certainly didn't fix all of the problems, right? And there's still a lot of effort that you have to put in as a human being. But it felt like there was a support system that she otherwise couldn't have afforded.

0
💬 0

2584.514 - 2599.585 Shankar Vedantam

And again, I don't think you're necessarily suggesting that, you know, a bot is necessarily an ideal replacement for a human therapist. But you're saying in a situation like this, where in fact, you know, the person cannot afford or cannot get to a human therapist, this would be a potential solution.

0
💬 0

2600.97 - 2624.931 Sandra Matz

Yeah, so I think if you have access to a human being, blood and flesh, who can be your therapist, that's probably preferable. However, there's this huge gap in terms of how many therapists there are and how many people are seeking therapy. So then there is a really huge need for people to get at least some support in cases where they can't get hold of a human being.

0
💬 0

2631.986 - 2652.662 Shankar Vedantam

Many people are worried that digital tracking has increased polarization. The moment you click on one video with a political theme, the algorithms quickly paint a picture of you as liberal or conservative and start feeding you more and more of the same content. In other words, digital tracking and psychological targeting can quickly leave you inside an echo chamber.

0
💬 0

2653.263 - 2658.407 Shankar Vedantam

You say it's at least theoretically possible to use these same tools to reduce polarization?

0
💬 0

2659.13 - 2680.632 Sandra Matz

Oh, yeah, that's it's one of my favorite applications. But the idea here is that it actually offers this what I think of as like a magical echo chamber swap machine. And because it's really difficult for me to figure out, well, what is the reality of, let's say, a 50 year old guy in the middle of Ohio? I just don't have direct access, right?

0
💬 0

2680.652 - 2698.964 Sandra Matz

It's really difficult for me to step into their shoes and see what does their day-to-day look like. Same for, let's say, a single mom in the suburbs of Chicago. But Google knows, right? Google knows exactly what those people see every day when they search for something specific. Facebook knows exactly what their newsfeed looks like every day.

0
💬 0

2699.405 - 2708.831 Sandra Matz

So instead of keeping me in my own echo chamber and just feeding more of the stuff that I already know, they could actually allow me to hop into the echo chambers of other people.

0
💬 0

2709.632 - 2722.332 Shankar Vedantam

In other words, if I know that you are basically self-selecting into one echo chamber, you're saying, what if these platforms in some ways can encourage us to basically visit other echo chambers and in some ways broaden our worldviews?

0
💬 0

2722.984 - 2742.979 Sandra Matz

Yeah, so it could be an explorer mode, right? And the explorer mode at the very basic level could be, well, just do an echo chamber swap with someone. So maybe someone is happy to let you access their Facebook feed and you give them access to yours. At a more sophisticated level, they could build an engine that allows you to specify exactly which echo chamber you want to hop into, right?

0
💬 0

2743.039 - 2763.456 Sandra Matz

I can say, here's the demographics of the person, here's the preferences, here's the age, gender, whatever you want to see, and then you can hop into the echo chamber. Now, I don't think we're going to use it all too often, right? The argument by Google is nobody would use it because it's so comfortable in our own echo chamber. And I think that is largely true.

0
💬 0

2763.616 - 2782.764 Sandra Matz

Most of the time, we probably love to not have to go to page two of Google because we find what we want to see on page one. But I at least want to have the option. See, well, what is the search result for like immigration that someone with a totally different political ideology than me and a totally different part of the country sees that I would never otherwise get to see?

0
💬 0

2783.715 - 2803.521 Shankar Vedantam

When I'm thinking about the concerns that major platforms might have in serving up this kind of information, I'm struck by the fact that in some ways I think, Sandra, what you're talking about is the difference between the information we want and the information that we need. So the information that I want might be information that basically confirms that my pre-existing views are correct.

0
💬 0

2803.561 - 2808.063 Shankar Vedantam

The information that I need might in fact tell me, hey, take a look at what's happening on the other side.

0
💬 0

2809.159 - 2830.464 Sandra Matz

I think that's absolutely true. And in all fairness, some of it is human nature. So the reason for why these algorithms work and the reason for why companies craft them in their effort to make profits is because we love to see stuff that we believe in anyway. It's very comforting. It's very reassuring to see stuff that is aligned with our worldview.

0
💬 0

2830.544 - 2844.9 Sandra Matz

So that's why I feel like this explorer mode is just one option that allows us to at least get some collective oversight. So even if we're not using it as much, it still means that we have an option to see what's happening on the other side.

0
💬 0

2850.669 - 2870.124 Shankar Vedantam

In our companion episode on Hidden Brain Plus, we look at the downsides of digital surveillance. We take a closer look at the harms of tracking technologies and why the most popular intervention to protect people, giving them control over whether they attract online and whether their children attract online, may not be the best approach.

0
💬 0

2870.865 - 2875.41 Sandra Matz

it feels much more of a burden and a responsibility that we're not really equipped to take on.

0
💬 0

2876.211 - 2901.615 Shankar Vedantam

To listen, please look for the episode titled How to Protect Yourself Online on Hidden Brain Plus. If you're not yet signed up, please visit support.hiddenbrain.org. If you're using an Apple device, please go to apple.co slash hiddenbrain. Sandra Matz is the author of Mindmasters, the data-driven science of predicting and changing human behavior.

0
💬 0

2902.396 - 2904.658 Shankar Vedantam

Sandra, thank you so much for joining me today on Hidden Brain.

0
💬 0

2905.579 - 2906.16 Sandra Matz

Thank you so much.

0
💬 0

2913.393 - 2936.325 Shankar Vedantam

Hidden Brain is produced by Hidden Brain Media. Our audio production team includes Annie Murphy-Paul, Kristen Wong, Laura Querell, Ryan Katz, Autumn Barnes, Andrew Chadwick, and Nick Woodbury. Tara Boyle is our executive producer. I'm Hidden Brain's executive editor. We end today with a story from our sister show, My Unsung Hero.

0
💬 0

2937.086 - 2951.918 Shankar Vedantam

This My Unsung Hero segment is brought to you by T-Mobile for Business. Today's story comes from Stephanie Cole. When Stephanie was a teenager, she got her very first job. It was around the winter holidays at a department store in Los Angeles.

0
💬 0

2952.639 - 2971.127 Stephanie Cole

There I was in my black skirt and my white blouse and ready to go the first day. And I had been trained very, very quickly. And as is true in a department store during Christmas, it was just bustling. You know how it is at Christmas when everybody's out shopping and everybody's in a hurry.

0
💬 0

2971.847 - 2997.505 Stephanie Cole

And all these people around, this woman comes up to me with, I think, a Christmas tree ornament she wanted to buy. And I freeze. I just freeze. All of a sudden, I can't remember anything. I can't remember how to run the cash register. I can't remember anything about the transactions. I am just absolutely frozen and probably very close to tears.

0
💬 0

2999.206 - 3026.614 Stephanie Cole

I so wanted this to go right and it was going so wrong. She looked at me and paused and with such a kind expression on her face said, It's all right. Take your time. I'm not in a hurry. And that was the release. All of a sudden, I could breathe. I could wait till somebody else could help me. It was going to be okay.

0
💬 0

3028.015 - 3057.951 Stephanie Cole

It made such an impression that all these years later, not only do I still remember it, but I I find myself, those words coming out of my mouth on numerous, many, many occasions over the years. You know, you encounter somebody who's first day on the job or they're just having a bad day and things are really, you can tell they're in a bad place. And you can say, it's okay. I'm not in a hurry.

0
💬 0

3058.011 - 3080.591 Stephanie Cole

Take your time. And it always makes the situation better. Always, always. And so this woman, I can't really remember her face. And certainly she's probably dead by now, given how old I was and how old she was. But she gave me that gift. And without knowing, she gave me that gift. And it's lasted all these years.

0
💬 0

3089.662 - 3107.542 Shankar Vedantam

Stephanie Cole is from Bainbridge Island, Washington. This segment of My Unsung Hero was brought to you by T-Mobile for Business. You can find more stories like this on the My Unsung Hero podcast or on our website, hiddenbrain.org. I'm Shankar Vedantham. See you soon.

0
💬 0
Comments

There are no comments yet.

Please log in to write the first comment.