Topics
Artificial Intelligence and Business Strategy
In collaboration with
BCGJoAnn Stonier can’t deny that her role as chief data officer at Mastercard isn’t easy. Advising the company on the mitigation of current and future risk while guiding her team to think critically about the problems they’re using AI to solve is challenging — but, she says, it’s also fun.
In Season 2, Episode 4, of the Me, Myself, and AI podcast, JoAnn talks with Sam Ransbotham and Shervin Khodabandeh about the elements of her job that are both demanding and rewarding. She also touches on the skill sets she finds most valuable in her colleagues and shares how her work in interior design helps her reframe technology challenges at work.
Read the article “Strategy For and With AI”.
Read more about our show and follow along with the series at https://dev03.mitsmr.io/aipodcast.
Subscribe to Me, Myself, and AI on Apple Podcasts, Spotify, or Google Podcasts.
Transcript
Sam Ransbotham: We hear a lot about the bias AI can exacerbate, but AI can help organizations reduce bias, too. Find out how when we talk with JoAnn Stonier, chief data officer at Mastercard.
Welcome to Me, Myself, and AI, a podcast on artificial intelligence in business. Each episode, we introduce you to someone innovating with AI. I’m Sam Ransbotham, professor of information systems at Boston College. I’m also the guest editor for the AI and Business Strategy Big Ideas program at MIT Sloan Management Review.
Shervin Khodabandeh: And I’m Shervin Khodabandeh, senior partner with BCG, and I colead BCG’s AI practice in North America. Together, MIT SMR and BCG have been researching AI for five years, interviewing hundreds of practitioners and surveying thousands of companies on what it takes to build and to deploy and scale AI capabilities and really transform the way organizations operate.
Sam Ransbotham: Today we’re talking with JoAnn Stonier. JoAnn is the chief data officer at Mastercard. JoAnn, thanks for taking the time to talk with us today. Welcome.
JoAnn Stonier: Thank you. Happy to be here.
Sam Ransbotham: JoAnn, let’s start with your current role at Mastercard. Can you give us a quick overview of what you do?
JoAnn Stonier: Sure. I’m currently, as you said, the chief data officer for the firm, and me and my team are responsible for ensuring that Mastercard’s information assets are available for information while navigating current and future data risk. So my team has a very broad mandate. We work on helping the firm develop our data strategy and then work on all the different aspects of data management, including data governance, data quality, as well as enabling things like artificial intelligence [and] machine learning. And then we also help design and operate some of our enterprise data platforms. It’s a very broad-based role. We also work on data compliance, and how you embed compliance and responsible data practices right into product design. We start at the very beginning of data sourcing all the way through to product creation and enablement. It’s a lot of fun.
Sam Ransbotham: Because our show is about artificial intelligence, let me pick up on that aspect.
JoAnn Stonier: Sure.
Sam Ransbotham: Can you give us examples of something you’re excited about that Mastercard is doing with artificial intelligence?
JoAnn Stonier: Oh my gosh. I’ve had so many conversations just this week about artificial intelligence, most of them centered on minimization of bias, as well as how do we build an inclusive future. The conversations that really excite me [are] how the whole firm is really getting behind this idea and notion. I’ve had conversations with our product development team [about] how we develop a broad-based playbook so that everybody in the organization really understands. How do you begin to really think about design at its very inception so that you are really thinking about inclusive concepts?
We’ve had conversations with our People and Capability team — or what’s more commonly known as human resources — talking about the skill sets of the future. How are we going to not only have a more inclusive workforce at Mastercard, and what do we need to do to provide education opportunities both inside the firm but also outside the firm so that we can create the right kind of profile of individuals so that they have the skill sets that we need? But also how do we upskill? How do we really begin to create the opportunities to have the right kinds of conversations?
We’re also working on our ethical AI process. There are so many different aspects of what we’re doing around artificial intelligence — not just in our products and solutions in fraud and cyber, [but also in] in general analytics and in biometric solutions around digital identity — that it’s really an interesting time to do this work and to really do it in a way that I think needs to last for the generations ahead.
Shervin Khodabandeh: JoAnn, that’s really interesting. I’m particularly excited that one of the things you’ve talked about is [the] use of AI to prevent bias. I mean, there’s been a lot of conversations around the unintended bias of AI and how to manage it, but I heard you also refer to it as a tool that can actually help uncover biases. Can you comment more about that?
JoAnn Stonier: Yeah, but it’s hard, right? This is a lot of hard work. I [have] a lot of conversations, both with academic institutions [and] other civil society organizations. We’re [in the] early days of AI and machine learning. I think we’re probably at Generation, maybe, 1.5, heading into Generation 2. But I think the events of this past year have taught us that we really need to pay attention to how we are designing products and solutions for society and that our data sets are really important in what are we feeding into the machines, and how do we design our algorithmic processes that we also are feeding into the intelligence, and what is it going to learn from us? And so I try to explain to people that [in] our first generation of data analytics, we were creating algorithms or analytic questions that really ask the question of, “This is the question. If this condition exists in the data set, then do something.” So we were looking for the condition to exist in the data set, and then we were acting.
Shervin Khodabandeh: Rules based.
JoAnn Stonier: Right. Rules based, exactly. Artificial intelligence and machine learning actually flips that a little bit on the head. Instead, we take the data set and say, “What does the data tell us? What does the data tell us, and what does the machine then learn from that?” Well, the challenge of that, though, is if you don’t understand what’s in the data and the condition of that data as you bring it into the inquiry, and you don’t understand how those two things fit, then you wind up with a biased perspective. Now, it’s unintended, it’s inherent, to your point, but nevertheless, it’s something that we have to back up and readjust our lenses as we begin to look at our processes around artificial intelligence. So we start with the data sets, and we understand that data sets are going to have all sorts of bias in them. And that’s OK. First of all, bias always gets a very gripping reaction, right? I use the example all the time: If you go back to the 1910 voter rolls in the United States, that’s a valid data set. You may use that for whatever purpose you may have for evaluating something that happened in 1910 or 1911. But you need to know that inherently, that data set is going to miss women, it’s going to be missing people of color, it’s going to be missing parts of society. As long as you know that, then you can design an inquiry that is fit for purpose.
The problem is, if you don’t remember that, or you’re not mindful of that, then you have an inquiry that’s going to learn off of a data set that is missing characteristics that [are] going to be important to whatever that other inquiry is. Those are some of the ways that I think we can actually begin to design a better future, but it means really being very mindful of what’s inherent in the data set, what’s there, what’s missing but also can be imputed. We can talk about that — what kind of variables can be created by the machine, what can be imputed, as well. And so all of those things are things that we’re looking at, at Mastercard. So we have a very specific framework that we’re using around ethical AI. But then we’re really getting into the nitty-gritty around different kinds of context.
Shervin Khodabandeh: I want to build on that, because I think it’s a very critical topic to so many of our listeners. You talked about, as long as you know, you could look for it. But then the things you don’t know and then you find out in hindsight — how do you prepare for those?
JoAnn Stonier: Well, I think you have to be aware, again, for what purpose? To what end? And now let’s go look at the data sets. And this is where you’ve got to [go] back up the data food chain to understand your data lineage, understand the quality, the consistency of the data sets that are going into the analysis. And this is not easy. So nothing I’m saying — I want everybody to hear me clearly — nothing I’m saying is easy. Everything requires a lot of scrutiny and time. That’s easiest if you’re doing it yourself. But if a vendor’s doing this and is presenting this to you as a combined solution, you need to be even more curious about what is going into this recipe.
Every one of these elements becomes super important. Why? Because if we do it when we’re building it — those of us who are the data scientists and the data experts, the data designers — we understand it because when we’re going to be looking at the information models and the outputs as they come out in the first generations, we’re going to be looking for the model drift, we’re going to be looking to see: Is this an accurate output? Is this truly the result? Or is it because of some inequity in the input? Which is OK; if it’s accurate, that’s OK. Because the machines are going to then start learning, and we’re going to put [in] more data and more information. But if it’s incorrect and we haven’t caught it, it could get amplified to the incorrect result, and it could have — and this is what we also really care about; that’s when we get to the output analysis — it could amplify really bad outcomes. And the outcomes can be significant or insignificant depending upon if it’s being designed for an individual or if it’s being designed for groups or if it’s just being something. … I talk about how I suspect that when the airlines were first modeling the size of the overhead bins, it was on very average heights. But the average height did not include enough women. How many ladies climb on seats to get their luggage at the very back of the bin or need to rely on one of you nice gentlemen to grab our overhead suitcases down to assist us, right? Averages sometimes are the worst result because they’re not fit for purpose.
Shervin Khodabandeh: I think if you’re talking about injecting an entire new layer in the data analysis or data usage process —
JoAnn Stonier: Maybe.
Shervin Khodabandeh: Right? Because was it not the case, Sam, that 20 years ago, people thought of data as neutral? Like, “Data is neutral; you use what you want.” But data could be potentially harmful, and I think what you’re talking about is, you’re trying to create a mindset shift that says it’s not just “data comes in, answers go out,” but you have to be mindful of why you’re using it, how you’re using it. And this mindset shift permeates not just the organization but also, you were saying, your vendors and other parts of the ecosystem; you say it’s a huge undertaking.
JoAnn Stonier: It is a huge undertaking.
Sam Ransbotham: So those are some challenging aspects. What’s rewarding? What kind of exciting things happen? These seem a little bit sort of like, “Oh, gosh, we have to worry about this; I have to worry about that.” … Get us excited about the fun part.
JoAnn Stonier: It think all of this is fun; I do. But I’m a data geek, right? What’s fun is actually seeing my firm come to life around this. These are actually very exciting conversations inside of the firm. I don’t mean to make them sound like just risk conversations at all. It’s intellectually challenging work, but we all agree that we think it’s going to bring us to better places and already is bringing us to better places in product design.
Shervin Khodabandeh: You talked about the workforce aspect of it and that technology is necessary, but it’s far from sufficient. We heard from one of our other speakers, the president of 1-800-Flowers, about learning quotient — the desire to want to learn. How do you bring all of that together in terms of the future of the workforce that you guys are looking at and the kind of talent and skill set and attributes that are going to be successful in different roles? Are you taking actions in that direction?
JoAnn Stonier: We really look for people who also can design controls and processes and make sure that we can navigate those. We live in a world of connected ecosystems, and so we’re only as good as our partners, but it means those handshakes, right? Those connections are super important to understand. And so how do you make those inquiries of other organizations so that you can create those connected ecosystems that are only going to grow in size and scale for the future, and how do we help design those? “How do we be the leaders in designing some of those?” is really important for us. So it really is this meshing. I talk about it being a three-sided triangle of data skills —
Shervin Khodabandeh: Is there a different kind?
Sam Ransbotham: [Laughs.]
JoAnn Stonier: [Laughs.] But we sit in the middle, right? We sit in the middle of the business, we sit with technology skills, right? As well as there’s an awful lot of policy that we need to understand, often. It’s the other design constraint of, where are laws evolving? Where [are] the restrictions, the other type of restrictions, that we need to know? Is it going to be on soil? Can we not use the data because it’s contractually restricted, or it’s restricted because it’s a certain type of data — it’s financial data? It only can be used for one specific type of purpose. Or it can only be used at an aggregated level — for example, it can be used at a segment level. Those types of restrictions as well at that compliance level also need to be understood. So sitting in the middle of the middle is sometimes really hard, so that’s why you have to be able to admit you don’t know one aspect of that triangle.
Sam Ransbotham: You mentioned the word design a couple of times, at least. Can you tell us a little a bit about —
JoAnn Stonier: [Laughs.] Here it comes.
Sam Ransbotham: Can you tell us a little bit about how you got to your role? Because I think that design thinking is coming from your background. Can you share with us how you got to where you are?
JoAnn Stonier: I think it’s probably easier if I just go quickly backwards. So, prior to being the chief data officer, I was the chief privacy officer for the firm, which was a lot of fun. I enjoyed that role immensely. I helped the company become GDPR compliant, which really was, I think, the moment in time when many, many companies were coming to the place where they needed to operationalize a lot of data risk. And we had been on that journey; we had a whole process called Privacy by Design. We still use that process. Lots of companies use that phrase because it’s a regulatory phrase, but we had already been looking at our products and solutions to try to understand how we could embed privacy and security into their very design and into their fabric, and we still do that to this day.
But as we were doing the compliance work and planning it out for the GDPR, the European privacy law, we were realizing we were going to need additional platforms and systems to be built. And as I was doing that, I kept saying to anyone who would listen, “Who’s going to own all the data? Because I really need somebody to speak with.” And they just kept patting me on the head saying, “You just keep designing everything, and it’ll be fine.” Well, OK. So here we are that I’m the first chief data officer, but it was kind of an expansion, and then a severing of a lot of the work that I had been doing. But I came to be the chief privacy officer. I was previously the chief privacy officer for American Express. I came to that role after a pretty good-sized career at American Express as well, working in a variety of roles. I understood how that firm works. So financial services is something I’ve been doing for a while. But the design piece comes in because of 9/11. I had the misfortune of being downtown that day, and the American Express building is right across the street from what was the World Trade Center. And so [I] saw a lot and lost colleagues that day. And we were all relocated for several months while the building was repaired.
And so on New Year’s of the next — I don’t know, it was probably like Jan. 4, actually, of 2002 — I was thinking there’s a lot of people who were not alive that New Year’s. And I thought, “Well, what can I do? What haven’t I done in my life that I really want to accomplish?” And so I decided to go back to design school. This is after law school, so I got my law transcripts [as] part of the process, which was fun — getting them to send my transcripts to a design school. But I got a design degree, and I’m really glad I did, because it’s made me a better businessperson, and it’s given me a whole different way of thinking about problem-solving. And then I’ve had the good fortune — so, yes, I do interior design work, and yes, I can help you with your kitchen and your bathroom and all the other things you want to do during COVID. I’ve helped several colleagues pick out tile and other things.
Sam Ransbotham: All right. We’ll talk after the podcast about that.
JoAnn Stonier: We can talk after the podcast about that. But I also then had the good fortune to meet the dean at Pratt Institute — and I teach in their design management master’s program, and I teach business strategy, and I’ve taught other courses in that program — and that’s also helped me really evolve my design thinking as well. And so all of these things. … Yes, I have a law degree, yes, I’m a data person, but having the design thinking as well really makes you not think of things as problems but just constraints around which you have to design things, and they will shift over time. So it’s no different than, well, the electric is over here and the plumbing is over there, and you only have so much space. So how can you utilize this, right? It’s the same thing for, well, I can only use the data in this way when I want to achieve an outcome; how do I do that?
And so it is the same kind of strategic toolkit. You just flip it for, “OK, well, the powder room has to be only this big, so that’s one challenge,” or the outcome is to design a look-alike model for fraud that only utilizes synthetic data, right? Or something along those lines. But it does give you a little bit of a can-do spirit, because you figure something has to be possible because there’s raw material in the world. So that’s kind of how I approach things.
Shervin Khodabandeh: Very well said.
Sam Ransbotham: That’s a very weird triangle. It’s a triangle with some very weird —
JoAnn Stonier: Yeah. My triangle is probably very weird. I get that a lot.
Sam Ransbotham: Well, it’s a bit of a theme though. … The other people we’ve talked to [say] that they’re bringing in these experiences from other places, and very often they’re not super technical things. We’re talking about artificial intelligence, and you might think that it would quickly go down a path of extreme technical, but I think it’s just as likely to go down a path of design.
JoAnn Stonier: Yeah, what we find on my team, and generally, is that if you find people that have that combination of right brain, left brain. … So I have lawyers and engineers on my team, right? They have both degrees. It’s a really interesting match of being able to translate the business to the technical, the technical to the business — translating the regulatory to the business or the regulatory to the legal. It kind of works as a giant translator role, and if you think about it, that’s kind of the moment that we’re in right now — the ability to be fluid in translating concepts from one domain into another. And I think it works. But I do think that some of those competencies are going to be equally important or more important as we continue to evolve as we begin to develop. There’ll be the core skill sets that we’ve always had as leadership skills and problem-solving skills and analytics skills. But I do think that the ability to translate that and then also be able to derive from the output — whether it’s from a dashboard or reports or whatever — I think [those are] also going to be really important business skills for any businessman or woman.
Sam Ransbotham: You said … “That’s the place we are right now.” What do you think has caused that? What’s making that so important right now?
JoAnn Stonier: I mean, I don’t know that I was emphasizing that, but I think when I look over the past year, and I think about [how] we’re just on the year mark of COVID for us, I can remember when we went virtual. I remember so many of the customer and client calls that I was helping to field at the time. Companies were in a moment, right? So many merchants were going online; if they didn’t have a huge presence, they needed to create one. Business models were really shaken, but everybody was looking for data to try to help make some decisions, and they needed guidance. If they didn’t have the data, they were looking for data. If they had the data, they were looking for guidance on how to interpret it. If they knew how to interpret it, they were looking for look-alike information to make sure they were making the right decisions.
So if you just look at that maturity curve, we have been thrust forward in time. So I think it would have been happening in a less compressed way. I think we’ve been in a time compression where data and digital have mattered, and so we can’t undo that. And so I think these skill sets matter more and more just because of the compression we’ve been under as a society. And so we’re going to see that be part of what this next normal or next generation — because I don’t really like the word normal — next generation [is]; this is now part and parcel of how we interact with each other. We will never go back to just being in person. This kind of … connecting digitally will always now be part of our mandate and part of the toolbox. So I just think that there will be more of a need to be able to interpret and to utilize than we had a year ago.
Sam Ransbotham: It seems like your superpower is taking some situation — whether it’s 9/11 and turning it into design school, or taking a pandemic and turning it into a more fluid approach to things — it sounds like your superpower in many cases.
JoAnn Stonier: Thank you. I’ll take that one.
Sam Ransbotham: JoAnn, thank you so much for talking to us. You’ve really picked up on a lot of points. We’ve covered a lot of ground. Thanks for taking the time to talk with us.
Shervin Khodabandeh: Thank you so much.
JoAnn Stonier: You’re welcome. Thanks for having me.
Sam Ransbotham: Shervin, that was great. JoAnn covered a lot today. What struck you as particularly interesting?
Shervin Khodabandeh: I mean, a lot of things struck me in a positive way. I liked how she talked about design thinking, she talked about emotional quotient, and I actually think that that’s been part of her secret sauce and part of Mastercard’s success with these kinds of initiatives. Because if you look in the industry, the CDO role is actually a somewhat precarious role, because there [are] very successful CDOs and there [are] many CDOs that just don’t have that vision or that ability or that autonomy, or sort of that multisided triangle as she talked about. And so they don’t succeed, and they last for a couple of years. And so I think there’s something to be said for that. What did you think about, Sam, her comments about implementation, the challenges?
Sam Ransbotham: Yeah, exactly. I thought it was interesting that they have not changed what they’re doing in terms of AI projects because of … the fact that it’s hard. I think they recognize —
Shervin Khodabandeh: They’ve doubled down on it.
Sam Ransbotham: — that it’s hard, and they’ve doubled down on it. And I think that, in and of itself, is a little bit of a validation that what they’re doing they believe in. That even though it’s hard, they’re still continuing. And I think they are picking projects based on their strategic focus rather than picking a project to do AI. And that’s something that just keeps coming up. No one’s out here saying, “Hey, let’s do some AI today. It’s Monday morning; let’s do some AI.”
Shervin Khodabandeh: Exactly.
Sam Ransbotham: These people are trying to deliver on things that are in their organization’s strategy, and it turns out that in many cases, AI is the tool. But if it’s not, that’s OK too, but it often is.
Shervin Khodabandeh: Strategy with AI, not strategy for AI.
Sam Ransbotham: Where did I read that?
Shervin Khodabandeh: I know, right. Didn’t you write it?
Sam Ransbotham: That was all David [Kiron and Michael Schrage].
Shervin Khodabandeh: The other thing I thought was quite insightful, and she went there very early on, is about trust and [the] ethical use of AI and sort of reining in the AI solution to make sure it’s ethical, but also using it to uncover hidden bias so that you could be more inclusive, you could be more aware of the workforce, of your customers, of the ecosystem. What I liked, [what] was particularly insightful there, was the need not to view all data as equally neutral and that, depending on where the data goes to, very harmful things can come out of it, which necessitates another layer. I mean, she hinted [at] it. There’s a layer of awareness and governance and a mix of tech artifacts as well as process protocols to make sure that the outputs are ethical and unbiased. And she talked a lot about the need for mindset change for that to work, that people have to ask, “What am I using it for? What is it going to do? What could go wrong?” And constantly probing for things that can go wrong so that you could preempt it.
Sam Ransbotham: But also, she saw it as a tool to prevent bias. I mean, we’ve seen so many stories out there about, “Oh, this AI system’s biased; that AI system has caused bias” — and I’m not denying those are true; I’m not a bias denier. It’s just [that] there’s an opportunity that she saw in that data to rectify that [bias is] a fact and … no amount of retrofitting is going to take that away. But she also said, “We don’t ignore the data, either. We just have to know what that provenance is.”
Shervin Khodabandeh: I think that’s a great point, Sam.
Sam Ransbotham: Thanks for joining us today. Next time, Shervin and I will talk with Chris Couch. Chris is the senior vice president and chief technology officer at Cooper Standard. Please join us.
Allison Ryder: Thanks for listening to Me, Myself, and AI. If you’re enjoying the show, take a minute to write us a review. If you send us a screenshot, we’ll send you a collection of MIT SMR’s best articles on artificial intelligence, free for a limited time. Send your review screenshot to smrfeedback@mit.edu.