9.11 Advanced implementation | Ethical use of recommender systems -- [ML |Andrew Ng]
 Even though recommender systems have been very profitable for some businesses, there have been some use cases that have left people and society at large worse off. However you use recommender systems, or for that matter other learning algorithms, I hope you only do things that make society at large and people better off. Let's take a look at some of the problematic use cases of recommender systems as well as ameliorations to reduce harm or to increase the amount of good that they can do. As you've seen in the last few videos, there are many ways of configuring a recommender system. When we saw binary labels, the label Y could be does the user engage or do they click or do they explicitly like an item. So when designing a recommender system, choices in setting the goal of the recommender system and a lot of choices in deciding what to recommend to users. For example, you can decide to recommend to users movies most likely to be rated 5 stars by that user. So that seems fine. This seems like a fine way to show users movies that they will like. Or maybe you can recommend to the user products that they are most likely to purchase. And that seems like a very reasonable use of a recommender system as well. Ameliorations of recommender systems can also be used to decide what ads to show to a user. And one thing you could do is to recommend or really to show to the user as the most likely to be clicked on. Actually, what many companies will do is try to show ads that are likely to click on and where the advertiser had put in a high bid because for many ad models, the revenue that the company collects depends on whether the ad was clicked on and what the advertiser had bid per click. And so while this is a profit maximizing strategy, there are also some possible negative implications of this type of advertising. I'll give a specific example on the next slide. One other thing that many companies do is try to recommend products that generate the largest profit. If you go to a website and search for a product today, there are many websites that are not showing you the most relevant product or the product that you are most likely to purchase, but is instead trying to show you the products that would generate the largest profit for the company. And so if a certain product is more profitable for them because they can buy it more cheaply and sell it at a higher price, that gets ranked higher in the recommendations. Now many companies feel a pressure to maximize profit. So this doesn't seem like an unreasonable thing to do, but on the flip side, from the user perspective, when a website recommends to you a product, sometimes it feels like it would be nice if the website was transparent with you about the criteria by which it is deciding what to show you. Is it trying to maximize their profits or trying to show you things that are most useful to you? On video websites or social media websites, a recommended system can also be modified to try to show you the content that leads to the maximum watch time. So specifically, websites that earn ad revenue tend to have an incentive to keep you on the website for a long time. And so try to maximize the time you spend on the site is one way for the site to try to get more of your time so they can show you more ads. And recommended systems today are used to try to maximize user engagements or to maximize the amount of time that someone spends on a site or a specific app. So whereas the first two of these seem quite innocuous, the third, fourth, and fifth, they may be just fine. They may not cause any harm at all, or they could also be problematic use cases for recommended systems. Let's take a deeper look at some of these potentially problematic use cases. Let me start with the advertising example. It turns out that the advertising industry can sometimes be an amplifier of some of the most harmful businesses. It can also be an amplifier of some of the best and the most fruitful businesses. Let me illustrate with a good example and a bad example. Take the travel industry. I think in the travel industry, the way to succeed is to try to give good travel experiences to users, to really try to serve users. Now it turns out that if there's a really good travel company that can sell your trip to fantastic destinations and make sure you and your friends and family have a lot of fun, then a good travel business, I think, will often end up being more profitable. And if a business is more profitable, it can then bid higher for ads. It can afford to pay more to get users. And because it can afford to bid higher for ads, an online advertising site will show its ads more often and drive more users to this good company. And this is a virtuous cycle where the more users you serve well, the more profitable the business, and the more you can bid more for ads and the more traffic you get and so on. And this virtuous circle will maybe even tend to help the good travel companies do even better. So this is a good example. Let's look at a problematic example. The payday loan industry tends to charge extremely high interest rates, often to low income individuals. And one of the ways to do well in the payday loan business is to be really efficient at squeezing customers for every single dollar you can get out of them. So if there's a payday loan company that is very good at exploiting customers, really squeezing customers for every single dollar, then that company will be more profitable. And thus, they can bid higher for ads. And because they can bid higher for ads, they will get more traffic sent to them. And this allows them to squeeze even more customers and exploit even more people for profit. And this in turn also creates a positive feedback loop. So a positive feedback loop that can cause the most exploitative, the most harmful payday loan companies to get sent more traffic. And this seems like the opposite effect than what we think would be good for society. I don't know that there's an easy solution to this. And these are very difficult problems that recommend the systems face. One amelioration might be to refuse to set ads from exploitative businesses. Of course, that's easy to say, but how do you define what is an exploitative business and what is not is a very difficult question. But as we build recommended systems for advertising or for other things, I think these are questions that each one of us working on these technologies should ask ourselves so that we can hopefully invite open discussion and debate, get multiple opinions from multiple people and try to come up with design choices that allows our systems to try to do much more good than potential harm. Let's look at some of the examples. It's been widely reported in news that maximizing user engagement, such as the amount of time that someone watches videos on a website or the amount of time someone spends on social media. This has led to large social media and video sharing sites to amplify conspiracy theories or hate and toxicity because conspiracy theories and certain types of hate toxic content is highly engaging and causes people to spend a lot of time on it. Even if the effect of amplifying conspiracy theories or amplifying hate and toxicity turns out to be harmful to individuals and to society at large. One amelioration for this, partial and imperfect, is to try to filter our problematic content, such as hate speech, fraud, scams, maybe certain types of violent content. And again, the definitions of what exactly we should filter out is surprisingly tricky to develop. And this is a set of problems that I think companies and individuals and even governments have to continue to wrestle with. Just one last example, when a user goes to many apps or websites, I think users think the Apple website are trying to recommend to the user things that they will like. And I think many users don't realize that many apps and websites are trying to maximize their profit rather than necessarily the user's enjoyment of the media items that are being recommended. I would encourage you and other companies, if at all possible, to be transparent with users about the criteria by which you are deciding what to recommend to them. I know this isn't always easy, but ultimately, I hope that being more transparent with users about what we're showing them and why will increase trust and also cause our systems to do more good for society. So recommend the systems that are very powerful technology, a very profitable, a very lucrative technology, and there are also some problematic use cases. If you are building one of these systems using recommended technology or really any other machine learning or other technology, I hope you think through not just the benefits you can create, but also the possible harm and invite diverse perspectives and discuss and debate and please only build things and do things that you really believe can leave society better off. I hope that collectively, all of us in AI can only do work that makes people better off. Thanks for listening. And we have just one more video to go in recommender systems in which we'll take a look at some practical tips for how to implement a content-based filtering algorithm in TensorFlow. So let's go on to that last video on recommender systems.
[{"start": 0.0, "end": 6.8, "text": " Even though recommender systems have been very profitable for some businesses, there"}, {"start": 6.8, "end": 13.96, "text": " have been some use cases that have left people and society at large worse off."}, {"start": 13.96, "end": 19.2, "text": " However you use recommender systems, or for that matter other learning algorithms, I hope"}, {"start": 19.2, "end": 24.44, "text": " you only do things that make society at large and people better off."}, {"start": 24.44, "end": 29.84, "text": " Let's take a look at some of the problematic use cases of recommender systems as well as"}, {"start": 29.84, "end": 35.34, "text": " ameliorations to reduce harm or to increase the amount of good that they can do."}, {"start": 35.34, "end": 40.2, "text": " As you've seen in the last few videos, there are many ways of configuring a recommender"}, {"start": 40.2, "end": 41.62, "text": " system."}, {"start": 41.62, "end": 47.28, "text": " When we saw binary labels, the label Y could be does the user engage or do they click or"}, {"start": 47.28, "end": 50.8, "text": " do they explicitly like an item."}, {"start": 50.8, "end": 57.32, "text": " So when designing a recommender system, choices in setting the goal of the recommender system"}, {"start": 57.32, "end": 62.28, "text": " and a lot of choices in deciding what to recommend to users."}, {"start": 62.28, "end": 69.24, "text": " For example, you can decide to recommend to users movies most likely to be rated 5 stars"}, {"start": 69.24, "end": 70.44, "text": " by that user."}, {"start": 70.44, "end": 71.44, "text": " So that seems fine."}, {"start": 71.44, "end": 75.84, "text": " This seems like a fine way to show users movies that they will like."}, {"start": 75.84, "end": 81.72, "text": " Or maybe you can recommend to the user products that they are most likely to purchase."}, {"start": 81.72, "end": 86.92, "text": " And that seems like a very reasonable use of a recommender system as well."}, {"start": 86.92, "end": 94.52, "text": " Ameliorations of recommender systems can also be used to decide what ads to show to a user."}, {"start": 94.52, "end": 100.44, "text": " And one thing you could do is to recommend or really to show to the user as the most"}, {"start": 100.44, "end": 102.44, "text": " likely to be clicked on."}, {"start": 102.44, "end": 108.64, "text": " Actually, what many companies will do is try to show ads that are likely to click on and"}, {"start": 108.64, "end": 117.32, "text": " where the advertiser had put in a high bid because for many ad models, the revenue that"}, {"start": 117.32, "end": 122.36, "text": " the company collects depends on whether the ad was clicked on and what the advertiser"}, {"start": 122.36, "end": 125.08, "text": " had bid per click."}, {"start": 125.08, "end": 133.16, "text": " And so while this is a profit maximizing strategy, there are also some possible negative implications"}, {"start": 133.16, "end": 134.64, "text": " of this type of advertising."}, {"start": 134.64, "end": 138.52, "text": " I'll give a specific example on the next slide."}, {"start": 138.52, "end": 144.48000000000002, "text": " One other thing that many companies do is try to recommend products that generate the"}, {"start": 144.48000000000002, "end": 146.38000000000002, "text": " largest profit."}, {"start": 146.38000000000002, "end": 152.28, "text": " If you go to a website and search for a product today, there are many websites that are not"}, {"start": 152.28, "end": 158.60000000000002, "text": " showing you the most relevant product or the product that you are most likely to purchase,"}, {"start": 158.60000000000002, "end": 163.4, "text": " but is instead trying to show you the products that would generate the largest profit for"}, {"start": 163.4, "end": 165.28, "text": " the company."}, {"start": 165.28, "end": 171.4, "text": " And so if a certain product is more profitable for them because they can buy it more cheaply"}, {"start": 171.4, "end": 176.56, "text": " and sell it at a higher price, that gets ranked higher in the recommendations."}, {"start": 176.56, "end": 180.32, "text": " Now many companies feel a pressure to maximize profit."}, {"start": 180.32, "end": 186.2, "text": " So this doesn't seem like an unreasonable thing to do, but on the flip side, from the"}, {"start": 186.2, "end": 191.32, "text": " user perspective, when a website recommends to you a product, sometimes it feels like"}, {"start": 191.32, "end": 196.28, "text": " it would be nice if the website was transparent with you about the criteria by which it is"}, {"start": 196.28, "end": 197.88, "text": " deciding what to show you."}, {"start": 197.88, "end": 203.51999999999998, "text": " Is it trying to maximize their profits or trying to show you things that are most useful"}, {"start": 203.51999999999998, "end": 205.0, "text": " to you?"}, {"start": 205.0, "end": 211.95999999999998, "text": " On video websites or social media websites, a recommended system can also be modified"}, {"start": 211.95999999999998, "end": 219.04, "text": " to try to show you the content that leads to the maximum watch time."}, {"start": 219.04, "end": 225.84, "text": " So specifically, websites that earn ad revenue tend to have an incentive to keep you on the"}, {"start": 225.84, "end": 228.0, "text": " website for a long time."}, {"start": 228.0, "end": 233.79999999999998, "text": " And so try to maximize the time you spend on the site is one way for the site to try"}, {"start": 233.79999999999998, "end": 238.07999999999998, "text": " to get more of your time so they can show you more ads."}, {"start": 238.07999999999998, "end": 244.34, "text": " And recommended systems today are used to try to maximize user engagements or to maximize"}, {"start": 244.34, "end": 248.32, "text": " the amount of time that someone spends on a site or a specific app."}, {"start": 248.32, "end": 254.23999999999998, "text": " So whereas the first two of these seem quite innocuous, the third, fourth, and fifth, they"}, {"start": 254.23999999999998, "end": 255.23999999999998, "text": " may be just fine."}, {"start": 255.23999999999998, "end": 261.64, "text": " They may not cause any harm at all, or they could also be problematic use cases for recommended"}, {"start": 261.64, "end": 263.4, "text": " systems."}, {"start": 263.4, "end": 268.88, "text": " Let's take a deeper look at some of these potentially problematic use cases."}, {"start": 268.88, "end": 272.96, "text": " Let me start with the advertising example."}, {"start": 272.96, "end": 278.76, "text": " It turns out that the advertising industry can sometimes be an amplifier of some of the"}, {"start": 278.76, "end": 281.44, "text": " most harmful businesses."}, {"start": 281.44, "end": 287.4, "text": " It can also be an amplifier of some of the best and the most fruitful businesses."}, {"start": 287.4, "end": 290.84, "text": " Let me illustrate with a good example and a bad example."}, {"start": 290.84, "end": 292.44, "text": " Take the travel industry."}, {"start": 292.44, "end": 298.0, "text": " I think in the travel industry, the way to succeed is to try to give good travel experiences"}, {"start": 298.0, "end": 301.2, "text": " to users, to really try to serve users."}, {"start": 301.2, "end": 306.56, "text": " Now it turns out that if there's a really good travel company that can sell your trip"}, {"start": 306.56, "end": 310.88, "text": " to fantastic destinations and make sure you and your friends and family have a lot of"}, {"start": 310.88, "end": 317.88, "text": " fun, then a good travel business, I think, will often end up being more profitable."}, {"start": 317.88, "end": 323.08, "text": " And if a business is more profitable, it can then bid higher for ads."}, {"start": 323.08, "end": 327.08, "text": " It can afford to pay more to get users."}, {"start": 327.08, "end": 333.47999999999996, "text": " And because it can afford to bid higher for ads, an online advertising site will show"}, {"start": 333.47999999999996, "end": 337.88, "text": " its ads more often and drive more users to this good company."}, {"start": 337.88, "end": 342.47999999999996, "text": " And this is a virtuous cycle where the more users you serve well, the more profitable"}, {"start": 342.47999999999996, "end": 346.88, "text": " the business, and the more you can bid more for ads and the more traffic you get and so"}, {"start": 346.88, "end": 347.88, "text": " on."}, {"start": 347.88, "end": 353.71999999999997, "text": " And this virtuous circle will maybe even tend to help the good travel companies do even"}, {"start": 353.71999999999997, "end": 354.71999999999997, "text": " better."}, {"start": 354.71999999999997, "end": 356.52, "text": " So this is a good example."}, {"start": 356.52, "end": 358.96, "text": " Let's look at a problematic example."}, {"start": 358.96, "end": 367.32, "text": " The payday loan industry tends to charge extremely high interest rates, often to low income individuals."}, {"start": 367.32, "end": 371.96, "text": " And one of the ways to do well in the payday loan business is to be really efficient at"}, {"start": 371.96, "end": 376.2, "text": " squeezing customers for every single dollar you can get out of them."}, {"start": 376.2, "end": 382.2, "text": " So if there's a payday loan company that is very good at exploiting customers, really"}, {"start": 382.2, "end": 388.12, "text": " squeezing customers for every single dollar, then that company will be more profitable."}, {"start": 388.12, "end": 390.88, "text": " And thus, they can bid higher for ads."}, {"start": 390.88, "end": 396.44, "text": " And because they can bid higher for ads, they will get more traffic sent to them."}, {"start": 396.44, "end": 400.84, "text": " And this allows them to squeeze even more customers and exploit even more people for"}, {"start": 400.84, "end": 402.12, "text": " profit."}, {"start": 402.12, "end": 406.2, "text": " And this in turn also creates a positive feedback loop."}, {"start": 406.2, "end": 412.24, "text": " So a positive feedback loop that can cause the most exploitative, the most harmful payday"}, {"start": 412.24, "end": 416.2, "text": " loan companies to get sent more traffic."}, {"start": 416.2, "end": 422.32, "text": " And this seems like the opposite effect than what we think would be good for society."}, {"start": 422.32, "end": 425.2, "text": " I don't know that there's an easy solution to this."}, {"start": 425.2, "end": 430.48, "text": " And these are very difficult problems that recommend the systems face."}, {"start": 430.48, "end": 436.22, "text": " One amelioration might be to refuse to set ads from exploitative businesses."}, {"start": 436.22, "end": 440.84000000000003, "text": " Of course, that's easy to say, but how do you define what is an exploitative business"}, {"start": 440.84000000000003, "end": 444.44, "text": " and what is not is a very difficult question."}, {"start": 444.44, "end": 449.96000000000004, "text": " But as we build recommended systems for advertising or for other things, I think these are questions"}, {"start": 449.96000000000004, "end": 456.86, "text": " that each one of us working on these technologies should ask ourselves so that we can hopefully"}, {"start": 456.86, "end": 462.96000000000004, "text": " invite open discussion and debate, get multiple opinions from multiple people and try to come"}, {"start": 462.96000000000004, "end": 469.92, "text": " up with design choices that allows our systems to try to do much more good than potential"}, {"start": 469.92, "end": 470.92, "text": " harm."}, {"start": 470.92, "end": 472.92, "text": " Let's look at some of the examples."}, {"start": 472.92, "end": 478.48, "text": " It's been widely reported in news that maximizing user engagement, such as the amount of time"}, {"start": 478.48, "end": 484.28000000000003, "text": " that someone watches videos on a website or the amount of time someone spends on social"}, {"start": 484.28000000000003, "end": 485.6, "text": " media."}, {"start": 485.6, "end": 491.06, "text": " This has led to large social media and video sharing sites to amplify conspiracy theories"}, {"start": 491.06, "end": 498.48, "text": " or hate and toxicity because conspiracy theories and certain types of hate toxic content is"}, {"start": 498.48, "end": 502.78000000000003, "text": " highly engaging and causes people to spend a lot of time on it."}, {"start": 502.78000000000003, "end": 509.12, "text": " Even if the effect of amplifying conspiracy theories or amplifying hate and toxicity turns"}, {"start": 509.12, "end": 513.64, "text": " out to be harmful to individuals and to society at large."}, {"start": 513.64, "end": 519.4399999999999, "text": " One amelioration for this, partial and imperfect, is to try to filter our problematic content,"}, {"start": 519.4399999999999, "end": 524.08, "text": " such as hate speech, fraud, scams, maybe certain types of violent content."}, {"start": 524.08, "end": 530.68, "text": " And again, the definitions of what exactly we should filter out is surprisingly tricky"}, {"start": 530.68, "end": 532.22, "text": " to develop."}, {"start": 532.22, "end": 537.74, "text": " And this is a set of problems that I think companies and individuals and even governments"}, {"start": 537.74, "end": 540.22, "text": " have to continue to wrestle with."}, {"start": 540.22, "end": 547.32, "text": " Just one last example, when a user goes to many apps or websites, I think users think"}, {"start": 547.32, "end": 552.5400000000001, "text": " the Apple website are trying to recommend to the user things that they will like."}, {"start": 552.5400000000001, "end": 557.48, "text": " And I think many users don't realize that many apps and websites are trying to maximize"}, {"start": 557.48, "end": 564.4, "text": " their profit rather than necessarily the user's enjoyment of the media items that are being"}, {"start": 564.4, "end": 565.4, "text": " recommended."}, {"start": 565.4, "end": 570.3199999999999, "text": " I would encourage you and other companies, if at all possible, to be transparent with"}, {"start": 570.3199999999999, "end": 574.92, "text": " users about the criteria by which you are deciding what to recommend to them."}, {"start": 574.92, "end": 582.0799999999999, "text": " I know this isn't always easy, but ultimately, I hope that being more transparent with users"}, {"start": 582.0799999999999, "end": 587.92, "text": " about what we're showing them and why will increase trust and also cause our systems"}, {"start": 587.92, "end": 590.12, "text": " to do more good for society."}, {"start": 590.12, "end": 595.1999999999999, "text": " So recommend the systems that are very powerful technology, a very profitable, a very lucrative"}, {"start": 595.2, "end": 599.7800000000001, "text": " technology, and there are also some problematic use cases."}, {"start": 599.7800000000001, "end": 604.5600000000001, "text": " If you are building one of these systems using recommended technology or really any other"}, {"start": 604.5600000000001, "end": 609.94, "text": " machine learning or other technology, I hope you think through not just the benefits you"}, {"start": 609.94, "end": 615.6, "text": " can create, but also the possible harm and invite diverse perspectives and discuss and"}, {"start": 615.6, "end": 622.24, "text": " debate and please only build things and do things that you really believe can leave society"}, {"start": 622.24, "end": 624.46, "text": " better off."}, {"start": 624.46, "end": 629.88, "text": " I hope that collectively, all of us in AI can only do work that makes people better"}, {"start": 629.88, "end": 630.88, "text": " off."}, {"start": 630.88, "end": 633.48, "text": " Thanks for listening."}, {"start": 633.48, "end": 638.76, "text": " And we have just one more video to go in recommender systems in which we'll take a look at some"}, {"start": 638.76, "end": 644.9200000000001, "text": " practical tips for how to implement a content-based filtering algorithm in TensorFlow."}, {"start": 644.92, "end": 655.36, "text": " So let's go on to that last video on recommender systems."}]