6.12 Machine Learning development process | Adding data  --[ML | Andrew Ng]
 In this video, I'd like to share with you some tips for adding data or collecting more data or sometimes even creating more data for your machine learning application. Just a heads up that this and the next few videos will seem a little bit like a grab bag of different techniques and I apologize if it seems a little bit grab baggy. And that's because machine learning applications are different. Machine learning is applied to so many different problems and for some humans are great at creating labels and for some you can't get more data and for some you can't. And that's why different applications actually sometimes call for slightly different techniques. But I hope in this and the next few videos to share with you some of the techniques that I've found to be most useful for different applications. Although not every one of them will apply for every single application, but I hope many of them will be useful for many of the applications that you'll be working on as well. But let's take a look at some tips for how to add data for your application. When training machine learning algorithms, it feels like always we wish we had even more data almost all the time. And so sometimes it's tempting to let's just get more data of everything. But trying to get more data of all types can be slow and expensive. Instead an alternative way of adding data might be to focus on adding more data of the types where error analysis is indicated in my help. In the previous slide, we saw if error analysis review that pharma spam was a large problem, then you may decide to have a more targeted effort not to get more data of everything under the sun, but to instead focus on getting more examples of pharma spam. With a more modest cost, this could let you add just the emails you need to help your learning algorithm get smarter on recognizing pharma spam. And so one example of how you might do this is if you have a lot of unlabeled email data, say email sitting around and no one has bothered to label yet as spam or non spam, you might be able to go to the unlabeled data. You may be able to ask your labelers to quickly skim through the unlabeled data and find more examples specifically of pharma related spam. And this could boost your learning algorithm's performance much more than just trying to add more data of all sorts of emails. But the more general pattern I hope you take away from this is if you have some ways to add more data of everything, that's okay, nothing wrong with that. But if error analysis has indicated that there's certain subsets of the data that the algorithm is doing particularly poorly on and that you want to improve performance on, then getting more data of just the types where you want it to do better, be it more examples of pharmaceutical spam or more examples of phishing spam or something else, that could be a more efficient way to add just a little bit of data, but boost your algorithm's performance by quite a lot. Beyond getting your hands on brand new training examples x y, there's another technique that's widely used, especially for images and audio data that can increase your training set size significantly. This technique is called data augmentation, and what we're going to do is take an existing training example to create a new training example. For example, if you're trying to recognize the letters from A to Z for an OCR optical character recognition problem, so not just a digit 0 to 9, but also the letters from A to Z. Given an image like this, you might decide to create a new training example by rotating the image a bit or by enlarging the image a bit or by shrinking a little bit or by changing the contrast of the image. And these are examples of distortions to the image that don't change the fact that this is still the alphabet, that this is still the letter A. And for some letters, but not others, you can also take the mirror image of the letter and it still looks like the letter A, but this only applies to some letters. But these would be ways of taking a training example x y and applying a distortion or transformation to the input x in order to come up with another example that has the same label. And by doing this, you're telling the algorithm that the letter A rotated a bit or enlarged a bit or shrunk a little bit. It is still the letter A. And creating additional examples like this helps the learning algorithm do a better job learning how to recognize the letter A. For a more advanced example of data augmentation, you can also take the letter A and place a grid on top of it. And by introducing random warping of this grid, you can take the letter A and introduce warping of the letter A to create a much richer library of examples of the letter A. And this process of distorting these examples then has turned one image or one example into here, training examples that you can feed to the learning algorithm to help it learn more robustly. What is the letter A? This idea of data augmentation also works for speech recognition. Let's say for a voice search application, you have an original audio clip that sounds like this. What is today's weather? One way you can apply data augmentation to speech data would be to take noisy background audio like this. For example, this is what the sound of a crowd sounds like. And it turns out that if you take these two audio clips, the first one and the crowd noise and you add them together, then you end up with an audio clip that sounds like this. What is today's weather? And you just created an audio clip that sounds like someone saying, what's the weather today? But they're saying it around a noisy crowd in the background. Or in fact, if you were to take a different background noise, say someone in a car, this is what background noise of a car sounds like. And you were to add the original audio clip to the car noise, then you get this. What is today's weather? And it sounds like the original audio clip, but as if the speaker was saying it from a car. And the more advanced data augmentation step would be if you make the original audio sound like you're recording on a bad cell phone connection like this. What is today's weather? And so we've seen how you can take one audio clip and turn it into three training examples here. One with crowd background noise, one with car background noise, and one as if it was recorded on a bad cell phone connection. And the times I've worked on speech recognition systems, this was actually a really critical technique for increasing artificially the size of the training data I had to build a more accurate speech recognizer. One tip for data augmentation is that the changes or the distortions you make to the data should be representative of the types of noise or distortions in the test set. So for example, if you take the letter A and warp it like this, this still looks like examples of letters you might see out there that you would like to recognize. Or for audio, adding background noise or bad cell phone connection, if that's representative of what you expect to hear in the test set, then these would be helpful ways to carry out data augmentation on your audio data. In contrast, it's usually not that helpful to add purely random meaningless noise to audio data. For example, here I've taken the letter A and I've added per pixel noise, where if XI is the intensity or the brightness of pixel I, if I were to just add noise to each pixel, they end up with images that look like this. But if to the extent that this isn't that representative of what you see in the test set, because you don't often get images like this in the test set, this is actually going to be less helpful. So one way to think about data augmentation is how can you modify or warp or distort or make more noise in your data, but in a way so that what you get is still quite similar to what you have in your test set, because that's what the learning algorithm will ultimately end up doing well on. Now whereas data augmentation takes an existing training example and modifies it to create another training example, there's one other technique which is data synthesis, in which you make up brand new examples from scratch, not by modifying an existing example, but by creating brand new examples. So take the example of photo OCR. Photo OCR or photo optical character recognition refers to the problem of looking at an image like this and automatically having a computer read the text that appears in this image. So there's a lot of text in this image. How can you train an OCR algorithm to read text from an image like this? Well, when you look closely at what the letters in this image looks like, they actually look like this. So this is real data from a photo OCR task. And one key step of the photo OCR task is to be able to look at the little image like this and recognize the letter at the middle. So this has T in the middle, this has the letter L in the middle, this has the letter C in the middle, and so on. So one way to create artificial data for this task is if you go to your computer's text editor, you find that it has a lot of different fonts. And what you can do is take these fonts and basically type out random text in your text editor and screenshot it using different colors and different contrasts and very different fonts. And you get synthetic data like that on the right. The images on the left were real data from real pictures taken out in the world. The images on the right are synthetically generated using fonts on the computer. And it actually looks pretty realistic. So with synthetic data generation like this, you can generate a very large number of images or examples for your photo OCR task. It can be a lot of work to write the code to generate realistic looking synthetic data for a given application. But when you spend time to do so, it can sometimes help you generate a very large amount of data for your application and give you a huge boost to your average performance. Synthetic data generation has been used most probably for computer vision tasks and less for other applications, not that much for audio tasks as well. All the techniques you've seen in this video relate to finding ways to engineer the data used by your system. In the way that machine learning has developed over the last several decades, many decades, most machine learning researchers attention was on the conventional model centric approach. And here's what I mean. A machine learning system on AI system includes both code to implement your algorithm or your model as well as the data that you train the algorithm on. And over the last few decades, most researchers doing machine learning research with download the data set and hold the data fix while they focus on improving the code or the algorithm or the model. Thanks to that paradigm of machine learning research, I find that today the algorithms we have access to, such as linear regression, logistic regression, neural networks, also decision trees, which you see next week, there are algorithms that are already very good and will work well for many applications. And so sometimes it can be more fruitful to spend more of your time taking a data centric approach in which you focus on engineering the data used by your algorithm. And this can be anything from collecting more data to collecting more data just on pharmaceutical spam, if that's what error analysis told you to do, to using data augmentation to generate more images or more audio or using data synthesis to just create more training examples. And sometimes that focus on the data can be an efficient way to help your learning algorithm improve its performance. So I hope that this video gives you a set of tools to be efficient and effective in how you add more data to get your learning algorithm to work better. Now, there are also some applications where you just don't have that much data and it's really hard to get more data. It turns out that there's a technique called transfer learning, which could apply in that setting to give your learning algorithm's performance a huge boost. And the key idea is to take data from a totally different, fairly related task. But using a neural network, there's sometimes ways to use that data from a very different task to get your algorithm to do better on your application. Doesn't apply to everything, but when it does, it can be very powerful. Let's take a look in the next video at how transfer learning works.
[{"start": 0.0, "end": 7.96, "text": " In this video, I'd like to share with you some tips for adding data or collecting more"}, {"start": 7.96, "end": 13.24, "text": " data or sometimes even creating more data for your machine learning application."}, {"start": 13.24, "end": 17.56, "text": " Just a heads up that this and the next few videos will seem a little bit like a grab"}, {"start": 17.56, "end": 22.76, "text": " bag of different techniques and I apologize if it seems a little bit grab baggy."}, {"start": 22.76, "end": 25.6, "text": " And that's because machine learning applications are different."}, {"start": 25.6, "end": 30.080000000000002, "text": " Machine learning is applied to so many different problems and for some humans are great at"}, {"start": 30.080000000000002, "end": 35.160000000000004, "text": " creating labels and for some you can't get more data and for some you can't."}, {"start": 35.160000000000004, "end": 40.24, "text": " And that's why different applications actually sometimes call for slightly different techniques."}, {"start": 40.24, "end": 44.36, "text": " But I hope in this and the next few videos to share with you some of the techniques that"}, {"start": 44.36, "end": 47.2, "text": " I've found to be most useful for different applications."}, {"start": 47.2, "end": 51.68000000000001, "text": " Although not every one of them will apply for every single application, but I hope many"}, {"start": 51.68, "end": 56.84, "text": " of them will be useful for many of the applications that you'll be working on as well."}, {"start": 56.84, "end": 61.92, "text": " But let's take a look at some tips for how to add data for your application."}, {"start": 61.92, "end": 66.28, "text": " When training machine learning algorithms, it feels like always we wish we had even more"}, {"start": 66.28, "end": 68.8, "text": " data almost all the time."}, {"start": 68.8, "end": 74.76, "text": " And so sometimes it's tempting to let's just get more data of everything."}, {"start": 74.76, "end": 81.03999999999999, "text": " But trying to get more data of all types can be slow and expensive."}, {"start": 81.04, "end": 87.36000000000001, "text": " Instead an alternative way of adding data might be to focus on adding more data of the"}, {"start": 87.36000000000001, "end": 91.72, "text": " types where error analysis is indicated in my help."}, {"start": 91.72, "end": 99.80000000000001, "text": " In the previous slide, we saw if error analysis review that pharma spam was a large problem,"}, {"start": 99.80000000000001, "end": 104.84, "text": " then you may decide to have a more targeted effort not to get more data of everything"}, {"start": 104.84, "end": 111.24000000000001, "text": " under the sun, but to instead focus on getting more examples of pharma spam."}, {"start": 111.24000000000001, "end": 117.68, "text": " With a more modest cost, this could let you add just the emails you need to help your"}, {"start": 117.68, "end": 122.2, "text": " learning algorithm get smarter on recognizing pharma spam."}, {"start": 122.2, "end": 128.56, "text": " And so one example of how you might do this is if you have a lot of unlabeled email data,"}, {"start": 128.56, "end": 135.68, "text": " say email sitting around and no one has bothered to label yet as spam or non spam, you might"}, {"start": 135.68, "end": 138.44, "text": " be able to go to the unlabeled data."}, {"start": 138.44, "end": 144.28, "text": " You may be able to ask your labelers to quickly skim through the unlabeled data and find more"}, {"start": 144.28, "end": 149.36, "text": " examples specifically of pharma related spam."}, {"start": 149.36, "end": 154.52, "text": " And this could boost your learning algorithm's performance much more than just trying to"}, {"start": 154.52, "end": 157.72, "text": " add more data of all sorts of emails."}, {"start": 157.72, "end": 163.12, "text": " But the more general pattern I hope you take away from this is if you have some ways to"}, {"start": 163.12, "end": 167.04, "text": " add more data of everything, that's okay, nothing wrong with that."}, {"start": 167.04, "end": 174.2, "text": " But if error analysis has indicated that there's certain subsets of the data that the algorithm"}, {"start": 174.2, "end": 179.12, "text": " is doing particularly poorly on and that you want to improve performance on, then getting"}, {"start": 179.12, "end": 185.2, "text": " more data of just the types where you want it to do better, be it more examples of pharmaceutical"}, {"start": 185.2, "end": 190.39999999999998, "text": " spam or more examples of phishing spam or something else, that could be a more efficient"}, {"start": 190.39999999999998, "end": 194.23999999999998, "text": " way to add just a little bit of data, but boost your algorithm's performance by quite"}, {"start": 194.23999999999998, "end": 195.23999999999998, "text": " a lot."}, {"start": 195.23999999999998, "end": 201.76, "text": " Beyond getting your hands on brand new training examples x y, there's another technique that's"}, {"start": 201.76, "end": 209.72, "text": " widely used, especially for images and audio data that can increase your training set size"}, {"start": 209.72, "end": 211.16, "text": " significantly."}, {"start": 211.16, "end": 216.04, "text": " This technique is called data augmentation, and what we're going to do is take an existing"}, {"start": 216.04, "end": 219.48, "text": " training example to create a new training example."}, {"start": 219.48, "end": 225.64, "text": " For example, if you're trying to recognize the letters from A to Z for an OCR optical"}, {"start": 225.64, "end": 230.4, "text": " character recognition problem, so not just a digit 0 to 9, but also the letters from"}, {"start": 230.4, "end": 231.88, "text": " A to Z."}, {"start": 231.88, "end": 238.32, "text": " Given an image like this, you might decide to create a new training example by rotating"}, {"start": 238.32, "end": 248.6, "text": " the image a bit or by enlarging the image a bit or by shrinking a little bit or by changing"}, {"start": 248.6, "end": 251.12, "text": " the contrast of the image."}, {"start": 251.12, "end": 256.4, "text": " And these are examples of distortions to the image that don't change the fact that this"}, {"start": 256.4, "end": 264.0, "text": " is still the alphabet, that this is still the letter A. And for some letters, but not"}, {"start": 264.0, "end": 270.44, "text": " others, you can also take the mirror image of the letter and it still looks like the"}, {"start": 270.44, "end": 273.64, "text": " letter A, but this only applies to some letters."}, {"start": 273.64, "end": 284.16, "text": " But these would be ways of taking a training example x y and applying a distortion or transformation"}, {"start": 284.16, "end": 290.76, "text": " to the input x in order to come up with another example that has the same label."}, {"start": 290.76, "end": 296.03999999999996, "text": " And by doing this, you're telling the algorithm that the letter A rotated a bit or enlarged"}, {"start": 296.03999999999996, "end": 297.68, "text": " a bit or shrunk a little bit."}, {"start": 297.68, "end": 303.7, "text": " It is still the letter A. And creating additional examples like this helps the learning algorithm"}, {"start": 303.7, "end": 307.86, "text": " do a better job learning how to recognize the letter A."}, {"start": 307.86, "end": 314.36, "text": " For a more advanced example of data augmentation, you can also take the letter A and place a"}, {"start": 314.36, "end": 321.88, "text": " grid on top of it. And by introducing random warping of this grid, you can take the letter"}, {"start": 321.88, "end": 328.2, "text": " A and introduce warping of the letter A to create a much richer library of examples of"}, {"start": 328.2, "end": 334.44, "text": " the letter A. And this process of distorting these examples then has turned one image or"}, {"start": 334.44, "end": 340.32, "text": " one example into here, training examples that you can feed to the learning algorithm to"}, {"start": 340.32, "end": 342.56, "text": " help it learn more robustly."}, {"start": 342.56, "end": 344.2, "text": " What is the letter A?"}, {"start": 344.2, "end": 351.32, "text": " This idea of data augmentation also works for speech recognition. Let's say for a voice"}, {"start": 351.32, "end": 356.32, "text": " search application, you have an original audio clip that sounds like this."}, {"start": 356.32, "end": 358.12, "text": " What is today's weather?"}, {"start": 358.12, "end": 365.2, "text": " One way you can apply data augmentation to speech data would be to take noisy background"}, {"start": 365.2, "end": 375.96, "text": " audio like this. For example, this is what the sound of a crowd sounds like. And it turns"}, {"start": 375.96, "end": 381.88, "text": " out that if you take these two audio clips, the first one and the crowd noise and you"}, {"start": 381.88, "end": 387.44, "text": " add them together, then you end up with an audio clip that sounds like this."}, {"start": 387.44, "end": 389.48, "text": " What is today's weather?"}, {"start": 389.48, "end": 394.96, "text": " And you just created an audio clip that sounds like someone saying, what's the weather today?"}, {"start": 394.96, "end": 400.64, "text": " But they're saying it around a noisy crowd in the background. Or in fact, if you were"}, {"start": 400.64, "end": 406.12, "text": " to take a different background noise, say someone in a car, this is what background"}, {"start": 406.12, "end": 414.32, "text": " noise of a car sounds like. And you were to add the original audio clip to the car noise,"}, {"start": 414.32, "end": 416.96, "text": " then you get this."}, {"start": 416.96, "end": 419.35999999999996, "text": " What is today's weather?"}, {"start": 419.35999999999996, "end": 424.24, "text": " And it sounds like the original audio clip, but as if the speaker was saying it from a"}, {"start": 424.24, "end": 430.76, "text": " car. And the more advanced data augmentation step would be if you make the original audio"}, {"start": 430.76, "end": 434.88, "text": " sound like you're recording on a bad cell phone connection like this."}, {"start": 434.88, "end": 437.0, "text": " What is today's weather?"}, {"start": 437.0, "end": 442.44, "text": " And so we've seen how you can take one audio clip and turn it into three training examples"}, {"start": 442.44, "end": 447.32, "text": " here. One with crowd background noise, one with car background noise, and one as if it"}, {"start": 447.32, "end": 452.56, "text": " was recorded on a bad cell phone connection. And the times I've worked on speech recognition"}, {"start": 452.56, "end": 458.36, "text": " systems, this was actually a really critical technique for increasing artificially the size"}, {"start": 458.36, "end": 462.88, "text": " of the training data I had to build a more accurate speech recognizer."}, {"start": 462.88, "end": 469.16, "text": " One tip for data augmentation is that the changes or the distortions you make to the"}, {"start": 469.16, "end": 475.52, "text": " data should be representative of the types of noise or distortions in the test set. So"}, {"start": 475.52, "end": 481.12, "text": " for example, if you take the letter A and warp it like this, this still looks like examples"}, {"start": 481.12, "end": 486.84000000000003, "text": " of letters you might see out there that you would like to recognize. Or for audio, adding"}, {"start": 486.84000000000003, "end": 491.96, "text": " background noise or bad cell phone connection, if that's representative of what you expect"}, {"start": 491.96, "end": 498.52, "text": " to hear in the test set, then these would be helpful ways to carry out data augmentation"}, {"start": 498.52, "end": 501.12, "text": " on your audio data."}, {"start": 501.12, "end": 506.44, "text": " In contrast, it's usually not that helpful to add purely random meaningless noise to"}, {"start": 506.44, "end": 514.08, "text": " audio data. For example, here I've taken the letter A and I've added per pixel noise, where"}, {"start": 514.08, "end": 520.32, "text": " if XI is the intensity or the brightness of pixel I, if I were to just add noise to each"}, {"start": 520.32, "end": 525.96, "text": " pixel, they end up with images that look like this. But if to the extent that this isn't"}, {"start": 525.96, "end": 529.84, "text": " that representative of what you see in the test set, because you don't often get images"}, {"start": 529.84, "end": 534.0, "text": " like this in the test set, this is actually going to be less helpful."}, {"start": 534.0, "end": 540.28, "text": " So one way to think about data augmentation is how can you modify or warp or distort or"}, {"start": 540.28, "end": 545.96, "text": " make more noise in your data, but in a way so that what you get is still quite similar"}, {"start": 545.96, "end": 551.52, "text": " to what you have in your test set, because that's what the learning algorithm will ultimately"}, {"start": 551.52, "end": 553.92, "text": " end up doing well on."}, {"start": 553.92, "end": 559.96, "text": " Now whereas data augmentation takes an existing training example and modifies it to create"}, {"start": 559.96, "end": 564.96, "text": " another training example, there's one other technique which is data synthesis, in which"}, {"start": 564.96, "end": 570.6800000000001, "text": " you make up brand new examples from scratch, not by modifying an existing example, but"}, {"start": 570.6800000000001, "end": 573.9200000000001, "text": " by creating brand new examples."}, {"start": 573.9200000000001, "end": 581.12, "text": " So take the example of photo OCR. Photo OCR or photo optical character recognition refers"}, {"start": 581.12, "end": 587.1600000000001, "text": " to the problem of looking at an image like this and automatically having a computer read"}, {"start": 587.16, "end": 592.9599999999999, "text": " the text that appears in this image. So there's a lot of text in this image."}, {"start": 592.9599999999999, "end": 601.0, "text": " How can you train an OCR algorithm to read text from an image like this? Well, when you"}, {"start": 601.0, "end": 606.04, "text": " look closely at what the letters in this image looks like, they actually look like this."}, {"start": 606.04, "end": 612.16, "text": " So this is real data from a photo OCR task. And one key step of the photo OCR task is"}, {"start": 612.16, "end": 616.5799999999999, "text": " to be able to look at the little image like this and recognize the letter at the middle."}, {"start": 616.58, "end": 623.4000000000001, "text": " So this has T in the middle, this has the letter L in the middle, this has the letter"}, {"start": 623.4000000000001, "end": 626.32, "text": " C in the middle, and so on."}, {"start": 626.32, "end": 633.0400000000001, "text": " So one way to create artificial data for this task is if you go to your computer's text"}, {"start": 633.0400000000001, "end": 640.9200000000001, "text": " editor, you find that it has a lot of different fonts. And what you can do is take these fonts"}, {"start": 640.92, "end": 647.8, "text": " and basically type out random text in your text editor and screenshot it using different"}, {"start": 647.8, "end": 654.4399999999999, "text": " colors and different contrasts and very different fonts. And you get synthetic data like that"}, {"start": 654.4399999999999, "end": 660.28, "text": " on the right. The images on the left were real data from real pictures taken out in"}, {"start": 660.28, "end": 667.0799999999999, "text": " the world. The images on the right are synthetically generated using fonts on the computer. And"}, {"start": 667.08, "end": 673.84, "text": " it actually looks pretty realistic. So with synthetic data generation like this, you can"}, {"start": 673.84, "end": 680.8000000000001, "text": " generate a very large number of images or examples for your photo OCR task. It can be"}, {"start": 680.8000000000001, "end": 686.0400000000001, "text": " a lot of work to write the code to generate realistic looking synthetic data for a given"}, {"start": 686.0400000000001, "end": 692.84, "text": " application. But when you spend time to do so, it can sometimes help you generate a very"}, {"start": 692.84, "end": 698.52, "text": " large amount of data for your application and give you a huge boost to your average"}, {"start": 698.52, "end": 704.8000000000001, "text": " performance. Synthetic data generation has been used most probably for computer vision"}, {"start": 704.8000000000001, "end": 710.96, "text": " tasks and less for other applications, not that much for audio tasks as well. All the"}, {"start": 710.96, "end": 717.0, "text": " techniques you've seen in this video relate to finding ways to engineer the data used"}, {"start": 717.0, "end": 722.8000000000001, "text": " by your system. In the way that machine learning has developed over the last several decades,"}, {"start": 722.8, "end": 729.4799999999999, "text": " many decades, most machine learning researchers attention was on the conventional model centric"}, {"start": 729.4799999999999, "end": 735.76, "text": " approach. And here's what I mean. A machine learning system on AI system includes both"}, {"start": 735.76, "end": 740.9599999999999, "text": " code to implement your algorithm or your model as well as the data that you train the algorithm"}, {"start": 740.9599999999999, "end": 748.04, "text": " on. And over the last few decades, most researchers doing machine learning research with download"}, {"start": 748.04, "end": 753.52, "text": " the data set and hold the data fix while they focus on improving the code or the algorithm"}, {"start": 753.52, "end": 762.52, "text": " or the model. Thanks to that paradigm of machine learning research, I find that today the algorithms"}, {"start": 762.52, "end": 767.36, "text": " we have access to, such as linear regression, logistic regression, neural networks, also"}, {"start": 767.36, "end": 772.28, "text": " decision trees, which you see next week, there are algorithms that are already very good"}, {"start": 772.28, "end": 779.4, "text": " and will work well for many applications. And so sometimes it can be more fruitful to"}, {"start": 779.4, "end": 786.12, "text": " spend more of your time taking a data centric approach in which you focus on engineering"}, {"start": 786.12, "end": 792.1999999999999, "text": " the data used by your algorithm. And this can be anything from collecting more data"}, {"start": 792.1999999999999, "end": 796.64, "text": " to collecting more data just on pharmaceutical spam, if that's what error analysis told you"}, {"start": 796.64, "end": 802.72, "text": " to do, to using data augmentation to generate more images or more audio or using data synthesis"}, {"start": 802.72, "end": 808.64, "text": " to just create more training examples. And sometimes that focus on the data can be an"}, {"start": 808.64, "end": 814.56, "text": " efficient way to help your learning algorithm improve its performance. So I hope that this"}, {"start": 814.56, "end": 821.0, "text": " video gives you a set of tools to be efficient and effective in how you add more data to"}, {"start": 821.0, "end": 826.68, "text": " get your learning algorithm to work better. Now, there are also some applications where"}, {"start": 826.68, "end": 831.76, "text": " you just don't have that much data and it's really hard to get more data. It turns out"}, {"start": 831.76, "end": 836.92, "text": " that there's a technique called transfer learning, which could apply in that setting to give"}, {"start": 836.92, "end": 841.96, "text": " your learning algorithm's performance a huge boost. And the key idea is to take data from"}, {"start": 841.96, "end": 847.68, "text": " a totally different, fairly related task. But using a neural network, there's sometimes"}, {"start": 847.68, "end": 853.1999999999999, "text": " ways to use that data from a very different task to get your algorithm to do better on"}, {"start": 853.1999999999999, "end": 858.88, "text": " your application. Doesn't apply to everything, but when it does, it can be very powerful."}, {"start": 858.88, "end": 878.88, "text": " Let's take a look in the next video at how transfer learning works."}]