AI_DL_Assignment / 21. TensorFlow Object Detection API /3. Experiment with a ResNet SSD on images, webcam and videos.srt
| 1 | |
| 00:00:00,650 --> 00:00:00,960 | |
| OK. | |
| 2 | |
| 00:00:01,020 --> 00:00:07,680 | |
| So welcome to the 21 point to where we actually start playing with our SSD inside by using sari | |
| 3 | |
| 00:00:11,660 --> 00:00:18,240 | |
| Hi welcome to Chapter 21 point to where we start experimenting with the object of action SSD based on | |
| 4 | |
| 00:00:18,280 --> 00:00:23,080 | |
| resonate and we do this on images webcams and all of them feel it and videos. | |
| 5 | |
| 00:00:23,100 --> 00:00:24,580 | |
| So let's get started. | |
| 6 | |
| 00:00:25,170 --> 00:00:27,000 | |
| So now we're here in a virtual machine. | |
| 7 | |
| 00:00:27,000 --> 00:00:32,000 | |
| And this project is going to be a bit different as we have done because we remember we created a new | |
| 8 | |
| 00:00:32,010 --> 00:00:38,120 | |
| environment so we have to launch what I put in the books from a new environment so fiercely that school | |
| 9 | |
| 00:00:38,130 --> 00:00:49,140 | |
| source caps lock is on source activate T.F. the API to get us to not use on the school. | |
| 10 | |
| 00:00:49,140 --> 00:00:49,680 | |
| There we go. | |
| 11 | |
| 00:00:49,860 --> 00:00:51,950 | |
| So that's a environment that we're in right now. | |
| 12 | |
| 00:00:52,230 --> 00:00:52,850 | |
| So that's good. | |
| 13 | |
| 00:00:52,900 --> 00:00:54,010 | |
| I will have to. | |
| 14 | |
| 00:00:54,010 --> 00:00:58,450 | |
| This will probably be any name you name that previously before if you're not using my pre-installed | |
| 15 | |
| 00:00:58,710 --> 00:01:00,020 | |
| with your machine. | |
| 16 | |
| 00:01:00,180 --> 00:01:07,080 | |
| So I put iPod it's on the books and it brings up a point on the book browser of Jupiter. | |
| 17 | |
| 00:01:07,560 --> 00:01:12,950 | |
| So now what I want us to go to is really there are two ways to get a set up. | |
| 18 | |
| 00:01:13,040 --> 00:01:18,540 | |
| You're supposed to download and I put it in the book file in the resources file that file was basically | |
| 19 | |
| 00:01:19,420 --> 00:01:20,090 | |
| this here. | |
| 20 | |
| 00:01:20,240 --> 00:01:20,940 | |
| All right. | |
| 21 | |
| 00:01:20,940 --> 00:01:26,130 | |
| However I left it in the artery here in case you wanted to manually copy and paste it into the directory. | |
| 22 | |
| 00:01:26,130 --> 00:01:28,640 | |
| So let's actually go ahead and do that. | |
| 23 | |
| 00:01:28,650 --> 00:01:38,940 | |
| So copy this file control Control-C and the doctor wants you to go to was the Saathiya models models. | |
| 24 | |
| 00:01:39,450 --> 00:01:45,240 | |
| Research sorry and object detection and pissed that file in to here. | |
| 25 | |
| 00:01:45,430 --> 00:01:46,160 | |
| OK. | |
| 26 | |
| 00:01:46,470 --> 00:01:48,070 | |
| This one here is actually ulo. | |
| 27 | |
| 00:01:48,180 --> 00:01:51,780 | |
| It's not actually going to work to paste it into here. | |
| 28 | |
| 00:01:52,260 --> 00:01:59,220 | |
| So now let's go to a Titan notebook browser and find this directory. | |
| 29 | |
| 00:01:59,520 --> 00:02:00,740 | |
| So find the file. | |
| 30 | |
| 00:02:00,740 --> 00:02:01,670 | |
| I should say so. | |
| 31 | |
| 00:02:01,680 --> 00:02:04,270 | |
| Good models research. | |
| 32 | |
| 00:02:04,560 --> 00:02:07,630 | |
| Scroll down to object detection | |
| 33 | |
| 00:02:09,980 --> 00:02:16,610 | |
| right here and let's launch this file. | |
| 34 | |
| 00:02:16,610 --> 00:02:23,220 | |
| Ok so here we go this file here is actually not a file I created I just modified it slightly. | |
| 35 | |
| 00:02:23,260 --> 00:02:28,900 | |
| This is a father comes intensive flows observation API and it allows you to basically play with the | |
| 36 | |
| 00:02:28,900 --> 00:02:31,850 | |
| different features in it it's in the official Demel. | |
| 37 | |
| 00:02:32,180 --> 00:02:33,770 | |
| So let's run the first box here. | |
| 38 | |
| 00:02:33,780 --> 00:02:40,990 | |
| So imports this plot of stuff in line by the way in case I haven't mentioned it to you what this does | |
| 39 | |
| 00:02:40,990 --> 00:02:47,200 | |
| is that it generates matplotlib Matlab plots inside a phone book as opposed to having it be like an | |
| 40 | |
| 00:02:47,200 --> 00:02:49,080 | |
| open TV and a new window. | |
| 41 | |
| 00:02:49,540 --> 00:02:52,650 | |
| So anyway that's duties imports here as well. | |
| 42 | |
| 00:02:53,230 --> 00:02:56,340 | |
| And let's run this block here. | |
| 43 | |
| 00:02:56,470 --> 00:02:59,830 | |
| These old directories would basically point to different models. | |
| 44 | |
| 00:02:59,830 --> 00:03:01,230 | |
| This is the SSD. | |
| 45 | |
| 00:03:01,240 --> 00:03:04,220 | |
| This is a resident SSD will be using that street and the cocoa. | |
| 46 | |
| 00:03:04,420 --> 00:03:09,840 | |
| That's a common object data set and it's going to download it the first time if you didn't already have | |
| 47 | |
| 00:03:09,840 --> 00:03:12,490 | |
| it saved is going to lose here. | |
| 48 | |
| 00:03:12,490 --> 00:03:16,680 | |
| Actually I do have it saved so it should not download. | |
| 49 | |
| 00:03:16,690 --> 00:03:21,960 | |
| I hope it is doing something so maybe it is downloading. | |
| 50 | |
| 00:03:22,010 --> 00:03:25,750 | |
| So anyway let's run this box and wait for that to finish. | |
| 51 | |
| 00:03:27,520 --> 00:03:37,780 | |
| And we load a little nap some help a code and then we do our detection boxes here and don't mind these | |
| 52 | |
| 00:03:38,590 --> 00:03:41,260 | |
| red things that look like it's going to be at URL. | |
| 53 | |
| 00:03:41,450 --> 00:03:42,750 | |
| This will still run. | |
| 54 | |
| 00:03:42,790 --> 00:03:44,360 | |
| So it's fine. | |
| 55 | |
| 00:03:44,430 --> 00:03:44,920 | |
| So right. | |
| 56 | |
| 00:03:44,950 --> 00:03:47,010 | |
| These these boxes have from now. | |
| 57 | |
| 00:03:47,320 --> 00:03:52,450 | |
| So let's do that we do this one and remember some of us do it again. | |
| 58 | |
| 00:03:53,220 --> 00:03:54,370 | |
| Let's run this one. | |
| 59 | |
| 00:03:54,550 --> 00:03:57,760 | |
| And that actually was not up wanted yet. | |
| 60 | |
| 00:03:57,760 --> 00:03:58,720 | |
| This is what we want. | |
| 61 | |
| 00:03:58,730 --> 00:04:04,020 | |
| So it goes through the images in a Test spot and it still takes a while to run. | |
| 62 | |
| 00:04:04,480 --> 00:04:05,110 | |
| To be fair. | |
| 63 | |
| 00:04:05,500 --> 00:04:11,980 | |
| And what it's going to do is basically it's going to take that image it found out and basically run | |
| 64 | |
| 00:04:11,980 --> 00:04:17,340 | |
| all of these SSD functions that require it to classify detect objects here. | |
| 65 | |
| 00:04:17,590 --> 00:04:18,590 | |
| So here we go. | |
| 66 | |
| 00:04:18,730 --> 00:04:26,440 | |
| So the first first test image it picked up this is a dog you can see it clearly says this woman. | |
| 67 | |
| 00:04:26,690 --> 00:04:30,740 | |
| I'm pressing control and moving my mouse button and we can see it's a dog here. | |
| 68 | |
| 00:04:30,770 --> 00:04:32,080 | |
| And you can see the probabilities. | |
| 69 | |
| 00:04:32,260 --> 00:04:33,310 | |
| It's a bit hard to make out. | |
| 70 | |
| 00:04:33,310 --> 00:04:37,720 | |
| Maybe we can actually change some parameters here to make this a little more legible. | |
| 71 | |
| 00:04:37,870 --> 00:04:38,560 | |
| Insightful. | |
| 72 | |
| 00:04:38,550 --> 00:04:39,790 | |
| I applied in the book. | |
| 73 | |
| 00:04:40,080 --> 00:04:41,500 | |
| It's a dog here and a dog here. | |
| 74 | |
| 00:04:41,530 --> 00:04:43,720 | |
| So it's quite good. | |
| 75 | |
| 00:04:43,720 --> 00:04:45,790 | |
| This is the image I use in my presentation slide. | |
| 76 | |
| 00:04:45,970 --> 00:04:51,940 | |
| You can see this is a kite kite kite person person and these are the probabilities which I can read | |
| 77 | |
| 00:04:52,180 --> 00:04:55,260 | |
| it looks like 60 tree just looks like a hundred. | |
| 78 | |
| 00:04:55,270 --> 00:04:57,400 | |
| But what it is it is. | |
| 79 | |
| 00:04:57,400 --> 00:05:03,010 | |
| So now let's try it on a webcam and I'm pretty much looking like a bit of a mess right now because it's | |
| 80 | |
| 00:05:03,010 --> 00:05:03,630 | |
| quite late. | |
| 81 | |
| 00:05:03,640 --> 00:05:07,710 | |
| And I have not comb my hair for a while but I'm sober to try this. | |
| 82 | |
| 00:05:07,720 --> 00:05:12,840 | |
| So let's run this webcam should come on any second now. | |
| 83 | |
| 00:05:15,680 --> 00:05:15,940 | |
| All right. | |
| 84 | |
| 00:05:15,980 --> 00:05:18,470 | |
| This is me in my natural element here. | |
| 85 | |
| 00:05:18,680 --> 00:05:26,040 | |
| And you can see that actually went up T-shirt on ice free advertising for Apple. | |
| 86 | |
| 00:05:26,060 --> 00:05:30,520 | |
| So this is me here and this is the person box that's affecting me right now. | |
| 87 | |
| 00:05:30,560 --> 00:05:31,780 | |
| So this is actually pretty cool. | |
| 88 | |
| 00:05:31,820 --> 00:05:37,640 | |
| So let me just close this and no let's try it out on the video. | |
| 89 | |
| 00:05:37,650 --> 00:05:40,880 | |
| So this is a dash cam video I downloaded off YouTube. | |
| 90 | |
| 00:05:40,960 --> 00:05:43,130 | |
| And so let's it it | |
| 91 | |
| 00:05:49,000 --> 00:05:50,170 | |
| it sometimes takes a while to load. | |
| 92 | |
| 00:05:50,170 --> 00:05:51,850 | |
| Oh there we go. | |
| 93 | |
| 00:05:52,720 --> 00:05:54,630 | |
| So this is a tip. | |
| 94 | |
| 00:05:54,850 --> 00:05:56,150 | |
| So this is pretty cool. | |
| 95 | |
| 00:05:56,230 --> 00:05:58,190 | |
| If I if I do say so. | |
| 96 | |
| 00:05:58,750 --> 00:06:05,170 | |
| So we're running it here detecting imprisons cause I think we just saw a bike from a mistaken call again | |
| 97 | |
| 00:06:06,610 --> 00:06:08,090 | |
| and the frame rate isn't that bad. | |
| 98 | |
| 00:06:08,170 --> 00:06:12,010 | |
| Honestly it being on a C.P. you not a GP. | |
| 99 | |
| 00:06:12,280 --> 00:06:14,210 | |
| This is actually pretty sick. | |
| 100 | |
| 00:06:18,900 --> 00:06:20,460 | |
| So let's close this video now. | |
| 101 | |
| 00:06:21,560 --> 00:06:27,150 | |
| So you've just run and experimented with SSD single shot detector. | |
| 102 | |
| 00:06:27,550 --> 00:06:29,090 | |
| So I hope you found this chapter fun. | |
| 103 | |
| 00:06:29,090 --> 00:06:32,660 | |
| I found it quite fun to play with this as well. | |
| 104 | |
| 00:06:32,660 --> 00:06:35,680 | |
| What you can do is put any video you want here. | |
| 105 | |
| 00:06:36,150 --> 00:06:39,840 | |
| Another dashcam video as well and any images you want. | |
| 106 | |
| 00:06:39,860 --> 00:06:45,590 | |
| We'll go there to see what fall they look at Image Pat. | |
| 107 | |
| 00:06:45,600 --> 00:06:52,170 | |
| Basically find fine image that is obviously not defined there. | |
| 108 | |
| 00:06:53,410 --> 00:06:54,450 | |
| Keep going. | |
| 109 | |
| 00:06:56,320 --> 00:06:57,510 | |
| Testament. | |
| 110 | |
| 00:06:57,720 --> 00:07:03,960 | |
| It is as if it's about OK syntactical test images. | |
| 111 | |
| 00:07:05,850 --> 00:07:06,590 | |
| This one here. | |
| 112 | |
| 00:07:07,020 --> 00:07:08,700 | |
| So this is the directory we're looking at. | |
| 113 | |
| 00:07:08,710 --> 00:07:10,650 | |
| We had what else images in it. | |
| 114 | |
| 00:07:10,700 --> 00:07:12,010 | |
| I'm not sure what's in this file. | |
| 115 | |
| 00:07:12,040 --> 00:07:16,950 | |
| I guess it's a source file for you want to put your source for images to sometimes. | |
| 116 | |
| 00:07:17,020 --> 00:07:18,300 | |
| So this is pretty cool. | |
| 117 | |
| 00:07:18,530 --> 00:07:23,420 | |
| So you can experiment with a web cam with your test images and watch your videos. | |
| 118 | |
| 00:07:23,520 --> 00:07:23,730 | |
| OK. | |