Worked Example Gmane Mail Model Chapter 16 | 3rd | week 4|.

Hello everybody and welcome to Python for Everybody. We are going to do, be doing some code walk throughs. If you want the sample code though you can download the zip from our website. The work that we're doing right now is we are in the process of building a spider and visual- visualization tool for email data that came originally from this website gmane. But I've got my own copy of it. And so, what we've done before is we ran gmane.py and I grabbed a url. I have a url that has all this data, and I downloaded that and then I ran gmane again to catch up. And so, it took quite a bit of catching up but by the time I get to- Remember how I said it run, tries to fails five times. Well, it ran out of data at 60,421 and then it started failing and then it quit. And so we pretty much have all of our data now. We have all- We have finished this process and S content SQLite, okay? And if I take a look in the database browser, we can see we got 59,823 e-mail messages. And so, if I look at any of these things, you see the headers, you see the subject line, you see the email address, you see the body of it. So remember I split the body into- in half and then the headers and so that's- I made this as raw as I possibly could because, as you saw, I had to spend so much time in the gmane just putting the data successfully retrieved. And so, I don't like cleaning the data up too much. And so, what we're going to look at next is the data cleaning process