Data Science Project from Scratch - Part 3 (Data Cleaning)

This is part 3 of the Data Science Project from Scratch Series. In this video I go through how to clean up your data to make it usable for exploratory data analysis (EDA) and model building.

github repo for this project: https://github.com/PlayingNumbers/ds_salary_proj

Data cleaning is an extremely important and often overlooked step in the data science lifecycle. Python has some handy functions that allow you to parse and replace data relatively easily. You can also use regular expressions to do this; however, those are a bit beyond the scope of this video. I mostly use lambda functions because I think that this is the simplest approach.

The first thing that we clean is the data science salary. We need to make sure that it is numeric because we are using that as our dependent variable. We also want to go through and do some light feature engineering. We can get some info about the state of the job postings and the nature of the job postings themselves.

I went through and looked to see if the postings had python, r-studio, spark, aws, or excel listed and added those as features.

Again, this is an iterative approach that is rather messy. Please stay tuned for part 4 of the series EDA!

Project from scratch playlist: https://www.youtube.com/watch?v=MpF9HENQjDo&list=PL2zq7klxX5ASFejJj80ob9ZAnBHdz5O1t
My other project playlist: https://www.youtube.com/playlist?list=PL2zq7klxX5AReJn7nZfqOKLZ3IpKj7fwc

#DataScience #KenJee #DataScienceProject

⭕ Subscribe: https://www.youtube.com/c/kenjee1?sub_confirmation=1
? Listen to My Podcast: https://www.youtube.com/c/KensNearestNeighborsPodcast
? Check out My Website - https://kennethjee.com/
✍️Sign up for My Newsletter - https://www.kennethjee.com/newsletter
? Books and Products I use - https://www.amazon.com/shop/kenjee (affiliate link)

Partners & Affiliates
? 365 Data Science - Courses ( 57% Annual Discount): https://365datascience.pxf.io/P0jbBY
? Interview Query - https://www.interviewquery.com/?ref=kenjee

MORE DATA SCIENCE CONTENT HERE:
?My Twitter - https://twitter.com/KenJee_DS
? LinkedIn - https://www.linkedin.com/in/kenjee/
? Kaggle - https://www.kaggle.com/kenjee
? Medium Articles - https://medium.com/@kenneth.b.jee
? Github - https://github.com/PlayingNumbers
? My Sports Blog -https://www.playingnumbers.com

Check These Videos Out Next!
My Leaderboard Project: https://www.youtube.com/watch?v=myhoWUrSP7o&ab_channel=KenJee
66 Days of Data: https://www.youtube.com/watch?v=qV_AlRwhI3I&ab_channel=KenJee
How I Would Learn Data Science in 2021: https://www.youtube.com/watch?v=41Clrh6nv1s&ab_channel=KenJee

My Playlists
Data Science Beginners: https://www.youtube.com/playlist?list=PL2zq7klxX5ATMsmyRazei7ZXkP1GHt-vs
Project From Scratch: https://www.youtube.com/watch?v=MpF9HENQjDo&list=PL2zq7klxX5ASFejJj80ob9ZAnBHdz5O1t&ab_channel=KenJee
Kaggle Projects: https://www.youtube.com/playlist?list=PL2zq7klxX5AQXzNSLtc_LEKFPh2mAvHIO