How to train XGBoost models in Python

Welcome to How to train XGBoost models in Python tutorial. You'll build an XGBoost Classifier model with an example dataset, step-by-step.

By following this tutorial, you’ll learn:

✅What is XGBoost (vs. gradient tree boosting algorithm)
✅How to build an XGBoost model (Classifier) in Python, step-by-step:
- Step #1: Explore and prep data
- Step #2: Build a pipeline of training
- Step #3: Set up hyperparameter tuning (cross-validation)
- Step #4: Train the XGBoost model
- Step #5: Evaluate the model and make predictions
- Step #6: Measure feature importance (optional)

If you want to use Python to create XGBoost models to make predictions, this practical tutorial will get you started.

GitHub Repo with code: https://github.com/liannewriting/YouTube-videos-public/blob/main/xgboost-python-tutorial-example/xgboost_python.ipynb

Technologies that will be used:
☑️ JupyterLab (Notebook)
☑️ pandas
☑️ scikit-learn (sklearn)
☑️ category_encoders
☑️ xgboost Python package
☑️ scikit-optimize (skopt)

Links mentioned in the video

► Bank marketing dataset: https://archive.ics.uci.edu/ml/datasets/bank+marketing

► What is gradient boosting in machine learning tutorial: fundamentals explained: https://www.justintodata.com/gradient-boosting-machine-learning/

► To learn Python basics, take our course Python for Data Analysis with projects: https://www.justintodata.com/courses/python-for-data-analysis-projects-online-course/

► sklearn pipeline: https://scikit-learn.org/stable/modules/generated/sklearn.pipeline.Pipeline.html

► Target Encoder: https://contrib.scikit-learn.org/category_encoders/targetencoder.html

► XGBClassifier documentation with hyperparameters definition: https://xgboost.readthedocs.io/en/stable/python/python_api.html#xgboost.XGBClassifier

There's also an article version of the same content. If you prefer reading, please check it out. How to build XGBoost models in Python: https://www.justintodata.com/xgboost-model-classifier-python-example/

Get access to more data science materials, check out our website Just into Data: https://justintodata.com/