LF logo
by learnformula
search
Log in
search
Courses/Engineering/Technology & Science

Interpreting Machine Learning Models: Trees to Ensembles

Master global and local explainability for decision trees, random forests, and gradient boosting machines.

Created bySoledad Galli
IntermediateUpdated Oct 2, 2026
Interpreting Machine Learning Models: Trees to Ensembles

What You'll Learn

check_circleCalculate feature importance using impurity-based metrics in decision trees
check_circleDifferentiate between global and local explainability techniques
check_circleImplement local feature contribution analysis for ensemble models
check_circleInterpret gradient boosting machines including XGBoost and LightGBM
check_circleAssess the impact of multicollinearity on feature importance rankings

About This Course

This course provides a comprehensive framework for interpreting tree-based machine learning models, moving from simple decision trees to complex ensemble methods. It covers the mechanics of tree induction, feature importance, and impurity-based metrics for both global and local model explanations. Participants will learn how to extract and visualize insights from random forests and gradient boosting machines, including practical implementations using scikit-learn, XGBoost, and LightGBM. The content emphasizes the mathematical intuition behind model predictions and provides strategies for assessing feature contributions in both regression and classification tasks.

Topics Covered:

  • Decision tree induction and partitioning
  • Impurity metrics and feature importance
  • Global versus local model explainability
  • Bootstrap aggregating and random forests
  • Gradient boosting machine mechanics
  • Feature contribution analysis in ensembles
  • Model interpretation in scikit-learn and XGBoost
  • Handling multicollinearity in model interpretation

Your Instructor

Soledad Galli
Soledad Galli

Data Scientist | Python Developer | Author and Instructor

menu_book6 courses

I'm a data scientist, machine learning educator and open-source developer. I've built machine learning models for credit risk, insurance claims and fraud prevention, and I am passionate about helping data scientists build models that hold up in real-world projects. My courses are designed for intermediate and advanced practitioners. They cover feature engineering, feature selection, hyperparameter optimization, imbalanced data and the design of robust machine learning pipelines, with a strong emphasis on techniques you can apply straight away in your own work. In the age of generative AI, when a working model can be coded in minutes, the real skill lies in understanding the methods deeply enough to review that output with rigor and a critical eye, and that's exactly what these courses are built to develop. I'm the creator and maintainer of Feature-engine, an open-source Python library for feature engineering and feature selection used by data scientists worldwide. I'm also the author of three books published by Packt: Python Feature Engineering Cookbook, Feature Selection in Machine Learning, and Imbalanced Data: Myths, Mistakes and Modern Solutions. I speak regularly at conferences and meetups, and I enjoy connecting technical communities with the tools and knowledge they need to succeed. In 2018 I received a Data Science Leaders Award, and in 2019 LinkedIn recognized me as one of its voices in data science and analytics. Before moving into data science, I earned an MSc in Biology and a PhD in Biochemistry, then spent more than eight years as a research scientist at institutions including University College London and the Max Planck Institute. That scientific training still shapes how I teach: rigorous, evidence-based, and focused on understanding why a method works before reaching for it.

Credit Information

What Students Are Saying

0.0
Student's Choice
0 reviews

Frequently Asked Questions

We are a registered provider with 327+ associations and regulatory bodies worldwide. We operate across 29 global markets including Canada, the US, Australia, and the UK. Every course page clearly displays its specific accreditations. Upon completion, you receive a professional certificate that can be validated online. Our certificates include all necessary accreditation details, credit hours, and completion dates, and are formatted specifically to meet the submission requirements of most global regulatory bodies.

You May Also Like

Ethics: Business Ethics

2026 Ethics and Corporate Compliance

star5.0(376)
2 CPD hrs
Ethics: Business Ethics

The Ethical Detective: AI and the New Fraud Frontier

star4.9(254)
2 CPD hrs
Accounting & Tax: Technology for Accountants

Claude Fundamentals for Accountants (2026 Update)

star5.0(445)
2.5 CPD hrs