Diving into data

A blog on machine learning, data mining and visualization

Main menu

Skip to content
  • About

Selecting good features – Part III: random forests

December 1, 2014

In my previous posts, I looked at univariate feature selection and linear models and regularization for feature selection.In this post, I’ll discuss random forests, another popular approach for feature ranking. Random forest feature importanceRandom forests are among the most popular … Continue reading →

Posted in Feature selection | Replies: 57

Selecting good features – Part II: linear models and regularization

November 12, 2014

In my previous post I discussed univariate feature selection where each feature is evaluated independently with respect to the response variable. Another popular approach is to utilize machine learning models for feature ranking. Many machine learning models have either some … Continue reading →

Posted in Feature selection, Machine learning | Replies: 27

Feature selection – Part I: univariate selection

November 2, 2014

Having a good understanding of feature selection/ranking can be a great asset for a data scientist or machine learning practitioner. A good grasp of these methods leads to better performing models, better understanding of the underlying structure and characteristics of … Continue reading →

Posted in Feature selection, Machine learning | Replies: 26

Interpreting random forests

October 19, 2014

Why model interpretation?Imagine a situation where a credit card company has built a fraud detection model using a random forest. The model can classify every transaction as either valid or fraudulent, based on a large number of features. What if, … Continue reading →

Posted in Machine learning, Random forest | Replies: 59

Post navigation

Newer posts →

Recent Posts

  • Monotonicity constraints in machine learning
  • Random forest interpretation – conditional feature contributions
  • Histogram intersection for change detection
  • Who are the best MMA fighters of all time. A Bayesian study
  • First Estonian Machine Learning Meetup

Archives

  • September 2018
  • October 2016
  • February 2016
  • December 2015
  • November 2015
  • October 2015
  • August 2015
  • June 2015
  • February 2015
  • December 2014
  • November 2014
  • October 2014

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org