VIF In Machine Learning


           VIF In Machine Learning

Variance Inflation Factor (VIF) is a measure used in statistics and machine learning to identify multicollinearity in multiple regression analysis. Multicollinearity is a situation in which two or more predictor variables are highly correlated, and it can create problems in regression models, such as making the model’s parameters estimation unstable.

The VIF provides an index that measures how much the variance of the estimated regression coefficients is increased when your predictors are correlated. If no factors are correlated, the VIFs will all be equal to 1.

Here’s how to interpret the VIF:

  • VIF = 1: No correlation between the predictor and the other variables.
  • VIF > 1 to 5: Moderate correlation, but it can still be acceptable.
  • VIF > 5 to 10: High correlation, which may be problematic, and you should consider reviewing the variables.
  • VIF > 10: Very high correlation, indicating that the variables contain redundant information. It’s usually suggested to remove one of these correlated variables.

In Python, you can compute VIF using the statsmodels library. Here’s an example of how you might do this:

pythonCopy code

from statsmodels.stats.outliers_influence import variance_inflation_factor

import pandas as pd

# Assuming X is your data

X = pd.DataFrame(…)

# Adding a constant column for the intercept

X[“Intercept”] = 1

# Calculating VIF for each variable

vif_data = pd.DataFrame()

vif_data[“feature”] = X.columns

vif_data[“VIF”] = [variance_inflation_factor(X.values, i) for i in range(len(X.columns))]


This will give you the VIF for each variable, and you can make decisions on whether or not to include them in your model based on the values you get.

Machine Learning Training Demo Day 1

You can find more information about Machine Learning in this Machine Learning Docs Link



Unogeeks is the No.1 Training Institute for Machine Learning. Anyone Disagree? Please drop in a comment

Please check our Machine Learning Training Details here Machine Learning Training

You can check out our other latest blogs on Machine Learning in this Machine Learning Blogs

💬 Follow & Connect with us:


For Training inquiries:

Call/Whatsapp: +91 73960 33555

Mail us at:

Our Website ➜

Follow us:





Leave a Reply

Your email address will not be published. Required fields are marked *