Data Analysis From Scratch With Python: Step By Step Guide

Decision Tree Classification
As with Regression, many data scientists also implement Decision Trees in
Classification. As mentioned in the previous chapter, creating a decision tree is
about breaking down a dataset into smaller and smaller subsets while branching
them out (creating an associated decision tree).
Here’s 
a 
simple 
example 
so 
you 
can 
understand 
it 
better: 

---

Notice that branches and leaves result from breaking down the dataset into
smaller subsets. In Classification, we can similarly apply this through the
following code (again using the Social_Network_Ads.csv): 
# Decision Tree
Classification
# Importing the libraries
import numpy as np
import matplotlib.pyplot as plt
import pandas as pd
%matplotlib inline
# Importing the dataset
dataset = pd.read_csv('Social_Network_Ads.csv')
X = dataset.iloc[:, [2, 3]].values
y = dataset.iloc[:, 4].values
# Splitting the dataset into the Training set and Test set
from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size = 0.25,
random_state = 0)
# Feature Scaling
from sklearn.preprocessing import StandardScaler
sc = StandardScaler()
X_train = sc.fit_transform(X_train)
X_test = sc.transform(X_test)

---

# Fitting Decision Tree Classification to the Training set
from sklearn.tree import DecisionTreeClassifier
classifier = DecisionTreeClassifier(criterion = 'entropy', random_state = 0)
classifier.fit(X_train, y_train)