Scikit-Learn Python Library CheatSheet

Machine learning is a dynamic and rapidly evolving field, and one of the most widely used libraries for implementing machine learning algorithms in Python is Scikit-Learn. Scikit-Learn provides simple and efficient tools for data analysis and modeling, making it an indispensable tool for both beginners and seasoned data scientists. To help you navigate the vast landscape of Scikit-Learn, we’ve put together a comprehensive cheatsheet that covers the essential components and functionalities.

1. Importing Scikit-Learn

from sklearn import *

Scikit-Learn is organized into several sub-modules, each specializing in different aspects of machine learning. Importing * allows you to access the entire library. However, it’s common to import specific modules or classes as needed.

2. Loading Datasets

from sklearn.datasets import load_iris, load_digits, fetch_openml

Scikit-Learn provides various built-in datasets for practice. Use the load_* functions to load datasets or fetch_openml for larger datasets.

iris = load_iris()
X, y = iris.data, iris.target

3. Data Preprocessing

a. Splitting Data

from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=42)

b. Standardization/Normalization

from sklearn.preprocessing import StandardScaler, MinMaxScaler

scaler = StandardScaler()
X_train_scaled = scaler.fit_transform(X_train)
X_test_scaled = scaler.transform(X_test)

4. Supervised Learning Models

a. Classification

Logistic Regression

from sklearn.linear_model import LogisticRegression

model = LogisticRegression()
model.fit(X_train, y_train)

Decision Trees

from sklearn.tree import DecisionTreeClassifier

model = DecisionTreeClassifier()
model.fit(X_train, y_train)

b. Regression

Linear Regression

from sklearn.linear_model import LinearRegression

model = LinearRegression()
model.fit(X_train, y_train)

Random Forest

from sklearn.ensemble import RandomForestRegressor

model = RandomForestRegressor()
model.fit(X_train, y_train)

5. Unsupervised Learning Models

a. Clustering

K-Means

from sklearn.cluster import KMeans

kmeans = KMeans(n_clusters=3)
kmeans.fit(X)

b. Dimensionality Reduction

PCA (Principal Component Analysis)

from sklearn.decomposition import PCA

pca = PCA(n_components=2)
X_pca = pca.fit_transform(X)

6. Model Evaluation

a. Classification Metrics

from sklearn.metrics import accuracy_score, precision_score, recall_score, f1_score, confusion_matrix

y_pred = model.predict(X_test)

accuracy = accuracy_score(y_test, y_pred)
precision = precision_score(y_test, y_pred, average='weighted')
recall = recall_score(y_test, y_pred, average='weighted')
f1 = f1_score(y_test, y_pred, average='weighted')

conf_matrix = confusion_matrix(y_test, y_pred)

b. Regression Metrics

from sklearn.metrics import mean_squared_error, r2_score

y_pred = model.predict(X_test)

mse = mean_squared_error(y_test, y_pred)
r2 = r2_score(y_test, y_pred)

7. Hyperparameter Tuning

from sklearn.model_selection import GridSearchCV

param_grid = {'C': [0.1, 1, 10], 'gamma': [0.01, 0.1, 1]}
grid_search = GridSearchCV(SVC(), param_grid, cv=5)
grid_search.fit(X_train_scaled, y_train)

best_params = grid_search.best_params_

8. Pipelines

from sklearn.pipeline import Pipeline

pipeline = Pipeline([
    ('scaler', StandardScaler()),
    ('classifier', LogisticRegression())
])

pipeline.fit(X_train, y_train)

9. Saving and Loading Models

import joblib

# Save model
joblib.dump(model, 'model.joblib')

# Load model
loaded_model = joblib.load('model.joblib')

Scikit-Learn provides a powerful and versatile set of tools for machine learning. This cheatsheet covers the fundamental aspects of using Scikit-Learn for various tasks, from data preprocessing to model evaluation. Keep experimenting with different models and parameters to deepen your understanding and enhance your machine learning skills.

FAQ