Self Organizing Map (or Kohonen Map or SOM) is a type of Artificial Neural Network which is also inspired by biological models of neural systems form the 1970’s. It follows an unsupervised learning approach and trained its network through a competitive learning algorithm. SOM is used for clustering and mapping (or dimensionality reduction) techniques to map multidimensional data onto lower-dimensional which allows people to reduce complex problems for easy interpretation. SOM has two layers, one is the Input layer and the other one is the Output layer. The architecture of the Self Organizing Map with two clusters and n input features of any sample is given below:
How SOM works?
Let’s say an input data of size (m, n) where m is the number of training example and n is the number of features in each example. First, it initializes the weights of size (n, C) where C is the number of clusters. Then iterating over the input data, for each training example, it updates the winning vector (weight vector with the shortest distance (e.g Euclidean distance) from training example). Weight updation rule is given by :
wij = wij(old) - alpha(t) * (xik - wij(old))
where alpha is a learning rate at time t, j denotes the winning vector, i denotes the ith feature of training example and k denotes the kth training example from the input data. After training the SOM network, trained weights are used for clustering new examples. A new example falls in the cluster of winning vector.
Steps involved are :
- Weight initialization
- For 1 to N number of epochs
- Select a training example
- Compute the winning vector
- Update the winning vector
- Repeat steps 3, 4, 5 for all training examples.
- Clustering the test sample
Below is the implementation of above approach:
Test Sample s belongs to Cluster : 0
Trained weights : [[0.6000000000000001, 0.8, 0.5, 0.9], [0.3333984375, 0.0666015625, 0.7, 0.3]]
Attention geek! Strengthen your foundations with the Python Programming Foundation Course and learn the basics.
To begin with, your interview preparations Enhance your Data Structures concepts with the Python DS Course.
- Python | Get a google map image of specified location using Google Static Maps API
- Creating interactive maps and Geo Visualizations in Java
- Stamen Toner ,Stamen Terrain and Mapbox Bright Maps in Python-Folium
- Plotting ICMR approved test centers on Google Maps using folium package
- Python Bokeh – Plot for all Types of Google Maps ( roadmap, satellite, hybrid, terrain)
- Google Maps Selenium automation using Python
- self in Python class
- OpenCV and Keras | Traffic Sign Classification for Self-Driving Car
- Overview of Kalman Filter for Self-Driving Car
- ANN - Implementation of Self Organizing Neural Network (SONN) from Scratch
- Python Library for Self-Balancing BST
- Grouped Boxplots in Python with Seaborn
- Bulk Posting on Facebook Pages using Selenium
- Serializing JSON data in Python