Augmented Reality using a Neural Network

AR using SOM

This is the project that I have worked on for senior seminar at Ripon College. It is a simple augmented reality system using a neural network inspired by the biological vision system. It uses

  1. Webcam as a visual sensor
  2. OpenCV for feature detection and extraction,
  3. A self-organizing map (SOM) for picture recognition, and
  4. Microsoft WPF 3D for 3D rendering

For image recognition, the global representation of images are used as image features. The SOM, also known as Kohonen Map, is a two-layer artificial neural network comprising the input layer and the competition layer that is a grid of neurons. Each neuron is represented by a vector that has the same dimension as an input feature vector. During the training, the SOM groups the similar pictures together in the competition layer and chooses a neuron for each group.


Source Code

Prezi Slides


One thought on “Augmented Reality using a Neural Network

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s