Data Compression using Neural Network
’Neural Network’ is method of information processing with model of nerve cells.
This model is powerful and useful.
A hierarchical neural network model is simply model and has some layers of neurons and every
neuron links neurons in only next layer. Every neuron has value
xi (i 1,2,L) is value from neuron in previous layer
Wi (i 1,2,L) is weight which mean strength value of links.
This model can be used like a ’Non-linear Regression Model’, as the first layer is used as
input and the last one is used as output, and neurones learned strength of links (weight) from
data. This model is simply but powerful.
Compression of data
In hierarchical neural network model, when the number of neurones of the first and the
last are same and the middle layer is fewer than others and learning with output data identity
with input data, the values of neurones of middle layer has a compression of data.
Feature of this method is following
Because a neural network model is changed according to data, it is not necessary to make
model according to data in advance.
The Strength of links of neurones tell us which data influence to compression
components.
In principal component analysis or factor analysis, we decide the number of components
after checking results. But in neural network model, we can decide the number of
compression components before analysis, because of we decide the number of neurones
in middle layer.