A software development company since 1986
Hearing the term "Neural Networks", I got interested to see if there was anything I should know. So I went and did some research to see what it was all about. I found some new words:
What first struck me was the similarity to Shift-Reduce look ahead compiler logic. The only difference I could see was the uncertain versus expected characteristics between the two problem solving results. In one the solution (look ahead) has a 100% certainty of use, where in other (neural networks) the use of the solution is uncertain. So the only difference I could see in the two systems was the expected confidence level on the result, however both are identical in concept and structure.
The one big advantage, of the look ahead approach, is that it is well defined, and can be easily programmed using a single declaration table, has better control on the source code, has control on the back propagation logic, can be uncertain, can be trained, and can be supervised.
My conclusion is that neural networks is the same as an already well defined technology, just with a different name because it has a difference use. So here we go again, re-inventing the wheel, five steps back.... I guess it sounds cool. For those of you that think the parallelism has been lost; no... we simply move it from theory to realistic implementation, as we should do will all logic. To implement neural networks in Jane I will use existing technology with an alternate name.
The true nature of the problem is that we are working toward having the uncertain become certain, then there is no difference between the two systems. This is moving toward, using another term I hate, "artificial intelligence" which is; stupid humans getting better at programming to have uncertain results "good enough" to be acceptable. Some examples are quantum numbers and image recognition, as the error rate approaches a level of usability, then we could say, for practical use, the result is certain. Just another name for another program that does something to get a result. For me this is just programming, doing the same thing every other program does. Using a different name is counter productive, just having forward and back propagation and switch statements does not make it different.