Article:		An Introduction to Artificial Intelligence
Subject:		Feedback
Date:		2005-10-22 23:22:18
From:		austins
Response to: Great Intro Article
Usually neural networks are trained by measuring the error in the ouput later and using an algorithm called backpropagation to adjust connection weights to explicitly correct the error. With enough training and a solvable problem, the network will usually converge. Sometimes, though, the network gets "overtrained" and just stores the desired output, so it doesn't generalize to new problems very easily. Neural networks are still good for some things, but there are now much better algorithms now for face recognition- the eigenfaces decomposition with support vector machines, for example, does a pretty good job. This is still a hot research area, and amazing things are being done.

Showing messages 1 through 1 of 1.

• Feedback
  2005-10-23 06:16:53  Matthew Russell | [View]
  
  
  Yep. Backpropagation is the standard technique for adjusting the weights and is used here as well.
  
  Good point about there being newer cutting edge ways of face detection than neural nets -- you're absolutely right about that. I chose neural nets here because of the general applicability to solve other problems in addition to the one at hand, and for the coolness factor as well. Lots of people hear about neural nets, but not too many people ever stop to figure out what they are.
  
  As for the overtraining: right again, and that's easier to do than you'd think. And another consideration I didn't mention in the main text is that unlike a tool like a decision tree, a neural net is like a black box -- you might get it to learn something, but there's almost never any way to generalize what it's learned. There are plenty of other factors to consider as well.
  
  Really, I just hit the tip of the iceberg with neural nets here -- like anything else, you could write a textbook on the subject. As a good resource, I recommend taking a look at the excellent chapter about them in Tom Mitchell's Machine Learning (the little blue book) if you're hungry for more than what you'll find on the (inter)net.