Added regularization and cross-entropy error to Neurolab about neurolab HOT 5 CLOSED

I would like to see these changes incorporated as well. Is this project still 
maintained? 

Yes, this project is maintaine. I look your code, its good job!
But I think that the regularization need to move out of error function.
I'll thinck how do it better.

Thanks for your work.

About CEE
Do you really sure in the method of calculating the derivateve of CCE function?
What sources did you use?

"I'll think how do it better."
Great, thanks for maintaining this package!

"About CEE. Do you really sure in the method of calculating the derivateve of 
CCE function?
What sources did you use?"
I did not perform the calculation myself. I was inspired by knowing that the 
gradient descent learning rule for logistic regression (which uses CEE) is the 
same as that for linear regression using MSE or SSE (as explained in this 
document: http://cs229.stanford.edu/notes/cs229-notes1.pdf). I performed the 
following experiment to determine whether CEE was working properly:
https://github.com/kwecht/NeuroLab/blob/master/test_cee.py

In summary: I show that a neural network using CEE, one logistic-sigmoid output 
node, and no hidden layers produces the same results as logistic regression. 
The optimal cost function value is the same to 6 significant figures, and 
network weights/regression coefficients are the same to 3 significant digits. I 
use this as confirmation that CEE and the CEE derivative are working properly. 
If they were not, I don't know how I could get the same results. 

This results of the experiment above was convincing to me, but if the results 
are not definitive evidence of the correct CEE and derivative, please let me 
know, I would like to understand why.

Kevin

I added regularization to Neurolob v 0.3.5 and CEE. 
For regularization, I did't change error funcs. All changes in train process.
Example 
http://nbviewer.ipython.org/urls/neurolab.googlecode.com/svn/trunk/example/Neuro
lab%20-%20Regularization.ipynb

Thx Kevin. I referred you in the CHANGELOG