query: Why is gradient descent and it's variants used instead of BFGS and L-BFGS for training neural nets?
positive_passages.docid: 145417
positive_passages.text: Why it is popular to use stochastic gradient descent in neural networks rather than the BFGS algorithm?
negative_passages.docid: 62842
negative_passages.text: Most common method for deciding when to stop training a neural net on a batch
negative_passages.docid: 98554
negative_passages.text: Deep NNs, backpropagation and error calculation
negative_passages.docid: 149346
negative_passages.text: What are the differences between Ridge regression using R's glmnet and Python's scikit-learn?
negative_passages.docid: 11553
negative_passages.text: Why bother with the dual problem when fitting SVM?
negative_passages.docid: 59635
negative_passages.text: Stochastic gradient descent Vs Mini-batch size 1
negative_passages.docid: 72547
negative_passages.text: Textbook on the *theory* of neural nets/ML algorithms?
negative_passages.docid: 41356
negative_passages.text: Reason for square images in deep learning
negative_passages.docid: 74904
negative_passages.text: Random initialization/order in neural network — bias or variance?
negative_passages.docid: 38075
negative_passages.text: What is the trade-off between batch size and number of iterations to train a neural network?
negative_passages.docid: 156390
negative_passages.text: Gradient Boosting for Linear Regression - why does it not work?
negative_passages.docid: 19651
negative_passages.text: What are the advantages of ReLU over sigmoid function in deep neural networks?
negative_passages.docid: 84504
negative_passages.text: Discrepancy between calculated and simulated error propagation
negative_passages.docid: 130956
negative_passages.text: Should we average weight decay loss in neural network?
negative_passages.docid: 62703
negative_passages.text: Is Gradient Boosting Regression Tree able to learn linear models
negative_passages.docid: 14183
negative_passages.text: Why Lasso or ElasticNet perform better than Ridge when the features are correlated
negative_passages.docid: 123017
negative_passages.text: How does a back-propagation training algorithm work?