Linked Questions
208 questions linked to/from What should I do when my neural network doesn't learn?
46 votes
3 answers
125k views
Training loss increases with time [duplicate]
I am training a model (Recurrent Neural Network) to classify 4 types of sequences. As I run my training I see the training loss going down until the point where I correctly classify over 90% of the ...
2 votes
1 answer
4k views
Does not being able to overfit a single training sample mean that the neural network architecure or implementation is wrong? [duplicate]
Is the following hypothesis true ? If a simple neural network cannot overfit a single training sample, there is something wrong with its architecture or its implementation. To give you more ...
0 votes
1 answer
7k views
Setting up a MLP for binary classification with tensorflow [duplicate]
I have some troubles trying to set up a multilayer perceptron for binary classification using tensorflow. I have a very large dataset (about 1,5*10^6 examples) each with a binary (0/1) label and 100 ...
1 vote
1 answer
3k views
Binary Classification of Numeric Sequences with Keras and LSTMs [duplicate]
I'm attempting to use a sequence of numbers (of fixed length) in order to predict a binary output (either 1 or 0) using Keras and a recurrent neural network. Each training example/sequence has 10 ...
1 vote
1 answer
3k views
My loss is either 0.0 or randomly very high - Tensorflow [duplicate]
I am making a CNN with 6 classes. The 8400 training samples are batched into 84 batches of size 100. I run the model and print out the loss after every batch, the loss is always either 0.0 or some ...
1 vote
1 answer
3k views
Why does a neural network have the same output for every item in a batch? [duplicate]
I am trying to train a small MLP in Pytorch. Here is the code for the net: ...
0 votes
0 answers
4k views
improving fitting results of neural network [duplicate]
I've trained fitnet network for prediction steel's yield stress with MATLAB ann toolbox. The neural network should predict yield stress. I have about 250 vector ...
1 vote
1 answer
2k views
Neural Network cannot learn a simple function [duplicate]
I am trying to train a simple neural network for regression, where the underlying function is a quadratic. Training data is generated by this underlying function, and I am just trying to get a network ...
1 vote
0 answers
3k views
Neural Network is only predicting the mean value PyTorch Regression [duplicate]
I'm trying to learn how to use PyTorch and to do so I pulled some Forex + COVID data I've used with other models in the past to predict the next-day exchange rate. The data has some COVID infection ...
0 votes
1 answer
2k views
Why is my Tensorflow training and validation accuracy and loss exactly the same and unchanging? [duplicate]
I am a beginner to CNN and using tensorflow in general. I have been referring to this image classification guide to train and classify my own dataset. I have 84310 images in 42 classes for the train ...
2 votes
1 answer
2k views
Why is the loss stuck in high plateau? [duplicate]
I'm struggling with my model (below), since despite some hyperparameters tuning i always end with a sudden rise of the loss function and then a 'infinite" plateau. My hypothesis were: -learning ...
3 votes
1 answer
3k views
What could cause my neural network model's loss increases dramatically? [duplicate]
I am training a network to solve a regression problem using Keras. During training, the loss of my model goes directly from 7 to more than 300000 dramatically. Here is the training output: Here is the ...
2 votes
2 answers
2k views
Getting a constant answer while finding patterns with neuralnet package [duplicate]
I'm trying to find patterns in a large dataset using the neuralnet package. My data file looks something like this (30,204,447 rows) : ...
1 vote
0 answers
2k views
Tuning a neural network [duplicate]
I have been designing a neural network to perform predictions on construction item costs. I've developed a core set of predictors that seem to describe the problem space well - they appear to be ...
0 votes
0 answers
2k views
Keras - LSTM loss increasing for each epoch [duplicate]
I'm using Keras to build and train a recurrent neural network. ...