Linked Questions
208 questions linked to/from What should I do when my neural network doesn't learn?
0 votes
0 answers
53 views
What to do if my LSTM model doesn't learn [duplicate]
I have taken text input then converted to a sequence of values and fed it to LSTM model where my loss is not reducing and accuracy is abnormal. The above image is about training and validation ...
3 votes
0 answers
57 views
Train a neural network for tic tac toe with a genetic algorithm [duplicate]
I was trying to implement a genetic algorithm for the game 'tic tac toe'. How I am doing it at the moment is the following: Initiliaze 50 random networks Let each network play against each network. ...
0 votes
0 answers
55 views
Why is deep neural net with linear activation diverges? [duplicate]
Why is this toy example so difficult for neural net to learn? My guess is that the output of the first hidden layer is not normalized, so propagated gradient is not very stable. I've tried adding <...
0 votes
0 answers
49 views
Validation performance is really problematic; should I give up on increasing the validation performance of my deep learning model? [duplicate]
I am working on a multiclassification problem using time series data. Three datasets are utilized in this study. My deep neural network performs satisfactorily across two different data sets. However, ...
0 votes
0 answers
48 views
What should i do when my recurrent neural network doesn't improve? [duplicate]
I am training an LSTM network using Tensorflow 2, is there a way to debug it to see if its learning or to know what areas should be adjusted ? Is there a way to debug to know if its the data, the ...
0 votes
0 answers
47 views
Multiclass Segmentation Using U-Net: My training loss is not decreasing after certain epoch (accuracy not increasing) [duplicate]
So the problem is to perform a multiclass segmentation (255 classes of crops), and I am using a U-Net model for that. The input images are grayscale and the images of dimensions (128,128,1) are ...
0 votes
0 answers
47 views
Improving MSE: Feed forward network predicting only same output within batches (MSE error) [duplicate]
I am training a feed-forward network on a regression problem (MSE error) to predict a scalar value 1x1 given an input of size Nx1. My batch size is 400 (though this problem is robust to multiple batch ...
0 votes
0 answers
44 views
What am I missing in designing ANN? [duplicate]
I implemented ANN and my dataset have the first 100 data from class 1, and next 100 from class 2,..., and last 100 from class 10 (so I have 10 binary output units). I do back_propagation on my data to ...
-1 votes
1 answer
125 views
How to troubleshoot loss not converging? [duplicate]
I am using a CNN model for a binary classification task, with a total training data of 24000 sampler (Positive to negative sample ratio: 1:10). ...
0 votes
0 answers
39 views
Keras accuracy not affected by any change in model [duplicate]
I am trying to construct a model for single-label multiclass classification using Keras in a Jupyter notebook. Here's my model (or see full jupyter notebook): ...
1 vote
0 answers
39 views
Keras NN - loss gets stuck at 8.6791 [duplicate]
What does it mean when my neural network always gets stuck at the exact number 8.6791 when I use binary-crossentropy loss? Some strange local minimum? It happens regardless of my learning rate, ...
0 votes
0 answers
37 views
Unable to learn weights of a Word2Vec model [duplicate]
I was going to implement a word embedding model - namely Word2Vec - by following this TensorFlow tutorial and adapting the code a little bit. Unfortunately, though, my model won't learn anything. I've ...
2 votes
0 answers
35 views
Backprop working on output layer but not hidden layer [duplicate]
I wrote a program to classify MNIST with a vanilla neural net using sigmoid activation and back-propagation training. I tried to work through the math myself (because I want to understand things ), ...
0 votes
0 answers
32 views
MLPRegressor with 'lbfgs' algorithm incredibly bad performance [duplicate]
I can't manage to train the MLPRegressor with 'lbfgs' algorithm to better R2 score than around -14. How comes? First I tried randomly guess the hidden layers shape, then I even tried to use Grid ...
0 votes
1 answer
42 views
Neural network Logic Errors [duplicate]
I was working on a neural network project that uses this dataset; https://archive.ics.uci.edu/dataset/320/student+performance. The data has two main types of data. It has binaries (0 or 1) and ...