Linked Questions
16 questions linked to/from How does Keras calculate the accuracy?
1 vote
0 answers
2k views
Objective function vs evaluation metric [duplicate]
I was reading XGBoost's documentation here: https://xgboost.readthedocs.io/en/latest/tutorials/custom_metric_obj.html. It's not immediately clear to me how the objective function and evaluation metric ...
95 votes
3 answers
45k views
What is the difference between loss function and metric in Keras? [duplicate]
It is not clear for me the difference between loss function and metrics in Keras. The documentation was not helpful for me.
47 votes
5 answers
16k views
What is "metrics" in Keras?
It is not yet clear for me what metrics are (as given in the code below). What exactly are they evaluating? Why do we need to define them in the model? Why we can have multiple metrics in one model? ...
20 votes
1 answer
13k views
Loss & accuracy - Are these reasonable learning curves?
I am learning neural networks and I built a simple one in Keras for the iris dataset classification from the UCI machine learning repository. I used a one hidden layer network with a 8 hidden nodes. ...
12 votes
1 answer
7k views
Comparing AUC, log loss and accuracy scores between models
I have the following evaluation metrics on the test set, after running 6 models for a binary classification problem: accuracy logloss AUC 1 19% 0.45 0.54 2 67% 0.62 0.67 3 66% ...
4 votes
1 answer
7k views
How does Keras compute validation accuracy and training accuracy for multi-class classification problems?
I would like to know how Keras computes the validation and training accuracies for multi-class classification problems (i.e., the function used). I set my model compile as follows: model.compile(...
2 votes
1 answer
5k views
Optimizing for accuracy instead of loss in Keras model
If I correctly understood the significance of the loss function to the model, it directs the model to be trained based on minimizing the loss value. So for example, if I want my model to be trained in ...
2 votes
2 answers
4k views
What to do when accuracy increasing but loss is also increasing on validation data?
I'm currently working on a multi-class classification problem which is highly imbalanced. I want to save my model weights for best epoch but I'm confused on which metric I should choose? Here's my ...
2 votes
2 answers
764 views
Understanding keras model.predict
I have gone through this, and this post. However, my question is very specific: If the output of my model.predict() function for a classification problem with class labelled 0 and 1 is something like: ...
0 votes
1 answer
1k views
When do I use scoring vs metrics to evaluate ML performance
hi what is the basic difference between 'scoring' and 'metrics'. these are used to measure performance but how do they differ? if you see the example in the below the cross val is using '...
1 vote
1 answer
655 views
How can I change the training threshold for any learning algorithm in sklearn?
I'm trying to try to train a model using sklearn, however, I want to change the decision threshold to train the model. Most of the result I find in SO are for prediction on test set.
0 votes
1 answer
527 views
Why we use the loss to update our model but use the metrics to choose the model we need? [closed]
First of all,I am confused about why we use the loss to update the model but use the metrics to choose the model we need. Maybe not all of code, but most of the code I've seen does,they use ...
1 vote
1 answer
376 views
Accuracy calculation in keras not matching
Currently doing a multi-label classifier. I receive suspiciously high accuracies (0.94) calling the evaluate method in keras(the evaluate method returns accuracy and loss). I then tried to program ...
2 votes
1 answer
244 views
would we ever compute the cost J(θ) on the *test* set?
I'm pretty sure that the answer is no, but wanted to confirm... When training a neural network or other learning algorithm, we will compute the cost function J(θ) as an expression of how well our ...
3 votes
1 answer
138 views
logistic regression alternative interpretation
I am trying to analyze the data that shows people catch the disease or not. That is, response is binary. I applied logistic regression. Assume the result of the log.reg (logistic regression) is like; ...