Linked Questions

1 vote
0 answers
2k views

I was reading XGBoost's documentation here: https://xgboost.readthedocs.io/en/latest/tutorials/custom_metric_obj.html. It's not immediately clear to me how the objective function and evaluation metric ...
rishai's user avatar
  • 515
95 votes
3 answers
45k views

It is not clear for me the difference between loss function and metrics in Keras. The documentation was not helpful for me.
Zaratruta's user avatar
  • 2,315
47 votes
5 answers
16k views

It is not yet clear for me what metrics are (as given in the code below). What exactly are they evaluating? Why do we need to define them in the model? Why we can have multiple metrics in one model? ...
DragonKnight's user avatar
  • 1,900
20 votes
1 answer
13k views

I am learning neural networks and I built a simple one in Keras for the iris dataset classification from the UCI machine learning repository. I used a one hidden layer network with a 8 hidden nodes. ...
Ananda's user avatar
  • 3,300
12 votes
1 answer
7k views

I have the following evaluation metrics on the test set, after running 6 models for a binary classification problem: accuracy logloss AUC 1 19% 0.45 0.54 2 67% 0.62 0.67 3 66% ...
quant's user avatar
  • 4,512
4 votes
1 answer
7k views

I would like to know how Keras computes the validation and training accuracies for multi-class classification problems (i.e., the function used). I set my model compile as follows: model.compile(...
user121's user avatar
  • 801
2 votes
1 answer
5k views

If I correctly understood the significance of the loss function to the model, it directs the model to be trained based on minimizing the loss value. So for example, if I want my model to be trained in ...
daniellga's user avatar
  • 1,244
2 votes
2 answers
4k views

I'm currently working on a multi-class classification problem which is highly imbalanced. I want to save my model weights for best epoch but I'm confused on which metric I should choose? Here's my ...
user_12's user avatar
  • 2,189
2 votes
2 answers
764 views

I have gone through this, and this post. However, my question is very specific: If the output of my model.predict() function for a classification problem with class labelled 0 and 1 is something like: ...
Saurabh Verma's user avatar
0 votes
1 answer
1k views

hi what is the basic difference between 'scoring' and 'metrics'. these are used to measure performance but how do they differ? if you see the example in the below the cross val is using '...
TRex's user avatar
  • 495
1 vote
1 answer
655 views

I'm trying to try to train a model using sklearn, however, I want to change the decision threshold to train the model. Most of the result I find in SO are for prediction on test set.
Bhaskar Dhariyal's user avatar
0 votes
1 answer
527 views

First of all,I am confused about why we use the loss to update the model but use the metrics to choose the model we need. Maybe not all of code, but most of the code I've seen does,they use ...
JALS's user avatar
  • 23
1 vote
1 answer
376 views

Currently doing a multi-label classifier. I receive suspiciously high accuracies (0.94) calling the evaluate method in keras(the evaluate method returns accuracy and loss). I then tried to program ...
Rami's user avatar
  • 43
2 votes
1 answer
244 views

I'm pretty sure that the answer is no, but wanted to confirm... When training a neural network or other learning algorithm, we will compute the cost function J(θ) as an expression of how well our ...
Stephen's user avatar
  • 8,985
3 votes
1 answer
138 views

I am trying to analyze the data that shows people catch the disease or not. That is, response is binary. I applied logistic regression. Assume the result of the log.reg (logistic regression) is like; ...
Mel's user avatar
  • 33

15 30 50 per page