Skip to main content

Loss Functions | MSE | MAE | RMSE

         Performance Metrics

The various metrics used to evaluate the results of the prediction are :

  • Mean Squared Error(MSE)
  • Mean Absolute error(MAE)
  • Root-Mean-Squared-Error(RMSE)
  • Adjusted R²

Mean Squared Error:
Mean Squared error is one of the most used metrics for regression tasks.
MSE is simply the average of the squared difference between the target value and value predicted by the regression model. 


As it squares the differences and penalizes (punish)even a small error which leads to over-estimation of how bad the model is.

It is preferred more than other metrics because it is differentiable and hence can be optimized better.



in the above formulae, y=actual value and (yhat) means predicted value by the model.


RMSE(Root Mean Squared Error:

This is the same as MSE (Mean Squared Error) but the root of the value is considered while determining the accuracy of the model.
It is preferred more in some cases because the errors are first squared before averaging which poses a high penalty on large errors. 
This implies that RMSE is useful when large errors are undesired.



Mean Absolute Error:

MAE is the Mean Absolute Error, The difference between the target value and value predicted by the model.
The MAE is more robust to outliers and does not penalize the errors like MSE.
The MAE takes an average of this error from every sample in a dataset and gives an output.
 



Comments

Popular posts from this blog

LSTM

                                                                                  LSTM  we will discuss now each and every stage with the help of the above diagram. State1:Memory View The memory view is responsible for remembering and forget the information based on the context of an input. (you didn't get it, wait now you will understand). In the above diagram, the memory view is the top line.   key points( Ct-1, X, +,  and Ct) . The input is an old memory, X is multiplication which forgets the useless information from the old memory, and " +"   addition lets merge all these things. when we multiply the old memory with '0' the old memory will "0" or if we multiply with vector "1" The old memory won't change. ( what ...

KNN Interview Questions

                           KNN interview questions 1) Which of the following distance metric can not be used in k-NN? A) Euclidean Distance B) Manhatten Distance c) Hamming Distance E) Minkowski Distance F) Jaccard Distance G) All the above Answer:- G All of these distance metric can be used as a distance metric for KNN 2)Knn is for regression or classification? Answer:- Knn is used for both classification and regression problems. 3) When we use Manhatten Distance? Answer:-Manhatten distance is used for continuous variables. 4) You have given the following 2 statements, find which of these options is/are true in case of k-NN? In the case of very large value of k , we may include points from other classes into the neighborhood, so it leads to overfitting. In case of too small value of k the algorithm is very sensitive to noise.(it will affect our model performance). Answer:-The above two points are answers. 5...