Skip to main content

WHAT IS BOOSTING

                                                 BOOSTING

What is Boosting?

Boosting and Bagging algorithms are belonging to the ensemble learning techniques.

Boosting refers to converting weak learners into Strong learners.

what are weak learners?

if our base model predicts wrongly(like spam mail as not spam) the features are called weak learners.

weak learners are nothing but the 

To convert Weak learners into strong learners we generally apply weights.

Let's take an example.

Note:-The base learner may be any model like decision Tree, SVM, etc...

we have a dataset with 100 features, in the ensemble technique we have base learners here what we do is we take some amount of data in the first base learner.

in our first base learner model, the model predicts some features are not predicted well These wrongly predicted features are called weak learners.

In the next base learner, we take this weak learner and some other features from the dataset we will do the same procedure here also we will get some other weak learners.

After applying base learners at some stage we get a pure model.

To convert weak learner to strong learner, we’ll combine the prediction of each weak learner using methods like:

> weighted average.

> Considering prediction has a higher vote.


in this way, the boosting algorithm convert weak learners into strong learners

THE END


 

Comments

Post a Comment

Popular posts from this blog

KNN Interview Questions

                           KNN interview questions 1) Which of the following distance metric can not be used in k-NN? A) Euclidean Distance B) Manhatten Distance c) Hamming Distance E) Minkowski Distance F) Jaccard Distance G) All the above Answer:- G All of these distance metric can be used as a distance metric for KNN 2)Knn is for regression or classification? Answer:- Knn is used for both classification and regression problems. 3) When we use Manhatten Distance? Answer:-Manhatten distance is used for continuous variables. 4) You have given the following 2 statements, find which of these options is/are true in case of k-NN? In the case of very large value of k , we may include points from other classes into the neighborhood, so it leads to overfitting. In case of too small value of k the algorithm is very sensitive to noise.(it will affect our model performance). Answer:-The above two points are answers. 5...
Post a Comment
Read more

SUPPORT VECTOR MACHINE

                 SUPPORT VECTOR MACHINE:- Support vector machine:-it is a type of supervised learning algorithm it is used to solve both classification and regression problem. Note :- It is mostly used for classification problems. what we are going to learn in SVM: a) Support vectors b) Hyperplane c) Marginal Distance d) Linear Separable e) Non-linear separable f) support kernels NOw we will discuss everything in detail. Hyper plane:- in the above diagram, we have drawn three lines(A, B, C) separating two data points (stars and reds) The lines (A, B, C) are called Hyperplanes. Note:- “Select the hyper-plane which segregates the two classes better” i.e  above there are three hyperplanes how to select the best hyperplane? b)Marginal Distance:- When we draw a hyperplane the plane creates two new(------) dotted lines one line above the hyperplane and one line below the hyperplane line. see the below image you will get an ...
Post a Comment
Read more

Multi Linear Regression

                                 MULTI LINEAR REGRESSION Before going into MULTI LINEAR REGRESSION first look into Linear Regression. LINEAR REGRESSION:-It is all about getting the best line for the given data that supports linearity. for Linear regression please check my previous post. In Linear regression, we have only one independent variable and one dependent variable. In Multilinear Regression, we have more than one independent variable and one dependent variable. This is the main difference between Multilinear regression and Linear regression. Formulae for Linear regression and Multilinear Regression is listed below: Evaluation metrics for Multi-linear Regression problems are: a)Mean Absolute error b)Mean Squared error c)Root Mean Squared Error d)..... For Evaluation metrics I had posted another post please check it. For the code part please check my Github In ...
Post a Comment
Read more