Tree boosting has empirically proven to be a highly effective and versatile approach for data-driven modelling. The core argument is that tree boosting can adaptively determine the local neighbourhoods of the model thereby taking the bias-variance trade-off into consideration during model fitting.
Recently, a tree boosting method known as XGBoost has gained popularity by providing higher accuracy. XGBoost further introduces some improvements which allow it to deal with the bias-variance trade-off even more carefully. In this research work, we propose to demonstrate the use of an adaptive procedure i.e. Learned Loss (LL) to update the loss function as the boosting proceeds.
Accuracy of the proposed algorithm i.e. XGBoost with Learned Loss boosting function is evaluated using test/train method, K-fold cross validation, and Stratified cross validation method and compared with the state of the art algorithms viz. XGBoost, AdaBoost, AdaBoost-NN, Linear Regression(LR),Neural Network(NN), Decision Tree(DT), Support Vector Machine(SVM), bagging-DT, bagging-NN and Random Forest algorithms. The parameters evaluated are accuracy, Type 1 error and Type 2 error (in Percentages). This study uses total ten years of historical data from Jan 2007 to Aug 2017 of two stock market indices CNX Nifty and S&P BSE Sensex which are highly voluminous.
Further, in this research work, we will investigate how XGBoost differs from the more traditional ensemble techniques. Moreover, we will discuss the regularization techniques that these methods offer and the effect these have on the models.
In addition to this, we will attempt to answer the question of why XGBoost seems to win so many competitions. To do this, we will provide some arguments for why tree boosting, and in particular XGBoost, seems to be such a highly effective and versatile approach to predictive modelling. The core argument is that tree boosting can be seen to adaptively determine the local neighbourhoods of the model. Tree boosting can thus be seen to take the bias-variance trade off into consideration during model fitting. XGBoost further introduces some improvements which allow it to deal with the bias-variance trade off even more carefully.
Table of Contents
CHAPTER I
Theoretical Foundations
1.1 Outline
1.1.1 AdaBoost
1.1.2 Gradient boosting
1.1.3 XGBoost
1.1.5 Comparison of Boosting Algorithms
1.1.6 Loss Functions in Boosting Algorithms
1.2 Motivation
1.3 Problem Statement
1.4 Scope and Main Objectives
1.5 Impact to the Society
1.6 Organization of the Book
CHAPTER II
Literature Review
2.1 History
2.2 XGBoost
2.3 Random Forest
2.4 AdaBoost
2.5 Loss Function
CHAPTER III
Proposed Work
3.1 Outline
3.2 Proposed Approach
3.2.1 Objective of XGBoost
3.2.2 Parameters
3.2.3 Parameters for Tree Booster
3.2.4 Learning Task Parameters
3.2.5 Training Parameter tuning
3.2.6 What XGBoost Brings to the Table
3.2.7 Square Logistics Loss Function (SqLL)
CHAPTER IV
Results Discussions
4.1 Outline
4.2 Dataset
4.3 Tools and Platforms
4.4 Feature Construction
4.5 Feature Selection
4.6 Training the Model
4.7 Evaluation Techniques
4.8 Analysis of Results
CHAPTER V
Summary, Recommendations, and Future Directions
5.1 Overview
5.2 Summary
5.3 Recommendations
5.4 Future Research Directions
References
-
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X. -
¡Carge sus propios textos! Gane dinero y un iPhone X.