Welcome to the Bagging Regression Trees project’s documentation!

• Introduction
  • Research Question
  • Overview for the project
  • How to run parts of the code? How to replicate the output myself?
• Overview and explanations for different design choices
  • Choices of classes instead of simple modules with functions
  • Different RandomSeeds within the Simulations
  • Speed-up Considerations
  • Violation of Python Conventions
• Main Algorithms and Model code
  • The BaggingTree class
  • The DataSimulation class
  • The MonteCarloSimulation class
• Main Calculations and Simulations
  • Theoretical Calculations
    • Simulating the convergence for the finite sample case
    • Calculations for the introductory example
    • Calculations for stump predictors using subagging
  • Main Simulations
    • The Case of Subagging
    • Varying the Number of Bootstrap Iterations
    • Varying the Complexity of the Regression Trees
  • Real Data Simulations using the Boston Housing Data
• Visualization and Results Formatting
  • Figures for the Theory Simulations and Calculations
    • Figure 2 - Simulating the convergence of the predictor
    • Figure 3 - Bias, Variance and MSE of the predictor in the introductory example
    • Figure 4 - Bias, Variance and MSE for the stump predictor
  • Figures and Table for the Main Simulations
    • Table 1 - The bagged Tree compared to the unbagged Tree
    • Figure 5 - The bagging Estimator convergences towards a stable value
    • Figure 6 - The effectiveness of Subagging compared to Bagging
    • Figure 7 - The effect of varying the Tree depth
  • Figure for the Real Data Simulation
    • Figure 8 - Bagging and Subagging applied to real data
• Research paper and the presentation
• Model specifications
  • Overview for JSON files
    • boston_settings.json
    • convergence_settings.json
    • finite_sample_settings.json
    • general_settings.json
    • normal_splits_settings.json
    • settings_plotting.json
    • subagging_settings.json
    • toy_example_settings.json
    • tree_depth_settings.json
• References