Description

The random forest use the bagging to prevent the overfitting.

In the operator, we implement three type of decision tree to increase diversity of the forest.

    id3 cart c4.5
and the criteria is
    information gini information ratio mse

Parameters

Name Description Type Required？ Default Value
featureSubsamplingRatio Ratio of the features used in each tree, in range (0, 1]. Double 0.2
numSubsetFeatures The number of features to consider for splits at each tree node. Integer 2147483647
numTrees Number of decision trees. Integer 10
subsamplingRatio Ratio of the training samples used for learning each decision tree. Double 100000.0
treeType treeType String “avg”
maxDepth depth of the tree Integer 2147483647
minSamplesPerLeaf Minimal number of sample in one leaf. Integer 2
createTreeMode series or parallel String “series”
maxBins MAX number of bins for continuous feature Integer 128
maxMemoryInMB max memory usage in tree histogram aggregate. Integer 64
featureCols Names of the feature columns used for training in the input table String[] ✓
labelCol Name of the label column in the input table String ✓
categoricalCols Names of the categorical columns used for training in the input table String[]
weightCol Name of the column indicating weight String null
maxLeaves max leaves of tree Integer 2147483647
minSampleRatioPerChild Minimal value of: (num of samples in child)/(num of samples in its parent). Double 0.0
minInfoGain minimum info gain when performing split Double 0.0

Script Example

Code

  1. import numpy as np
  2. import pandas as pd
  3. from pyalink.alink import *
  6. def exampleData():
  7.     return np.array([
  8.         [1.0, "A", 0, 0, 0],
  9.         [2.0, "B", 1, 1, 0],
  10.         [3.0, "C", 2, 2, 1],
  11.         [4.0, "D", 3, 3, 1]
  12.     ])
  15. def sourceFrame():
  16.     data = exampleData()
  17.     return pd.DataFrame({
  18.         "f0": data[:, 0],
  19.         "f1": data[:, 1],
  20.         "f2": data[:, 2],
  21.         "f3": data[:, 3],
  22.         "label": data[:, 4]
  23.     })
  26. def batchSource():
  27.     return dataframeToOperator(
  28.         sourceFrame(),
  29.         schemaStr='''
  30.     f0 double, 
  31.     f1 string, 
  32.     f2 int, 
  33.     f3 int, 
  34.     label int
  35.     ''',
  36.         op_type='batch'
  37.     )
  40. def streamSource():
  41.     return dataframeToOperator(
  42.         sourceFrame(),
  43.         schemaStr='''
  44.     f0 double, 
  45.     f1 string, 
  46.     f2 int, 
  47.     f3 int, 
  48.     label int
  49.     ''',
  50.         op_type='stream'
  51.     )
  54. trainOp = (
  55.     RandomForestRegTrainBatchOp()
  56.     .setLabelCol('label')
  57.     .setFeatureCols(['f0', 'f1', 'f2', 'f3'])
  58. )
  60. predictBatchOp = (
  61.     RandomForestRegPredictBatchOp()
  62.     .setPredictionCol('pred')
  63. )
  65. (
  66.     predictBatchOp
  67.     .linkFrom(
  68.         batchSource().link(trainOp),
  69.         batchSource()
  70.     )
  71.     .print()
  72. )
  74. predictStreamOp = (
  75.     RandomForestRegPredictStreamOp(
  76.         batchSource().link(trainOp)
  77.     )
  78.     .setPredictionCol('pred')
  79. )
  81. (
  82.     predictStreamOp
  83.     .linkFrom(
  84.         streamSource()
  85.     )
  86.     .print()
  87. )
  89. StreamOperator.execute()

Result

Batch prediction

  1.     f0 f1  f2  f3  label  pred
  2. 0  1.0  A   0   0      0   0.0
  3. 1  2.0  B   1   1      0   0.0
  4. 2  3.0  C   2   2      1   1.0
  5. 3  4.0  D   3   3      1   1.0

Stream Prediction

  1. f0    f1    f2    f3    label    pred
  2. 0    2.0    B    1    1    0    0.0
  3. 1    4.0    D    3    3    1    1.0
  4. 2    1.0    A    0    0    0    0.0
  5. 3    3.0    C    2    2    1    1.0