Description

Calculate the evaluation data within time windows for binary classifiction. You can either give label column and predResult column or give label column and predDetail column. Once predDetail column is given, the predResult column is ignored. PositiveValue is optional, if given, it will placed at the first position in the output label Array. If not given, the labels are sorted in descending order.

Parameters

Name Description Type Required？ Default Value
positiveLabelValueString positive label value with string format. String null
timeInterval Time interval of streaming windows, unit s. Integer 3
labelCol Name of the label column in the input table String ✓
predictionCol Column name of prediction. String ✓
predictionDetailCol Column name of prediction result, it will include detailed info. String

Script Example

Code

  1. import numpy as np
  2. import pandas as pd
  3. data = np.array([
  4.     ["prefix1", "{\"prefix1\": 0.9, \"prefix0\": 0.1}"],
  5.     ["prefix1", "{\"prefix1\": 0.8, \"prefix0\": 0.2}"],
  6.     ["prefix1", "{\"prefix1\": 0.7, \"prefix0\": 0.3}"],
  7.     ["prefix0", "{\"prefix1\": 0.75, \"prefix0\": 0.25}"],
  8.     ["prefix0", "{\"prefix1\": 0.6, \"prefix0\": 0.4}"]])
  10. df = pd.DataFrame({"label": data[:, 0], "detailInput": data[:, 1]})
  11. inOp = BatchOperator.fromDataframe(df, schemaStr='label string, detailInput string')
  13. metrics = EvalBinaryClassBatchOp().setLabelCol("label").setPredictionDetailCol("detailInput").linkFrom(inOp).collectMetrics()
  14. print("AUC:", metrics.getAuc())
  15. print("KS:", metrics.getKs())
  16. print("PRC:", metrics.getPrc())
  17. print("Accuracy:", metrics.getAccuracy())
  18. print("Macro Precision:", metrics.getMacroPrecision())
  19. print("Micro Recall:", metrics.getMicroRecall())
  20. print("Weighted Sensitivity:", metrics.getWeightedSensitivity())
  22. inOp = StreamOperator.fromDataframe(df, schemaStr='label string, detailInput string')
  23. EvalBinaryClassStreamOp().setLabelCol("label").setPredictionDetailCol("detailInput").setTimeInterval(1).linkFrom(inOp).print()
  24. StreamOperator.execute()