Description

Intersect two batch operators. It returns records that exist in both batch operators. Duplicated records are removed.

Parameters

Name Description Type Required? Default Value

Script Example

Code

  1. URL = "http://alink-dataset.cn-hangzhou.oss.aliyun-inc.com/csv/iris.csv"
  2. SCHEMA_STR = "sepal_length double, sepal_width double, petal_length double, petal_width double, category string";
  3. data1 = CsvSourceBatchOp().setFilePath(URL).setSchemaStr(SCHEMA_STR)
  4. data2 = CsvSourceBatchOp().setFilePath(URL).setSchemaStr(SCHEMA_STR)
  5. intersectOp = IntersectBatchOp()
  6. output = intersectOp.linkFrom(data1, data2)