Description
Intersect two batch operators. It returns records that exist in both batch operators. Duplicated records are removed.
Parameters
Name | Description | Type | Required? | Default Value |
---|---|---|---|---|
Script Example
Code
URL = "http://alink-dataset.cn-hangzhou.oss.aliyun-inc.com/csv/iris.csv"
SCHEMA_STR = "sepal_length double, sepal_width double, petal_length double, petal_width double, category string";
data1 = CsvSourceBatchOp().setFilePath(URL).setSchemaStr(SCHEMA_STR)
data2 = CsvSourceBatchOp().setFilePath(URL).setSchemaStr(SCHEMA_STR)
intersectOp = IntersectBatchOp()
output = intersectOp.linkFrom(data1, data2)