Row Generator
Description
This transform outputs a specified number of rows. By default, the rows are empty; however they can contain a number of static fields. This transform is used primarily for testing purposes. It may be useful for generating a fixed number of rows, for example, you want exactly 12 rows for 12 months. Sometimes you may use Generate Rows to generate one row that is an initiating point for your pipeline. For example, you might generate one row that contains two or three field values that you might use to parameterize your SQL and then generate the real rows.
Options
Option | Description |
---|---|
Transform Name | Name of the transform this name has to be unique in a single pipeline |
Limit | Sets the maximum number of rows you want to generate |
Fields | This table is where you configure the structure and values of the rows you are generating (optional). |
Never stop generating rows | This option is intended for real-time use cases where you never want to stop the running pipeline. The output of this transform is then used to drive recurring tasks like polling from a file, queue, database, … |
Interval in ms | The interval between generated rows in milliseconds. |
Current row time field name | The optional field name for the Date field containing the time when the current row was generated |
Previous row time field name | The optional field name for the Date field containing the time when the previous row was generated |