Controlling the processing of data using partition strategies ...

4 downloads 90 Views 552KB Size Report
External Script Training Overview. This is the R script version. 1. Introduction to external script interface. 2. Controlling Script Processes – threads and nodes. 3.
Controlling the processing of data using partition strategies

External Script Training Overview

Click here to download the supporting SQL script

This is the R script version 1. 2. 3. 4.

Introduction to external script interface Controlling Script Processes – threads and nodes Controlling Data Processing – partitions Passing parameters through to scripts

Controlling data processing: Partition Strategies Overview • SQL Windowing style syntax controls bucketing and sorting of data • Scripting modes control processing strategy Default / Mixed

Separate

SQL

SQL

Isolate User view of Data in RAM

SQL

RAM Stores Parallel Script Processes Output

Result

Result

Result

Control script input split by declaring partition columns from receives. Using SQL windowing syntax

Controlling data processing: Default Behaviour

create external script Kog_R_AvgOverPartID_Def1 environment rscript receives(Part_ID int, value float) partition by Part_ID sends(Part_ID int, avg1 decimal(10,2), count1 int) Set variables and open script connection via standard S'EOF( input to stream data f

Suggest Documents