Leverage the Talend random data generator to spawn records onto a CUSTOMER table residing on the Netezza emulator. Additionally, leverage Talend’s Netezza specific functions for loading to Netezza.
Recently, a client wanted to compare some of the leading data integration tools on the market for their ability to integrate with Netezza. Coming from an Oracle solution most of their existing code was written for singleton transactions and the client needed to take advantage of MPP’s ability to bulk load and bulk transform their data sets. Since Talend’s data integration tool contains a library of Netezza specific functions they were chosen as part of the evaluation. One challenge for the evaluation was that they did not have an existing Netezza server in house as they were still in their acquisition phase. To accomplish the evaluation of Talend’s built-in Netezza functions we utilized the virtual Netezza emulator along with version 5.6 of Talend.
Software Versions and Hardware:
Software Configuration Before you begin, you will need an environment configured with the emulator and Talend.
On Netezza, create the CUSTOMERS table
CREATE TABLE customers (
custid INT
,custfirstname VARCHAR(50)
,custlastname VARCHAR(50)
,custage SMALLINT
,custstreet VARCHAR(100)
,custcity VARCHAR(100)
,custstate VARCHAR(100)
) distribute ON random;
Step 1: In Talend, create a new project and job
Utilizing Talend’s built-in Netezza functionality along with the Netezza emulator we were able to demonstrate how easy it is to develop a Talend job, point to Netezza, and load with randomly generated customer records.