combining records from file

Author
Messages
Joan Herzfeldt
Veteran Member
Posts: 74
Veteran Member

    Looking for the best way to combine records using IPA v11 with LSF v10 –on premise

    I have an Inbound delimited file with 65 fields.  I only use around 20 fields.  The records are in no particular order, usually less than 50 records.

    I need to combine the records that have the same number in field-11 (F-11).  There are only 4 fields that have different data if F-11 matches.

    My preference is to create array fields, for the 4 with different data and combine the matching records into one with the different values in the arrays.  What is the best way to do this?

    1. Will the Data Transformation node do this?  I’ve never used the ‘WebSphere Transformation Extender Design Studio’.  According to the documentation it comes with IPA, but I don’t think we even have it installed for me to look at.
    2. We’re on premise so I can use a System Command node and run a script to transform the data.  We’ve used SysCmd node for simple bcp stuff so familiar with setting up the node, but honestly I don’t do a lot of scripting.  Is this something PowerShell can do?  Is there a different/better script language to use?
    3. Other suggestions? 

    I need someone to point me in the right direction.  If the Data Transformation node will do what I need then I’ll figure out how to design the map.  I just don’t want to waste a lot of time looking at it if it’s not designed to do what I need.  Same with the script, I think I can do what I want with PS, but I don’t know the PS commands so can you give me the basic commands I would need and I’ll figure it out the rest.

    Thanks in advance!

    Joan

    Ragu Raghavan
    Veteran Member
    Posts: 468
    Veteran Member
      Can't you just use JavaScript in a Assign node to compare F11 and accumulate the remaining fields in an Array?
      ---