Odd Errors in PFlow with record limit over 10000 records

Friends,

My admins and I took the necesssary steps to updating the iosconfig.xml file to change the MAX query length to be 999999.

But now i get some odd behavior in my pflow; what I am doing in the flow is simply pulling all vendors from the lawson table (which has 34k plus records). The query is below.

So running the query below in the pflow (with my full server info) returns me the following error ( I have stripped our server and host information but all works good; plug yours in). But running this in the browser works fine:


++++++++++

Starting Execution of Activities .....
currentDate = Tue Oct 19 2010 09:47:05 GMT-0500 (GMT-05:00)
requestDateTime = 20101019
fileExtractSaveFileName = lr0apvendors.txt
fileExtractSavePath = C:\Documents and Settings\mitchellw\Desktop\
prettyDateTimeStamp = Tue Oct 19 2010 09:47:05 GMT-0500 (GMT-05:00)
testPadPath = C:\Documents and Settings\mitchellw\Desktop\
fileExtract = C:\Documents and Settings\mitchellw\Desktop\lr0apvendors.txt
apvmVendorGroup =
apvmVendor =
apvaAddr1 =
apvaAddr2 =
apvaAddr3 =
apvaAddr4 =
apvaCityAddr5 =
apvaStateProv =
apvaPostalCode =
apvmVendorVName =

Executing ProcessQuery Activity VLQuery.....

Calling host:  user: mitchellw

Query string: PROD=TMP&FILE=APVENMAST&FIELD=VENDOR-GROUP;VENDOR;VENDOR-VNAME;APVENADDR%2EADDR1;APVENADDR%2EADDR2;APVENADDR%2EADDR3;APVENADDR%2EADDR4;APVENADDR%2ECITY-ADDR5;APVENADDR%2ESTATE-PROV;APVENADDR%2EPOSTAL-CODE&OUT=CSV&NEXT=TRUE&NOHEADER=TRUE&DELIM=%7E&MAX=999999

VLQuery_errorCode = 6
VLQuery_informationCode = 0

VLQuery_returnMessage = Error connecting to ?PROD=TMP&FILE=APVENMAST&FIELD=VENDOR-GROUP;VENDOR;VENDOR-VNAME;APVENADDR%2EADDR1;APVENADDR%2EADDR2;APVENADDR%2EADDR3;APVENADDR%2EADDR4;APVENADDR%2ECITY-ADDR5;APVENADDR%2ESTATE-PROV;APVENADDR%2EPOSTAL-CODE&OUT=CSV&NEXT=TRUE=TRUE&DELIM=%7E&MAX=999999&delim=~ with user mitchellw Query string

VLQuery_outputData =

Error while executing ProcessQuery activity

java.lang.Exception: Error connecting to ?PROD=TMP&FILE=APVENMAST&FIELD=VENDOR-GROUP;VENDOR;VENDOR-VNAME;APVENADDR%2EADDR1;APVENADDR%2EADDR2;APVENADDR%2EADDR3;APVENADDR%2EADDR4;APVENADDR%2ECITY-ADDR5;APVENADDR%2ESTATE-PROV;APVENADDR%2EPOSTAL-CODE&OUT=CSV&NEXT=TRUE=TRUE&DELIM=%7E&MAX=999999&delim=~ with user mitchellw Query string

at com/lawson/bpm/coreutils/CGIInvoker.invoke

at com/lawson/bpm/coreutils/CGIInvoker.invoke

at com/lawson/bpm/coreutils/CGIInvoker.invoke

at com/lawson/bpm/database/dme/DmeQuery.doQuery

at com/lawson/bpm/processflow/workFlow/flowGraph/FgaProcessQuery.startActivity

at com/lawson/bpm/processflow/workFlow/flowGraph/FgActivity.execute

at com/lawson/bpm/processflow/workFlow/flowGraph/FgProcess.run

at workFlow/gui/AppView.RunLocally

at workFlow/gui/AppView.mnuRun_click

at workFlow/gui/AppView.toolBarMain_buttonClick

at com/ms/wfc/ui/ToolBarButtonClickEventHandler.invoke

at com/ms/wfc/ui/ToolBar.onButtonClick

at com/ms/wfc/ui/ToolBar.wmReflectCommand

at com/ms/wfc/ui/ToolBar.wndProc

at com/ms/wfc/ui/Control$ControlWindow.wndProc

at com/ms/wfc/app/Window.callback

at com/ms/wfc/win32/Windows.SendMessage

at com/ms/wfc/ui/Control.sendMessage

at com/ms/wfc/ui/Control.reflectMessage

at com/ms/wfc/ui/Control.wmCommand

at com/ms/wfc/ui/Control.wndProc

at com/ms/wfc/ui/Form.wndProc

at com/ms/wfc/app/Application$ParkingForm.wndProc

at com/ms/wfc/ui/Control$ControlWindow.wndProc

at com/ms/wfc/app/Window.callback

at com/ms/wfc/win32/Windows.CallWindowProc

at com/ms/wfc/app/Window.defWndProc

at com/ms/wfc/ui/Control$ControlWindow.defWndProc

at com/ms/wfc/ui/Control.defWndProc

at com/ms/wfc/ui/Control.wmMouseUp

at com/ms/wfc/ui/Control.wndProc

at com/ms/wfc/ui/ToolBar.wndProc

at com/ms/wfc/ui/Control$ControlWindow.wndProc

at com/ms/wfc/app/Window.callback

at com/ms/wfc/win32/Windows.DispatchMessage

at com/ms/wfc/app/Application$ThreadContext.runMessageLoop

at com/ms/wfc/app/Application.run

at workFlow/gui/AppView.main

VLQuery_RECORD_COUNT = 0

RemoveTXTFile_errorCode = 0

RemoveTXTFile_informationCode = 0

RemoveTXTFile_returnMessage = File C:\Documents and Settings\mitchellw\Desktop\lr0apvendors.txt deleted.

RemoveTXTFile_outputData =

File C:\Documents and Settings\mitchellw\Desktop\lr0apvendors.txt deleted.

CreateTXTFile_errorCode = 0

CreateTXTFile_informationCode = 0

CreateTXTFile_returnMessage = 0 bytes written to file C:\Documents and Settings\mitchellw\Desktop\lr0apvendors.txt

CreateTXTFile_outputData =

0 bytes written to file C:\Documents and Settings\mitchellw\Desktop\lr0apvendors.txt

Executing Email Activity Email1980.....

Executing Stop Activity .....

++++++++++++

What looks to be happening is a &delim=~ is being added to my query causing issues, but I already have &DELIM=%7E in there. I think the appending of the lowercased delim is causing me issues first off.

Second, if I change MAX to be some lower number, everything is good. But I cannot set it to the max amount of recrods needing querying though, which is the point of the flow.

So can anyone assist with this? A simple flow has taken me days now to complete. If this is a limitation, can creating a JDBC connection and pulling the database via SQL work to get all 32k plus records back and written to a flat file for our other process to pick up?

Thanks!