Lawson not running (help) (2)

Mike,
No worries, that's what this community is for. Can you send error messages? you can post them here publicly, or send them on the private message.
I'll also send you a private message now.

Kwane

I'll boot the server so it's clean and then send messages.
Thanks, Kwane.

Here is the transcript of what I did:
Script command is started on Tue Jun 9 11:26:11 2020.
# c^H. cv lsfprod
# cd $GENDIR
# pwd
/lawprd/lsf/gen
# cd bin
# ls
%webstop.sh dbcndusage jqsubmit metaloadtbl startpfbpm
FileClient dbcopy jscluster metaloadwrk startpfem
FourGLClient dbcreate kndef middd startpfrmi
LoadPortalAttributes dbdef laclear middlvdb startpfsch
LoadPortalBookmarks dbdesc lacobrts middlvlib startqueue
LoadPortalGroups dbdoc lacobrts.o middlvmnu stgcmp
LoadPortalMXMenus dbdump ladb middlvpgm stopclient
MQSClient60_c dbfldusage ladeath mkhdr stopjobqueue
MQSClient60_s dbgcontrol ladebug mkproddir stopladb
ScanFileClient dbindusage ladirs mlarw stopladebug
TestInstall.txt dbload laenv modjobqueue stoplase
addExecsToArchive.pl dbmode lafile mrgcfg stoplatm
add_asp_da.pl dbnode lajavarts msggen stoplaw
add_asp_da.sh dbrelusage lajs msgmnt stoppfbpm
addenv dbreorg langdef msgrpt stoppfem
addresourceutil dbrpt lapm nodedef stoppfrmi
addversions dbupdate lapmmimic ocsdump stoppfsch
analyze_stats dburf lapmmon ocsxltmap stopqueue
app_create_delta_readme dbusers larw ora10du su_deljobhst
app_readmefile.pm delas4 lase ora11du su_execjob
app_update_installed_tasks delckpoint laservipc ora12du su_getrptaccess
appinstall delement lasetup oradb10 su_jobschd
appinstallanalysis delfile lashow oradb11 su_jqcontrol
appinstallutils.pm deljobhst lashowio oradb12 su_ladb
applibdiff delmid latm oralibs.10.1.0 su_ladebug
applinstall delphrase laua patchcompile su_lajs
apploadcsv delprod lawappinstall patches_installed_report su_latm
appmetadiff delrpt lawappvmprune path su_lawsec
appmetaload delsys lawbsh permsmaint su_ldarmcfg
apprptchg deltc lawcmp pficcfg su_qcompile
apprtnlst deltemplatelsrdir.pl lawdir pflowimpexp.pl su_qcontrol
appsec delusers lawosh pflowsetProp.pl su_qstatus
appsetup delvallst lawsec pfserv su_queue
appuninstall derfldrpt lctags pftest.pl su_startlase
ascscr dmpappclmphr ldapbind pgftxt su_stopjobqueue
astounix dmpappmsg ldappclmphr pgmdef su_stopladb
batch.pl dmpappphr ldappmsg pgmdef2 su_stoplase
batchanim dmpappvallst ldappphr pgmdoc su_stoplatm
bin dmpcluster ldappvallst pgmdump su_stopqueue
bismark dmpdftxt ldarmcfg pgmload su_tcpexecjobd
bldbpd dmpdict lddocphrases pgmtrndef su_tcpjsd
bldckp dmpfldtxt lddoctxt phraserpt su_tcprmtfiled
bldcluster dmpint ldeconphr pldbsetup su_tcptmd
blddbdict dmplang ldifgen pmenu su_transgen
blddbvers dmplapmerr ldjobqdflt populatedirectives su_unldarmcfg
bldddpgm dmppgftxt ldlang prmdump swapdict
bldexpfd dmppi ldprodmenus prmload sysdelfile
bldibmddl dmpprodmenus ldtitle prmstrctgen sysdump
bldibmsec dmpscrtxt lduniveng proddadi sysload
bldiortns dmpsecdict ldunivlibs prtdef tcpexecjob
bldlarpt dmptitle ldunivmenus prtdict tcpexecjobd
bldlibloc dmpuniveng ldunivtkns prtgrpdef tcpjsd
bldmicdict dmpunivlibs ldunvmsg prtgrprpt tcprmtfiled
bldmsg dmpunivmenus ldunvphr prtmgr tcptm
bldopd dmpunivtkns led prtpath tcptmd
bldora10ddl dmpunvmsg libdef qcompile tdc
bldora10sec dmpunvphr libdump qcontrol termtype
bldora11ddl docname libload qstatus termutil
bldora11sec dsprpt licsta queue testLibrary
bldora12ddl dstlstgrpdef loadhelp rcvcntl testatt
bldora12sec dstlstgrprpt loadrpts rdlarpt testchr
bldpgm dumphelp loadusers rebuild testgra
bldprtrs editda loadusers.hos rebuildatch testkbd
bldrpt edittd loan recdef titlerpt
bldsecdict elmgrpdef loccmp recrpt tknsecrpt
bldsh envrelease locdef redefscr tmcontrol
bldxffiles execjob lsconfig rmbasicsmoketest tmdump
bsisetup expsysdb lsdelete rmldapbuildutil tmmon
calc faxit lsdump rngdbdump tokendef
caldef faxit.rem lsfdb2start.sh rngdump transgen
checkibmplan fileinfo lsfdb2start.sh.130221 rpgdb tranxml
chkdbstamp filepop lsfdb2start.sh.200605 rpgerrmsg truncfile
chkrec fileuse lsfdb2stop.sh rpghlp ujobdump
cleanprt fix_stale_urp_records lsfdb2stop.sh.130221 rpgio ujobload
cmc fldrpt lsfdb2stop.sh.200605 rpgmsgmnt univsec
cmpdict flxelmdef lsfldapstart.sh rpgname univver
cmpint fmtlarpt lsfldapstart.sh.200605 rpgxio unixtoas
cmprts fpd lsfldapstop.sh rptdef unjs
cmptfxcaibm fsutil lsfldapstop.sh.200605 rptgen unldarmcfg
cmptfxcaora fws lsfstart.sh rptmap unpm
cmptfxibm10 gen.cnt lsfstart.sh.200605 rtsldr unvmnurpt
cmptfxibm9 gendbload lsfstartall.sh rulerpt updatchfile
cmptfxora10 genformap lsfstartall.sh.200605 runrpt updatchorph
cmptfxora9 getdictrundir lsfstop.sh runscr updateArchive.pl
cndload getpwnam lsfstop.sh.200605 scclsrpt upgelmdef
cndrpt getrptaccess lsfstopall.sh scdatrpt upgelmstatus
cntnode grpdef lsfstopall.sh.130221 scrdef upgelmuse
cnv70rpt hd lsfstopall.sh.200605 scrgen upgenvgrps
cnv70scr hlpgen lsinteg scrrpt upgmsgs
cnvexp ibmdb lsload scusrrpt upgradeoravarchars
cnvimp ibmdu lstinvk secdump usercndrpt
cnvjobstep ileio lstprodatch secinteg userdoc
cnvrecjobs impcsv lstver secload usergrpdef
cnvrpgnames impexp lx secrptbtch usergrprpt
cnvrpt importdb mach secupgdschema usersec
cnvrpt76 instsh maketypetree setdbstamp vallstrpt
cnvscr jbsubmit menudef setdbvers verifyibm
cnvtape jobdef menurpt setgenloc verifyora10
cobanim jobdump metadumpelm setnmr verifyora11
cobcmp jobinq metadumplib setnotused verifyora12
core jobinteg metadumpmnu setsfl vldbtchprms
count jobload metadumpmsg skndef vwdblog
createjobdef jobprmrpt metadumppgm source_versions_report webstart.sh
createprodline jobqgrpdef metadumpskn sqldbcopy webstop.sh
cse jobqgrprpt metadumpsys srgen webstopall.sh
csvdef jobrpt metadumptbl srxmlgen workdef
ctmaint jobschd metadumpwrk ssoconfig workdump
cv.env jobstatus metaloadelm ssosmoketest workload
cvx.env jqaction metaloadlib startjobqueue wtsubmit
cwf jqcontrol metaloadmnu startladb xferreq
dbadmin jqdef metaloadmsg startladebug xlarw
dbatables jqdflt metaloadpgm startlase xltrpt
dbatables11 jqrpt metaloadskn startlatm xscrgen
dbatables12 jqstatus metaloadsys startlaw
# start ^Hd^Hladb
ladb 9.0.1.13.539 2014-02-27 04:00:00 started, pid = 9306122
# start^C
# ls *ldap*
ldapbind ldappmsg ldappvallst lsfldapstart.sh.200605 lsfldapstop.sh.200605
ldappclmphr ldappphr lsfldapstart.sh lsfldapstop.sh rmldapbuildutil
# lsfldapstart.sh
Starting LDAP ......

GLPSRV041I Server starting.
GLPCTL113I Largest core file size creation limit for the process (in bytes): '-1'(Soft limit) and '-1'(Hard limit).
GLPCTL119I Maximum Data Segment(Kbytes) soft ulimit for the process is -1 and the prescribed minimum is 262144.
GLPCTL119I Maximum File Size(512 bytes block) soft ulimit for the process is -1 and the prescribed minimum is 2097151.
GLPCTL119I Maximum Open Files soft ulimit for the process is -1 and the prescribed minimum is 500.
GLPCTL119I Maximum Physical Memory(Kbytes) soft ulimit for the process is -1 and the prescribed minimum is 262144.
GLPCTL122I Maximum Stack Size(Kbytes) soft ulimit for the process is 4194304 and the prescribed minimum is 65536.
GLPCTL119I Maximum Virtual Memory(Kbytes) soft ulimit for the process is -1 and the prescribed minimum is 1048576.
GLPCOM024I The extended Operation plugin is successfully loaded from libevent.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libtranext.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libldaprepl.a.
GLPSRV155I The DIGEST-MD5 SASL Bind mechanism is enabled in the configuration file.
GLPCOM021I The preoperation plugin is successfully loaded from libDigest.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libevent.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libtranext.a.
GLPCOM023I The postoperation plugin is successfully loaded from libpsearch.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libpsearch.a.
GLPCOM025I The audit plugin is successfully loaded from libldapaudit.a.
GLPSCH046W EQUALITY Matching Rule 2.5.13.2 for attribute lwsnSvcPropValueBinary is not compatible with its syntax 1.3.6.1.4.1.1466.115.121.1.5
GLPSCH046W EQUALITY Matching Rule 2.5.13.2 for attribute lwsnssoPropBinValue is not compatible with its syntax 1.3.6.1.4.1.1466.115.121.1.5
GLPCOM024I The extended Operation plugin is successfully loaded from libevent.a.
GLPCOM023I The postoperation plugin is successfully loaded from libpsearch.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libpsearch.a.
GLPCOM022I The database plugin is successfully loaded from libback-config.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libevent.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libtranext.a.
GLPCOM023I The postoperation plugin is successfully loaded from libpsearch.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libpsearch.a.
GLPCOM022I The database plugin is successfully loaded from libback-rdbm.a.
GLPCOM010I Replication plugin is successfully loaded from libldaprepl.a.
GLPSRV189I Virtual list view support is enabled.
GLPCOM021I The preoperation plugin is successfully loaded from libpta.a.
GLPSRV194I The Record Deleted Entries feature is disabled. Deleted entries are immediately removed from the database.
GLPSRV207I Group conflict resolution during replication is disabled.
GLPSRV200I Initializing primary database and its connections.
GLPRDB126I The directory server will not use DB2 selectivity.
GLPCOM024I The extended Operation plugin is successfully loaded from libloga.a.
GLPCOM024I The extended Operation plugin is successfully loaded from libidsfget.a.
GLPSRV180I Pass-through authentication is disabled.
GLPSRV221I Replication of security attributes feature is disabled.
GLPCOM003I Non-SSL port initialized to 389.
GLPCTL108E Unable to run the command on the directory server instance 'db2inst1' while the admin server is running.
GLPSRV088E The server is unable to run because of initialization error.
***** ldap started ****

ps -ef |grep ldap
db2inst1 9502824 1 0 11:17:59 - 0:00 /opt/IBM/ldap/V6.3/sbin/64/ibmdiradm -I db2inst1
root 9568354 10289256 0 11:29:36 pts/1 0:00 grep ldap
root 10289256 9633842 0 11:29:06 pts/1 0:00 /bin/ksh /lawprd/lsf/gen/bin/lsfldapstart.sh
db2inst1 10616910 1 0 11:29:31 pts/1 0:00 /opt/IBM/ldap/V6.3/sbin/64/ibmslapd -I db2inst1
# lase
Tue Jun 9 11:30:05 2020: Trying to test connection to Security server ''.
Tue Jun 9 11:30:06 2020: Trying to test connection to Security server ''.
Security environment not running.
# startlase
lase: security environment 9.0.1.13.579 2014-04-08 04:00:00 started.
# lase
Tue Jun 9 11:30:22 2020: Trying to test connection to Security server ''.
Security environment running.
# startlaw
Security Environment already started.
Waiting on security connection...
ladb (main): Database server already running.
latm: transaction manager 9.0.1.13.539 2014-02-27 04:00:00 started, pid = 6946944.
lajs: job server 9.0.1.13.699 2014-08-06 04:00:00 started, pid = 7536820.
queue: compile queue server 9.0.1.13.539 2014-02-27 04:00:00 started, pid = 7536822.
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
Nested exception:
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
at com.lawson.rdtech.db.api.DBJni.jniTsOpenDBFile(Native Method)
at com.lawson.rdtech.db.api.DBInternalFile.open(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.create(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.checkOut(Unknown Source)
at com.lawson.rdtech.db.api.DBDataAreaFactory$PooledDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getRows(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getAllRecords(Unknown Source)
at com.lawson.bpm.db.model.abstracts.DatabaseModelImpl.getAllEventServerRecord(Unknown Source)
at com.lawson.bpm.eventmanager.EventMgr.isEventMgrRunning(Unknown Source)
at com.lawson.bpm.eventmanager.EventMgr.main(Unknown Source)

com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
Nested exception:
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
at com.lawson.rdtech.db.api.DBJni.jniTsOpenDBFile(Native Method)
at com.lawson.rdtech.db.api.DBInternalFile.open(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.create(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.checkOut(Unknown Source)
at com.lawson.rdtech.db.api.DBDataAreaFactory$PooledDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getRows(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getAllRecords(Unknown Source)
at com.lawson.bpm.db.model.abstracts.DatabaseModelImpl.getAllEventServerRecord(Unknown Source)
at com.lawson.bpm.eventmanager.EventMgr.removeAllServerEntries(Unknown Source)
at com.lawson.bpm.eventmanager.EventMgr.main(Unknown Source)

com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
Nested exception:
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
at com.lawson.rdtech.db.api.DBJni.jniTsOpenDBFile(Native Method)
at com.lawson.rdtech.db.api.DBInternalFile.open(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.create(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.checkOut(Unknown Source)
at com.lawson.rdtech.db.api.DBDataAreaFactory$PooledDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getRows(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getAllRecords(Unknown Source)
at com.lawson.bpm.db.model.abstracts.DatabaseModelImpl.getAllEventServerRecord(Unknown Source)
at com.lawson.bpm.eprocessserver.EProcessServer.isPflowServerRunning(Unknown Source)
at com.lawson.bpm.eprocessserver.EProcessServer.main(Unknown Source)

ProcessFlow RMI Server is running on 192.168.120.187:16003
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
Nested exception:
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
at com.lawson.rdtech.db.api.DBJni.jniTsOpenDBFile(Native Method)
at com.lawson.rdtech.db.api.DBInternalFile.open(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.create(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.checkOut(Unknown Source)
at com.lawson.rdtech.db.api.DBDataAreaFactory$PooledDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getRows(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getAllRecords(Unknown Source)
at com.lawson.bpm.db.model.abstracts.DatabaseModelImpl.getAllEventServerRecord(Unknown Source)
at com.lawson.bpm.eventmanager.EventMgr.isEventMgrRunning(Unknown Source)
at com.lawson.bpm.eventmanager.EventMgr.main(Unknown Source)

Event Manager is not running
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
Nested exception:
com.lawson.rdtech.opf.OPFRuntimeException:
File LOGAN/WFEVTSERV.
OpenDBFile2 error is Unable to communicate with database driver process (99).
Additional information is 1167.
at com.lawson.rdtech.db.api.DBJni.jniTsOpenDBFile(Native Method)
at com.lawson.rdtech.db.api.DBInternalFile.open(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.create(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.util.ObjectPool.internalCheckOut(Unknown Source)
at com.lawson.rdtech.db.api.DBFileFactory.checkOut(Unknown Source)
at com.lawson.rdtech.db.api.DBDataAreaFactory$PooledDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.rdtech.db.api.DBDataArea.openFile(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getRows(Unknown Source)
at com.lawson.bpm.db.model.impl.thindb.ThinDBImplBase.getAllRecords(Unknown Source)
at com.lawson.bpm.db.model.abstracts.DatabaseModelImpl.getAllEventServerRecord(Unknown Source)
at com.lawson.bpm.eprocessserver.EProcessServer.isPflowServerRunning(Unknown Source)
at com.lawson.bpm.eprocessserver.EProcessServer.main(Unknown Source)

ProcessFlow Server is not running
ProcessFlow Scheduler is not running
# dbmode -p
Multi user mode
# exit

Script command is complete on Tue Jun 9 11:31:56 2020.

I recall this now. There’s something broken with that webstop.sh script

Thank you, Kwane, for helping again! Lawson is up.

No worries.