Hello Community,
when we are trying to extract a huge amount of data with the ProjectWise Connector for Oracle (SELECTseries 3) we run into problems since the extraction process seems to restart after almost exactly 60 minutes. Afterwards it won't finish or restart again after 60 minutes (see screenshot).
Every extraction process below 60 minutes succeeded but we want more :)
I spoke to my Oracle Admin and he excluded a database timeout since there are other applications with much longer sessions.
Hopefully someone may help us here and can give a hint where to look. Maybe there are limits on Application Server or some parameters set on server site but I don't know where.
Thanks for any help in advance,
Maik
I would of checked the session timeout as you have already done. 60 minutes of extracting to a file is a long time. Did you check in the detailed messages for the "killing job" status item in the job status tool to see if there is further information ? These short messages usually have an explanation as to why the error was encountered.
An idea that we think could give us something: could you please verify if the tablespace used has enough space. It could be that the tablespace runs out of space and the operation gets suspended without giving any error message and resumes automatically after the specified “time out”. It could be that the timeout is set to 60 minutes (it can be set in init.ora file) and after every 60 minutes, it checks If table space is proper or not and resumes automatically.
If the above does not help can you please provide us with the complete error message (right clicking on the message detail in Job status), that may give a hint to the problem.
Regards,Carlos
Thank you so far, I'll ask my DB admin for tablespace information.
The killing job status was caused by myself in order to stop the process after 15 hours and here's the copied status information:
Datasource - ***.**.**.**:Test_SS4Job Id - 954Job Type - ExtractionUser Name - ocFolder Name - pwname:\\***.**.**.**:Test_SS4\Documents\sdo_testDocument Name - get_pr_grossFile Name - get_pr_gross.dgnStart Time - 09.01.2014 15:39:14Last Update - 10.01.2014 07:06:32Last Status - FAILED
2014-01-09 15:39:14 - Recording Job ID: [954].
Bentley.GeoSpatialWorkflow.Orchestration.ContentMgmtExtractionAgentProcessorHandleJobMessage
2014-01-09 15:39:14 - Obtained CM connection params from extraction request message - server[***.**.**.**] datasource[***.**.**.**:Test_SS4] user[oc]Bentley.GeoSpatialWorkflow.Orchestration.ContentMgmtExtractionAgentProcessorGetPWDatasource
2014-01-09 15:39:14 - Datasource login succeeded.Bentley.GeoSpatialWorkflow.Orchestration.ContentMgmtExtractionAgentProcessorHandleJobMessage
2014-01-09 15:39:18 - File has been Checked Out.<request type="GISDataUpdate" id="954"> <parameters documentId="_x0037_8" folderId="_x0035_8" DocumentAccessType="Disconnected" ClipToSpatialCriteria="False" xfmProject="TestSdo" statusCode="PENDING"> <extractionCriteria>_x003C_ECCompoundCriteria_x0020_combinationOperator_x003D__x0022_COMBO_Or ... </extractionCriteria> <extractionLockMode>LockFeaturesOptimistically</extractionLockMode> <coordSystemName>DHDN.Gauss3d-4</coordSystemName> <geodatabase>sdogis_test_x0040_ora11</geodatabase> <workingStorage>xfm</workingStorage> <validTime>_x0032_014_x002C_1_x002C_9_x002C_15_x002C_38_x002C_57</validTime> <datasourceHost>_x0031_**.**.**.**</datasourceHost> <datasourceName>_x0031_**.**.**.**:Test_SS4</datasourceName> <connectorUser>oc</connectorUser> <connectorPassword>**</connectorPassword> <requestingUser>oc</requestingUser> <sdeVersion>LIVE</sdeVersion> <versionDescription>get_pr_gross_x0028_***.**.**.**:Test_SS4_x002F_sdo_test_x0029_</versionDescription> <parentVersion>LIVE</parentVersion> <commit /> </parameters></request>
2014-01-09 15:39:18 - The SelectionCriteria for job 954 has been produced by the ContentMgmtExtractionProcessor.Bentley.GeoSpatialWorkflow.Orchestration.ContentMgmtExtractionAgentProcessorHandleJobMessage
2014-01-09 15:39:18 - Request message for extraction was processed.Bentley.GeoSpatialWorkflow.Orchestration.ContentMgmtExtractionAgentProcessorHandleJobMessage
2014-01-09 15:39:18 - Instance Name:Extraction Message Type number:GISDataUpdate, appropriate.
Bentley.GeoSpatialWorkflow.Orchestration.ContentMgmtExtractionAgentProcessorIsMessageAppropriate
2014-01-09 15:39:18 - Enter method.Bentley.GeoSpatialWorkflow.Orchestration.TranslationDispatcherHandleJobMessage
2014-01-09 15:39:18 - Job [954] is running in fully licensed mode.Bentley.GeoSpatialWorkflow.Orchestration.TranslationDispatcherHandleJobMessage
2014-01-09 15:39:18 - Specified ExtraParameters:<-wsBENTLEY_MAP "-wr\\marksrv3\ocw\Workspace">Bentley.GeoSpatialWorkflow.Orchestration.TranslationDispatcherGetKeyinAugmentedMessage
2014-01-09 15:39:18 - Added extract keyin TRANSGDB2DGN to MicroStationMessage.Bentley.GeoSpatialWorkflow.Orchestration.TranslationDispatcherGetKeyinAugmentedMessage
2014-01-09 15:39:18 - Leaving method.Bentley.GeoSpatialWorkflow.Orchestration.TranslationDispatcherHandleJobMessage
2014-01-09 15:40:11 - Preparing to extract file [\\marksrv3\ocw\files\954\get_pr_gross.dgn]. <request type="GISDataUpdate" id="954" timeStamp="09.01.2014 15:39:18"> <parameters documentId="_x0037_8" folderId="_x0035_8" DocumentAccessType="Disconnected" ClipToSpatialCriteria="False" xfmProject="TestSdo" statusCode="PENDING" textMsg="The_x0020_SelectionCriteria_x0020_for_x0020_job_x0020_954_x0020_has_x0020_been_x0020_produced_x0020_by_x0020_the_x0020_ContentMgmtExtractionProcessor." url="_x005C__x005C_marksrv3_x005C_ocw_x005C_files_x005C_954_x005C_get_pr_gross.dgn"> <extractionCriteria>_x003C_ECCompoundCriteria_x0020_combinationOperator_x003D__x0022_COMBO_Or ... </extractionCriteria> <extractionLockMode>LockFeaturesOptimistically</extractionLockMode> <coordSystemName>DHDN.Gauss3d-4</coordSystemName> <geodatabase>sdogis_test_x0040_ora11</geodatabase> <workingStorage>xfm</workingStorage> <validTime>_x0032_014_x002C_1_x002C_9_x002C_15_x002C_38_x002C_57</validTime> <datasourceHost>_x0031_**.**.**.**</datasourceHost> <datasourceName>_x0031_**.**.**.**:Test_SS4</datasourceName> <connectorUser>oc</connectorUser> <connectorPassword>**</connectorPassword> <requestingUser>oc</requestingUser> <sdeVersion>LIVE</sdeVersion> <versionDescription>get_pr_gross_x0028_1**.**.**.**:Test_SS4_x002F_sdo_test_x0029_</versionDescription> <parentVersion>LIVE</parentVersion> <commit /> </parameters> <MicroStation Configfile="C:\Program Files (x86)\Bentley\ProjectWise Connector for Oracle\config\GISConn.cfg" Project="" ExtraParameters="-wsBENTLEY_MAP "-wr\\marksrv3\ocw\Workspace"" User="sdogis_test_ora11_TestSdo"> <Keyin>mdl load gcsdialog</Keyin> <Keyin>mdl load bentleymap</Keyin> <Keyin>mdl load TranslationCmds</Keyin> <Keyin>TRANSGDB2DGN</Keyin> </MicroStation></request>
TranslationCmdsBuildDgnFromGeodatabase
2014-01-09 15:40:11 - Using Orchestration Framework peek attempt 2 of a maximum 5TranslationCmdsBuildDgnFromGeodatabase
2014-01-09 15:40:11 - Copied seed file: [\\marksrv3\ocw\Workspace\Projects\Examples\Geospatial\sdogis_test_ora11\TestSdo\seed\SEED_SDO.DGN] to new file: [\\marksrv3\ocw\files\954\get_pr_gross.dgn].
TranslationCmdsBuildDgn
2014-01-09 15:40:11 - Translator dgn filename:[C:\Program Files (x86)\Bentley\ProjectWise Connector for Oracle\dgn\GISConnTranslationProcessor5.dgn].
TranslationCmdsGetTranslatorDgnFilename
2014-01-09 15:40:38 - Activated new file [\\marksrv3\ocw\files\954\get_pr_gross.dgn] for extraction.
2014-01-09 15:40:38 - Created a new Schema object for gdb:[sdogis_test@ora11] and workingStorage:[xfm].
TranslationCmdsGetCriteria
2014-01-09 15:40:38 - Created a new Criteria object for geodatabase:[sdogis_test@ora11] workingStorage:[xfm].
2014-01-09 15:40:54 - Created a new StorageTranslator object.
2014-01-09 15:40:54 - Starting extract to file [\\marksrv3\ocw\files\954\get_pr_gross.dgn] from geodatabase [sdogis_test@ora11].TranslationCmdsBuildDgn
2014-01-09 16:40:45 - Preparing to extract file [\\marksrv3\ocw\files\954\get_pr_gross.dgn]. <request type="GISDataUpdate" id="954" timeStamp="09.01.2014 15:39:18"> <parameters documentId="_x0037_8" folderId="_x0035_8" DocumentAccessType="Disconnected" ClipToSpatialCriteria="False" xfmProject="TestSdo" statusCode="PENDING" textMsg="The_x0020_SelectionCriteria_x0020_for_x0020_job_x0020_954_x0020_has_x0020_been_x0020_produced_x0020_by_x0020_the_x0020_ContentMgmtExtractionProcessor." url="_x005C__x005C_marksrv3_x005C_ocw_x005C_files_x005C_954_x005C_get_pr_gross.dgn"> <extractionCriteria>_x003C_ECCompoundCriteria_x0020_combinationOperator_x003D__x0022_COMBO_Or ... </extractionCriteria> <extractionLockMode>LockFeaturesOptimistically</extractionLockMode> <coordSystemName>DHDN.Gauss3d-4</coordSystemName> <geodatabase>sdogis_test_x0040_ora11</geodatabase> <workingStorage>xfm</workingStorage> <validTime>_x0032_014_x002C_1_x002C_9_x002C_15_x002C_38_x002C_57</validTime> <datasourceHost>_x0031_**.**.**.**</datasourceHost> <datasourceName>_x0031_**.**.**.**:Test_SS4</datasourceName> <connectorUser>oc</connectorUser> <connectorPassword>**</connectorPassword> <requestingUser>oc</requestingUser> <sdeVersion>LIVE</sdeVersion> <versionDescription>get_pr_gross_x0028_1**.**.**.**:Test_SS4_x002F_sdo_test_x0029_</versionDescription> <parentVersion>LIVE</parentVersion> <commit /> </parameters> <MicroStation Configfile="C:\Program Files (x86)\Bentley\ProjectWise Connector for Oracle\config\GISConn.cfg" Project="" ExtraParameters="-wsBENTLEY_MAP "-wr\\marksrv3\ocw\Workspace"" User="sdogis_test_ora11_TestSdo"> <Keyin>mdl load gcsdialog</Keyin> <Keyin>mdl load bentleymap</Keyin> <Keyin>mdl load TranslationCmds</Keyin> <Keyin>TRANSGDB2DGN</Keyin> </MicroStation></request>
2014-01-09 16:40:45 - Using Orchestration Framework peek attempt 4 of a maximum 5TranslationCmdsBuildDgnFromGeodatabase
2014-01-09 16:40:45 - Copied seed file: [\\marksrv3\ocw\Workspace\Projects\Examples\Geospatial\sdogis_test_ora11\TestSdo\seed\SEED_SDO.DGN] to new file: [\\marksrv3\ocw\files\954\get_pr_gross.dgn].
2014-01-09 16:40:45 - Translator dgn filename:[C:\Program Files (x86)\Bentley\ProjectWise Connector for Oracle\dgn\GISConnTranslationProcessor5.dgn].
2014-01-09 16:40:46 - Activated new file [\\marksrv3\ocw\files\954\get_pr_gross.dgn] for extraction.
2014-01-09 16:40:46 - Created a new Schema object for gdb:[sdogis_test@ora11] and workingStorage:[xfm].
2014-01-09 16:40:46 - Created a new Criteria object for geodatabase:[sdogis_test@ora11] workingStorage:[xfm].
2014-01-09 16:40:47 - Created a new StorageTranslator object.
2014-01-09 16:40:47 - Starting extract to file [\\marksrv3\ocw\files\954\get_pr_gross.dgn] from geodatabase [sdogis_test@ora11].TranslationCmdsBuildDgn
2014-01-10 07:06:32 - Killing JobBentley.GeoSpatialWorkflow.ServicesKillJobById
2014-01-10 07:06:33 - Job 954 stopped.Bentley.GeoSpatialWorkflow.ServicesKillJobById
Thank you for helping,
Could you please try the following
Access to the Orchestration Framework Administrator (Start > All Programs > Bentley > ProjectWise > Orchestration Framework )
In the left Pane under the Processors node there is a number of entries, probably you will see several “MicroStation Processor” entries. Select one, right-click and go to properties.
In the Component Properties dialog in the General Tab it identifies the name of the processor, change to the Process Management Tab, you will see:
Maximum Memory Usage;The Maximum Single Message Processing Time;Force restart after;Maximum Attempts to Process Message
looking at your log I hope this may be related with the issue.
I am not sure if the same "Processor" will be the used so perhaps we can try to increase the Maximum Memory Usage in all “MicroStation Processor” entries to see if they makes a difference in the extraction. After making the changes I believe it is required to restart the Orchestration Framework. Restart it and then test the extraction again.
Let us know the outcomeRegards,Carlos
Answer Verified By: Maik Schulze
Thank you very much, you pointed to the solution of our problem.
We changed to 90 minutes and it extracted well. Now we're playing with the maximum memory usage to reduce the extraction time.
Thank a lot!
Regads,