Slow data load due to insufficient resources


 Product(s):APM Implementation and Performance Management
 Version(s):7
 Environment:N/A
 Area:N/A
 Subarea:N/A

Problem Description

User was in urgent need to load 100K Assets and Asset Hierarchy but the processing job was running to slowly.

Solution

Data loads are resource intensive actions. Unseen to the user, individual item data loads may need to lock and write to several different classes to complete the action and may take several seconds to process per record. When running a data load, user should ensure they they are set to run when few end users are actively using APM and should not run concurrent with other resource intensive actions such as PM Generation in APM or taking Back-ups/transactional back-ups of the database. Making these adjustments, especially turning off the transactional back-ups will greatly improve the available resource on the servers to complete the data load.

In addition, multiple Job Transaction Brokers can be set to run in parallel to process through the records and use all available resource. This can allow in most cases the loading of 100K + records per day, depending on the objects loaded.

In all cases, when planning for large data loads please contact Cohesive Group or Bentley APM Support for help setting this up.