Schema Differencing - How Are You All Coping??

We have globally deployed both OPM and OPPID, and currently are struggling now with the most-recent updates to the SS5 series because there are backbone schema updates that have occurred.  We have a global dataset which we have deployed for our projects, thus allowing us to make singular updates to apply to the breadth of our projects.  With the current OPM refresh update, there is a great fix with respect to Consistency Checker, but to get that fix we need to upgrade our schemas to account for any additions / alterations made over the past 18 months.  THEN, once we've upgraded the schemas, we need to either update our dataset and see if it works for both old and new projects, or create a new version of the dataset just for new projects, etc.

OPPID is even more challenging because we have active projects dating back to 2010, using SS3, SS4, SS5, and now SS5 refresh 1, and also SS5 refresh 2.  We grew accustom to the schema changes across major SS versions, but now there are updates within the refreshes.  Deployment is a nightmare for OPPID not only for new project setups but for the ability to potentially leverage content across projects which carry similar data requirements.

Has anyone else experienced these schema update challenges?  Schema Differencing is a "treat"...any ideas on a potential EASY button?  Is it possible for updates to simply have new supplemental schemas with updates thus not requiring updates to base schema files?  (I know some changes cannot be made without modifying the base, but maybe updates of that nature should be restricted to major releases)?

Not sure there is a point to this posting, but I hope it generates some virtual discussion...

Parents
  • Hi Brent,
    I feel your pain... Well, part of it anyway.
    I've recently finished updating our OPM build to 440. I knew the Schema Differencing tool wasn't all that great, but I'd hoped that with 440 things would be better. I was not exactly surprised to find it wasn't. To do my upgrade, I manually updated the 440 schemas with the changes I had done previously, a time consuming and extremely tedious process to say the least. I skipped OPPID for now as we've decided it isn't a workable solution for us at this time.
    To mitigate the migration pains in the future I also had the idea of using custom supplemental schemas to isolate changes, but that quickly went out the window. At this point I can only be glad that our environment is not highly configured, but it is heading that way as time marches on.
    I've had a long-standing problem with the way Bentley handles administrative tools in general, and OPM/PID is no exception to this. I've filed quite a few CR's over the years trying to get the administrative tools enhanced (not just OP) with no real advancement so far. Perhaps if more folks jumped on this bandwagon Bentley will start listening and realize that the tools are nothing if they cannot be more easily managed.

    Scott
Reply
  • Hi Brent,
    I feel your pain... Well, part of it anyway.
    I've recently finished updating our OPM build to 440. I knew the Schema Differencing tool wasn't all that great, but I'd hoped that with 440 things would be better. I was not exactly surprised to find it wasn't. To do my upgrade, I manually updated the 440 schemas with the changes I had done previously, a time consuming and extremely tedious process to say the least. I skipped OPPID for now as we've decided it isn't a workable solution for us at this time.
    To mitigate the migration pains in the future I also had the idea of using custom supplemental schemas to isolate changes, but that quickly went out the window. At this point I can only be glad that our environment is not highly configured, but it is heading that way as time marches on.
    I've had a long-standing problem with the way Bentley handles administrative tools in general, and OPM/PID is no exception to this. I've filed quite a few CR's over the years trying to get the administrative tools enhanced (not just OP) with no real advancement so far. Perhaps if more folks jumped on this bandwagon Bentley will start listening and realize that the tools are nothing if they cannot be more easily managed.

    Scott
Children
  • I totally agree with all your comments Scott & Brent. When I started implementing OPM late last year it quickly dawned on me this was going to be an administration nightmare. There needs to be better mechanisms to achieve this. I would like more detailed reports on what's changed /added in the new releases. This will make it far easier to see if the benefits are there to go through the upgrade process for that release.
    I agree, if Bentley could package and deliver new schema changes into a better fashion it would make the upgrade process a lot less daunting.

    So far I'm having to go down the same path. Deploy new schemas then re-apply all my changes previously made. The margin for error will always be there using this method and I will constantly have to be re-testing configuration.

    I've just moved onto implementing PowerPID and it appears I will face the same challenges.

    I hope others have some comments too.
    Ben
  • Thanks Scott and Brent for bringing out some very good points. We have received similar requests and as mentioned few CRs were also logged to enhance not only the user experience but add capability and functionality for administration tools. It not only is related to schema differencing, upgrades but also towards other areas of project setup, configuration and administration during the project life cycle.

    This actually aligns with our planned product development roadmap, and to cater for this exact need, we have been working on creating a brand new tool "OpenPlant Project Administrator". I would encourage you to join a introductory webinar on its upcoming release. You can register at:

    http://pages.info.bentley.com/webinars/

    With this tool you will find many improvements in project creation, configuration, tagging (defining expressions on ec properties) and schema management.

    Schema differencing and upgrade is something we are currently working on and is not part of the early Q2 release. The schema update feature is planned for late July 2015 release. The idea is to present users with change sets or lists the fixes, enhancements for which any schema change occurred. So instead of trying to figure out individual changes, all schema upgrade will be automatically done based on your choice of opting to include an upgraded feature or not. All of your existing changes are retained and any clashes (if properties are changed in our new version of out of the box schemas) are reported and resolved. In this way you will not need to select individual schemas as you do now with class editor but for a particular feature change all schemas changes will be automatically done through an interface which will show you all the changes and details. It may be a good idea to engage you more and show this in more detail once this is part of certified alpha builds and get feedback.

    I appreciate the comments provided looking forward to you using OpenPlant Project Administrator.

    Regards,
    Abbas

     

  • That’s exciting news Abbas. Looking forward to giving it a try.

    We have had success with a similar process of comparing the delivered workspaces for each version to create a delta file which includes only changed classes and properties. We can then review to determine if we will accept changes or not and update our 4 business line configurations accordingly. This works well when updates to the OPM and OPPID tools are delivered separately but can become frustrating when we are updating both tools such as with the OPM 440 and OPPID 523 release. We have found that the common files delivered with both tools (Open plant and supplemental) are not always identical. I assume that these files branched when development of the next build started but were not conformed before being packaged into the delivered workspace. The result is two copies of the same file showing different changes.

    Ultimately, I am still hoping that you will consider making OPM and OPPID honor the priority of customer created supplemental files rather than hardcoding functions to read specific supplemental files. This would allow us to segregate a high percentage of our changes to a set of corporate, business line, and project supplemental files.

    Kris Wishart

    Lead Mechanical Admin

    Black & Veatch

  • Abbas, did this make it in??
    "Schema differencing and upgrade is something we are currently working on and is not part of the early Q2 release. The schema update feature is planned for late July 2015 release. The idea is to present users with change sets or lists the fixes, enhancements for which any schema change occurred. So instead of trying to figure out individual changes, all schema upgrade will be automatically done based on your choice of opting to include an upgraded feature or not. All of your existing changes are retained and any clashes (if properties are changed in our new version of out of the box schemas) are reported and resolved. In this way you will not need to select individual schemas as you do now with class editor but for a particular feature change all schemas changes will be automatically done through an interface which will show you all the changes and details. It may be a good idea to engage you more and show this in more detail once this is part of certified alpha builds and get feedback."

    After a minimal poke around in the new OP Project Admin and Class Editor, I'm not seeing what is described above.
    Can you confirm if and where this schema differencing is please?
    Thanks
    Ben