Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-14678

Performance degradation with MySQL repos when creating managed users as delegated admin

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 7.0.0
    • Fix Version/s: None
    • Component/s: Module - Relationships
    • Environment:
      IDM 7.0.0 latest master runs on CentOS7, Java 11, MySQL or Postgres as repo
    • Target Version/s:
    • Story Points:
      5
    • Sprint:
      2020.07 - IDM, 2020.08 - IDM, 2020.09 - IDM

      Description

      When comparing the performance between IDM 7.0.0 and 6.5.0.3, noticed significant throughput drop when creating managed users with relationships(roles and manager) for JDBC based repos(MySQL and Postgres):

          7.0.0 7.0.0 6.5.0.3 6.5.0.3
      Repos difference in percentage throughput
      (users/sec)
      mean response times(ms) throughput
      (users/sec)
      mean response times(ms)
      MySQL -18.75 78 385 96 310
      Postgres -13.1147541 106 283 122 246

       

      Attached are the IDM metrics for different repos and releases from the tests. From the metrics, we can see significant mean response differences between the releases in different modules: The following is taken from metrics for MySQL, F1 is for 6.5.0, F2 is for 7.0.0.

      id : managed.user.create
      F1-mean: 293.1113631004432
      F1-count: 28838
      F2-mean: 365.5955813703023
      F2-count: 29451
      F2-F1 total: 2314409.977846192
      
      id : managed.user.relationship.validate-relationship-fields
      F1-mean: 41.186500198461715
      F1-count: 28838
      F2-mean: 77.09620296078252
      F2-count: 29451
      F2-F1 total: 1082823.980674767
      
      id : managed.role.read
      F1-mean: 3.2907449202217767
      F1-count: 865140
      F2-mean: 4.878547230562228
      F2-count: 880980
      F2-F1 total: 1450947.4789000438
      
      

      To reproduce it using Pyforge:
      Run the following command using the configuration attached(for 6.5.0.3, uncomment #connector_version = 5.1.34)

      :

      -./run-pybot.py -v -c perf -s relationship.CreateManUsersWithRolesManager OpenIDM -

        Attachments

        1. idm-metrics.6.5.0
          33 kB
        2. idm-metrics.7.0.0
          52 kB
        3. idm-metrics.a0952d5
          32 kB
        4. idm-metrics.eb9db00d
          32 kB

          Activity

            People

            • Assignee:
              alin Alin Brici
              Reporter:
              Tinghua.Xu Tinghua.Xu [X] (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: