Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-14685

Mean response increased significantly for updating and deleting managed users in stress mode test

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 7.0.0
    • Fix Version/s: None
    • Environment:
      IDM latest master runs on a CentOS7, Java11, MySQL as repo
    • Target Version/s:

      Description

      The test first creates managed users by sending 300 requests per second for 900 seconds, then update the users, then delete the users, the test shows an increase in mean response times from IDM 6.5.0.3 to  7.0.0 for both update and delete:

        6.5.0.3 7.0.0 difference in percentage
      Update 58 112 93.10344828
      Delete 61 158 159.0163934

       

      Attached a metrics collected for the update part(the metrics is not enabled before update), no delete was done after disable metrics in this test.

      To reproduce using pyforge(pyforge config for 7.0.0 is attached), run command:

      run-pybot.py -v -c stress -s idm.crud_on_managed_users.CrudManUsers OpenIDM 

       

      Note that: 

      Didn't test this for DJ as repo neither postgres

      We fixed similar issue earlier: https://bugster.forgerock.org/jira/browse/OPENIDM-14312

      Also see mean response time increases(throughput drop) in perf mode simple managed users update test as well:

        6.5.0.3 6.5.0.3 7.0.0 7.0.0  
        throughput mean response times throughput mean response times Throughput difference
      Update 356 56 314 63 -11.79775281

       

       

        Attachments

        1. update.metrics-dj-7.0.0
          39 kB
        2. update.metrics-dj-6.5.0.3
          39 kB
        3. update.metrics-7.0.0
          65 kB
        4. idm-metrics-6.5.0
          41 kB
        5. delete.metrics-dj-7.0.0
          34 kB
        6. delete.metrics-dj-6.5.0.3
          36 kB
        7. delete.metrics-7.0.0
          58 kB
        8. config.cfg
          10 kB

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Tinghua.Xu Tinghua Xu
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: