Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-14714

Response time increased significantly with certain read operations of managed users with relationship using DS as repo

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: 7.0.0
    • Fix Version/s: 7.0.0
    • Component/s: Module - Relationships
    • Environment:
      IDM 7.0.0 master(c286e03) runs on a CentOS 7 machine, Java11, external DJ(7.0.0-M2020-6.1) as repo. Vs. IDM 6.5.0.3 with DJ 6.5.2
    • Target Version/s:
    • Verified Version/s:
    • Story Points:
      3
    • Sprint:
      2020.07 - IDM, 2020.08 - IDM

      Description

      The test preload 30K users with managed roles and managers, then either read the user w/o link expansion as managed/user/A-A-123 or w/ link expansion on roles like managed/user/A-A-123?_fields=,roles/. Between 6.5.0.3 and 7.0.0, we see mean response time(throughput drops) jumped significantly:

      Tests 6.5.0 Throughput 6.5.0 Mean response time 7.0.0
      Throughput
      7.0.0 Mean response time Mean response time(ms) diff in percentage
      Read w/o expansion 126 237 103 290 22
      Read w/ expansion on roles 121 247 95 313 27

       

      Attached are the idm metrics collected during the tests. From both tests, noticed that, 7.0.0 needs more connections to DS and the mean response time on the connection is higher than 6.5(F1 is for 6.5, F2 is for 7.0) 

      id : repo.ds.get-connection
      F1-mean: 4.599533146591592
      F1-count: 1787293
      F2-mean: 7.708673457367644
      F2-count: 3831051
      F2-F1 total: 21311607.761350643

      To reproduce the symptom:
      Use the config attached and run the following tests between 6.5 and 7.0:

      ./run-pybot.py -v -c perf -s relationship.ReadManUsersWithRolesManager -t IDM_Read_User_With_No_Link_Expansion OpenIDM

      or 

      ./run-pybot.py -v -c perf -s relationship.ReadManUsersWithRolesManager -t IDM_Read_User_With_Roles_Link_Expansion OpenIDM

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dhogan Dirk Hogan
                Reporter:
                Tinghua.Xu Tinghua.Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: