Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-14714

Response time increased significantly with certain read operations of managed users with relationship using DS as repo


    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: 7.0.0
    • Fix Version/s: 7.0.0
    • Component/s: Module - Relationships
    • Environment:
      IDM 7.0.0 master(c286e03) runs on a CentOS 7 machine, Java11, external DJ(7.0.0-M2020-6.1) as repo. Vs. IDM with DJ 6.5.2
    • Target Version/s:
    • Verified Version/s:
    • Story Points:
    • Sprint:
      2020.07 - IDM, 2020.08 - IDM


      The test preload 30K users with managed roles and managers, then either read the user w/o link expansion as managed/user/A-A-123 or w/ link expansion on roles like managed/user/A-A-123?_fields=,roles/. Between and 7.0.0, we see mean response time(throughput drops) jumped significantly:

      Tests 6.5.0 Throughput 6.5.0 Mean response time 7.0.0
      7.0.0 Mean response time Mean response time(ms) diff in percentage
      Read w/o expansion 126 237 103 290 22
      Read w/ expansion on roles 121 247 95 313 27


      Attached are the idm metrics collected during the tests. From both tests, noticed that, 7.0.0 needs more connections to DS and the mean response time on the connection is higher than 6.5(F1 is for 6.5, F2 is for 7.0) 

      id : repo.ds.get-connection
      F1-mean: 4.599533146591592
      F1-count: 1787293
      F2-mean: 7.708673457367644
      F2-count: 3831051
      F2-F1 total: 21311607.761350643

      To reproduce the symptom:
      Use the config attached and run the following tests between 6.5 and 7.0:

      ./run-pybot.py -v -c perf -s relationship.ReadManUsersWithRolesManager -t IDM_Read_User_With_No_Link_Expansion OpenIDM


      ./run-pybot.py -v -c perf -s relationship.ReadManUsersWithRolesManager -t IDM_Read_User_With_Roles_Link_Expansion OpenIDM


          Issue Links



              • Assignee:
                dhogan Dirk Hogan
                Tinghua.Xu Tinghua Xu
              • Votes:
                0 Vote for this issue
                2 Start watching this issue


                • Created: