Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-16662

Commit c45008b414 causes about 8% regression in managed user query using delegated admin test

    XMLWordPrintable

    Details

      Description

      Noticed that commit c45008b414(OPENIDM-16385) causes about 8% regression in managed user query using delegated admin test when MySQL is used as repo, before the commit, the Gatling report from the test has:

      ---- Global Information --------------------------------------------------------
      > request count                                     474803 (OK=474803 KO=0     )
      > min response time                                      7 (OK=7      KO=-     )
      > max response time                                    206 (OK=206    KO=-     )
      > mean response time                                    25 (OK=25     KO=-     )
      > std deviation                                          7 (OK=7      KO=-     )
      > response time 50th percentile                         24 (OK=24     KO=-     )
      > response time 95th percentile                         37 (OK=37     KO=-     )
      > response time 99th percentile                         46 (OK=46     KO=-     )
      > response time 99.9th percentile                       83 (OK=83     KO=-     )
      > mean requests/sec                                1577.419 (OK=1577.419 KO=-     )
      ---- Response Time Distribution ------------------------------------------------
      > t < 800 ms                                        474803 (100%)
      > 800 ms < t < 1200 ms                                   0 (  0%)
      > t > 1200 ms                                            0 (  0%)
      > failed                                                 0 (  0%)
      

      With the commit we have:

      ---- Global Information --------------------------------------------------------
      > request count                                     438601 (OK=438601 KO=0     )
      > min response time                                      8 (OK=8      KO=-     )
      > max response time                                    197 (OK=197    KO=-     )
      > mean response time                                    27 (OK=27     KO=-     )
      > std deviation                                          7 (OK=7      KO=-     )
      > response time 50th percentile                         26 (OK=26     KO=-     )
      > response time 95th percentile                         39 (OK=39     KO=-     )
      > response time 99th percentile                         48 (OK=48     KO=-     )
      > response time 99.9th percentile                       76 (OK=76     KO=-     )
      > mean requests/sec                                1457.146 (OK=1457.146 KO=-     )
      ---- Response Time Distribution ------------------------------------------------
      > t < 800 ms                                        438601 (100%)
      > 800 ms < t < 1200 ms                                   0 (  0%)
      > t > 1200 ms                                            0 (  0%)
      > failed                                                 0 (  0%)
      

      The throughput dropped from 1577.419 to 1457.14, it's about 8% drop.
      To reproduce using Pyforge:
      1. Using the following config:

      [Stress]
      num_users = 10
      duration = 60
      concurrency = 10
      max_throughput = -1
      test_duration = 300
      preload_users = 100
      previliges_per_role = 2
      preload_duration = 300
      number_of_internal_roles = 2
      internal_roles_per_user = 2
      delegated_users = 200
      test_concurrency = 40
      

      2. Run the test:

      ./run-pybot.py -v -c perf -s delegated_admin.DAQueryManUsers OpenIDM
      

      Check the Gatling report in debug.txt file.

      Note: Don't see similar drop with Postgres.

      See throughput drops on Read and Delete as well, see attached trend charts.

        Attachments

          Issue Links

            Activity

              People

              jason.vincent jason vincent
              Tinghua.Xu Tinghua Xu [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: