Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
7.0.0
-
None
-
IDM 7.0.0 latest master runs on CentOS7, Java 11, MySQL or Postgres as repo
-
5
-
2020.07 - IDM, 2020.08 - IDM, 2020.09 - IDM
Description
When comparing the performance between IDM 7.0.0 and 6.5.0.3, noticed significant throughput drop when creating managed users with relationships(roles and manager) for JDBC based repos(MySQL and Postgres):
| 7.0.0 | 7.0.0 | 6.5.0.3 | 6.5.0.3 | ||
| Repos | difference in percentage | throughput (users/sec) |
mean response times(ms) | throughput (users/sec) |
mean response times(ms) |
| MySQL | -18.75 | 78 | 385 | 96 | 310 |
| Postgres | -13.1147541 | 106 | 283 | 122 | 246 |
Attached are the IDM metrics for different repos and releases from the tests. From the metrics, we can see significant mean response differences between the releases in different modules: The following is taken from metrics for MySQL, F1 is for 6.5.0, F2 is for 7.0.0.
id : managed.user.create F1-mean: 293.1113631004432 F1-count: 28838 F2-mean: 365.5955813703023 F2-count: 29451 F2-F1 total: 2314409.977846192 id : managed.user.relationship.validate-relationship-fields F1-mean: 41.186500198461715 F1-count: 28838 F2-mean: 77.09620296078252 F2-count: 29451 F2-F1 total: 1082823.980674767 id : managed.role.read F1-mean: 3.2907449202217767 F1-count: 865140 F2-mean: 4.878547230562228 F2-count: 880980 F2-F1 total: 1450947.4789000438
To reproduce it using Pyforge:
Run the following command using the configuration attached(for 6.5.0.3, uncomment #connector_version = 5.1.34)
:
-./run-pybot.py -v -c perf -s relationship.CreateManUsersWithRolesManager OpenIDM -