-
Type:
Bug
-
Status: Open
-
Priority:
Critical
-
Resolution: Unresolved
-
Affects Version/s: 7.0.0
-
Fix Version/s: None
-
Component/s: Module - Relationships
-
Labels:
-
Environment:IDM 7.0.0 latest master runs on CentOS7, Java 11, MySQL or Postgres as repo
-
Target Version/s:
-
Story Points:5
-
Sprint:2020.07 - IDM, 2020.08 - IDM, 2020.09 - IDM
When comparing the performance between IDM 7.0.0 and 6.5.0.3, noticed significant throughput drop when creating managed users with relationships(roles and manager) for JDBC based repos(MySQL and Postgres):
| 7.0.0 | 7.0.0 | 6.5.0.3 | 6.5.0.3 | ||
| Repos | difference in percentage | throughput (users/sec) |
mean response times(ms) | throughput (users/sec) |
mean response times(ms) |
| MySQL | -18.75 | 78 | 385 | 96 | 310 |
| Postgres | -13.1147541 | 106 | 283 | 122 | 246 |
Attached are the IDM metrics for different repos and releases from the tests. From the metrics, we can see significant mean response differences between the releases in different modules: The following is taken from metrics for MySQL, F1 is for 6.5.0, F2 is for 7.0.0.
id : managed.user.create F1-mean: 293.1113631004432 F1-count: 28838 F2-mean: 365.5955813703023 F2-count: 29451 F2-F1 total: 2314409.977846192 id : managed.user.relationship.validate-relationship-fields F1-mean: 41.186500198461715 F1-count: 28838 F2-mean: 77.09620296078252 F2-count: 29451 F2-F1 total: 1082823.980674767 id : managed.role.read F1-mean: 3.2907449202217767 F1-count: 865140 F2-mean: 4.878547230562228 F2-count: 880980 F2-F1 total: 1450947.4789000438
To reproduce it using Pyforge:
Run the following command using the configuration attached(for 6.5.0.3, uncomment #connector_version = 5.1.34)
:
-./run-pybot.py -v -c perf -s relationship.CreateManUsersWithRolesManager OpenIDM -