Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-9314

clustered recon latency optimizations

    XMLWordPrintable

    Details

      Description

      When testing clustered recon create for one million user from DJ to managed, observed that enable target phase and disable target phase would have 60~70 minutes difference in total recon times. Here are some total times used for the recon:
      one node clustered recon with target phase enabled: 383 minutes,
      one node clustered recon with target phase disabled: 310 minutes.
      two nodes clustered recon with target phase enabled: 265 minutes,
      two nodes clustered recon with target phase disabled:199 minutes.
      Three nodes clustered recon with target phase enabled: 232 minutes,
      Four nodes clustered recon with target phase enabled: 222 minutes,
      while regular recon with target phase enabled took 268 minutes.

      Talked to Dirk, this difference is mainly introduced by storing targetId one by one in the repo during source phase, using bloom filter can reduce the difference significantly.
      reducing the difference can raise overall clustered recon throughput and can also make the recon times/throughput better scaled with increasing number of cluster nodes. More test result data can be seen from https://wikis.forgerock.org/confluence/display/QA/IDM+Clustered+Recon+Performance+Test+Summary

        Attachments

          Activity

            People

            Assignee:
            dhogan Dirk Hogan
            Reporter:
            Tinghua.Xu Tinghua Xu
            QA Assignee:
            Tinghua Xu Tinghua Xu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: