Uploaded image for project: 'OpenIDM'
  1. OpenIDM
  2. OPENIDM-11926

Backport OPENIDM-11852: clustered recon in multi-node environment may never complete

    Details

      Description

      In a multi-node environment, a clustered recon may never complete because the sourcePagePhase never ends.

      Setup:

      • 12 IDM nodes in a cluster
      • Run a sizable recon job that will allow multiple nodes to pick up a sourcePage tasks (> 1M users)

      State Description:

      • REST GET openidm/recon/ {reconid}

        reveals the following state:

          "state": "ACTIVE",
          "stage": "ACTIVE_RECONCILING_SOURCE_PAGE",
          "stageDescription": "reconciling page of source entries",
      

      processed entries equal to total entries:

        "progress": {
              "source": {
                  "existing": {
                      "processed": 15339417,
                      "total": "15339417"
                  }
              },
      
      • GET /openidm/scheduler/job?_queryFilter=true&_fields=*

      Returns NO jobs matching the form

      clustered_recon-*-sourcePage-*

      but DOES return jobs matching the form

      clustered_recon-*-sourcePageCompletionCheck-*

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                matthias.grabiak Matthias Grabiak
                Reporter:
                mark.offutt Mark Offutt [X] (Inactive)
                QA Assignee:
                Jakub Janoska [X] (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: