Uploaded image for project: 'OpenDJ'
  1. OpenDJ
  2. OPENDJ-2978

RuntimeException while stressing the changelog

    Details

    • Type: Bug
    • Status: Done
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 4.0.0, 3.5.0
    • Fix Version/s: 4.0.0, 3.5.0
    • Component/s: replication
    • Labels:
      None

      Description

      Problem found using OpenDJ 4.0.0.

      Problem introduced between rev f30855c701f (test PASS) and 0de10af1666 (test FAIL).
      Seems to be related to the change in rev e84de8ea992 (OPENDJ-2794 Move check of key ordering from Log to LogFile class when adding a changelog record).

      Scenario

      • install a server
      • enable changelog
      • delete default backend and create a null backend
      • do modrate to stress the changelog

      During the test, modrate reports errors and we have the following exceptions in the logs/errors file:

      [29/Apr/2016:04:27:06 +0200] category=org.opends.server.api.DirectoryThread severity=ERROR msgID=org.opends.messages.core.140 msg=An uncaught exception during processing for thread Change number indexer has caused it to terminate abnormally. The stack trace for that exception is: RuntimeException: org.opends.server.replication.server.changelog.api.ChangelogException: Could not decode a record from data read in log file 'java.io.RandomAccessFile@13027cd9' (ChangeNumberIndexer.java:478)
      [29/Apr/2016:04:27:06 +0200] category=SYNC severity=ERROR msgID=org.opends.messages.replication.26 msg=Error trying to use the underlying database. The Replication Server is going to shut down: ChangelogException: Could not position and read newest record from log file '/local/OpenDJ-Stress-Tests-Any-Changelog-FileBased/results/20160429-042212/changelog/DSRS1/opendj/changelogDb/1.dom/3.server/000001545fd749400003009710b6_000001545fd74d29000300979b52.log' (BlockLogReader.java:629 LogFile.java:402 LogFile.java:122 LogFile.java:143 Log.java:1096 Log.java:968 Log.java:457 FileReplicaDB.java:156 FileChangelogDB.java:806 ReplicationServerDomain.java:504 ReplicationServerDomain.java:328 ServerHandler.java:1131 ServerReader.java:103)
      [29/Apr/2016:04:27:06 +0200] category=CORE severity=NOTICE msgID=org.opends.messages.core.139 msg=The Directory Server has sent an alert notification generated by class org.opends.server.api.DirectoryThread (alert type org.opends.server.UncaughtException, alert ID org.opends.messages.core-140): An uncaught exception during processing for thread Change number indexer has caused it to terminate abnormally. The stack trace for that exception is: RuntimeException: org.opends.server.replication.server.changelog.api.ChangelogException: Could not decode a record from data read in log file 'java.io.RandomAccessFile@13027cd9' (ChangeNumberIndexer.java:478)
      [29/Apr/2016:04:27:06 +0200] category=SYNC severity=ERROR msgID=org.opends.messages.replication.269 msg=When closing log '/local/OpenDJ-Stress-Tests-Any-Changelog-FileBased/results/20160429-042212/changelog/DSRS1/opendj/changelogDb/1.dom/3.server', found 1 cursor(s) still opened on the log
      [29/Apr/2016:04:27:06 +0200] category=SYNC severity=ERROR msgID=org.opends.messages.replication.26 msg=Error trying to use the underlying database. The Replication Server is going to shut down: ChangelogException: Could not create replica database because the changelog database is shutting down (FileChangelogDB.java:209 FileChangelogDB.java:803 ReplicationServerDomain.java:504 ReplicationServerDomain.java:328 ServerHandler.java:1131 ServerReader.java:103)
      [29/Apr/2016:04:27:06 +0200] category=SYNC severity=ERROR msgID=org.opends.messages.replication.26 msg=Error trying to use the underlying database. The Replication Server is going to shut down: ChangelogException: Could not create replica database because the changelog database is shutting down (FileChangelogDB.java:209 FileChangelogDB.java:803 ReplicationServerDomain.java:504 ReplicationServerDomain.java:328 ServerHandler.java:1131 ServerReader.java:103)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nicolas.capponi@forgerock.com Nicolas Capponi
                Reporter:
                csovant Christophe Sovant
                QA Assignee:
                Christophe Sovant
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: