Uploaded image for project: 'Indy Node'
  1. Indy Node
  2. INDY-869

Nodes are reverting to 1.1.33 when doing manual upgrade to 1.1.37

    Details

    • Type: Bug
    • Status: Complete
    • Priority: High
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Environment:

      ESN, running 1.1.33

    • Sprint:
      13, 14, INDY 17.21

      Description

      Two weeks ago we upgraded the ESN to 1.1.33 using a ledger transaction.  The upgrade was successful, although no entries were seen on the config ledger to reflect this.  Today, I have been upgrading the nodes of the ESN manually (as required) to 1.1.37, one at a time.  I have seen that after doing "sudo apt update", "sudo apt upgrade", and "sudo apt install indy-plenum indy-node", that the correct packages are installed on the node.  

      However, a few minutes after executing "sudo systemctl start sovrin-node", I notice that the packages have auto-reverted back to 1.1.33 and 1.1.24.  Looking in the logs (attached) I see at 17:17:14, that upgrader.py is running, and I see that there are now transactions in the config ledger (with today's timestamp) indicating that a successful upgrade to 1.1.33 was performed.

      My theory is: when we upgraded to 1.1.33 two weeks ago, we had to use the --force flag, and we had the upgrade happen on all nodes at the same time.  This made it so that during the upgrade there was no consensus, and transactions could not be written to the config ledger.  Now, when we restarted the process today after upgrading to 1.1.37, it discovered an "upgrade" transaction pending in the config ledger, and actually downgraded it to 1.1.33.

        Attachments

        1. journalctl.tgz
          229 kB
        2. majiyan_config_ledger.txt
          2 kB
        3. majiyan_log.tgz
          4 kB

          Activity

            People

            • Assignee:
              nage Nathan George
              Reporter:
              mgbailey Mike Bailey
              Watchers:
              Andrey Goncharov, Kelly Wilson, Mike Bailey, Nikita Spivachuk, Vladimir Shishkin
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: