Details
-
Bug
-
Status: Complete
-
High
-
Resolution: Done
-
None
-
None
-
None
-
ESN, running 1.1.33
-
13, 14, INDY 17.21
Description
Two weeks ago we upgraded the ESN to 1.1.33 using a ledger transaction. The upgrade was successful, although no entries were seen on the config ledger to reflect this. Today, I have been upgrading the nodes of the ESN manually (as required) to 1.1.37, one at a time. I have seen that after doing "sudo apt update", "sudo apt upgrade", and "sudo apt install indy-plenum indy-node", that the correct packages are installed on the node.
However, a few minutes after executing "sudo systemctl start sovrin-node", I notice that the packages have auto-reverted back to 1.1.33 and 1.1.24. Looking in the logs (attached) I see at 17:17:14, that upgrader.py is running, and I see that there are now transactions in the config ledger (with today's timestamp) indicating that a successful upgrade to 1.1.33 was performed.
My theory is: when we upgraded to 1.1.33 two weeks ago, we had to use the --force flag, and we had the upgrade happen on all nodes at the same time. This made it so that during the upgrade there was no consensus, and transactions could not be written to the config ledger. Now, when we restarted the process today after upgrading to 1.1.37, it discovered an "upgrade" transaction pending in the config ledger, and actually downgraded it to 1.1.33.