Affects Version/s: None
Fix Version/s: None
STN running 1.3.52
Today we upgraded the STN from 1.2.50 to 1.3.52. We were posting transactions to it successfully yesterday before the upgrade, but now we are unable to successfully post transactions. For example, at 19:17:17 I attempted to post a DID:
But it did not get written to the ledger.
The upgrade was successful for all nodes except for ibm, where we performed a manual upgrade. I have access to 7 of 10 nodes, whose logs are attached. All of our nodes (plus ibm) show that the same primaries have been selected on them. validator-info shows connectivity between all nodes.
One thing that I am seeing are errors regarding consistency proofs:
It appears that one of the nodes, pcValidator01, has 3 more transactions than the rest? I will be contacting that steward for logs and ledger data, which I will post here.
If my supposition that there are 3 additional transactions in one validator's ledger is correct, then there are 2 things to look at:
- How did the transactions get in there?
- Why does one node's ledger being out of sync prevent transactions in the whole pool?