Uploaded image for project: 'Indy Node'
  1. Indy Node
  2. INDY-1454

Pool has stopped working due to several incomplete view changes

    XMLWordPrintable

Details

    • Bug
    • Status: Complete
    • High
    • Resolution: Done
    • None
    • 1.6
    • None
    • None

    Description

      Build Info:
      indy-node 1.4.492

      Steps to Reproduce:
      1. Install pool of 22 nodes.
      2. Run load test `python3 perf_processes.py -n 1 -t 1 -c 10 -g pool_transactions_genesis`.

      Actual Results:
      Load script has stopped writing at 71760 txns in ledger because of `_indy_loop_callback: Function returned error 307` (PoolLedgerTimeout error).

      There are the last entries about incomplete view changes in logs:

      2018-07-05 08:29:09,498 | INFO     | view_changer.py      ( 448) | sendInstanceChange | VIEW CHANGE: Node22 sending an instance change with view_no 203 since View change could not complete in time
      2018-07-05 08:29:10,041 | INFO     | view_changer.py      ( 485) | do_view_change_if_possible | VIEW CHANGE: Node22 initiating a view change to 203 from 202
      2018-07-05 08:29:10,044 | INFO     | node.py              ( 570) | on_view_change_start | VIEW CHANGE: Node22 changed to view 203, will start catchup now
      --------------------
      2018-07-05 08:34:09,939 | INFO     | view_changer.py      ( 448) | sendInstanceChange | VIEW CHANGE: Node22 sending an instance change with view_no 204 since View change could not complete in time
      2018-07-05 08:34:10,616 | INFO     | view_changer.py      ( 485) | do_view_change_if_possible | VIEW CHANGE: Node22 initiating a view change to 204 from 203
      2018-07-05 08:34:10,637 | INFO     | node.py              ( 570) | on_view_change_start | VIEW CHANGE: Node22 changed to view 204, will start catchup now
      

      Additional Information:
      Pool works after all nodes restarting.

      Attachments

        Activity

          People

            sergey.khoroshavin Sergey Khoroshavin
            VladimirWork Vladimir Shishkin
            Sergey Khoroshavin, Vladimir Shishkin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: