Uploaded image for project: 'Indy Node'
  1. Indy Node
  2. INDY-1477

Pool starts cyclic view change after 12 hours load

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Complete
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.6
    • Component/s: None
    • Labels:
      None
    • Environment:

      indy-node 1.4.500

    • Documentation Impact:
      Unset
    • Epic Link:
    • Sprint:
      EV 18.15 Stability/Availabilit

      Description

      Steps to Reproduce:
      1) prepare pool with 25 nodes and 100l txns
      2) setup load - 2000 clients, 15 txns/sec write-only

      python3 perf_processes.py -g pool_transactions_genesis -m t -c 200 -t 22 -n 1 -k nym
python3 perf_processes.py -g pool_transactions_genesis -m t -c 200 -t 66 -n 1 -k schema
python3 perf_processes.py -g pool_transactions_genesis -m t -c 200 -t 66 -n 1 -k attrib
python3 perf_processes.py -g pool_transactions_genesis -m t -c 200 -t 132 -n 1 -k cred_def
python3 perf_processes.py -g pool_transactions_genesis -m t -c 200 -t 132 -n 1 -k cred_def

      Actual results:
      After ~12 hours pool performance started to degrade and 11 view_changes were happened one by one (no veiw_change happened before)

      Additional info:
      Logs are available on LogProcessor:logs/cyclic_view_change_14jul2018
      Historical states of nodes are available in status_nodeX.log files

        Attachments

          Issue Links

          relates to

          Task - A task that needs to be done. INDY-1547 If the node is crashed with some uncommitted state persisted, it must recover its state and continue ordering

          • Medium - Has the potential to affect progress.
          • Complete

          Task - A task that needs to be done. INDY-1343 Prove production stability of an Indy network

          • High - Serious problem that could block progress.
          • Complete

          Task - A task that needs to be done. INDY-2214 Repeat: Prove production stability of an Indy network

          • High - Serious problem that could block progress.
          • New

            Activity

              People

              Assignee:
              sergey-shilov Sergey Shilov
              Reporter:
              zhigunenko.dsr NIkita Zhigunenko
              Watchers:
              Alexander Shcherbakov, NIkita Zhigunenko, Sergey Shilov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: