2017-12-21 15:38:37,304 | DEBUG | selector_events.py (53) | __init__ | Using selector: EpollSelector 2017-12-21 15:38:37,321 | DEBUG | ledger.py (201) | start | Starting ledger... 2017-12-21 15:38:37,332 | DEBUG | ledger.py (67) | recoverTree | Recovering tree from transaction log 2017-12-21 15:38:37,346 | DEBUG | ledger.py (82) | recoverTree | Recovered tree in 0.013880940969102085 seconds 2017-12-21 15:38:37,372 | DEBUG | ledger.py (201) | start | Starting ledger... 2017-12-21 15:38:37,383 | DEBUG | ledger.py (67) | recoverTree | Recovering tree from transaction log 2017-12-21 15:38:37,397 | DEBUG | ledger.py (82) | recoverTree | Recovered tree in 0.014510671026073396 seconds 2017-12-21 15:38:37,405 | INFO | node.py (2556) | initStateFromLedger | Node6 found state to be empty, recreating from ledger 2017-12-21 15:38:37,409 | INFO | pool_manager.py (399) | _order_node | Node6 node Node1 ordered, NYM Gw6pDLhcBcoQesN72qfotTgFa7cbuqZpkX3Xo6pLhPhv 2017-12-21 15:38:37,409 | INFO | pool_manager.py (399) | _order_node | Node6 node Node2 ordered, NYM 8ECVSk179mjsjKRLWiQtssMLgp6EPhWXtaYyStWPSGAb 2017-12-21 15:38:37,410 | INFO | pool_manager.py (399) | _order_node | Node6 node Node3 ordered, NYM DKVxG2fXXTU8yT5N7hGEbXB3dfdAnYv1JczDUHpmDxya 2017-12-21 15:38:37,410 | INFO | pool_manager.py (399) | _order_node | Node6 node Node4 ordered, NYM 4PS3EDQ3dW1tci1Bp6543CfuuebjFrg36kLAUcskGfaA 2017-12-21 15:38:37,427 | INFO | node.py (721) | _create_bls_bft | BLS: BLS Signatures will be used for Node Node6 2017-12-21 15:38:37,432 | INFO | node.py (2556) | initStateFromLedger | Node6 found state to be empty, recreating from ledger 2017-12-21 15:38:37,442 | INFO | node.py (558) | setPoolParams | Node6 updated its pool parameters: f 1, totalNodes 5, allNodeNames {'Node4', 'Node2', 'Node1', 'Node3', 'Node6'}, requiredNumberOfInstances 2, minimumNodes 3, quorums {'ledger_status': Quorum(3), 'prepare': Quorum(3), 'bls_signatures': Quorum(4), 'reply': Quorum(2), 'checkpoint': Quorum(2), 'propagate': Quorum(2), 'timestamp': Quorum(2), 'observer_data': Quorum(2), 'f': 1, 'same_consistency_proof': Quorum(2), 'election': Quorum(4), 'propagate_primary': Quorum(2), 'view_change_done': Quorum(4), 'view_change': Quorum(4), 'commit': Quorum(4), 'consistency_proof': Quorum(2)} 2017-12-21 15:38:37,489 | INFO | plugin_loader.py (118) | _load | plugin FirebaseStatsConsumer successfully loaded from module plugin_firebase_stats_consumer 2017-12-21 15:38:37,490 | DISPLAY | replicas.py (41) | grow | Node6 added replica Node6:0 to instance 0 (master) 2017-12-21 15:38:37,491 | DISPLAY | replicas.py (41) | grow | Node6 added replica Node6:1 to instance 1 (backup) 2017-12-21 15:38:37,491 | DEBUG | plugin_helper.py (23) | loadPlugins | Plugin loading started to load plugins from plugins_dir: /var/lib/indy/plugins 2017-12-21 15:38:37,491 | DEBUG | plugin_helper.py (28) | loadPlugins | Plugin directory created at: /var/lib/indy/plugins 2017-12-21 15:38:37,492 | DEBUG | plugin_helper.py (63) | loadPlugins | Total plugins loaded from plugins_dir /var/lib/indy/plugins are : 0 2017-12-21 15:38:37,509 | DEBUG | ledger.py (201) | start | Starting ledger... 2017-12-21 15:38:37,514 | DEBUG | ledger.py (67) | recoverTree | Recovering tree from transaction log 2017-12-21 15:38:37,530 | DEBUG | ledger.py (82) | recoverTree | Recovered tree in 0.016339575056917965 seconds 2017-12-21 15:38:37,537 | INFO | node.py (2556) | initStateFromLedger | Node6 found state to be empty, recreating from ledger 2017-12-21 15:38:37,537 | DEBUG | ledger.py (199) | start | Ledger already started. 2017-12-21 15:38:37,538 | DEBUG | ledger.py (199) | start | Ledger already started. 2017-12-21 15:38:37,538 | DEBUG | ledger.py (199) | start | Ledger already started. 2017-12-21 15:38:37,540 | DEBUG | authenticator.py (31) | start | Starting ZAP at inproc://zeromq.zap.1 2017-12-21 15:38:37,540 | DEBUG | base.py (72) | allow | Allowing 0.0.0.0 2017-12-21 15:38:37,540 | DEBUG | base.py (112) | configure_curve | Configure curve: *[/var/lib/indy/sandbox/keys/Node6/public_keys] 2017-12-21 15:38:37,541 | INFO | stacks.py (84) | start | CONNECTION: Node6 listening for other nodes at 0.0.0.0:9701 2017-12-21 15:38:37,542 | DEBUG | authenticator.py (31) | start | Starting ZAP at inproc://zeromq.zap.2 2017-12-21 15:38:37,542 | DEBUG | base.py (72) | allow | Allowing 0.0.0.0 2017-12-21 15:38:37,542 | DEBUG | base.py (112) | configure_curve | Configure curve: *[*] 2017-12-21 15:38:37,543 | INFO | node.py (786) | start | Node6 first time running... 2017-12-21 15:38:37,546 | INFO | zstack.py (584) | connect | CONNECTION: Node6 looking for Node2 at 10.0.0.3:9703 2017-12-21 15:38:37,547 | INFO | zstack.py (584) | connect | CONNECTION: Node6 looking for Node4 at 10.0.0.5:9707 2017-12-21 15:38:37,548 | INFO | zstack.py (584) | connect | CONNECTION: Node6 looking for Node3 at 10.0.0.4:9705 2017-12-21 15:38:37,549 | INFO | zstack.py (584) | connect | CONNECTION: Node6 looking for Node1 at 10.0.0.2:9701 2017-12-21 15:39:37,549 | INFO | node.py (2249) | propose_view_change | Node6 primary has been disconnected for too long 2017-12-21 15:39:37,549 | INFO | view_changer.py (206) | on_primary_loss | Node6 sending instance with view_no = 1 and trying to start view change since primary was lost 2017-12-21 15:39:37,549 | INFO | view_changer.py (380) | sendInstanceChange | VIEW CHANGE: Node6 sending an instance change with view_no 1 since Primary of master protocol instance disconnected 2017-12-21 15:39:37,550 | INFO | view_changer.py (383) | sendInstanceChange | MONITORING: Node6 metrics for monitor: Node6 Monitor metrics:: None Delta: 0.4 Lambda: 60 Omega: 5 instances started: [524476.126813847, 524476.127388358] ordered request counts: {0: 0, 1: 0} ordered request durations: {0: 0, 1: 0} master request latencies: {} client avg request latencies: [{}, {}] throughput: {0: 0, 1: 0} master throughput: None total requests: 0 avg backup throughput: None master throughput ratio: None 2017-12-21 15:44:57,839 | INFO | node.py (1696) | preLedgerCatchUp | Node6 reverted 0 batches before starting catch up for ledger 0 2017-12-21 15:44:57,856 | INFO | pool_manager.py (399) | _order_node | Node6 node Node5 ordered, NYM 4Tn3wZMNCvhSTXPcLinQDnHyj56DTLQtL61ki4jo2Loc 2017-12-21 15:44:57,859 | INFO | zstack.py (584) | connect | CONNECTION: Node6 looking for Node5 at 10.0.0.6:9701 2017-12-21 15:44:57,862 | INFO | node.py (1085) | nodeJoined | Node6 new node joined by txn {'dest': '4Tn3wZMNCvhSTXPcLinQDnHyj56DTLQtL61ki4jo2Loc', 'seqNo': 5, 'reqId': 1513870694066875, 'type': '0', 'signature': '4X2R4rJDbebGgmzS2tsEQfinMCR68j1hn4LKGi5vWp3dANDiJrn9kurnT4HuyMtYXbi1MUHsXmK8pHZEHA5QAiHH', 'signatures': None, 'data': {'blskey': '2RdajPq6rCidK5gQbMzSJo1NfBMYiS3e44GxjTqZUk3RhBdtF28qEABHRo4MgHS2hwekoLWRTza9XiGEMRCompeujWpX85MPt87WdbTMysXZfb7J1ZXUEMrtE5aZahfx6p2YdhZdrArFvTmFWdojaD2V5SuvuaQL4G92anZ1yteay3R', 'client_port': 9702, 'node_ip': '10.0.0.6', 'services': ['VALIDATOR'], 'node_port': 9701, 'client_ip': '10.0.0.6', 'alias': 'Node5'}, 'identifier': 'XhYtvJqezMUKfF6KVNaGmT', 'txnTime': 1513870694} 2017-12-21 15:44:57,863 | INFO | node.py (558) | setPoolParams | Node6 updated its pool parameters: f 1, totalNodes 6, allNodeNames {'Node4', 'Node1', 'Node5', 'Node2', 'Node6', 'Node3'}, requiredNumberOfInstances 2, minimumNodes 3, quorums {'ledger_status': Quorum(4), 'prepare': Quorum(4), 'bls_signatures': Quorum(5), 'reply': Quorum(2), 'checkpoint': Quorum(2), 'propagate': Quorum(2), 'timestamp': Quorum(2), 'observer_data': Quorum(2), 'f': 1, 'same_consistency_proof': Quorum(2), 'election': Quorum(5), 'propagate_primary': Quorum(2), 'view_change_done': Quorum(5), 'view_change': Quorum(5), 'commit': Quorum(5), 'consistency_proof': Quorum(2)} 2017-12-21 15:44:57,865 | INFO | pool_manager.py (399) | _order_node | Node6 node Node6 ordered, NYM 6G9QhQa3HWjRKeRmEvEkLbWWf2t7cw6KLtafzi494G4G 2017-12-21 15:44:57,866 | INFO | node.py (753) | update_bls_key | BLS: BLS key is rotated/set for Node Node6. BLS Signatures will be used for Node. 2017-12-21 15:44:57,868 | INFO | node.py (1696) | preLedgerCatchUp | Node6 reverted 0 batches before starting catch up for ledger 2 2017-12-21 15:44:57,870 | INFO | ledger_manager.py (871) | mark_ledger_synced | CATCH-UP: Node6 completed catching up ledger 2, caught up 0 in total 2017-12-21 15:44:57,870 | INFO | ledger_manager.py (871) | mark_ledger_synced | CATCH-UP: Node6 completed catching up ledger 0, caught up 2 in total 2017-12-21 15:44:57,950 | INFO | node.py (1696) | preLedgerCatchUp | Node6 reverted 0 batches before starting catch up for ledger 1 2017-12-21 15:44:57,952 | INFO | keep_in_touch.py (98) | _connsChanged | CONNECTION: Node6 now connected to Node2 2017-12-21 15:44:57,952 | INFO | keep_in_touch.py (98) | _connsChanged | CONNECTION: Node6 now connected to Node3 2017-12-21 15:44:57,957 | INFO | keep_in_touch.py (98) | _connsChanged | CONNECTION: Node6 now connected to Node4 2017-12-21 15:45:27,908 | INFO | keep_in_touch.py (98) | _connsChanged | CONNECTION: Node6 now connected to Node1