Uploaded image for project: 'Fabric'
  1. Fabric
  2. FAB-12928

PTE [Enhancement]: Add failure threshold and abort when failure threshold is exceeded

    Details

    • Type: Story
    • Status: Backlog (View Workflow)
    • Priority: High
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fabric-quality
    • Labels:
      None

      Description

      Currently PTE keeps running even if transactions fail due to underlying Fabric bug or due to any server side environment issue. There is no value in continuing the run when failures occur. Instead, it will help aborting the test and sending failure report to tester so a bug can be filed sooner than later.

      1. Add parameter for failure threshold. This could either be % failures or absolute threshold count for # of failed transactions.
      2. Check failure threshold value and abort test when threshold is crossed i.e. failure count > threshold.
      3. Save logs. This should include test client CPU, memory, disk and block chain network - peer, order and CA container - CPU, memory, disk utilization when threshold is crossed. test client stats required so we can isolate if it's client side issue or network side issue.
      4. Generate report to show total transactions, total successful transaction, total failed transactions, test name, network id (applicable for IBP), type of network (IBP - starter, EP. or simple non-IBP, if it can be determined).

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              nileshdeotale Nilesh Deotale
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Git Source Code