Uploaded image for project: 'Indy Node'
  1. Indy Node
  2. INDY-1770

Test ZMQ Memory Consumption with restricted number of client connections

    Details

    • Type: Task
    • Status: Complete
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.6.79
    • Component/s: None
    • Labels:
      None

      Description

      As was understood in INDY-1686, ZMQ may consume a lot of memory if there are a lot of simultaneous client requests, since it uses round-robin to read client queues.

      Plenum does (be default) 100 reads in one looper run.

      We need to test if situation with memory consumption improves when we restrict the number of client connections.

      Acceptance criteria

      • Run load test with restricting maximum number of connections
        • Configure a pool with maximum number of incoming client connections set to 200
        • set MAX_CONNECTED_CLIENTS_NUM = 100
        • Run two write only tests: 10 NYMs per sec and 100 NYMs per sec.
        • Run a test with write and read: 10 write NYMs per sec and 100 read NYMs per sec from 1000 clients
        • Run a test with write and read: 100 write NYMs per sec and 1000 read NYMs per sec from 1000 clients
        • Run more experiments if needed
      • Monitor and analyze memory consumption in every case
      • Check how many client requests were processed, and how many rejected because the pool was busy (due to timeout). Do it for the both read and write reqs
      • Decide if we should reduce MAX_CONNECTED_CLIENTS_NUM  in production

       

        Attachments

        1. 1770_100w_1000r_node1.PNG
          1770_100w_1000r_node1.PNG
          377 kB
        2. 1770_100w_1000r_node13.PNG
          1770_100w_1000r_node13.PNG
          358 kB
        3. 1770_100w_1000r_node25.PNG
          1770_100w_1000r_node25.PNG
          312 kB
        4. 1770_100w_node1.PNG
          1770_100w_node1.PNG
          294 kB
        5. 1770_100w_node25.PNG
          1770_100w_node25.PNG
          265 kB
        6. 1770_10w_100r_node1.PNG
          1770_10w_100r_node1.PNG
          296 kB
        7. 1770_10w_100r_node13.PNG
          1770_10w_100r_node13.PNG
          298 kB
        8. 1770_10w_100r_node25.PNG
          1770_10w_100r_node25.PNG
          304 kB
        9. 1770_10w_node15.PNG
          1770_10w_node15.PNG
          303 kB
        10. 1770_10w_node5.PNG
          1770_10w_node5.PNG
          310 kB

          Activity

            People

            • Assignee:
              anikitinDSR Andrew Nikitin
              Reporter:
              ashcherbakov Alexander Shcherbakov
              Watchers:
              Alexander Shcherbakov, Andrew Nikitin, Vladimir Shishkin
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: