Uploaded image for project: 'Indy Node'
  1. Indy Node
  2. INDY-1770

Test ZMQ Memory Consumption with restricted number of client connections



    • Task
    • Status: Complete
    • Medium
    • Resolution: Done
    • None
    • 1.6.79
    • None
    • None


      As was understood in INDY-1686, ZMQ may consume a lot of memory if there are a lot of simultaneous client requests, since it uses round-robin to read client queues.

      Plenum does (be default) 100 reads in one looper run.

      We need to test if situation with memory consumption improves when we restrict the number of client connections.

      Acceptance criteria

      • Run load test with restricting maximum number of connections
        • Configure a pool with maximum number of incoming client connections set to 200
        • set MAX_CONNECTED_CLIENTS_NUM = 100
        • Run two write only tests: 10 NYMs per sec and 100 NYMs per sec.
        • Run a test with write and read: 10 write NYMs per sec and 100 read NYMs per sec from 1000 clients
        • Run a test with write and read: 100 write NYMs per sec and 1000 read NYMs per sec from 1000 clients
        • Run more experiments if needed
      • Monitor and analyze memory consumption in every case
      • Check how many client requests were processed, and how many rejected because the pool was busy (due to timeout). Do it for the both read and write reqs
      • Decide if we should reduce MAX_CONNECTED_CLIENTS_NUM  in production



        1. 1770_100w_1000r_node1.PNG
          377 kB
          Vladimir Shishkin
        2. 1770_100w_1000r_node13.PNG
          358 kB
          Vladimir Shishkin
        3. 1770_100w_1000r_node25.PNG
          312 kB
          Vladimir Shishkin
        4. 1770_100w_node1.PNG
          294 kB
          Vladimir Shishkin
        5. 1770_100w_node25.PNG
          265 kB
          Vladimir Shishkin
        6. 1770_10w_100r_node1.PNG
          296 kB
          Vladimir Shishkin
        7. 1770_10w_100r_node13.PNG
          298 kB
          Vladimir Shishkin
        8. 1770_10w_100r_node25.PNG
          304 kB
          Vladimir Shishkin
        9. 1770_10w_node15.PNG
          303 kB
          Vladimir Shishkin
        10. 1770_10w_node5.PNG
          310 kB
          Vladimir Shishkin



            anikitinDSR Andrew Nikitin
            ashcherbakov Alexander Shcherbakov
            Alexander Shcherbakov, Andrew Nikitin, Vladimir Shishkin
            0 Vote for this issue
            3 Start watching this issue