How main memory is distributed across the node is grid db cluster

Home Forums Developer Forum How main memory is distributed across the node is grid db cluster

This topic contains 4 replies, has 2 voices, and was last updated by  Owen 5 months, 3 weeks ago.

Viewing 5 posts - 1 through 5 (of 5 total)
  • Author
    Posts
  • #24223 Reply

    Devaraju M K (TSIP INIDA)

    Hi,

    Hi,

    I have created the clusetr with 4 node, each node has 32GB RAM and 64GB, 64GB, 32GB and 32GB SSD respectively. We were inserted the 34GB data, and trying to read all the 34GB(22400 records) from the application. While reading Master node is giving the error after successfully reading 15300 records out of 22400 records, error code is 1043:CM_MEMORY_LIMIT_EXCEED. If we looked in gs_admin monitor window, Master’s RAM space is fully allocated but others node has 90% of free space. we could not able to understand how RAM is distributed in cluster environment.

    Cluster Config Details as follows:
    CLUSTER NAME : GS_CLUSTER,
    Number Nodes in Cluster : 4,
    StoreMemoryLimit : 10GB Notification,
    Mode: FIXED_LIST

    Please help us to resolve the issue.

    Thanks and regards
    Devaraju M K

    #24233 Reply

    Owen
    Keymaster

    What is the replication number?

    You may be close to exceeding the available storage size on your cluster. Please see https://griddb.net/en/blog/estimating-requirements-griddb-cluster/

    #24283 Reply

    Anonymous

    Dear Owen-san,

    Thanks for the reply.

    >>What is the replication number?
    Replica number is 2

    We checked but still we are facing same issue.

    Our storage data as following
    each columns size : 4096 bytes
    Number of columns in a row : 30
    Row size : (30*4096)
    Number of rows registered : 224600

    please help us to resolve this issue.

    Thanks and regards
    Devaraju M K

    #24293 Reply

    Devaraju M K (TSIP INIDA)

    Dear Owen-san,

    Thanks for the reply.

    >>What is the replication number?
    Replica number is 2

    We checked but still we are facing same issue.

    Our storage data as following
    each columns size : 4096 bytes
    Number of columns in a row : 30
    Row size : (30*4096)
    Number of rows registered : 224600

    please help us to resolve this issue.

    Thanks and regards
    Devaraju M K

    #24313 Reply

    Owen
    Keymaster

    Devaraju,

    By my math, you have 37GB of memory used per replica, so 74gb total or 18.5gb per node. It is quite likely that combined transaction log file size and checkpoint file size exceed the 32gb capacity of your smallest disk especially if you’re doing a batch load. This does not take into account whether or not the OS is also installed that disk as it would decrease the available space further.

    The solution is likely bigger disks or replication level = 1.

    We can confirm the issue further if you can provide the output of gs_stat and df -h on the small disk nodes.

    Owen

Viewing 5 posts - 1 through 5 (of 5 total)
Reply To: How main memory is distributed across the node is grid db cluster
Your information: