Is it possible to create cluster without replica..?

Home Forums Developer Forum Is it possible to create cluster without replica..?

This topic contains 7 replies, has 2 voices, and was last updated by  Devaraju M K (TSIP INIDA) 3 months, 1 week ago.

Viewing 8 posts - 1 through 8 (of 8 total)
  • Author
    Posts
  • #24423 Reply

    Devaraju MK (TSIP)

    Hi,

    I have created cluster with 4 nodes without replica factor. disk size of the node is 64GB, 64GB, 32GB and 32GB respectively. whatever data has inserted, all data goes to only last 2 node which are having 32GB SDD. But data can not be stored in 64SDD node. From this i am not able to understand how disk has been shared in cluster node. For this issue i am getting following error and cluster want failed.
    Log:
    ERROR TRANSACTION_SERVICE [80007:LM_WRITE_LOG_BLOCK_FAILED] Failed to accept replication log (nd={serverId=3, address=10.10.10.76:10001}, pId=83, reason=Apply replication log failed. (mode=0, pId=83, reason=Write log block failed. reason=(Result size unmatched (path=data/gs_log_0_79.log))))
    2018-04-11T06:44:45.562Z griddb-follower-node3-vm 29673 ERROR TRANSACTION_SERVICE [10026:TXN_REPLICATION_LOG_LSN_INVALID] Failed to redo log (nd={serverId=3, address=10.10.10.76:10001}, pId=83, reason=(mode=0, pId=83, reason=Invalid LSN (pId=83, currentLsn=100575, logLsn=100577)))

    Configuration Details:
    gs_cluster.json:
    {
    “dataStore”:{
    “partitionNum”:128,
    “storeBlockSize”:”1MB”
    },
    “cluster”:{
    “clusterName”:”GS_CLUSTER”,
    “notificationInterval”:”5s”,
    “heartbeatInterval”:”5s”,
    “loadbalanceCheckInterval”:”5s”,
    “notificationMember”:[
    {
    “cluster”:{“address”:”10.10.10.68″, “port”:10010},
    “sync”:{“address”:”10.10.10.68″, “port”:10020},
    “system”:{“address”:”10.10.10.68″,”port”:10040},
    “transaction”:{“address”:”10.10.10.68″,”port”:10001},
    “sql”:{“address”:”10.10.10.68″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.74″,”port”:10010},
    “sync”:{“address”:”10.10.10.74″,”port”:10020},
    “system”:{“address”:”10.10.10.74″,”port”:10040},
    “transaction”:{“address”:”10.10.10.74″,”port”:10001},
    “sql”:{“address”:”10.10.10.74″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.75″,”port”:10010},
    “sync”:{“address”:”10.10.10.75″,”port”:10020},
    “system”:{“address”:”10.10.10.75″,”port”:10040},
    “transaction”:{“address”:”10.10.10.75″,”port”:10001},
    “sql”:{“address”:”10.10.10.75″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.76″,”port”:10010},
    “sync”:{“address”:”10.10.10.76″,”port”:10020},
    “system”:{“address”:”10.10.10.76″,”port”:10040},
    “transaction”:{“address”:”10.10.10.76″,”port”:10001},
    “sql”:{“address”:”10.10.10.76″, “port”:20001}
    }
    ]
    },
    “sync”:{
    “timeoutInterval”:”30s”
    }
    }
    gs_node.jsno
    {
    “dataStore”:{
    “partitionNum”:128,
    “storeBlockSize”:”1MB”
    },
    “cluster”:{
    “clusterName”:”GS_CLUSTER”,
    “notificationInterval”:”5s”,
    “heartbeatInterval”:”5s”,
    “loadbalanceCheckInterval”:”5s”,
    “notificationMember”:[
    {
    “cluster”:{“address”:”10.10.10.68″, “port”:10010},
    “sync”:{“address”:”10.10.10.68″, “port”:10020},
    “system”:{“address”:”10.10.10.68″,”port”:10040},
    “transaction”:{“address”:”10.10.10.68″,”port”:10001},
    “sql”:{“address”:”10.10.10.68″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.74″,”port”:10010},
    “sync”:{“address”:”10.10.10.74″,”port”:10020},
    “system”:{“address”:”10.10.10.74″,”port”:10040},
    “transaction”:{“address”:”10.10.10.74″,”port”:10001},
    “sql”:{“address”:”10.10.10.74″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.75″,”port”:10010},
    “sync”:{“address”:”10.10.10.75″,”port”:10020},
    “system”:{“address”:”10.10.10.75″,”port”:10040},
    “transaction”:{“address”:”10.10.10.75″,”port”:10001},
    “sql”:{“address”:”10.10.10.75″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.76″,”port”:10010},
    “sync”:{“address”:”10.10.10.76″,”port”:10020},
    “system”:{“address”:”10.10.10.76″,”port”:10040},
    “transaction”:{“address”:”10.10.10.76″,”port”:10001},
    “sql”:{“address”:”10.10.10.76″, “port”:20001}
    }
    ]
    },
    “sync”:{
    “timeoutInterval”:”30s”
    }
    }

    Please help us to resolve the issue.

    Thanks and regards
    Devaraju M K
    TOSHIBA INDIA

    #24433 Reply

    Owen
    Keymaster

    Can you share the client’s gsProperties settings?

    Also, to disable replication, you need to edit the configs so replicationNumber is 1 on all nodes.

    #24483 Reply

    Anonymous

    Hi Owen-san,

    I have changed my replication factor to 1. Now data is not distributed with other node SSD,
    all data has been stored in last node which has 32GB SSD. please share your concern.

    Thanks and regards
    Devaraju M K

    #24493 Reply

    Devaraju M K (TSIP INIDA)

    Hi Owen-san,

    Can you share the client’s gsProperties settings?
    >>

    notificationMember: 10.10.10.68:10001
    clusterName: GS_CLUSTER
    database: public
    user: admin
    password: xxxx

    I have changed my replication factor to 1. still data is not distributed with other node SSD,
    all data has been stored in last node which has 32GB SSD. please share your concern.

    Thanks and regards
    Devaraju M K

    #24513 Reply

    Owen
    Keymaster

    Devaraju,

    notificationMember should include all of the nodes in your GridDB cluster, not just one.

    notificationMember=”10.10.10.68:10001,10.10.10.74:10001,10.10.10.75:10001,10.10.10.76:10001″

    Owen

    #24523 Reply

    Devaraju MK (TSIP)

    Dear Owen-san,

    Thanks for your suggestion.

    >>>>notificationMember=”10.10.10.68:10001,10.10.10.74:10001,10.10.10.75:10001,10.10.10.76:10001″
    We tried with your approach but still problem is exist. please share your concern.

    Please find attached gs_node.json and ge_cluster.json config file

    gs_node.json
    {
    “dataStore”:{
    “dbPath”:”data”,
    “backupPath”:”backup”,
    “storeMemoryLimit”:”10GB”,
    “storeWarmStart”:true,
    “concurrency”:1,
    “logWriteMode”:1,
    “persistencyMode”:”NORMAL”,
    “affinityGroupSize”:4,
    “storeCompressionMode”:”NO_COMPRESSION”
    },
    “checkpoint”:{
    “checkpointInterval”:”1200s”,
    “checkpointMemoryLimit”:”1024MB”,
    “useParallelMode”:false
    },
    “cluster”:{
    “servicePort”:10010
    },
    “sync”:{
    “servicePort”:10020
    },
    “system”:{
    “servicePort”:10040,
    “eventLogPath”:”log”
    },
    “transaction”:{
    “servicePort”:10001,
    “connectionLimit”:5000
    },
    “sql”:{
    “servicePort”:20001,
    “storeMemoryLimit”:”1024MB”,
    “workMemoryLimit”:”128MB”,
    “workCacheMemory”:”128MB”,
    “connectionLimit”:5000,
    “concurrency”:5
    },
    “trace”:{
    “default”:”LEVEL_ERROR”,
    “dataStore”:”LEVEL_ERROR”,
    “collection”:”LEVEL_ERROR”,
    “timeSeries”:”LEVEL_ERROR”,
    “chunkManager”:”LEVEL_ERROR”,
    “objectManager”:”LEVEL_ERROR”,
    “checkpointFile”:”LEVEL_ERROR”,
    “checkpointService”:”LEVEL_INFO”,
    “logManager”:”LEVEL_WARNING”,
    “clusterService”:”LEVEL_ERROR”,
    “syncService”:”LEVEL_ERROR”,
    “systemService”:”LEVEL_INFO”,
    “transactionManager”:”LEVEL_ERROR”,
    “transactionService”:”LEVEL_ERROR”,
    “transactionTimeout”:”LEVEL_WARNING”,
    “triggerService”:”LEVEL_ERROR”,
    “sessionTimeout”:”LEVEL_WARNING”,
    “replicationTimeout”:”LEVEL_WARNING”,
    “recoveryManager”:”LEVEL_INFO”,
    “sqlService”:”LEVEL_WARNING”,
    “eventEngine”:”LEVEL_WARNING”,
    “clusterOperation”:”LEVEL_INFO”,
    “ioMonitor”:”LEVEL_WARNING”
    }
    }

    gs_cluster.json
    {
    “dataStore”:{
    “partitionNum”:128,
    “storeBlockSize”:”1MB”
    },
    “cluster”:{
    “clusterName”:”GS_CLUSTER”,
    “notificationInterval”:”5s”,
    “replicationNum”:1,
    “heartbeatInterval”:”5s”,
    “loadbalanceCheckInterval”:”5s”,
    “notificationMember”:[
    {
    “cluster”:{“address”:”10.10.10.68″, “port”:10010},
    “sync”:{“address”:”10.10.10.68″, “port”:10020},
    “system”:{“address”:”10.10.10.68″,”port”:10040},
    “transaction”:{“address”:”10.10.10.68″,”port”:10001},
    “sql”:{“address”:”10.10.10.68″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.74″,”port”:10010},
    “sync”:{“address”:”10.10.10.74″,”port”:10020},
    “system”:{“address”:”10.10.10.74″,”port”:10040},
    “transaction”:{“address”:”10.10.10.74″,”port”:10001},
    “sql”:{“address”:”10.10.10.74″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.75″,”port”:10010},
    “sync”:{“address”:”10.10.10.75″,”port”:10020},
    “system”:{“address”:”10.10.10.75″,”port”:10040},
    “transaction”:{“address”:”10.10.10.75″,”port”:10001},
    “sql”:{“address”:”10.10.10.75″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.76″,”port”:10010},
    “sync”:{“address”:”10.10.10.76″,”port”:10020},
    “system”:{“address”:”10.10.10.76″,”port”:10040},
    “transaction”:{“address”:”10.10.10.76″,”port”:10001},
    “sql”:{“address”:”10.10.10.76″, “port”:20001}
    }
    ]
    },
    “sync”:{
    “timeoutInterval”:”30s”
    }
    }

    Thanks and Regards
    Devaraju M K
    TOSHIBA SOFTWARE INDIA PVT LTD

    #24533 Reply

    Devaraju MK (TSIP)

    Dear Owen-san,

    Thanks for your suggestion.

    >>>>notificationMember=”10.10.10.68:10001,10.10.10.74:10001,10.10.10.75:10001,10.10.10.76:10001″
    We tried with your approach but still problem is exist. please share your concern.

    Please find attached gs_node.json and ge_cluster.json config file

    gs_node.json
    {
    “dataStore”:{
    “dbPath”:”data”,
    “backupPath”:”backup”,
    “storeMemoryLimit”:”10GB”,
    “storeWarmStart”:true,
    “concurrency”:1,
    “logWriteMode”:1,
    “persistencyMode”:”NORMAL”,
    “affinityGroupSize”:4,
    “storeCompressionMode”:”NO_COMPRESSION”
    },
    “checkpoint”:{
    “checkpointInterval”:”1200s”,
    “checkpointMemoryLimit”:”1024MB”,
    “useParallelMode”:false
    },
    “cluster”:{
    “servicePort”:10010
    },
    “sync”:{
    “servicePort”:10020
    },
    “system”:{
    “servicePort”:10040,
    “eventLogPath”:”log”
    },
    “transaction”:{
    “servicePort”:10001,
    “connectionLimit”:5000
    },
    “sql”:{
    “servicePort”:20001,
    “storeMemoryLimit”:”1024MB”,
    “workMemoryLimit”:”128MB”,
    “workCacheMemory”:”128MB”,
    “connectionLimit”:5000,
    “concurrency”:5
    },
    “trace”:{
    “default”:”LEVEL_ERROR”,
    “dataStore”:”LEVEL_ERROR”,
    “collection”:”LEVEL_ERROR”,
    “timeSeries”:”LEVEL_ERROR”,
    “chunkManager”:”LEVEL_ERROR”,
    “objectManager”:”LEVEL_ERROR”,
    “checkpointFile”:”LEVEL_ERROR”,
    “checkpointService”:”LEVEL_INFO”,
    “logManager”:”LEVEL_WARNING”,
    “clusterService”:”LEVEL_ERROR”,
    “syncService”:”LEVEL_ERROR”,
    “systemService”:”LEVEL_INFO”,
    “transactionManager”:”LEVEL_ERROR”,
    “transactionService”:”LEVEL_ERROR”,
    “transactionTimeout”:”LEVEL_WARNING”,
    “triggerService”:”LEVEL_ERROR”,
    “sessionTimeout”:”LEVEL_WARNING”,
    “replicationTimeout”:”LEVEL_WARNING”,
    “recoveryManager”:”LEVEL_INFO”,
    “sqlService”:”LEVEL_WARNING”,
    “eventEngine”:”LEVEL_WARNING”,
    “clusterOperation”:”LEVEL_INFO”,
    “ioMonitor”:”LEVEL_WARNING”
    }
    }

    gs_cluster.json
    {
    “dataStore”:{
    “partitionNum”:128,
    “storeBlockSize”:”1MB”
    },
    “cluster”:{
    “clusterName”:”GS_CLUSTER”,
    “notificationInterval”:”5s”,
    “replicationNum”:1,
    “heartbeatInterval”:”5s”,
    “loadbalanceCheckInterval”:”5s”,
    “notificationMember”:[
    {
    “cluster”:{“address”:”10.10.10.68″, “port”:10010},
    “sync”:{“address”:”10.10.10.68″, “port”:10020},
    “system”:{“address”:”10.10.10.68″,”port”:10040},
    “transaction”:{“address”:”10.10.10.68″,”port”:10001},
    “sql”:{“address”:”10.10.10.68″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.74″,”port”:10010},
    “sync”:{“address”:”10.10.10.74″,”port”:10020},
    “system”:{“address”:”10.10.10.74″,”port”:10040},
    “transaction”:{“address”:”10.10.10.74″,”port”:10001},
    “sql”:{“address”:”10.10.10.74″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.75″,”port”:10010},
    “sync”:{“address”:”10.10.10.75″,”port”:10020},
    “system”:{“address”:”10.10.10.75″,”port”:10040},
    “transaction”:{“address”:”10.10.10.75″,”port”:10001},
    “sql”:{“address”:”10.10.10.75″, “port”:20001}
    },
    {
    “cluster”:{“address”:”10.10.10.76″,”port”:10010},
    “sync”:{“address”:”10.10.10.76″,”port”:10020},
    “system”:{“address”:”10.10.10.76″,”port”:10040},
    “transaction”:{“address”:”10.10.10.76″,”port”:10001},
    “sql”:{“address”:”10.10.10.76″, “port”:20001}
    }
    ]
    },
    “sync”:{
    “timeoutInterval”:”30s”
    }
    }

    gs_node.json and gs_cluster files are same for all the nodes.

    Thanks and Regards
    Devaraju M K
    TOSHIBA SOFTWARE INDIA PVT LTD

    #24543 Reply

    Devaraju M K (TSIP INIDA)

    Still same problem is exist. Whatever data has been inserted into cluster, it stored inside node_4 only, all others node’s disk and main memory cannot be used by cluster except node_v4.
    If the node_4 disk is full then node_4 went to abnormal state and cluster failed.

    Thanks and regards
    Devaraju M K

Viewing 8 posts - 1 through 8 (of 8 total)
Reply To: Is it possible to create cluster without replica..?
Your information: