caching - Hazelcast avg get latency is > 2 ms for 18k/s throughput

Question

Background: We are working on evaluating hazelcast which can act as an alternative of Redis.

Setup :

1. 3 members in a cluster under a single subnet (production boxes). Each member has ~1.4GB of data.
2. Near caching is off.
3. Each member has 1 backup.
4. Code deployed by preparing a spring boot jar and cache is implemented as embedded one.
5. VM config : 8C, 31GB RAM
6. code uses IMAP to retrieve and put the keys in the cache.

LoadTest : Attempted 18K/s rest API calls to read the data. But hazelcast is showing avg get latency of around 3-4ms which I feel should be in microsecond as we have been already seeing that much of get command latency with redis setup. CPU Load was ~95% during this test.

A member which gave this latency has heap usage of ~60% (committed: 7.85GB, used: 4.68GB). It is though with all the members in the cluster.

Need help to understand that is my configuration somewhere wrong, because of which I am NOT able to achieve get latency in microseconds?

Config for starting embedded cache:

        config.addMapConfig(mapConfig());

        NetworkConfig networkConfig = config.getNetworkConfig();
        JoinConfig join = networkConfig.getJoin();
        join.getMulticastConfig().setEnabled(false);
        join.getTcpIpConfig().setEnabled(true).setMembers(
                Arrays.asList(
                        "ip1:5701",
                        "ip2:5701",
                        "ip3:5701"
                )
        );
        return config;```

Answer 1

等待大神答复