It turned out to be the spark configuration parameter - maxConnections was set low. We had to set it at 1.2*Number of cores to make sure there are enough connections.
1 Like
It turned out to be the spark configuration parameter - maxConnections was set low. We had to set it at 1.2*Number of cores to make sure there are enough connections.