Flink FAQs
What configurable parameters are there for FlinkDeployment?
You can refer to the FlinkDeployment
What are the parameters in the flinkConfiguration of FlinkDeployment?
Please refer to the FlinkConfiguration
Jobmanager and Taskmanager heartbeat timeout, causing Flink job exceptions.
- Analyze if there are any network flickers, and check if the cluster load is high at that time.
- Determine if there is frequent Full GC; if Full GC is frequent, users can investigate the code to confirm if there is a memory leak.
- Adjust the
taskManager.resource.memory
parameter to increase the resources for the Taskmanager.
OutOfMemoryError: Java heap space
The exception usually indicates that the JVM heap is too small.
- Adjust the
taskManager.resource.memory
parameter to increase the resources occupied by the Taskmanager.
- Optimize the code to reduce memory usage.
- Or configure the
taskmanager.memory.task.heap.size
in the flinkConfiguration
for reference. Refer
Increase the number of slots.
Could not allocate the required slot within slot request timeout
- Adjust the
taskmanager.numberOfTaskSlots
parameter to increase the number of slots.
- Adjust the parallelism of the job; excessive parallelism can lead to a shortage of slots.
IOException: Insufficient number of network buffers
This error typically indicates that the configured network memory size is not large enough. You can try to increase the network memory by adjusting the configurations in the flinkConfiguration
:
- taskmanager.memory.network.min
- taskmanager.memory.network.max
- taskmanager.memory.network.fraction