Monitor broadcast variable's size.
Boardcast variable causes Spark driver OOM
Tag: data engineering
Why signal file is a bad idea
Replace it with direct API call
Monitor broadcast variable's size.
Replace it with direct API call
Yisheng's blog 