If a pipeline was previously using the DataprocPySparkBatchOp component and upgrades to dataproc 2.1, and the batch job takes longer than 4 hours to run, then it will not complete. Instead the batch ...
Run DataprocPySparkBatchOp: "Insufficient 'DISKS_TOTAL_GB' quota. #1805 Closed anhdangqb opened this issue on Apr 27, 2023 · 1 comment ...