Running C4 dataset pipeline on Cloud Dataflow - running time and resources

What I need help with / What I was wondering
I'm running the C4 Dataflow pipeline as described in this guide:
https://www.tensorflow.org/datasets/beam_datasets.
At first, I ran it without any restrictions, and it tried to scale up, until it used all of our free addresses across our entire Gcloud account.
On the second run, we set max_workers to 20. It's running for quite some time (~72h) and we do not have any way to estimate for how long it will run, if there's any error (no errors are shown in logs).

We'll be happy to understand if that's reasonable running time, and to get some ways to inspect this pipeline and figure out our progress.

Thank you.

Environment information
(if applicable)

• Python version: 3.7.4
• tensorflow-datasets/tfds-nightly version: tfds-nightly
• tensorflow/tensorflow-gpu/tf-nightly/tf-nightly-gpu version: tensorflow 2

Start with the TensorFlow Datasets Beam datasets guide and the C4 Dataflow pipeline configuration, then inspect the Cloud Dataflow job and its logs with max_workers set to 20. The issue is asking whether a roughly 72-hour run is expected and how to expose progress or errors; the work is complete only when runtime expectations and a practical inspection method are established.