Dataflow: No Worker Activity

I'm having a few problems running a relatively vanilla Dataflow job from an AI Platform Notebook (the job is meant to take data from BigQuery > cleanse and prep > write to a

Solution 1:

Upon code inspection, I noticed that the syntax of the ‘WriteToText transform’ used does not match the one suggested in the Apache beam docs.

Please follow the “WriteToText” argument syntax as outlined in here.

The suggested workaround is to consider using BQ to CSV file export option available in batch mode.

There are even more export options available. The full list can be found in “the data formats and compression types” documentation here.