When running a pipeline that has a BigQuery source, on your local machine, you continue to get permission denied errors. What could be the reason for that?
Answer(s): A
When reading from a Dataflow source or writing to a Dataflow sink using DirectPipelineRunner, the Cloud Platform account that you configured with the gcloud executable will need access to the corresponding source/sink
https://cloud.google.com/dataflow/java-sdk/JavaDoc/com/google/cloud/dataflow/sdk/runners/DirectPipelineRunner
What Dataflow concept determines when a Window's contents should be output based on certain criteria being met?
Answer(s): D
Triggers control when the elements for a specific key and window are output. As elements arrive, they are put into one or more windows by a Window transform and its associated WindowFn, and then passed to the associated Trigger to determine if the Windows contents should be output.
https://cloud.google.com/dataflow/java-sdk/JavaDoc/com/google/cloud/dataflow/sdk/transforms/windowing/Trigger
Which of the following is NOT one of the three main types of triggers that Dataflow supports?
There are three major kinds of triggers that Dataflow supports: 1. Time-based triggers 2. Data-driven triggers. You can set a trigger to emit results from a window when that window has received a certain number of data elements. 3. Composite triggers. These triggers combine multiple time-based or data-driven triggers in some logical way
https://cloud.google.com/dataflow/model/triggers
Which Java SDK class can you use to run your Dataflow programs locally?
Answer(s): B
DirectPipelineRunner allows you to execute operations in the pipeline directly, without any optimization. Useful for small local execution and tests
The Dataflow SDKs have been recently transitioned into which Apache service?
Dataflow SDKs are being transitioned to Apache Beam, as per the latest Google directive
https://cloud.google.com/dataflow/docs/
Post your Comments and Discuss Google Professional Data Engineer exam prep with other Community members:
Our website is free, but we have to fight against AI bots and content theft. We're sorry for the inconvenience caused by these security measures. You can access the rest of the Professional Data Engineer content, but please register or login to continue.