Package Classes (5.23.0)

The API interface for managing autoscaling policies in the Dataproc API.

The API interface for managing autoscaling policies in the Dataproc API.

A pager for iterating through list_autoscaling_policies requests.

This class thinly wraps an initial ListAutoscalingPoliciesResponse object, and provides an __aiter__ method to iterate through its policies field.

If there are more pages, the __aiter__ method will make additional ListAutoscalingPolicies requests and continue to iterate through the policies field on the corresponding responses.

All the usual ListAutoscalingPoliciesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_autoscaling_policies requests.

This class thinly wraps an initial ListAutoscalingPoliciesResponse object, and provides an __iter__ method to iterate through its policies field.

If there are more pages, the __iter__ method will make additional ListAutoscalingPolicies requests and continue to iterate through the policies field on the corresponding responses.

All the usual ListAutoscalingPoliciesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

The BatchController provides methods to manage batch workloads.

The BatchController provides methods to manage batch workloads.

A pager for iterating through list_batches requests.

This class thinly wraps an initial ListBatchesResponse object, and provides an __aiter__ method to iterate through its batches field.

If there are more pages, the __aiter__ method will make additional ListBatches requests and continue to iterate through the batches field on the corresponding responses.

All the usual ListBatchesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_batches requests.

This class thinly wraps an initial ListBatchesResponse object, and provides an __iter__ method to iterate through its batches field.

If there are more pages, the __iter__ method will make additional ListBatches requests and continue to iterate through the batches field on the corresponding responses.

All the usual ListBatchesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

The ClusterControllerService provides methods to manage clusters of Compute Engine instances.

The ClusterControllerService provides methods to manage clusters of Compute Engine instances.

A pager for iterating through list_clusters requests.

This class thinly wraps an initial ListClustersResponse object, and provides an __aiter__ method to iterate through its clusters field.

If there are more pages, the __aiter__ method will make additional ListClusters requests and continue to iterate through the clusters field on the corresponding responses.

All the usual ListClustersResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_clusters requests.

This class thinly wraps an initial ListClustersResponse object, and provides an __iter__ method to iterate through its clusters field.

If there are more pages, the __iter__ method will make additional ListClusters requests and continue to iterate through the clusters field on the corresponding responses.

All the usual ListClustersResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

The JobController provides methods to manage jobs.

The JobController provides methods to manage jobs.

A pager for iterating through list_jobs requests.

This class thinly wraps an initial ListJobsResponse object, and provides an __aiter__ method to iterate through its jobs field.

If there are more pages, the __aiter__ method will make additional ListJobs requests and continue to iterate through the jobs field on the corresponding responses.

All the usual ListJobsResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_jobs requests.

This class thinly wraps an initial ListJobsResponse object, and provides an __iter__ method to iterate through its jobs field.

If there are more pages, the __iter__ method will make additional ListJobs requests and continue to iterate through the jobs field on the corresponding responses.

All the usual ListJobsResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

The NodeGroupControllerService provides methods to manage node groups of Compute Engine managed instances.

The NodeGroupControllerService provides methods to manage node groups of Compute Engine managed instances.

The SessionController provides methods to manage interactive sessions.

The SessionController provides methods to manage interactive sessions.

A pager for iterating through list_sessions requests.

This class thinly wraps an initial ListSessionsResponse object, and provides an __aiter__ method to iterate through its sessions field.

If there are more pages, the __aiter__ method will make additional ListSessions requests and continue to iterate through the sessions field on the corresponding responses.

All the usual ListSessionsResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_sessions requests.

This class thinly wraps an initial ListSessionsResponse object, and provides an __iter__ method to iterate through its sessions field.

If there are more pages, the __iter__ method will make additional ListSessions requests and continue to iterate through the sessions field on the corresponding responses.

All the usual ListSessionsResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

The SessionTemplateController provides methods to manage session templates.

The SessionTemplateController provides methods to manage session templates.

A pager for iterating through list_session_templates requests.

This class thinly wraps an initial ListSessionTemplatesResponse object, and provides an __aiter__ method to iterate through its session_templates field.

If there are more pages, the __aiter__ method will make additional ListSessionTemplates requests and continue to iterate through the session_templates field on the corresponding responses.

All the usual ListSessionTemplatesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_session_templates requests.

This class thinly wraps an initial ListSessionTemplatesResponse object, and provides an __iter__ method to iterate through its session_templates field.

If there are more pages, the __iter__ method will make additional ListSessionTemplates requests and continue to iterate through the session_templates field on the corresponding responses.

All the usual ListSessionTemplatesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

The API interface for managing Workflow Templates in the Dataproc API.

The API interface for managing Workflow Templates in the Dataproc API.

A pager for iterating through list_workflow_templates requests.

This class thinly wraps an initial ListWorkflowTemplatesResponse object, and provides an __aiter__ method to iterate through its templates field.

If there are more pages, the __aiter__ method will make additional ListWorkflowTemplates requests and continue to iterate through the templates field on the corresponding responses.

All the usual ListWorkflowTemplatesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

A pager for iterating through list_workflow_templates requests.

This class thinly wraps an initial ListWorkflowTemplatesResponse object, and provides an __iter__ method to iterate through its templates field.

If there are more pages, the __iter__ method will make additional ListWorkflowTemplates requests and continue to iterate through the templates field on the corresponding responses.

All the usual ListWorkflowTemplatesResponse attributes are available on the pager. If multiple requests are made, only the most recent response is retained, and thus used for attribute lookup.

Specifies the type and number of accelerator cards attached to the instances of an instance. See GPUs on Compute Engine <https://cloud.google.com/compute/docs/gpus/>__.

Authentication configuration for a workload is used to set the default identity for the workload execution. The config specifies the type of identity (service account or user) that will be used by workloads to access resources on the project(s).

Authentication types for workload execution.

Autoscaling Policy config associated with the cluster.

Describes an autoscaling policy for Dataproc cluster autoscaler.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Autotuning configuration of the workload.

Scenario represents a specific goal that autotuning will attempt to achieve by modifying workloads.

Node group identification and configuration information.

Auxiliary services configuration for a Cluster.

Basic algorithm for autoscaling.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Basic autoscaling configurations for YARN.

A representation of a batch workload in the service.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The batch state.

Historical state information.

Metadata describing the Batch operation.

Operation type for Batch resources

The abstract base class for a message.

A request to cancel a job.

Describes the identifying information, config, and status of a Dataproc cluster

The abstract base class for a message.

The cluster config.

The cluster tier.

Contains cluster daemon metrics, such as HDFS and YARN stats.

Beta Feature: This report is available for testing purposes only. It may be changed before final release.

The abstract base class for a message.

The abstract base class for a message.

The cluster operation triggered by a workflow.

Metadata describing the operation.

The abstract base class for a message.

The status of the operation.

The operation state.

A selector that chooses target cluster for jobs based on metadata.

The abstract base class for a message.

The status of a cluster and its instances.

The cluster state.

 **Note:** The cluster state changes from "creating" to "running" status after the master node(s), first two primary worker nodes (and the last primary worker node if primary workers > 2) are running. ERROR (3): The cluster encountered an error. It is not ready for use. ERROR_DUE_TO_UPDATE (9): The cluster has encountered an error while being updated. Jobs can be submitted to the cluster, but the cluster cannot be updated. DELETING (4): The cluster is being deleted. It cannot be used. UPDATING (5): The cluster is being updated. It continues to accept and process jobs. STOPPING (6): The cluster is being stopped. It cannot be used. STOPPED (7): The cluster is currently stopped. It is not ready for use. STARTING (8): The cluster is being started. It is not ready for use. REPAIRING (10): The cluster is being repaired. It is not ready for use. 

The cluster substate.

 Applies to RUNNING state. STALE_STATUS (2): The agent-reported status is out of date (may occur if Dataproc loses communication with Agent). Applies to RUNNING state. 

Cluster components that can be activated.

Confidential Instance Config for clusters using Confidential VMs <https://cloud.google.com/compute/confidential-vm/docs>__

A request to create an autoscaling policy.

A request to create a batch workload.

A request to create a cluster.

A request to create a node group.

A request to create a session.

A request to create a session template.

A request to create a workflow template.

Dataproc metric config.

A Dataproc custom metric.

A source for the collection of Dataproc custom metrics (see Custom metrics).

A request to delete an autoscaling policy.

Autoscaling policies in use by one or more clusters will not be deleted.

A request to delete a batch workload.

A request to delete a cluster.

A request to delete a job.

A request to delete a session.

A request to delete a session template.

A request to delete a workflow template.

Currently started workflows will remain running.

A request to collect cluster diagnostic information.

Defines who has access to the diagnostic tarball

The location of diagnostic output.

Specifies the config of disk options for a group of VM instances.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Driver scheduling configuration.

Encryption settings for the cluster.

Endpoint config for this cluster

The abstract base class for a message.

Environment configuration for a workload.

Execution configuration for a workload.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Actions in response to failure of a resource associated with a cluster.

A Dataproc job for running Apache Flink applications on YARN.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

PrivateIpv6GoogleAccess controls whether and how Dataproc cluster nodes can communicate with Google Services through gRPC over IPv6. These values are directly mapped to corresponding values in the Compute Engine Instance fields <https://cloud.google.com/compute/docs/reference/rest/v1/instances>__.

A request to fetch an autoscaling policy.

A request to get the resource representation for a batch workload.

Request to get the resource representation for a cluster in a project.

A request to get the resource representation for a job in a project.

A request to get a node group .

A request to get the resource representation for a session.

A request to get the resource representation for a session template.

A request to fetch a workflow template.

The cluster's GKE config.

The configuration of a GKE node pool used by a Dataproc-on-GKE cluster <https://cloud.google.com/dataproc/docs/concepts/jobs/dataproc-gke#create-a-dataproc-on-gke-cluster>__.

Parameters that describe cluster nodes.

A GkeNodeConfigAcceleratorConfig represents a Hardware Accelerator request for a node pool.

GkeNodePoolAutoscaling contains information the cluster autoscaler needs to adjust the size of the node pool to the current cluster usage.

GKE node pools that Dataproc workloads run on.

Role specifies the tasks that will run on the node pool. Roles can be specific to workloads. Exactly one GkeNodePoolTarget within the virtual cluster must have the DEFAULT role, which is used to run all workloads that are not associated with a node pool.

A Dataproc job for running Apache Hadoop MapReduce <https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html> jobs on Apache Hadoop YARN <https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html>.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

A Dataproc job for running Apache Hive <https://hive.apache.org/>__ queries on YARN.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The abstract base class for a message.

Identity related configuration, including service account based secure multi-tenancy user mappings.

The abstract base class for a message.

Instance flexibility Policy allowing a mixture of VM shapes and provisioning models.

Defines machines types and a rank to which the machines types belong.

Defines a mapping from machine types to the number of VMs that are created with each machine type.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Defines how Dataproc should create VMs with a mixture of provisioning models.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Configuration for the size bounds of an instance group, including its proportional size to other groups.

The config settings for Compute Engine resources in an instance group, such as a master or worker group.

Controls the use of preemptible instances within the group.

 This option is allowed for all instance groups and is the only valid value for Master and Worker instance groups. PREEMPTIBLE (2): Instances are [preemptible] (https://cloud.google.com/compute/docs/instances/preemptible). This option is allowed only for [secondary worker] (https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms) groups. SPOT (3): Instances are [Spot VMs] (https://cloud.google.com/compute/docs/instances/spot). This option is allowed only for [secondary worker] (https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms) groups. Spot VMs are the latest version of [preemptible VMs] (https://cloud.google.com/compute/docs/instances/preemptible), and provide additional features. 

A reference to a Compute Engine instance.

A request to instantiate an inline workflow template.

A request to instantiate a workflow template.

The abstract base class for a message.

A Dataproc job resource.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Job Operation metadata.

Dataproc job config.

The abstract base class for a message.

Encapsulates the full scoping used to reference a job.

Job scheduling options.

Dataproc job status.

The job state.

 Applies to restartable jobs only. 

The job substate.

 Applies to RUNNING state. QUEUED (2): The Job has been received and is awaiting execution (it might be waiting for a condition to be met). See the "details" field for the reason for the delay. Applies to RUNNING state. STALE_STATUS (3): The agent-reported status is out of date, which can be caused by a loss of communication between the agent and Dataproc. If the agent does not send a timely update, the job will fail. Applies to RUNNING state. 

Jupyter configuration for an interactive session.

Jupyter kernel types.

Specifies Kerberos related configuration.

The configuration for running the Dataproc cluster on Kubernetes.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The software configuration for this Dataproc cluster running on Kubernetes.

The abstract base class for a message.

The abstract base class for a message.

Specifies the cluster auto-delete schedule configuration.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

A request to list autoscaling policies in a project.

A response to a request to list autoscaling policies in a project.

A request to list batch workloads in a project.

A list of batch workloads.

A request to list the clusters in a project.

The list of all clusters in a project.

A request to list jobs in a project.

A matcher that specifies categories of job states.

A list of jobs in a project.

A request to list session templates in a project.

A list of session templates.

A request to list sessions in a project.

A list of interactive sessions.

A request to list workflow templates in a project.

A response to a request to list workflow templates in a project.

The runtime logging config of the job.

The abstract base class for a message.

The Log4j level for job execution. When running an Apache Hive <https://hive.apache.org/>__ job, Cloud Dataproc configures the Hive client to an equivalent verbosity level.

Cluster that is managed by the workflow.

The abstract base class for a message.

Specifies the resources used to actively manage an instance group.

Specifies a Metastore configuration.

Dataproc Node Group. The Dataproc NodeGroup resource is not related to the Dataproc NodeGroupAffinity resource.

The abstract base class for a message.

Node pool roles.

Node Group Affinity for clusters using sole-tenant node groups. The Dataproc NodeGroupAffinity resource is not related to the Dataproc NodeGroup resource.

Metadata describing the node group operation.

The abstract base class for a message.

Operation type for node group resources.

Specifies an executable to run on a fully configured node and a timeout period for executable completion.

A job executed by the workflow.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Configuration for parameter validation.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Auxiliary services configuration for a workload.

A Dataproc job for running Apache Pig <https://pig.apache.org/>__ queries on YARN.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The abstract base class for a message.

A Dataproc job for running Presto <https://prestosql.io/> queries. IMPORTANT: The Dataproc Presto Optional Component <https://cloud.google.com/dataproc/docs/concepts/components/presto> must be enabled when the cluster is created to submit a Presto job to the cluster.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Configuration for PyPi repository

A configuration for running an Apache PySpark <https://spark.apache.org/docs/latest/api/python/getting_started/quickstart.html>__ batch workload.

A Dataproc job for running Apache PySpark <https://spark.apache.org/docs/0.9.0/python-programming-guide.html>__ applications on YARN.

The abstract base class for a message.

A list of queries to run on a cluster.

Validation based on regular expressions.

Configuration for dependency repositories

Reservation Affinity for consuming Zonal reservation.

Indicates whether to consume capacity from an reservation or not.

A request to resize a node group.

Runtime configuration for a workload.

The abstract base class for a message.

Runtime information about workload execution.

The abstract base class for a message.

Security related configuration, including encryption, Kerberos, etc.

A representation of a session.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Historical state information.

The session state.

Metadata describing the Session operation.

The abstract base class for a message.

Operation type for Session resources

A representation of a session template.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

Shielded Instance Config for clusters using Compute Engine Shielded VMs <https://cloud.google.com/security/shielded-cloud/shielded-vm>__.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Specifies the selection and config of software inside the cluster.

The abstract base class for a message.

A configuration for running an Apache Spark <https://spark.apache.org/>__ batch workload.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Spark Connect configuration for an interactive session.

Spark History Server configuration for the workload.

A Dataproc job for running Apache Spark <https://spark.apache.org/>__ applications on YARN.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

A configuration for running an Apache SparkR <https://spark.apache.org/docs/latest/sparkr.html>__ batch workload.

A Dataproc job for running Apache SparkR <https://spark.apache.org/docs/latest/sparkr.html>__ applications on YARN.

The abstract base class for a message.

A configuration for running Apache Spark SQL <https://spark.apache.org/sql/>__ queries as a batch workload.

The abstract base class for a message.

A Dataproc job for running Apache Spark SQL <https://spark.apache.org/sql/>__ queries.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

The abstract base class for a message.

A request to start a cluster.

Configuration to handle the startup of instances during cluster create and update process.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

A request to stop a cluster.

A request to submit a job.

A configurable parameter that replaces one or more fields in the template. Parameterizable fields:

• Labels
• File uris
• Job properties
• Job arguments
• Script variables
• Main class (in HadoopJob and SparkJob)
• Zone (in ClusterSelector)

A request to terminate an interactive session.

A Dataproc job for running Trino <https://trino.io/> queries. IMPORTANT: The Dataproc Trino Optional Component <https://cloud.google.com/dataproc/docs/concepts/components/trino> must be enabled when the cluster is created to submit a Trino job to the cluster.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The abstract base class for a message.

A request to update an autoscaling policy.

A request to update a cluster.

A request to update a job.

A request to update a session template.

A request to update a workflow template.

Usage metrics represent approximate total resources consumed by a workload.

The usage snapshot represents the resources consumed by a workload at a specified time.

Validation based on a list of allowed values.

The Dataproc cluster config for a cluster that does not directly control the underlying compute resources, such as a Dataproc-on-GKE cluster <https://cloud.google.com/dataproc/docs/guides/dpgke/dataproc-gke-overview>__.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

The workflow graph.

A Dataproc workflow template resource.

The abstract base class for a message.

The operation state.

The workflow node.

The workflow node state.

A Dataproc workflow template resource.

Encryption settings for encrypting workflow template job arguments.

The abstract base class for a message.

Specifies workflow execution target.

Either managed_cluster or cluster_selector is required.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

A YARN application created by a job. Application information is a subset of org.apache.hadoop.yarn.proto.YarnProtos.ApplicationReportProto.

Beta Feature: This report is available for testing purposes only. It may be changed before final release.

The application state, corresponding to YarnProtos.YarnApplicationStateProto.

API documentation for dataproc_v1.services.autoscaling_policy_service.pagers module.

API documentation for dataproc_v1.services.batch_controller.pagers module.

API documentation for dataproc_v1.services.cluster_controller.pagers module.

API documentation for dataproc_v1.services.job_controller.pagers module.

API documentation for dataproc_v1.services.session_controller.pagers module.

API documentation for dataproc_v1.services.session_template_controller.pagers module.

API documentation for dataproc_v1.services.workflow_template_service.pagers module.