awswrangler.emr.submit_steps

awswrangler.emr.submit_steps(cluster_id: str, steps: List[Dict[str, Any]], boto3_session: Optional[boto3.session.Session] = None)List[str]

Submit a list of steps.

Parameters
  • cluster_id (str) – Cluster ID.

  • steps (List[Dict[str, Any]]) – Steps definitions (Obs: Use EMR.build_step() to build it).

  • boto3_session (boto3.Session(), optional) – Boto3 Session. The default boto3 session will be used if boto3_session receive None.

Returns

List of step IDs.

Return type

List[str]

Examples

>>> import awswrangler as wr
>>> for cmd in ['echo "Hello"', "ls -la"]:
...     steps.append(wr.emr.build_step(name=cmd, command=cmd))
>>> wr.emr.submit_steps(cluster_id="cluster-id", steps=steps)