I want to programtically kill an EMR streaming task. If I kill it from EMR UI or boto client, it disappears in EMR, but it is still active in the Hadoop cluster (see this article). Only if I go through the Hadoop resource manager and kill it from there, the job is terminated. How can do the same programatically?
CodePudding user response:
You can ssh
to cluster and use yarn application -kill application_id
or use yarn api to kill application