How to reduce the verbosity of sagemaker training jobs?-CodePudding

I am training a model with tqdm in the dataloader, the log prints every update in a seperate line that fills up the entire notebook. Is there a way to reduce the verbosity or remove the logs entirely from the jupyter cell similar to from IPython.display import clear_output clear_output(wait=True)?

CodePudding user response：

usually the logging can be controlled using the API parameters and SageMaker doesn't usually add a lot of additional verbose. If you are using a sagemaker notebook instance to run your training you can very well use Ipython clear_output as the notebook is based on jupyter lab.

CodePudding user response：

You can set log="None" inside the .fit() parameter.

Here's an example how I set it

job_name = "something"

model = sagemaker.estimator.Estimator(image_uri=container_image_uri,
                                    ...)
model.fit(inputs=train_input,
       job_name=job_name,
       wait=True,
       logs="None")