I'm Running any job then I want to log all information like ---
- job name
- Source detail and destination details (file name/Table name)
- No of records input and number of records processed or save. so I want log all the above information and insert into Mongodb using talend open studio Components also explain what component do I need to perform that task. need some serious response thanks.
CodePudding user response:
I have the solution but it is not proper please suggest some other methods using talend.
CodePudding user response:
I'd consider using log4j which has most of this information. Using MDC you could expand the log messages with custom attributes. Log4j does have a JSON format, and there seems to be a MongoDB appender as well.
It might take a bit more time to configure (I'd suggest adding the dependencies via a routine) but once configured it will require absolutely no configuration in the job. Using log4j you can create filters, etc.