Python logger - Redirecting STDOUT to logfile as well as any debug messages

Well, I can make it work, but I don't yet know whether there are any repercussions due to it. Perhaps others will be able to point out any potential pitfalls, such as multithreading.

You can set sys.stdout to any file-like object that you like. This would include the file to which your logging.FileHandler() is writing. Try this:

fh = logging.FileHandler('debug.log') fh.setLevel(logging.DEBUG) old_stdout = sys.stdout # in case you want to restore later sys.stdout = fh.stream # the file to which fh writes 

And you can remove the code that deals with sh that is hooked up to stdout.

If you really want all output to stdout to end up in the log file, see e.g. mhawke's answer, as well as the linked questions and answers.

However, if you are really just interested in the output from your own print() calls, then I would replace all of those by Logger.log() calls, using a custom logging level. That gives you fine-grained control over what happens.

Below, I define a custom log level with a value higher than logging.CRITICAL, so our console output is always printed, even if the logger's level is CRITICAL. See docs.

Here's a minimal implementation, based on the OP's example:

import sys import logging # define a custom log level with a value higher than CRITICAL CUSTOM_LEVEL = 100 # dedicated formatter that just prints the unformatted message # (actually this is the default behavior, but we make it explicit here) # See docs: https://docs.python.org/3/library/logging.html#logging.Formatter console_formatter = logging.Formatter('%(message)s') # your basic console stream handler console_handler = logging.StreamHandler(sys.stdout) console_handler.setFormatter(console_formatter) # only use this handler for our custom level messages (highest level) console_handler.setLevel(CUSTOM_LEVEL) # your basic file formatter and file handler file_formatter = logging.Formatter( '%(asctime)s - %(name)s - %(levelname)s - %(message)s') file_handler = logging.FileHandler('debug.log') file_handler.setFormatter(file_formatter) file_handler.setLevel(logging.DEBUG) # use a module logger instead of the root logger logger = logging.getLogger(__name__) # add the handlers logger.addHandler(console_handler) logger.addHandler(file_handler) # include messages with level DEBUG and higher logger.setLevel(logging.DEBUG) # NOW, instead of using print(), we use logger.log() with our CUSTOM_LEVEL x = 4 y = 5 logger.debug(f'X: {x}') logger.debug(f'Y: {y}') logger.log(CUSTOM_LEVEL, f'x is {x}') logger.log(CUSTOM_LEVEL, f'y is {y}') logger.log(CUSTOM_LEVEL, f'x * y = {x*y}') logger.log(CUSTOM_LEVEL, f'x^y = {x**y}') 

I don't think you want ALL stdout output going to log file.

What you could do is set the logging level of the console handler to logging.INFO and the logging level of the file handler to logging.DEBUG. Then replace your print statements with calls to logging.info. This way only info messages and above will be output to the console.

Something like this:

import logging import sys logger = logging.getLogger(__name__) console_handler = logging.StreamHandler(sys.stdout) file_handler = logging.FileHandler("debug.log") console_handler.setLevel(logging.INFO) file_handler.setLevel(logging.DEBUG) console_formatter = logging.Formatter('%(message)s') file_formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s') console_handler.setFormatter(console_formatter) file_handler.setFormatter(file_formatter) logger.addHandler(console_handler) logger.addHandler(file_handler) logger.setLevel(logging.DEBUG) #set root logging level to DEBUG if __name__ == "__main__": x = 4 y = 5 logger.debug("X: %s", x) logger.debug("Y: %s", y) logger.info("x is {}".format(x)) logger.info("y is {}".format(y)) logger.info("x * y = {}".format(x * y)) logger.info("x^y = {}".format(x ** y)) 

Demo