Add checks to avoid patching debugger modules

Add checks to avoid patching debugger modules #902