In my experience I also found that after using them directly that they were OK, but to be on the safe side with my design I added the level shifters to the tx/rx pins.
When applying 5V to the module instead of 3.3V, I found that I could still communicate with the module but the radio seemed to shut down as nothing was transmitted.