How to unfreeze a frozen water pipe?

Use a hair dryer. The heat is adequate but gentle enough to not cause side problems like setting fire to walls etc. About 1 minute an each metre will probably get the water moving. As it is inside the house the ice should not be hard frozen. Once you have the water flowing take steps to lag the pipe or get some low level heat into the area during the freezing conditions.