How to remove paste from my ceilings and baseboards?

When using the Paste-the-Wall or Paste-the-Paper methods, it is common to find excess paste on your ceilings and baseboards. This can be easily removed with a wet sponge and clean water.