You absolutely should back up sensitive data. Any data that pertains to your business or customer bases, such as emails, addresses, phone numbers and important files and documents should be backed up, due to their nature being private and personal. If they are accidentally deleted or access to the files is lost, having a backup of the data on an external hard drive, for example, would be a good recovery solution.