Check the switch on the back of the PSU.
I know these seem like small things, but those are the things you'll overlook if you're in a hurry or not thinking.
Try another wall outlet. If neither of those two things work, check the motherboard over, see if there are any loose parts or burn marks. You may have to return the motherboard if there's something wrong with the electronics.