Pull out all the PCI cards that are installed. If you have a motherboard without onboard video, leave the video card in.
Unplug any disk and optical drives from the motherboard. Also unplug the power from these devices. Power up and see what happens.
Do you have a motherboard speaker plugged in?