You can test the voltages whilst the computer is switched on but if you're not compotent then I wouldn't try it as you could blow both the computer and the voltmeter.
Alternatively get a proper testing kit
I have the above unit an it makes using a voltmeter easy.