Interesting, even with no nvidia drivers installed it still will freeze up like that.
I guess the next test is to see if I can still connect to the SSH that I just setup when it's frozen like that - might narrow things down more.
Will PCBSD offer me anything over Ubuntu?