I remember programming in hex on a cut down Z80. I think it was a z80. Anyway Baez and Saxon are dead on.
PS that z80 programming is something I did in college as part of an electronics course. so if you are still thinking about this (I would not recommend thinking about it too much) then maybe you will be able to find a course with something similar.