http://homepage.mac.com/randyhyde/webster.cs.ucr.edu/www.artofasm.com/Windows/HTML/AoATOC.html
Scroll down that page to the "Volumn 2" section. Gives lots of information about the architecture side.
Also, research Compilers, Linkers, and Loaders -- lots of learning involved in that. These should be a good start:
http://www.diku.dk/hjemmesider/ansatte/torbenm/Basics/
http://en.wikipedia.org/wiki/Compiler
And this should give you a start on conceptualizing what an Interpreter does:
http://en.wikipedia.org/wiki/Shunting-yard_algorithm
You may also want to look-up "small C", "miniBasic", and Forth.
Happy Learning!!