I have my eye on the Raspberry Pi. This little machine has a vibrant community and help is available all around the web.
This morning, I found The Errant Scientist blog; Matthew takes a walk through the set up process and installation of software via the LXTerminal.