I couldn't believe it - Today I was out doing regular daily errands, and ran into someone I know who was giving away an old computer - actually, he said he was ready to just throw it out, but when I said I collect such things he said I could have it!
I also happened to have an old IDE hard drive, internal cables, and after digging through my old sh*t in my apartment I found an old roller-ball PS2 mouse and keyboard.
Didn't come with an OS, but I'd imagine it should run Kubuntu without too many problems. It actually has a 2.4 Ghz CPU, single core.
Here it is:
(You'll have to scroll to the right of the guitar, sorry, I should have re-sized the photos!)

Interestingly enough, It has a CD burner and USB ports so I can get stuff off of it, yet it is old enough to have a floppy drive!
After more digging, I'm also glad I kept these:

(No, they aren't for sale!)

With Kubuntu and DOSBox, I now have an opportunity for some nostalgia...