Another source of hum noise is ground loops in your wiring. There are several things you can do to help avoid this. One is to get better cables, as the other poster suggested, but specifically get cables with better shielding. Most RCA cables are poorly shielded; better shielding may result in less hum.
Another is to check the wiring of your house. By this I mean make sure that all the outlets that things are plugged into are three prong grounded outlets. Also make sure that the ground pin (the round hole in the outlet) has a good electrical connection to ground. You can do this with a voltmeter and ohmmeter:
1. Measure voltages on your outlet: use the voltmeter to measure the voltage between the two slotted holes and between each slotted hole and the round hole.
2.Figure out which slotted hole is at the same voltage (0 volts) as the round ground pin. This is what is usually connected to the white wire inside the wall.
3.Turn the meter to resistance/ohmmeter mode. Measure the resistance between the ground pin and the slotted hole you found above. This resistance should be near zero.
4.If you have some alligator clip wires, use them to extend the reach of your ohmmeter and measure the resistance between the ground pins of the different outlets you are using.
Another thing that can help is if you are using power strips is to put closely connected devices on the same power strip. i.e. plut the G4 and the USB device into the same power strip, and the CD player too if possible.
Above all, if you have anything with a 3-pin plug which you are adapting to a two-pin power plug, remove the adapter and use a true three pin outlet.