Muting specs would be a good option. They can get quite annoying at times. Also an option to dissalow specs from even joining the game, if that is not already implemented.
if the spectator doesn't lag. but a better connection is ALWAYS a good thing, hell if someone asked me for a cure for baldness i'd advise a better connection :D