Yeah, starting over sounds rough. Did you try the disavow tool before you rebuilt everything? Sometimes you can fix a flagged site if you cut out the bad links and wait a few months.

Ugh, yes! Like @lilyr25 said, you gotta get everyone on the street to call it in every single time, otherwise nothing happens.