Ok, here is an update. I replaced the front brake calipers, rear brake drums (chunks of mine kept coming off and the parts truck had 2 like new ones, so I machined them) and bled the entire system. I can stop pretty damn good now!
But I do have one concern. The pain on the booster right below the master cylinder is all peeled off and there is rust under there. I'm not concerned about the rust but the fact that this area was wet. I am not losing any more fluid so far. Also I noticed that there is a hole in the MC right in between 2 of the lines that was wet, and bubbles were coming out of it while I did the bleeding, what is that for?