I got a 64 impala with the 4 wheel drums. Is there any other cars I can swap the brakes from? Its got the 5x4.5 but I'm problay going to have to switch it to 5x4.75.  

are you sure it's got 5 on 4.5? Never heard of that.

As for your brake problem. Impala's didn't even get discs as an option til 68. Unfortunately, the car completely changed in 65. I know we car crafters aren't made of money, but why not get an aftermarket disc changeover? Classic Performance Products makes a nice kit for about $600 complete. By the time you find forty year old parts and replace what's worn out or not useable; you'll end up spending near the same amount as a kit with all new parts. I put this kit on my 65 Impala. It went on in less than a day and works great. I now feel comfortable driving with all those idiots on the LA freeways at speed.  

LMAO, I measured it wrong, it is 5x4.75. I figured I would have to just buy a convertion kit anyways, I was just looking for a cheaper way.