If the booster had a leaking diaphragm the engine would be running like crap because of the massive vacuum leak. Check the vacuum hose running from the intake manifold to the booster. It could be all balled up inside giving you a really hard pedal.