you are either dragging the brake or using it so much the heat builds up faster than it can be dissipated. you are boiling the brake fluid causing bubbles which makes the brakes fade, when the fluid cools down, the bubbles go away and the brakes return. it is pretty common for people who drag their rear brake, I know from experience