I come to find out after-the-fact this is a common issue on BBSHD motors, maybe also the 03 units - the crank arm bolts can loosen and if you don't catch it on time, like it happened to me, the crank can come off.
About a month ago my cranks started squeaking a lot. The bolts were a bit loose...