36V times 11 A gives 396W, you have a 500W motor. Up your volts or amps or both.
Your controller has a LARGE number of wires, knowing WHICH TWO melted would allow for some useful diagnostics. Most likely related to the fact that your controller is a bit underpowered for your motor.