You can withdraw from any course that is not required.
A required course is one that a training administrator has enrolled you in and marked as required training. On the Current Training tab of My Training, courses are listed and there is a required field for each course. If the required field is No, then a withdraw button is available. If the required field is Yes, then there is no withdraw button.