Do others perceive me as a danger? Have I ever physically aggressed on someone and do not remember? I self-harm and I yell. I'm not violent.

wonder who brought the issue up. you don’t sound/look like a violent person to me.

My physician of 21 years removed me from his practice while handing me a bunch of controlled prescriptions as a "public threat"

I'd talk to the group where he practices and demand he justify his position and explain what makes you a public threat