Check your rear wheel alignment first!
Also the fork tubes might be twisted and clamped in place that way, just loosening the triple clamps and tweaking it a bit may fix it. Have the bike weight off the front wheel for that.
Serious problems would be a bent frame or bent fork tubes. A slightly bent main frame is pretty hard to diagnose, but if you see damaged/repaired tubing in the frame around the engine or around the neck it's not a good sign. I've seen a few bikes that had been is hard collisions and twisted the neck "down". The damage where someone had heated the frame tubes and forced it back to what looked OK was quite obvious and explained the wacky steering and handling.
The rear fork (swingarm) can be checked with a level and plumb bob. With the bike on level ground on the centre stand - a flat concrete garage floor is good enough - and rear wheel off the ground, level the frame with a spirit level across the main frame tubes under the seat (shim under the centre stand feet with whatever works). measure from the ground up to the bottom of the fork flat sections under where the axle is. The measurements should be identical but don't sweat about a quarter inch off. To really check it, it has to be off the bike. The swingarm is often bent in a crash where the bike went in a ditch or similarly bounced around a bit.
Broken steering stops aren't really rare, and don't necessarily mean a crash severe enough to bend anything.
Bent fork tubes are hard to see on the bike but very easy to diagnose if you take them out. Just roll them on a flat surface: a bent one will be obvious.