Couple of options for you to consider that may make it better or fix it before you need to consider a rebuild or replace it, which have been mentioned already.
1. If you don't know when the last gear oil change was, and if it was a considerable time ago, then it wouldn't do any harm to drain and replace with fresh gearbox oil, this will also allow you to inspect the drain plug. This has a magnet on the end and any metal debris will collect here, not good to see large fragments here.
2. From inside the car remove the centre console, you will need to unscrew your gear knob off first. Then you will see an oval frame around the gearstick, this secures a rubber membrane around the gearstick, remove. You will now be able to see the gearbox, you have to remove the gearstick by prising out the circlip, once that's off push the pin out and this will relase the gearstick, on the bottom of the gearstick is like a round socket, that is where a plastic bush lives that may have disintegrated. Replace this and refit everything.
After doing all that it may still not fix the problem but least you've ruled out the most basic and easiest bits to do.