If you are using Dota PvP Ladder, the script comes with a setting that only counts the rank from the map that has been set.
But, even if you do this, your player still abuses the rank system. Entering the pvp, use a dummy character (their own character or friend) and nonstop kill or kill each other to get the higher rank. Most abuse happens when you add a reward for top rank/point.