Maybe you have the "CPU schedule visits" assist on. So even though you aren't scheduling the CPU does it for you. You can schedule a recruit visit for the last week of the season and you'll still be their "1st visit" if other schools haven't scheduled visits yet. But as other schools schedule visits in weeks prior to yours, this will change (and the points you get will change).