Nope, that shouldn't affect the game at all; I've accidentally done this with other game downloads and didn't affect those at all. I guess that's the beauty with these next gen consoles.
Also, I always have to remember to press menu on the game itself, then scroll down to information to see how much of the game has downloaded.