Same thing is happening to me late at night when I typically like to get on and play. Every game I join after about 11 or 12 at night is either a very small number of people in the game or something like 2 v 4. Quite frankly this is pissing me off, between work and school the only time I have to play is late at night and most nights there is no point even trying to play the game.
DICE needs to do something about this as it is clearly a server issue. I have never had this problem in other game playing later at night. Seems like DICE is completely ignoring this problem though.