You need to get in a good league. Honestly I wouldn't worry about 12 guys...we have 8 and that is just fine with us. You need a good balance of competition and pace of advancement. 12 guys can run into problems quick.
I'd say 6 is the minimum. You could have two conferences represented and some good in-season battles each year.