This was the concern I figured people would have.
I thought about it and the ONLY thing I can consider is taking his SPD down a couple points, but it does him a disservice.
I am beginning to think more and more that this makes a lot of sense (just moving him to OLB).