It's definitely tough my eldest son just went to university, second off-spring (my daughter is now at Ball State doing her masters) ... my youngest lives mainly with his mother so the house seems a LOT quieter now all of a sudden.
That being said I think its easier for our generation than for our parents - when I went to University apart from very occasional phone calls home I wasn't in touch with my parents ... with my kids they text nearly daily and I seem to stay far more involved and updated in their lives.
Yes its natural they drift away to some extent as they establish themselves - but I try and remind myself that is a sigh I did something right as a parent