Losing a fair portion of your friends.
You'll keep the close ones and you may even go with them to the same college, but you'll lose all those that you only met because they're in your classes/activities.
Also, you'll get bored real fast (if you don't have a job/college) because you won't have a schedule to stick to or anything to accomplish.