The more you learn about and the more you work with computers, the more you realize that most people have no idea what they're talking about. This will include people in your own field.
There will be days when you encounter problems that nobody else will understand and you will need to explain the gravity of the situation to a higher up who thinks your entire department doesn't contribute anything of monetary value to the company.
You will, at some point, get a user who swears up and down that they need some software installed. When pressed, you will find out that they don't know the name of the software, don't know what it does, don't know who else has it, and don't know what job function they can't perform without it.
Being a "computer guy" (regardless of what you specialize in) means that when you touch a home user's computer, you own it. If their cheapie emachine mobo dies 4 months after you cleaned out their spyware, YOU will be responsible because "it was working fine until you touched it."
Make sure you work towards being specialized. You may think that you're pigeonholing yourself, but really, if you want to move up, you're going to need to concentrate on some specific skills.
Really, IT isn't that bad of an industry, but when you're in it, you're stuck in a spot where you understand something intimately that most people having an extremely passing knowledge of. You will need good people skills and will need to know how to deal with slamming your head against your desk when something stupid comes up.
Good luck.