From your post I've got to assume that you came straight out of high school to USNA. I can speak from having a *very limited (one yearish)* experience as an enlisted guy and then going to the Academy, so my point of view is a little different.
Realize it's a game. It sucks, it's meant to suck, but it's only going to suck as much as you let it suck. The powers that be give you the "be an officer" and then treat you like a kid. That's the point, because it ain't gonna be easy any where else, either. If you can't handle it as a mid when all you've got to worry about are your grades and the prt, then you're probably not gonna be able to handle a cat shot or dropping dudes out the back of a helo.
That said, during my time there, the dudes I knew who had the hardest times were the ones who only looked at the bad parts. Go find fun things to do, albeit you may only be a youngster now but you've got time to get out and enjoy the area. Believe it or not, Annapolis is actually a really nice town, it's sad that too many mids can't see the awesome forest because of that one damn stone tree. If you can unwrap your head from that and have fun, it'll be a much better time.
Also, a little trick I learned in boot camp. Don't look for the far off events, i.e. intercessionals, Summer break, etc. That just sets you up to be disappointed in how long it takes. Instead, make plans for something a week or two away, maybe something going on at USNA, specific plans for you and your roommates to go do something, etc. Trust me, it makes the time fly by, it's actually pretty amazing. Before you know it, presto, another year gone. In boot camp, it was as simple as getting to eat a doughnut on Sunday morning, or something bigger like the rifle range.
In the long run, it all boils down to what you want to do. Cynicism abounds there, I was full of it but I didn't let that distract from graduating. If you don't want to deal with it, fine, I'll respect you more for making a decision than for waffling either way. But believe me, flying a plane, getting paid to fly a plane, knowing that most of the guys I went to high school with get to look forward to working in a factory all day, and some of the places I've been have made it all worth it.
Last comment. How will you feel if you do pack it in and go home, only to see your parents, your friends? Will you be able to look them in the eye and say that you gave it your best but it just beat you, or will you have to explain you couldn't handle a few years of pseudo-crap for a lifetime of opportunity?
It was an easy choice for me.
Good luck.