So what exactly makes you think you're gonna cut it in another community? Your height isn't going to change. If you'll stick out like a sore thumb in the aviation community, you'll also stick out in Supply, SWO, Intel...etc. Not physically fit? Guess what? Transferring to another community isn't going to magically make you fit. And the standards and expectations will be exactly the same regardless where you end up. You're not a strong swimmer? Who cares? Water survival isn't about beating the next person in a race. It's about surviving in the water. I'm a weak swimmer too and sink like a rock. There are a lot of weak swimmers that go through the program and do just fine. As for API, it is not hard. Yes, you have to study a little bit. But it is not hard at all and you will have PLENTY of time.
Now, if suddenly you had an epiphany one day and realized you really don't want to be an aviator that's one thing. But your reasons thus far tell us you don't want to be an NFO anymore because it's too hard. If this is the case, go tell your DI today that you don't want to be in the Navy anymore. The Navy is hard work and if the reasons you outline for us are in fact real, you're just going to come up with some other reasons in a different community.
You want to see the fleet fast? Drop out of OCS and go see your nearest enlisted recruiter. It sounds like you may have some growing up to do and enlisting may serve you very well.