The most recent CO of the BLUE RIDGE, Captain Paradise I believe was a former Enlisted SEAL and current Naval Aviator.
... and an occasional poster on this site...
There are several routes to be both a SEAL and then a pilot, they're all difficult. I only know of one that allows someone to be both at the same time and that's no small feat either.
To the OP- Bottom line is it's possible in theory (I've personally met two who've done it) but there's only a very small number of folks who become SEALs in the first place, so the number for folks who end up doing both is so small to the point where they're almost statistical anomalies.
Pick what you have a passion for and pursue that, but be aware that the road to being a SEAL and the road to being a pilot are paved with crushed hopes and dreams. Either path will be difficult in its own right, traveling both will be exponentially so.