Even if you take a more than minimum built FWD car it will still never be as good as an RWD car because of physics. Maybe FWD has an advantage of interior room, fuel efficiency, cost of manufacture, and smaller size but it will never handle as good or accelerate as nice or be able to use as much power as a RWD car can. Precise1, I know all about luxury FWD cars and RWD luxury cars still top them when it comes to road manners. Nothing will beat FWD for space efficiency though.
Anyway, to the OP, if you want to exchange your Pathfinder for something smaller I'm not here to stop you from doing that but you will never know what you had until you lose it. Pathfinders may be more expensive to own and drive than the stereotypical FWD vehicle but they are so worth it in my opinion. There is nothing like a large luxury RWD vehicle for a comfortable and fun driving experience even if it is powered by a rice burning V6 (which is very efficient).