Magnus-

You will be well served by either design.  Interestingly, the Passagemaker is reputed to be a slightly quicker sailer in light airs than the Skerry, what with the Passagemaker's greater sail area.  In a stiffer breeze, the Skerry will take the lead, of course, with its longer waterline and finer shape.  The Passagemaker's real forte is cargo hauling capacity, which might be of interest to a taller individual.  Many owners cartop their standard Passagemakers.  I'm sure the same can be said of the Skerry, even though the greater length and beam might make that slightly more difficult.  You mention the Skerry forums you have perused; have you explored the Passagemaker Dinghy Forum?  You should also be aware of a bit of cross-pollination as regards sail rigs for the respective boats- some builders of Passagemakers have adopted the lug rig of the Skerry, while some Skerry builders have installed the gunter sloop rig of the Passagemaker.  So you needen't feel constrained by one rig or the other when choosing your hull.