In his “The Foundations of Mathematics”, Ramsey attempted to marry the Tractarian idea that all logical truths are tautologies and vice versa, and the logicism of the Principia. In order to complete his project, Ramsey was forced to introduce propositional functions in extension (PFEs): given Ramsey's definitions of 1 and 2, without PFEs even the quantifier-free arithmetical truth that 1 ≠ 2 is not a tautology. However, a number of commentators have argued that the notion of PFEs is incoherent. This response was first given by Wittgenstein but has been best developed by Sullivan. While I agree with Wittgenstein and Sullivan's common conclusion, I believe that even the most compelling of Sullivan's arguments is importantly mistaken and that Wittgenstein's remarks are too opaque to be left as the end of the matter. In this article I uncover the fault in Sullivan's argument and present an alternative criticism of PFEs which is Wittgensteinian in spirit without being too mystifying.