Ghys and Sergiescu proved in the 1980s that Thompson's group T, and hence F, admits actions by C-infinity diffeomorphisms of the circle. They proved that the standard actions of these groups are topologically conjugate to a group of C-infinity diffeomorphisms. Monod defined a family of groups of piecewise projective homeomorphisms, and Lodha and Moore defined finitely presentable groups of piecewise projective homeomorphisms. These groups are of particular interest because they are nonamenable and contain no free subgroup. In contrast to the result of Ghys and Sergiescu, we prove that the groups of Monod and Lodha and Moore are not topologically conjugate to a group of C-1 diffeomorphisms. Furthermore, we show that the group of Lodha and Moore has no nonabelian C-1 action on the interval. We also show that many of Monod's groups H(A), for instance when A is such that PSL(2, A) contains a rational homothety x bar right arrow p/q x, do not admit a C-1 action on the interval. The obstruction comes from the existence of hyperbolic fixed points for C-1 actions. With slightly different techniques, we also show that some groups of piecewise affine homeomorphisms of the interval or the circle are not smoothable.