US House of Representatives Speaker Paul Ryan forced out the Jesuit priest who had served as House chaplain since 2011, in an apparent partisan squabble, a new report said Thursday.