Poilievre may have peaked too soon, says May