Prime Minister Mark Carney told thousands rallying in Calgary on Thursday that Albertans should vote to keep the province in Canada.