The vote which came in at 63 to 49 comes after Robertson met opposition to his proposed move to outsource services to the private sector, including benefits, libraries and IT services.
Robertson had tried to move forward with the move without a full council majority vote which resulted in a backlash and the move to a vote of no confidence.
Former Conservative deputy leader Jim Currie has now filled the vacant position.