Tradition

Saad b. Abi Waqqas – When Prophet (s.a.w.a.) left for Tabook, he left Ali in Medina. So the people spread the rumour – Prophet is not happy with Ali and does not wish for his company. Hearing this – Ali went and met Prophet (s.a.w.a.) and said – O Prophet! You are leaving me with women and children because of which people are saying that you do not wish to keep me with yourself and are not happy with me. Prophet (s.a.w.a.) said – I have left you as caliph with my family, are you not pleased that you have the same status as Haroon had with Moosa, except that there is no Prophet after me.
Sunan Kubra v 7 p 307, 725 Musnad Abi Ya'laa al-Mosuli v 1 p 313 Tarikh Dimishq v 42 p 151