If Sloane is Vaughn's dad, Vaughn would recognize him because (spoilerish stuff coming up) two people were cloned--Agent Lennox and Francie. JJ said that there would be NO other clones. So Vaughn would recognize daddySloane. (spoiler over)
Also, Sloane has worked with Jack for thirty years. He would know if Sloane was Vaughn's dad.