“What could be the worse kind of injustice to him than to hang him only on hearsay….The Letters Patent Bench can not interfere with the decision