There is the appearance of impropriety.
No, what does it matter if they became friends after Thomas became a justice? As long as there is no business dealings between them, there should be no impropriety. At least that’s what the law appears to say.