the man must have visited the city. No,he couldn't have,beca

the man must have visited the city. No,he couldn't have,because he didn't have any time
上面那个couldn't也可以换成Can't吗?
如果可以有什么不同呢?
谢谢大家