I invited him to have a dinner with me yesterday 有没有语法错误?

I invited him to have a dinner with me yesterday 有语法错误.
可改为：I invited him to (have) dinner with me yesterday.
invite sb to do sth.
invite sb to sth.