It doesn't matter much whether Mary comes to the party or no

此处的matter是不及物动词“重要,有关系”.副词在修饰动词时可以后置.eg
the baby cried bitterly.
the horse ran fast when it was young.
"Shut up!" she shouted angrily.
供参考.