do可以用作双宾语动词，如 do sb a favor, do sb some good/harm damage.

Criticism can do people a lot of harm/damage; praise can do people a lot of good.

the damage done me = the damage that was done me

damage为主动语态时的直接宾语，在被动语态中作主语，do改为被动语态be done后，间接宾语作为保留宾语。有人认为这种被动结构在me前应该加介词to. 即双宾语用法转换为单宾语用法，然后再改为被动结构。do sb the damage —— do the damage to sb —— the damage is done to sb —— the damage done to sb.