你的两个句子都对，其中的 for 是可以省略的（省略 for 的用法多见于口语或非正式文体）。

Excuse me (for) being late. 请原谅我迟到了。

Excuse me (for) breaking in, but l have some news for you. 请原谅我打断你，我有些消息要告诉你。

要表示汉语的“原谅某人做某事”，常用的表达有：

1. excuse / forgive / pardon sb doing sth

Excuse me interrupting, but there's a client to see you. 对不起打扰一下，有位客户要见你。

Forgive my phoning you so late. 原谅我这么晚打电话给你。

Forgive me asking an indelicate question, but how are you off for money? 原谅我问一个粗率的问题，你有多少钱？

2. excuse / forgive / pardon sb’s doing sth

Please forgive my interrupting. 对不起，打搅了。

Excuse my opening your letter by mistake. 原谅我不慎把你的信拆开。

Pardon my asking, but is that your husband? 请原谅我多问，那位是您的先生吗？

3. excuse / forgive / pardon sb for doing sth

Please excuse him not writing to you. 请原谅他没给你写信。

Forgive me interrupting you. 打扰了，请原谅?

Pardon me for asking, but isn’t that my hat you’re wearing? 对不起冒昧问一下，您戴的是不是我的帽子?

比较同义表达：

Pardon me for saying so, but isn't he a little old for her?

=Pardon me saying so, but isn't he a little old for her?

=Pardon my saying so, but isn't he a little old for her?

请原谅我这么说，但对她来说他是不是年纪大了点？

They forgave him for being rude.

=They forgave him being rude.

=They forgave his being rude.

=They forgave (him) his rudeness.

他们原谅了他的鲁莽。

注意，英语习惯上不用 excuse / forgive / pardon sb to do sth。