a bit confused about perfect infinitive

Hello,

‘I’ve always loved you,’ he told her.
can be reported like this
He confessed to having always loved her.

is it also right to say the following?

He confessed to always loving her.

Thank you.

I wonder could this be all right

the perfect infinitive

to have + past participle of the main verb

to have loved
to have flown
to have gone

The perfect infinitive continuous

to have +past participle of the verb to be + present participle of the main verb

to have been loving
to have been flowing
to have been going