//Edit: a less cynical view is that you are essentially loaning that money to the credit card company and then it pays you back but it keeps the interest

It's literally the opposite. The credit card lends you money for free - if you pay your bill every month.

That's the "credit" in "credit card" - they are extending a line of credit to you, not the other way around.