Scooter Rental - Passport as deposit

I rented a scooter for 2 days in Tulum and the man operating the business required a deposit - either $200 USD in cash, or my US passport. Not having that amount of cash on me, I opted for the passport (stupid idea yes I know, but I was in a pinch and he was affiliated with my hotel). I did get my passport back after returning the scooter, but now I’m paranoid that he may have made copies of it/etc. he wasn’t exactly a shady character, but wasn’t the most pleasant/trustworthy person either if you catch my drift.

Is this a valid concern, or is there anything I should worry about regarding my passport/identity?