“I don’t want to go to school” (toddler)

So I’m sure this is developmentally normal, but I wanted to ask advice for anyone that’s been through it. My son is 2 and a half (first born) and he’s been going to daycare since he was 1. It’s a wonderful daycare with a great curriculum, outdoor playground time twice a day, and great teachers. He loves his friends there and every day when I pick him up he’s happy and sometimes doesn’t want to leave. However, every morning the second I bring down his clothes for the day he says “where are we going?” “I don’t wanna go to school” and starts tearing up. He’s been doing this for as long as I can remember and I can’t figure out why. We’ve had maybe a couple week stretch here and there where he doesn’t get sad about school, but it’s been pretty constant for a long time.

Every time I bring it up to the teachers they seem surprised and say he’s fine right after I leave. I don’t know if I’m watching too many true crime shows, but I’m so scared that something bad is happening at school or someone is preying on him (no signs of that) and I’m not there to protect him. Side note that I’m sure has a lot to do with it: I had another baby who is now 6 months old and stays home with me, so I assume he thinks we’re home all day playing and having fun without him and that’s a big reason of why he doesn’t want to go lately, but this has been happening long before I had my daughter. I would just pull him out of school and keep him home, but he honestly does way more fun stuff at school than I would be able to do with him with an infant in tow. Anyone else been through this? I’ve asked the other moms and they’ve all said they’ve had phases of it, but never constant like my son.