Fellow Christ-followers, what do you think about this?

I agree with the pastor. You don't have to have Sunday School. As long as you do worship God, and you do have a close relationship with Jesus, that should be all that matters. My church doesn't even have Sunday School.