I think you might hit a very good time. With all the cold weather and storms this month, I'm expecting a surge in the next week or so. You'll be ahead of the leaves, but statistically, you probably have a better chance of more species the following week.
Years ago, I used to make 2 3-day trips: early May and mid May. It was always different from one week to the next, but not consistently better one time or the other.
BB