You might be on to something about the timing. We do early dinners and lunches to avoid crowds both in restaurants and on rides*
(so we ate dinner there at 4:45).
*I could write a Josh Humphries Easy WDW style thesis on this. Let me know if you're interested!
