The late at night part may be the biggest downer.
Why not have it the next day at a time where out-of- towners would attend.....late morning or early afternoon.
Have some incentives for fans to attend like give aways......music......other entertainment events.....it wouldn't take too many creative minds to get the fans there.
It was not "late" at all last couple times I went - 7:00-ish if I remember right.
Maybe the better idea is BEFORE a late start football game - leave a couple hours after for tailgating time....