One last thing about Baylor.  
Imagine the buzz and excitement that would be generated if a big name program rolled into Waco to play a game.  Again, I'm not necessarily talking about an LSU/Alabama caliber opponent but a middle of the pack type of team that still has a pretty solid national following.  Think Penn St. or Miami.
I think there would be a tremendous amount of local buzz for a matchup like that.  Fans love when teams who they don't get a chance to see very often come to town. 
So I'm not sure why Baylor has been hesitant to reward the fan base with sexier matchups.