I am not entirely sure that is true. When you are dealing with opinion polls, based on coaches who are too busy coaching their own teams to watch every game so their AAD gets the vote (or with an agenda) along with the Harris poll, which may as well be run by the WOB, along with a bunch of computers what only two show their work, you are going to get a lot of variance on that.
If a team has a good reputation an early season loss (or two - I am looking at you 2007 LSU,) can be overlooked. Quality wins don't count extra, except when they do. Only schedule OOC games you can win. And as much as I would miss the history and pagentry of the Beef 'O' Brady's Bowl and the Go Daddy Bowl, more bowl games do not make the bowl season better. They loose money for the teams, they have lousy ratings, and they dilute the process. And as much as I hate BSU fans, the fact that Boise State with an 11-1 record and the #7 BCS ranking ends up in the freaking Las Vegas Bowl and far worse teams end up in the BCS Bowls because they "travel better," there is a problem.