if the defense continues to give up 30 plus points a game and we lose when do the people that are supporting the defense begin saying we need changes.
Herein lies the rift that exists between people on each side of this argument.
For people who think in terms of the FEI as opposed to flat, unadjusted stats, overall point totals aren't as important as percentages of possessions that end in points. And yes, we do think in terms of what the defense is doing both when the game is close and when the offense has clearly pulled away (such as when coaches go into prevent mode just to remove the threat of quick scores that might help opponents catch up without eating clock).
When I watch games -- last year's Cal game was a great example -- I also strongly consider whether the defense was given good field position by the offense or special teams. If our kicker shanks a punt, or if we lose the ball deep in our own territory to an INT or fumble, then I don't pull my hair out of the defense gives up a score on a short field. In my opinion, it's not really fair to the defense to judge them as harshly for giving up a 30-yard scoring drive as opposed to an 80-yard scoring drive. I believe offense and defense are symbiotic, and both must do their jobs for each unit to thrive.
And usually, both units do their jobs. Our defense is usually solid in the category of redzone offense and takeaways, and our offense is usually solid in either scoring points or not putting our defense right up against its own endzone.
I'll start getting more upset about the defense when it continually shows that it is failing to do its job. That didn't happen last year; after some problems early in the season (partially because our offense could barely stay on the field with our massive O-line issues), the defense stabilized against UCLA and played solid against just about everyone left except for Cal and Ohio State (and, as I said above, that Cal game is very divisive... I think the D was just average in that game, if you actually look at the context of the game; but if you only look at flat stats, then yeah, it looked bad). And the Ohio State game is another good example of the relationship between offense and defense. Our offense started off good, and so did the defense; but our offense stalled a couple times, and our defense started getting a little winded, then everything seemed to crumble on both sides of the ball.
Anyway...
This is a tough question to answer, especially on this forum, because so many people have already made up their minds that our defense has been bad for a long time... just like I've watched the same games and seen the defense usually doing its job and even being above average. It's all a matter of interpretation, based on what each of us think constitutes a good performance.
I'm a big-time context guy. For me, the end results always matter less than the context. In football, perhaps the more popular mindset is to flip that around, and say end results are all that matter, context be damned (no excuses for anything ever!). Personally, though, I believe that if you worry about context first, then the good end results will follow... and not the other way around.
This is also a tough question to answer because of the inexperience in our secondary. It's very rare to have this much youth in the defensive backfield's two-deep... not just in our program, but in any elite program. As frustrating as this season may turn out to be, I personally take issue with blaming the coaches on guys being young and needing time to develop.
I know I didn't really answer your question, but that's just because the inexperience of this secondary makes this a difficult year for me to pass judgement. I need to see how things unfold.
EDIT: I could just as easily ask, "How many seasons will it take for the defense to do its job and repeatedly keep us in position to win games (and blow other teams out of the water) before people realize our unit is usually pretty good?"
It really is a circular discussion. Different folks measure success according to different metrics, which is why this goes around and around. I personally prefer an analytical approach like the FEI, but not everyone does, which means agreement on this is impossible.