A number of folks have inquired as to what the current status on this is, so here's an update:
Our internal discussions and analysis have led at least some of us to conclude that the proposal may do more harm than good.
While the selection method Jon proposed, particularly the length input, is really clever, when we reviewed an (admittedly small) sample of questions where it would hide comments, it's pretty safe to say the following:
It essentially hides everything but a small percent that seem to have a very strong quality indicator.##
This led a couple of us to conclude that:
It clears out a bunch of noise, but takes a fair amount of signal with it.
In reviewing some posts where the comments would be hidden, there were a lot of examples where the comments, while far from awesome, seemed to add some value to a reader by being default visible, by adding information, clarifying a point, or simply asking a question so no one else needs to. Some examples:
- Requests for clarification or details
- Comments that add color, like the pros and cons of a proposed solution
- Comments that explain why an answer that sounds good won't actually work
- Requests for additional code, and the response explaining why the OP can't share it (which prevents others from asking the same thing).
- Feedback that the suggested solution didn't work (conveying to others that it looks good, but isn't actually effective
- You actually need to start here and get more information before asking this question
Note that some of the above are not ideal use of comments. Some of the places it felt harmful to hide comments, they were being slightly misused, because an edit would be more appropriate. But the key is that edits weren't happening, so the comment being visible to a visitor who'd otherwise miss the warning, etc. is better than it being hidden.
Another observation:
There appears to be more low-hanging-fruit for comment hiding on Questions than answers.
- Answer comments were more often signal.
- Plus the noise harm is much bigger on questions, as comments there could be pushing the top answer off the page, (as opposed to bumping a lower-ranked answer for questions).
We haven't given up on this, as there's a lot of strong of internal belief that we can do much better here, but this particular implementation has left us fairly split on whether its a net win or loss.
We'll keep you posted.