One way to do a test in a randomised trial is re-randomisation. That is, you generate the sampling distribution under the null by re-running the randomisation and dividing up the study participants according to the new imaginary assignments, and repeating this a lot of times.
For the usual statistical models, the re-randomisation test with no strata is close to the test (especially the score test) with no adjustment variables. Stratified randomisation, however, implies that between-stratum variation in the outcome doesn't contribute to the uncertainty in the treatment effect. If you do stratified re-randomisation, the between-stratum variation doesn't contribute to the variability of the null distribution, and the same is true if you adjust for the stratifying variables.
That is, an unadjusted test is conservative and an adjusted test has the correct level (in large samples, up to the usual assumptions).
Note that unlike most of the reasons in the other answer, this applies only to variables you actually stratified on, and applies whether or not they were good variables to stratify on. You might also want to adjust for other variables that are predictive of outcome, and that's a different question.