Mark test as ignored based on condition

Question

I want only some subset of my test methods to run on a production environment. I annotate such test methods with @ProdAllowed annotation. I also wrote a small custom JUnit runner, which overrides the runChild method so it runs only for @ProdAllowed methods while on "PROD" environment:

public class ProdAwareRunner extends BlockJUnit4ClassRunner { public ProdAwareRunner(Class<?> klass) throws InitializationError { super(klass); } @Override protected void runChild(FrameworkMethod method, RunNotifier notifier) { ProdAllowed annotation = method.getAnnotation(ProdAllowed.class); String env = CreditCheckSuite.getEnv().trim(); if (annotation != null || "DEV".equalsIgnoreCase(env) || "UAT".equalsIgnoreCase(env)) { super.runChild(method, notifier); } else { notifier.fireTestIgnored(null); // this probably needs to be changed } } }

This works quite well, but I want a little more - to have this skipped test methods to be marked in Eclipse as ignored (right now they are marked as not run, which is not exactly what I want)

A built-in mechanism within junit is using categories.

cheffe
– cheffe

2014-11-27 15:02:03 +00:00
Commented Nov 27, 2014 at 15:02 — cheffe
– cheffe, Commented Nov 27, 2014 at 15:02

Stefan Birkner · Accepted Answer · 2014-11-27 20:58:58Z

You could write a rule by extending TestWatcher

public class DoNotRunOnProd extends TestWatcher { protected void starting(Description description) { { ProdAllowed annotation = description.getAnnotation(ProdAllowed.class); String env = CreditCheckSuite.getEnv().trim(); if ((annotation == null) && !"DEV".equalsIgnoreCase(env) && !"UAT".equalsIgnoreCase(env)) { throw new AssumptionViolatedException("Must not run on production.") } } }

and add it to your test

public class Test { @Rule public final TestRule doNotRunOnProd = new DoNotRunOnProd(); ... }

It seems that these days rules are replacing runners, no need to write a custom runner here. +1
My main question is in the last sentence of original post - I would like to have not annotated tests marked as ignored while on PROD. With your approach, Eclipse marks not annotated tests as passed, which is not really what I want to see.

ursa · Accepted Answer · 2014-11-27 14:10:38Z

This is already implemented (and actively used) in TestNG Groups:

public class Test1 { @Test(groups = { "dev", "uat" }) public void testMethod1() { } @Test(groups = {"uat", "prod"} ) public void testMethod2() { } @Test(groups = { "prod" }) public void testMethod3() { } }

Collectives™ on Stack Overflow

Mark test as ignored based on condition

2 Answers 2

2 Comments

Comments

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Related