the --doPassFail command line option is not working properly (and needs some redesign)
At the moment the --doPassFail command line option turns on pass/fail testing for the purposes of the return codes, but it doesn't actually control how reports generate at the moment.
On a higher level, I think I want this setting to be on by default and I need to create an appropriate config file setting that will let you do the same thing.
-
Turn pass/fail testing on by default -
Make a command line option to turn pass/fail testing off -
Make the current command line option (that turns pass/fail testing on) invisible in the docs (because it won't be needed anymore) but leave it in the system so people's existing calls don't break -
Make a config file setting to turn pass/fail on and off (probably in the settings dictionary) -
review report and stats code to make sure it will respect the pass/fail setting for all things (returns and how variables are analyzed) -
Change the documentation to reflect the new way pass/fail testing works -
Update that one config file that's intended to turn pass/fail testing off