Running ksh93 test suite prior shipping... / was: Re: [ksh93-integration-discuss] building extensions to ksh93

[Roland Mainz]

Casper.Dik at Sun.COM wrote:
> 
> >As to the actual value of this: in a slight modification to your
> >scenario above: I wouldn't want Sun service personnel (or whoever) to
> >tell a user to run the ksh93 test suite before helping them with a ksh
> >problem.  As for your scenario: A user who saw a test case failure would
> >probably call support and claim that something was broken.  A user who
> >was seeing a failure (lets say a ksh core dump) but a successful test
> >suite run would probably still call for help.
> 
> Also, I would hope that we run the test suite *prior* to shipping the
> product and make sure it was successful.

Yes, the ksh93-integration prototype002/003 run the test suite by
default. However I still have concerns about a possible removal of the
test suite - it helped a lot in the past with hunting down compiler-,
locale- or library-specific problems and IMO the test suite should be
around for the next couple of months to help finding any possible
bugs&&regressions in- and outside the ksh93 codebase.

> In that sense, shipping any testsuite is unhelpful.

Only if the test suite actually runs as part of the default OS/Net
build. We're doing exactly that right now - the question is whether code
reviewers will like that design or not... ;-/

----

Bye,
Roland

-- 
  __ .  . __
 (o.\ \/ /.o) roland.mainz at nrubsig.org
  \__\/\/__/  MPEG specialist, C&&JAVA&&Sun&&Unix programmer
  /O /==\ O\  TEL +49 641 7950090
 (;O/ \/ \O;)