Comment 7 for bug 426283

Revision history for this message
Jelmer Vernooij (jelmer) wrote : Re: [Bug 426283] Re: HTML formatter

On Sun, 2009-09-27 at 22:37 +0000, Robert Collins wrote:
> On Sun, 2009-09-27 at 14:22 +0000, Jelmer Vernooij wrote:
> > Actually, the output from
> > http://tungwaiyip.info/software/HTMLTestRunner.html would be sortof the
> > thing we're looking for.
> >
> > What I would like to replicate is something that works at least as well
> > as this:
> >
> > http://build.samba.org/?function=View+Build;host=bnhtest;tree=samba_4_0_test;compiler=gcc
> >
> > but preferably something nicer and with more overview.
>
> So, basically this looks like:
> - pick a template engine
> - pick a JS UI library
> - write your page
>
> The glue code required is quite trivial - you can see how small
> pyjunitxml is.
I'll have a look at this next time I play with the Samba buildfarm.

One of the next steps would be to display HTML with statistics about
these various tests over different test runs. This might need a helper
Python module that's not specific to HTML though.

Some examples of things this could display would be: what tests are
flapping, what tests fail across all buildfarm hosts (as opposed to one
that might be broken), what tests break regularly (and might be good to
run first or as part of "make quicktest"), etc.

Cheers,

Jelmer

--
Jelmer Vernooij <email address hidden> - http://samba.org/~jelmer/
Jabber: <email address hidden>