[rb-general] Finding Packages With Tests

[Eli Schwartz]

On 2/21/19 10:56 AM, Omar Navarro Leija wrote:
> Hello,
> 
> I'm part of a team at UPenn researching tools for building package
> reproducibly. We use the Debian Apt Repo for our testing. Currently, we're
> verifying "correctness" for our builds, that is, does the package not only
> build reproducibly, but work as intended after running through our tool.
> 
> We have manually verified packages like blender, clang, latexmk, work by
> building them, and then running them manually.
> 
> I know some packages come with built in unit tests that run during build
> time, which is the reason behind the DEB_BUILD_OPTIONS=nocheck flag. I want
> to find these packages with tests and run them.
> 
> Is there some way to identify which packages which have built in tests?
> We're working with Debian Wheezy currently.

I think that packages which contain a testsuite should define a Makefile
target for override_dh_auto_test.

On a related note, methods of defining a package that contains (and
should run) tests in other build/packaging systems:

- Arch Linux PKGBUILDs define a bash function called "check"
- RPM spec files define the "%check" directive
- Gentoo ebuilds define a bash function called "src_test"
- Guix does something very complicated in scheme, which seems to create
  buildsystem templates that know whether a package already contains a
  testsuite, possibly by e.g. checking packages that use Make to see if
  a check target is defined.

-- 
Eli Schwartz
Bug Wrangler and Trusted User

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 1601 bytes
Desc: OpenPGP digital signature
URL: <http://lists.reproducible-builds.org/pipermail/rb-general/attachments/20190221/deba4d74/attachment.sig>