Re: [Bug-gsl] gsl 2.1 test failures

[Orion Poplawski]

Thanks for the quick response.  I can't speak to 2.0 as we never built that
version.

I start to see other test failures on x86_64 (and i386) if I start to tweak
those values though.  Are you sure that's the proper variable to tweak?  For
example:

diff -up gsl-2.1/multifit/test_nonlinear.c.tol gsl-2.1/multifit/test_nonlinear.c
--- gsl-2.1/multifit/test_nonlinear.c.tol       2015-11-03 09:21:55.000000000
-0700
+++ gsl-2.1/multifit/test_nonlinear.c   2015-11-12 13:41:48.290084641 -0700
@@ -175,8 +175,8 @@ static test_fdf_problem *test_fdf_nist[]
 static void
 test_nonlinear(void)
 {
-  const double xtol = pow(GSL_DBL_EPSILON, 0.9);
-  const double gtol = pow(GSL_DBL_EPSILON, 0.9);
+  const double xtol = pow(GSL_DBL_EPSILON, 0.9) * 10;
+  const double gtol = pow(GSL_DBL_EPSILON, 0.9) * 10;
   const double ftol = 0.0;
   size_t i, j;


leads to:

======================================
   gsl 2.1: multifit/test-suite.log
======================================

# TOTAL: 1
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: test
==========

FAIL: lmsder/scale=1/powell_singular i=0 (1.81652250744047584e-05 observed vs
0 expected) [190794]
FAIL: lmsder/scale=1/weights/powell_singular i=0 (1.81652250744047584e-05
observed vs 0 expected) [190800]
FAIL: ridge/lmsder/powell_singular i=0 (1.81652250744047584e-05 observed vs 0
expected) [190806]
FAIL: lmniel/scale=1/powell_badly_scaled i=0 (1.09815932976790051e-05 observed
vs 1.09815932969975976e-05 expected) [192849]
FAIL: lmniel/scale=1/powell_badly_scaled i=1 (9.10614673930196616 observed vs
9.10614673986700218 expected) [192850]
FAIL: lmniel/scale=1/weights/powell_badly_scaled i=0 (1.09815932976790051e-05
observed vs 1.09815932969975976e-05 expected) [192853]
FAIL: lmniel/scale=1/weights/powell_badly_scaled i=1 (9.10614673930196616
observed vs 9.10614673986700218 expected) [192854]
FAIL: lmsder/scale=1/powell_singular i=0 (1.81652250744047584e-05 observed vs
0 expected) [193519]
FAIL: lmsder/scale=1/weights/powell_singular i=0 (1.81652250744047584e-05
observed vs 0 expected) [193525]
FAIL: ridge/lmsder/powell_singular i=0 (1.81652250744047584e-05 observed vs 0
expected) [193531]


Perhaps something like lin2_epsrel instead?


On 11/12/2015 12:45 PM, Patrick Alken wrote:
> Hello,
> 
>   It looks like the test tolerances are too tight for 32 bit - all of my
> testing has been on 64 bit systems and I unfortunately don't have access to a
> 32 bit system to debug this. Just to verify, did you see these same failures
> for version 2.0? That code didn't change at all between 2.0 and 2.1 but just
> wanted to make sure.
> 
> The first thing I would try is to locate lines 178-179 of
> multifit/test_nonlinear.c:
> 
> 178   const double xtol = pow(GSL_DBL_EPSILON, 0.9);
> 179   const double gtol = pow(GSL_DBL_EPSILON, 0.9);
> 
> and increase these tolerances (set both them to 1.0e-3 as a starting point).
> Could you let me know if the test passes with this change? Then it would
> simply be a matter of finding a good value to get 32 bit tests to pass.
> 
> Patrick
> 
> On 11/12/2015 10:55 AM, Orion Poplawski wrote:
>> Looking at updating the Fedora gsl package to 2.1, but we're seeing test
>> failures on 32-bit builds:
>>
>> FAIL: test
>> ==========
>> FAIL: lmsder/scale=1/linear_rank1 did not converge, status=exceeded max 
>> number
>> of iterations [190252]
>> FAIL: lmsder/scale=1/weights/linear_rank1 did not converge, status=exceeded
>> max number of iterations [190255]
>> FAIL: ridge/lmsder/linear_rank1 did not converge, status=exceeded max number
>> of iterations [190258]
>> FAIL: lmsder/scale=10/linear_rank1 did not converge, status=exceeded max
>> number of iterations [190284]
>> FAIL: lmsder/scale=10/weights/linear_rank1 did not converge, status=exceeded
>> max number of iterations [190287]
>> FAIL: ridge/lmsder/linear_rank1 did not converge, status=exceeded max number
>> of iterations [190290]
>> FAIL: lmsder/scale=100/linear_rank1 did not converge, status=exceeded max
>> number of iterations [190316]
>> FAIL: lmsder/scale=100/weights/linear_rank1 did not converge, status=exceeded
>> max number of iterations [190319]
>> FAIL: ridge/lmsder/linear_rank1 did not converge, status=exceeded max number
>> of iterations [190322]
>> FAIL: lmsder/scale=1/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [190354]
>> FAIL: lmsder/scale=1/weights/linear_rank1zeros did not converge,
>> status=exceeded max number of iterations [190357]
>> FAIL: ridge/lmsder/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [190360]
>> FAIL: lmsder/scale=10/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [190396]
>> FAIL: lmsder/scale=10/weights/linear_rank1zeros did not converge,
>> status=exceeded max number of iterations [190399]
>> FAIL: ridge/lmsder/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [190402]
>> FAIL: lmsder/scale=100/linear_rank1zeros did not converge, status=exceeded 
>> max
>> number of iterations [190438]
>> FAIL: lmsder/scale=100/weights/linear_rank1zeros did not converge,
>> status=exceeded max number of iterations [190441]
>> FAIL: ridge/lmsder/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [190444]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [190657]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [190658]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [190660]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [190661]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [190697]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [190698]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [190700]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [190701]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [190737]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [190738]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [190740]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [190741]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [190777]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [190778]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [190780]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [190781]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [193074]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [193075]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [193077]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [193078]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [193114]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [193115]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [193117]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [193118]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [193154]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [193155]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [193157]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [193158]
>> FAIL: ridge/lmsder/lambda/helical did not converge, status=exceeded max 
>> number
>> of iterations [193194]
>> FAIL: ridge/lmsder/L/helical did not converge, status=exceeded max number of
>> iterations [193195]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=1 (-4.83804396442769695e-317
>> observed vs -4.83804396442769695e-317 expected) [test uses subnormal value]
>> [193197]
>> FAIL: ridge/lmsder/helical ridge lambda=5 i=2 (2.33809353535940645e-317
>> observed vs 2.33809353535940645e-317 expected) [test uses subnormal value]
>> [193198]
>> FAIL: lmsder/scale=1/linear_rank1 did not converge, status=exceeded max 
>> number
>> of iterations [195842]
>> FAIL: lmsder/scale=1/weights/linear_rank1 did not converge, status=exceeded
>> max number of iterations [195845]
>> FAIL: ridge/lmsder/linear_rank1 did not converge, status=exceeded max number
>> of iterations [195848]
>> FAIL: lmsder/scale=10/linear_rank1 did not converge, status=exceeded max
>> number of iterations [195874]
>> FAIL: lmsder/scale=10/weights/linear_rank1 did not converge, status=exceeded
>> max number of iterations [195877]
>> FAIL: ridge/lmsder/linear_rank1 did not converge, status=exceeded max number
>> of iterations [195880]
>> FAIL: lmsder/scale=100/linear_rank1 did not converge, status=exceeded max
>> number of iterations [195906]
>> FAIL: lmsder/scale=100/weights/linear_rank1 did not converge, status=exceeded
>> max number of iterations [195909]
>> FAIL: ridge/lmsder/linear_rank1 did not converge, status=exceeded max number
>> of iterations [195912]
>> FAIL: lmsder/scale=1/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [195944]
>> FAIL: lmsder/scale=1/weights/linear_rank1zeros did not converge,
>> status=exceeded max number of iterations [195947]
>> FAIL: ridge/lmsder/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [195950]
>> FAIL: lmsder/scale=10/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [195986]
>> FAIL: lmsder/scale=10/weights/linear_rank1zeros did not converge,
>> status=exceeded max number of iterations [195989]
>> FAIL: ridge/lmsder/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [195992]
>> FAIL: lmsder/scale=100/linear_rank1zeros did not converge, status=exceeded 
>> max
>> number of iterations [196028]
>> FAIL: lmsder/scale=100/weights/linear_rank1zeros did not converge,
>> status=exceeded max number of iterations [196031]
>> FAIL: ridge/lmsder/linear_rank1zeros did not converge, status=exceeded max
>> number of iterations [196034]
>> FAIL: lmsder/scale=1/fdiff/nist-hahn1 did not converge, status=exceeded max
>> number of iterations [196260]
>> FAIL: lmsder/scale=1/fdiff/weights/nist-hahn1 did not converge,
>> status=exceeded max number of iterations [196276]
>> FAIL: lmder/scale=1/fdiff/nist-hahn1 did not converge, status=exceeded max
>> number of iterations [196292]
>> FAIL: lmder/scale=1/fdiff/weights/nist-hahn1 did not converge, 
>> status=exceeded
>> max number of iterations [196308]
>>
>> Full build logs here:
>> https://copr-be.cloud.fedoraproject.org/results/orion/gsl2/fedora-23-i386/00139079-gsl/build.log.gz
>>
>>
>> Any ideas?
>>
> 


-- 
Orion Poplawski
Technical Manager                     303-415-9701 x222
NWRA, Boulder/CoRA Office             FAX: 303-415-9702
3380 Mitchell Lane                       address@hidden
Boulder, CO 80301                   http://www.nwra.com