[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Discuss-gnuradio] gnuradio radio test repeatability
|
From: |
Cinaed Simson |
|
Subject: |
Re: [Discuss-gnuradio] gnuradio radio test repeatability |
|
Date: |
Sat, 10 Jun 2017 16:35:46 -0700 |
|
User-agent: |
Mozilla/5.0 (X11; Linux i686; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 |
On 06/08/2017 10:24 PM, address@hidden wrote:
> If the idea is to navigate to
> build/gr-fec
> then
> make test
> I don't pass that either.
Blow away the build directory and build it again, then run
make test
twice. Don't do an install or change userids.
The tests are reproducible.
If it's not repeatable, then it's operator error, i.e., you're
responsible for your machine.
There's not much we can do if it's not repeatable - but it's not a
gnuradio problem. It could be a OpenSUSE problem but I haven't heard the
other OpenSUSE users complain.
I just built version 3.7.12git, and did a
make test
All tests passed and all tests were reproducible.
The following is the head of
git log
for version 3.7.12git:
commit 37d373acee2112b0bb350e5abe09aca0115e5cc6
Merge: 0e32fca b57a37f
Author: Johnathan Corgan <address@hidden>
Date: Wed Jun 7 11:55:44 2017 -0700
Note, it's easy to work around the gsl-2.x problem - install version
1.16 from source in /usr/local/gsl. Keep it out of ldconfig, and add it
the front of your LD_LIBRARY_PATH, and the front of your PATH - ideally
set them all in a build script.
And add
PKG_CONFIG_PATH=/usr/local/gsl/lib/pkgconfig:$PKG_CONFIG_PATH
Make sure all environment variables are exported otherwise cmake will
most likely ignore them.
Edit the file
./gnuradio/cmake/Module/FindGSL.cmake
and add
/usr/local/gsl/bin
to the the UNIX branch just below find_program but above /usr/bin so it
looks like
find_program( GSL_CONFIG_EXECUTABLE gsl-config
/usr/local/gsl/bin
/usr/bin/
/usr/local/bin
)
I would make a copy of the file outside the gnuradio tree before editing it.
The bottom line is cmake has to know to look for gsl-config, find it
your path, and be able to find the gsl includes and libraries. Or
something like that - sometimes it's a complete mystery how it gets its
information.
Configure gsl as
./configure --prefix=/usr/local/gsl \
--enable-shared \
--enable-static
Not sure if enable-static is needed but I always add anyway.
>
> linux-0u81:/usr/local/src/gnuradio_latest/gnuradio/build/gr-fec # make test
> Running tests...
> Test project /usr/local/src/gnuradio_latest/gnuradio/build/gr-fec
> Start 1: gr-fec-reed-solomon-test
> 1/14 Test #1: gr-fec-reed-solomon-test ......... Passed 0.03 sec
> Start 2: qa_polar_encoder_systematic
> 2/14 Test #2: qa_polar_encoder_systematic ......***Failed 0.38 sec
> Start 3: qa_ecc_ccsds_27
> 3/14 Test #3: qa_ecc_ccsds_27 .................. Passed 0.37 sec
> Start 4: qa_fecapi_cc
> 4/14 Test #4: qa_fecapi_cc ..................... Passed 1.21 sec
> Start 5: qa_polar_encoder
> 5/14 Test #5: qa_polar_encoder .................***Failed 0.38 sec
> Start 6: qa_fecapi_dummy
> 6/14 Test #6: qa_fecapi_dummy .................. Passed 1.59 sec
> Start 7: qa_polar_decoder_sc
> 7/14 Test #7: qa_polar_decoder_sc ..............***Failed 0.57 sec
> Start 8: qa_polar_decoder_sc_list
> 8/14 Test #8: qa_polar_decoder_sc_list .........***Failed 0.57 sec
> Start 9: qa_depuncture
> 9/14 Test #9: qa_depuncture .................... Passed 1.75 sec
> Start 10: qa_ber_bf
> 10/14 Test #10: qa_ber_bf ........................ Passed 0.42 sec
> Start 11: qa_polar_decoder_sc_systematic
> 11/14 Test #11: qa_polar_decoder_sc_systematic ...***Failed 0.56 sec
> Start 12: qa_fecapi_ldpc
> 12/14 Test #12: qa_fecapi_ldpc ................... Passed 4.08 sec
> Start 13: qa_puncture
> 13/14 Test #13: qa_puncture ...................... Passed 3.39 sec
> Start 14: qa_fecapi_repetition
> 14/14 Test #14: qa_fecapi_repetition ............. Passed 2.92 sec
>
> 64% tests passed, 5 tests failed out of 14
>
> Total Test time (real) = 18.22 sec
>
> The following tests FAILED:
> 2 - qa_polar_encoder_systematic (Failed)
> 5 - qa_polar_encoder (Failed)
> 7 - qa_polar_decoder_sc (Failed)
> 8 - qa_polar_decoder_sc_list (Failed)
> 11 - qa_polar_decoder_sc_systematic (Failed)
> Errors while running CTest
> Makefile:72: recipe for target 'test' failed
> make: *** [test] Error 8
>
>
>
>
> On Thu, 8 Jun 2017 18:16:22 -0700
> Cinaed Simson <address@hidden> wrote:
>
>> To be clear, in your case, the "recipe for target 'test' failed" so
>> you can't possibly have single successful test.
>>
>> And here's what successful tests look like.
>>
>> Test project /home/cinaed/gnuradio/build/gr-fec
>> Start 1: gr-fec-reed-solomon-test
>> 1/14 Test #1: gr-fec-reed-solomon-test ......... Passed 0.06
>> sec Start 2: qa_polar_decoder_sc_systematic
>> 2/14 Test #2: qa_polar_decoder_sc_systematic ... Passed 2.59
>> sec Start 3: qa_puncture
>> 3/14 Test #3: qa_puncture ...................... Passed 7.96
>> sec Start 4: qa_fecapi_ldpc
>> 4/14 Test #4: qa_fecapi_ldpc ................... Passed 9.10
>> sec Start 5: qa_fecapi_dummy
>> 5/14 Test #5: qa_fecapi_dummy .................. Passed 4.07
>> sec Start 6: qa_fecapi_repetition
>> 6/14 Test #6: qa_fecapi_repetition ............. Passed 5.74
>> sec Start 7: qa_polar_decoder_sc_list
>> 7/14 Test #7: qa_polar_decoder_sc_list ......... Passed 2.07
>> sec Start 8: qa_polar_encoder
>> 8/14 Test #8: qa_polar_encoder ................. Passed 2.02
>> sec Start 9: qa_polar_decoder_sc
>> 9/14 Test #9: qa_polar_decoder_sc .............. Passed 2.41
>> sec Start 10: qa_ecc_ccsds_27
>> 10/14 Test #10: qa_ecc_ccsds_27 .................. Passed 0.99
>> sec Start 11: qa_polar_encoder_systematic
>> 11/14 Test #11: qa_polar_encoder_systematic ...... Passed 1.59
>> sec Start 12: qa_depuncture
>> 12/14 Test #12: qa_depuncture .................... Passed 4.58
>> sec Start 13: qa_ber_bf
>> 13/14 Test #13: qa_ber_bf ........................ Passed 1.12
>> sec Start 14: qa_fecapi_cc
>> 14/14 Test #14: qa_fecapi_cc ..................... Passed 3.05
>> sec
>>
>> 100% tests passed, 0 tests failed out of 14
>>
>> Total Test time (real) = 47.42 sec
>>
>> -- Cinaed
>>
>>
>>
>>
>>
>>
>>
>>
>> On 06/08/2017 04:44 PM, address@hidden wrote:
>>> As a follow up, the memtest found no errors.
>>>
>>> On Thu, 8 Jun 2017 01:47:43 -0700
>>> "address@hidden" <address@hidden> wrote:
>>>
>>>> I downloaded gnuradio off of github. Hopefully this is sufficient
>>>> identification of the version:
>>>>
>>>> "Latest commit 37d373a 14 hours ago @jmcorgan jmcorgan Merge
>>>> branch 'maint'"
>>>>
>>>> I noticed ZMQ failed, which is odd since it worked before. I reran
>>>> the test and ZMQ worked. This makes me wonder if some variable
>>>> isn't being set.
>>>>
>>>> Here are the results when ZMQ worked:
>>>>
>>>> Total Test time (real) = 210.83 sec
>>>>
>>>> The following tests FAILED:
>>>> 86 - qa_polar_encoder_systematic (Failed)
>>>> 89 - qa_polar_encoder (Failed)
>>>> 91 - qa_polar_decoder_sc (Failed)
>>>> 92 - qa_polar_decoder_sc_list (Failed)
>>>> 95 - qa_polar_decoder_sc_systematic (Failed)
>>>> 162 - qa_packet_format (Failed)
>>>> Errors while running CTest
>>>> Makefile:72: recipe for target 'test' failed
>>>> ------------------------------
>>>>
>>>> Here we have ZMQ failing:
>>>>
>>>> Total Test time (real) = 206.96 sec
>>>>
>>>> The following tests FAILED:
>>>> 86 - qa_polar_encoder_systematic (Failed)
>>>> 89 - qa_polar_encoder (Failed)
>>>> 91 - qa_polar_decoder_sc (Failed)
>>>> 92 - qa_polar_decoder_sc_list (Failed)
>>>> 95 - qa_polar_decoder_sc_systematic (Failed)
>>>> 162 - qa_packet_format (Failed)
>>>> 215 - qa_zeromq_sub (Failed)
>>>> 216 - qa_zeromq_pub (Failed)
>>>> Errors while running CTest
>>>> Makefile:72: recipe for target 'test' failed
>>>> make: *** [test] Error 8
>>>> ----------------------------
>>>>
>>>> I thought I'd try setting the affinity to one CPU with results:
>>>>
>>>> taskset 0x1 make test
>>>> Total Test time (real) = 206.35 sec
>>>>
>>>> The following tests FAILED:
>>>> 86 - qa_polar_encoder_systematic (Failed)
>>>> 89 - qa_polar_encoder (Failed)
>>>> 91 - qa_polar_decoder_sc (Failed)
>>>> 92 - qa_polar_decoder_sc_list (Failed)
>>>> 95 - qa_polar_decoder_sc_systematic (Failed)
>>>> 215 - qa_zeromq_sub (Failed)
>>>> 216 - qa_zeromq_pub (Failed)
>>>> Errors while running CTest
>>>> Makefile:72: recipe for target 'test' failed
>>>> make: *** [test] Error 8
>>>> ------------------
>>>>
>>>> Well I see test 162 worked this time. Of course, is this
>>>> repeatable? Next test:
>>>>
>>>> taskset 0x1 make test
>>>> Total Test time (real) = 206.65 sec
>>>>
>>>> The following tests FAILED:
>>>> 86 - qa_polar_encoder_systematic (Failed)
>>>> 89 - qa_polar_encoder (Failed)
>>>> 91 - qa_polar_decoder_sc (Failed)
>>>> 92 - qa_polar_decoder_sc_list (Failed)
>>>> 95 - qa_polar_decoder_sc_systematic (Failed)
>>>> 159 - qa_header_payload_demux (Failed)
>>>> 162 - qa_packet_format (Failed)
>>>> 215 - qa_zeromq_sub (Failed)
>>>> 216 - qa_zeromq_pub (Failed)
>>>> Errors while running CTest
>>>> Makefile:72: recipe for target 'test' failed
>>>> make: *** [test] Error 8
>>>> -----------------
>>>>
>>>> Not repeatable, plus an additional test (159) failed.
>>>>
>>>> I don't think affinity is an issue. I ran the gnu
>>>> system monitor and swap was never used. The PC has 8Gbytes and the
>>>> maxium memory used never exceeded 1.9G.
>>>>
>>>> I'm going to do a memtest on the PC, but I kind of doubt there is a
>>>> ram issue.
>>>>
>>>> _______________________________________________
>>>> Discuss-gnuradio mailing list
>>>> address@hidden
>>>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>>
>>>
>>> _______________________________________________
>>> Discuss-gnuradio mailing list
>>> address@hidden
>>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>>>
>>
>>
>> _______________________________________________
>> Discuss-gnuradio mailing list
>> address@hidden
>> https://lists.gnu.org/mailman/listinfo/discuss-gnuradio
>
>