[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Octave-bug-tracker] [bug #37830] Incorrect results from factor
|
From: |
Jordi Gutiérrez Hermoso |
|
Subject: |
[Octave-bug-tracker] [bug #37830] Incorrect results from factor |
|
Date: |
Thu, 29 Nov 2012 19:41:36 +0000 |
|
User-agent: |
Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.13) Gecko/20110109 Hyperchipmunk/3.6.13 |
Follow-up Comment #3, bug #37830 (project octave):
No, qq > 2^52, so it requires more precision than can fit in a double's
mantissa. factor works correctly if you use uint64 with the right value in
it:
octave:1> factor(uint64(1e15)*10*10+1)
ans =
11 103 4013 21993833369
This agrees with Maxima:
(%i1) factor(10^17+1);
(%o1) 11 103 4013 21993833369
_______________________________________________________
Reply to this item at:
<http://savannah.gnu.org/bugs/?37830>
_______________________________________________
Message sent via/by Savannah
http://savannah.gnu.org/