octave-bug-tracker
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #61788] arrays of type int16 contain wrong num


From: Arun Giridhar
Subject: [Octave-bug-tracker] [bug #61788] arrays of type int16 contain wrong numbers
Date: Tue, 11 Jan 2022 10:22:45 -0500 (EST)
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:95.0) Gecko/20100101 Firefox/95.0

Follow-up Comment #5, bug #61788 (project octave):

Here is a partial fix, still a work in progress.

I now get this result. The final value calculation is still buggy due to
saturation but the rest of the elements are OK.


octave:4> int16(-3e4) : int16(1e4) : int16(+3e4)
ans =

  -30000  -20000  -10000       0   10000   20000    2767


WIP patch attached. Feedback and advice solicited.


(file #52646)
    _______________________________________________________

Additional Item Attachment:

File name: range_v1.patch                 Size:3 KB
    <https://file.savannah.gnu.org/file/range_v1.patch?file_id=52646>



    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?61788>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/




reply via email to

[Prev in Thread] Current Thread [Next in Thread]