|
From: | Arun Giridhar |
Subject: | [Octave-bug-tracker] [bug #61788] arrays of type int16 contain wrong numbers |
Date: | Tue, 11 Jan 2022 10:22:45 -0500 (EST) |
User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:95.0) Gecko/20100101 Firefox/95.0 |
Follow-up Comment #5, bug #61788 (project octave): Here is a partial fix, still a work in progress. I now get this result. The final value calculation is still buggy due to saturation but the rest of the elements are OK. octave:4> int16(-3e4) : int16(1e4) : int16(+3e4) ans = -30000 -20000 -10000 0 10000 20000 2767 WIP patch attached. Feedback and advice solicited. (file #52646) _______________________________________________________ Additional Item Attachment: File name: range_v1.patch Size:3 KB <https://file.savannah.gnu.org/file/range_v1.patch?file_id=52646> _______________________________________________________ Reply to this item at: <https://savannah.gnu.org/bugs/?61788> _______________________________________________ Message sent via Savannah https://savannah.gnu.org/
[Prev in Thread] | Current Thread | [Next in Thread] |