[Octave-bug-tracker] [bug #34893] conv2 produces different results for shape 'valid' depending on the orientation of matrix B

[Jordi Gutiérrez Hermoso]

Follow-up Comment #13, bug #34893 (project octave):

After some analysis, it appears that Sunghyun Cho's patch is not correct,
since it breaks this case:


      x = rand(100);
      y = ones(5);
      A = conv2(x,y)(5:end-4,5:end-4);
      B = conv2(x,y,"valid");


With the patch, A and B are only approximately equal. Without it, they're
exactly equal.

However, I think I'm slowly starting to understand the convoluted (haha) conv2
code. I will attempt another fix, but probably not for the 3.6.2 release.

    _______________________________________________________

Reply to this item at:

  <http://savannah.gnu.org/bugs/?34893>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.gnu.org/