[gs-bugs] [Bug 692805] fitz/base_geometry.c Commit "Remove fuzzing from fz_round_rect" results in incorrect pixmap sizes.

[bugzilla-daemon at ghostscript.com]

http://bugs.ghostscript.com/show_bug.cgi?id=692805

Dan <danwaleke at quickenloans.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |REOPENED
         Resolution|INVALID                     |

--- Comment #2 from Dan <danwaleke at quickenloans.com> 2012-03-15 16:20:29 UTC ---
(In reply to comment #1)
> > I can provide more details in necessary.
> 
> Well, yes please. At least enough information for us to be able to recreate the
> problem; if we can't recreate the problem it's hard to solve it.

Ok.  Hopefully you can make sense of this.  Basically I have an 8.5x11" PDF
(612,792 - 0 rotation) that I want to render at 2592x3354.

I use the following code:

fz_matrix ctm = fz_scale(zoomX, zoomY); //zoomX = 4.2352943 //zoomY = 4.2348485
ctm = fz_concat(ctm, fz_rotate(rotation)); //rotation = 0
bbox = fz_round_rect(fz_transform_rect(ctm, bounds)); //bounds = 0,0,612,792


Th original rect passed into fz_round_rect is this:
rect = 0,0,2592.0002,3354.0000

I expect the output after fz_round_rect to be:
bbox = 0,0,2592,3354

But it rounds .0002 up to 2593 and outputs this:
bbox = 0,0,2593,3354

Reversing the commit above I get the correct rounding.

-- 
Configure bugmail: http://bugs.ghostscript.com/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.