This repository has been archived by the owner on May 18, 2024. It is now read-only.

In some cases modp_dtoa/modp_dtoa2 gives different precision then requested #12

Open

GoogleCodeExporter opened this issue May 24, 2015 · 2 comments

Labels

auto-migrated Priority-Medium Type-Defect

GoogleCodeExporter commented May 24, 2015

Nick,

The code has the following branch:

    if (value > thres_max) {
        sprintf(str, "%e", neg ? -value : value);
        return;
    }

This is wrong as it ignores requested precision - sprintf uses 6 precision by 
default.

Original issue reported on code.google.com by [email protected] on 10 Jun 2010 at 8:56

The text was updated successfully, but these errors were encountered:

GoogleCodeExporter added Priority-Medium Type-Defect auto-migrated labels

Owner

client9 commented Sep 23, 2016

happy to have pull request to fix this.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.