Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues with rounding and numbers less than 0.0005 #42

Open
awsharif opened this issue Apr 10, 2023 · 5 comments
Open

Issues with rounding and numbers less than 0.0005 #42

awsharif opened this issue Apr 10, 2023 · 5 comments
Labels
bug Something isn't working question Further information is requested

Comments

@awsharif
Copy link

awsharif commented Apr 10, 2023

Hi thanks for the development of numerals.

I just want to flag an issue - it appears you are unable to get accuracy more than 3 decimal places. This does not impact calculations but when the result is less than 0.0005 it will render as 0. Additionally round() function did not seem to help. Rounding greater than 3 decimal places does not register. Is this a known bug? Screenshot below. Issue persists across math, math-tex and math-plain.

Thanks!

Screenshot_20230410_045111_Obsidian.jpg

@publicvirtualvoid
Copy link

Having the same problem, is there any way to address this?

@gtg922r
Copy link
Owner

gtg922r commented Mar 7, 2024

@publicvirtualvoid can you provide some example math blocks where you were seeing this to help me debug

@over2sd
Copy link

over2sd commented May 7, 2024

image
I'm experiencing the same problem. See the lines where m,p,d, and e are defined for the start of the problem, and lines for k and l for the resulting 0 delta.

@gtg922r gtg922r added the bug Something isn't working label May 25, 2024
@gtg922r
Copy link
Owner

gtg922r commented May 25, 2024

I believe this is a result of using default System Formatting. If you change the "Rendered Number Format" option you can force it to show results in engineering or scientific notation:

image

Does this solve your need? Is there a different solution you want to see?

@gtg922r gtg922r added the question Further information is requested label May 25, 2024
@over2sd
Copy link

over2sd commented May 27, 2024

No. I tried each of the format options. None of them result in anything over three digits of precision.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants