Floating point computer - Trouble with getting back correct results

Posted by Francisco P. on Stack Overflow See other posts from Stack Overflow or by Francisco P.
Published on 2011-01-17T15:46:14Z Indexed on 2011/01/17 16:54 UTC
Read the original article Hit count: 136

Filed under:

floating-point

|

theory

Having trouble with a challenge.

Let's say I have a theoretical, base 10, floating point calculator with the following characteristics

Only 3 digits for mantissa
1 digit for exponent
Sign for mantissa and exponent

How would this machine compute the following?

300 + \sum_{i=1}^{100} 0.2

The correct result is 320. The machine's result is 300. But why? Can't get where the 20 goes goes missing...

Thanks for your time.

© Stack Overflow or respective owner

Related posts about floating-point

understanding floating point variables

as seen on Stack Overflow - Search for 'Stack Overflow'
There is some problem, i can't understand anyway. look at this code please <script type="text/javascript"> function math(x) { var y; y = x*10; alert(y); } </script> <input type="button" onclick="math(0.011)"> What must be alerted after i click on button? i think 0.11… >>> More
Comparing floating point values

as seen on Stack Overflow - Search for 'Stack Overflow'
I just read a statement about the floating point value comparison Floating point values shall not be compared using either the == or != operators. Most floating point values have no exact binary representation and have a limited precision. If so what is the best method for comparing two floating… >>> More
floating point hex octal binary

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am working on a calculator that allows you to perform calculations past the decimal point in octal, hexadecimal, binary, and of course decimal. I am having trouble though finding a way to convert floating point decimal numbers to floating point hexadecimal, octal, binary and vice versa. The… >>> More
What is a Bias Value of Floating Point Numbers?

as seen on Stack Overflow - Search for 'Stack Overflow'
In learning how floating point numbers are represented in computers I have come across the term "bias value" that I do not quite understand. The bias value in floating point numbers has to do with the negative and positiveness of the exponent part of a floating point number. The bias value of a… >>> More
Why are floating point values so prolific?

as seen on Stack Overflow - Search for 'Stack Overflow'
So, title says it all. Why are floating point values so prolific in computer programming. Due to problems like rounding errors, and not being able to even accurately represent numbers such as 0.1, I really can't see how they got as far as they did. I understand that the computation is faster… >>> More

Related posts about theory

Why does NUnit ignore datapoints when using generics in a theory

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to make use of the TheoryAttribute, introduced in NUnit 2.5. Everything works fine as long as the arguments are of a defined type: [Datapoint] public double[,] Array2X2 = new double[,] { { 1, 0 }, { 0, 1 } }; [Theory] public void TestForArbitraryArray(double[,] array) { // ... } It… >>> More
How do you deal with translating theory into practice?

as seen on Programmers - Search for 'Programmers'
Hello all! Being a computer scientist in a research field I am often tasked with working alongside professionals outside of the software domain (think math people, electrical engineer etc), and then translating their theories and ideas into real-world implementations. I often find it difficult when… >>> More
Title Tag Optimization - Common Grounds Between Raw SEO Theory & Search Engine Marketing Priorities

as seen on Ezine Articles - Search for 'Ezine Articles'
All you have to know about how to properly optimize title tag if you're just starting an onpage optimization campaign. Plus some easy to implement marketing tips to attract endless visitors to your content. >>> More
Database theory - relationship between two tables

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a database with two tables - let's call them Foo and Bar. Each foo may be related to any number of bars, and each bar may be related to any number of foos. I want to be able to retrieve, with one query, the foos that are associated with a certain bar, and the bars that are associated with a… >>> More
Recommended book about parallel programming - theory & best practice?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm looking for a book or books about multicore, multithreaded programming. The perfect book should focus on best practices and maybe include a bit of theory background. I'm not interested in a book which only describes a single library and focuses on its API. OS actually doesn't matter. >>> More