Questions tagged [floating-point]

Approximate representation of numbers as a fixed number of digits multiplied by a logarithmic scale.

Filter by
Sorted by
Tagged with
0
votes
1answer
56 views

Why are floats converted from different integers sometimes equal?

I'm trying to understand the following algorithm: ...
0
votes
2answers
34 views

Can area-partitioning lose included points due to floating point precision?

I'm currently partitioning a big area $A$ into $n$ areas $B_i$ such that $$\bigcup_{i=1}^n B_i = A$$ I have geo-coordinates which I know are in $A$ (also with the finite precision of floats). ...
1
vote
2answers
53 views

Hypothetical question on floating point normalization

I've seen a few questions posted regarding the upsides/downsides of floating point formats that have explicit integrals vs. formats that have implicit integrals, but have not seen an answer that ...
1
vote
1answer
96 views

Algorithm for implementing the modulus “%” operator?

How can an efficient modulus operator be implemented? Here's a naive way of defining A % B: given $(a,b) \in \mathbb{Z}$ (represented as ...
1
vote
3answers
59 views

How does computer store non-repeating decimal very accurately?

Maybe it is not accurate at all, but it looks very accurate for me. I'm making a scientific calculator for my portfolio, and I found an interesting phenomenon. Because computers store decimals not ...
0
votes
0answers
38 views

Using half float to represent scaled short (int16), do I lose precision comparing to using double?

A device is generating 14-bit integer which is stored as int16 (short), a scaling process will then scale the data to value of order 10E-3. Does it then matter if I store these number with half float ...
2
votes
1answer
46 views

Implementing Gauss–Legendre algorithm using arbitrary-length rationals

I am trying to re-implement SuperPI myself in Rust, but the results I get are not very accurate. SuperPI computes pi using the Gauss-Legendre algorithm. The Gauss–Legendre algorithm is quite simple, ...
2
votes
1answer
700 views

How to calculate machine epsilon

In a binary system we know that the next floating point number after 4 is 4+1/32. What is the machine epsilon? Is it 1/32 and if yes, why?
1
vote
1answer
75 views

What does floating point biased notation have to do with 2's complement?

During lecture the professor talked about Integer Compare for floats and kept mentioning two's complement. What's the relation between them? All I understand is that two's complement can take us ...
1
vote
4answers
112 views

Float multiplication

While doing the multiplication 1.4*0.8 in a python program, I got the result as 1.1199999999999999. Why didn't I get ...
9
votes
1answer
239 views

Why does floating point modulus exactness matters?

Most Smalltalk dialects currently implement a naive inexact floating modulus (fmod/remainder). I just changed this to improve Squeak/Pharo and eventually other Smalltalk adherence to standards (IEEE ...
3
votes
1answer
90 views

Understanding truncation and rounding error in IEEE floating point system?

I'm trying to understand the theory behind finding the optimal $h$ value for differentiation in this definition: $$ \frac{f(x+h) - f(x)}{h}$$ as $h$ tends to 0. Here is my understanding: ...
3
votes
1answer
53 views

Why do I get really different results with my benchmarking code I made?

I'm doing research work for my last year in high school. My work is about processors and for the experimental part i've coded an app that can mesure how many Floating Point Operation can a processor ...
1
vote
1answer
561 views

How to Add IEEE 754 Floating Point Numbers

I'm trying to add two 16 bit numbers that use a similar format as IEEE 754. The format is in the image below: I can't figure out how to add together two numbers for the life of me. Specifically, ...
1
vote
2answers
319 views

Is IEEE 754 float arithmetic associative, commutative, distributive, etc? Why?

Does the associative/commutative/distributive/etc property hold for arithmetic performed with IEEE 754 floats? Obviously the answer is no to most of those questions, but do any of the properties of ...
4
votes
1answer
90 views

Imaginary numbers and negative zero

I've been studying the low-level hardware implementations of floating point numbers and doing an exercise to design a custom floating point implementation. I know that being able to represent ...
1
vote
2answers
52 views

Float type variable uncertainty

I developed an image processing software and I need to do a numerical analysis of it, considering the error propagation associated to its operations and the uncertainty of float type variables caused ...
4
votes
2answers
60 views

Union of fixed and floating point types

Say I have two real number types. They may be floating or fixed point. How can I construct a new type whose values are at least the union of the two with the minimal number of bits? There are 3 cases ...
1
vote
1answer
23 views

Exact Value of Denormalised number related to floating point numbers

I faced with the following issue: if the value of a floating point format number is in the range of underflow, it must be 0 or a denormal number.If the value is not 0 than what is the exact value of ...
0
votes
0answers
58 views

Inverting an IEEE 754 double

While preparing for an exam I've come across this problem: Let $x$ be an IEEE 754 double precision number. Show that $$ \texttt{fl}(x * \texttt{fl}(1/x)) $$ has only 2 possible results ...
0
votes
1answer
1k views

What is exponent of denormalized real in IEEE 754 floating point format?

I was reading this link. Here I noticed that, in table titles "Float Values (b = bias)", in exponent column, entry for denormalized reals is $00..00$, but in value column, the entry is $-b+1$. Why is ...
1
vote
1answer
159 views

Genetic Algorithm Getting Stuck on Certain Values

I'm attempting to teach myself something about genetic algorithms. I found a simple tutorial on it here, and it made enough sense that I was able implement the suggested example of generating a string ...
1
vote
1answer
44 views

How do proof assistants nowadays avoid floatpoint error?

I heard that Coq is using "Dedekind cut", but how's that related to floatpoint errors? Can we just use something like ...
3
votes
1answer
401 views

Why do floating point values have infinity?

Why do floating point values have infinity instead of just a higher exponent?
1
vote
1answer
4k views

8-bit floating-point representation

I'm studying about representing fractional numbers as floating-point values. It is going to be an 8-bit representation. Somewhere in the text, it is said that: "We use the first bit to represent ...
1
vote
1answer
40 views

Converting a 32-bit bit pattern into floating point number

In The Scientist and Engineer's Guide to Digital Signal Processing By Steven W. Smith, Ph.D. i have read something like that, Single precision or 32-bit floating point forms the floating point number,...
2
votes
2answers
1k views

How to estimate floating-point precision of function?

Let's say I have a function that consists solely of floating-point operations where the last operation rounds the computed value to a predefined number of digits. And I feed this function with a range ...
1
vote
1answer
1k views

How does conversion from fixed-point to floating-point happen?

I came across to the code that convert 32-bit signed fixed-point number (16.16) to a float and it looks like (pseudocode) floating = fixed / 65536.0 Could you ...
2
votes
0answers
28 views

Heuristic Consistency with float multiplications

I'm running A* search with a theoretically consistent heuristic. I'm doing a lot of float multiplications, and I'm not sure how best to ensure that my heuristic remains consistent down to the last ...
1
vote
1answer
166 views

how to convert any fraction to decimal

So for a project I am working on. I need to take a string representation of a floating point number, lets say "1.5" and do arithmetic on it with another floating point number. The catch is I cannot ...
0
votes
2answers
516 views

Convert a decimal floating-point number into a binary floating-point number

Let's say I have a decimal floating-point number, i.e. a mantissa and precision (negative exponent), both represented as integers. How do I convert this into a binary floating point number (of the ...
1
vote
1answer
61 views

Compress 32 bit integer into a normalized float

and sorry if this is a duplicate of some sort, my poor technical vocabulary doesn't get me very far with google. I am trying to implement some well-known PRNG algorithms. For the time, the algorithm ...
0
votes
1answer
151 views

-4 as floating point

How would one represent the number -4 as an 8-bit normalised, 2's complement, floating point, with 4 bits dedicated to the exponent? As a normal 4-bit 2's complement number, it would be represented ...
1
vote
1answer
114 views

What are some of the practical applications of functions that extract the exponent and mantissa of a floating point number?

I'm talking about functions such as Python's math.frexp() : math.frexp(x) Return the mantissa and exponent of x as the pair (m, e). m is a float and e is an integer such that x == m * 2**e ...
1
vote
2answers
1k views

What are the reasons for and against using normalized floating point?

Floating point number formats can be normalized or not, meaning that ‘normal’ floating point numbers have an implicit (hidden) leading bit 1 in the significand. For example, the binary IEEE 754 ...
1
vote
1answer
411 views

Neural Networks: Simulate the working of Dynamic Fixed Point representation of the weights on hardware

I am looking to implement a neural network on hardware using Verilog. I have completed and tested with floating point representation and a 20 bit fixed point representation. I want to further reduce ...
2
votes
0answers
32 views

numeric stability of map reduce operations

I am building a small library for computing information retrieval metrics for classifiers (precision, recall, f1, accuracy, whatever). Typically each metric is built by calculating a single value for ...
0
votes
0answers
31 views

When do you know whether an exponent represents a movement of the decimal point to the left?

I'm learning about floating point numbers and I don't quite understand when one should interpret an exponent as moving the decimal point to the left. By book shows an example of converting -10.5 ...
2
votes
3answers
3k views

Floating point normalised numbers in binary

Many text books state that for a binary floating point representation in a computer byte, that if the mantissa is normalised, then a positive number must start with 01 from the left or a negative ...
2
votes
1answer
213 views

Are IEEE floating point numbers intervals or point values?

The context is IEEE 754-2008 floating point number systems. The systems defined by the standard comprise, as far as I understand it, a bit-level representation and a set of guarantees on the precision ...
18
votes
7answers
7k views

Why floating point representation uses a sign bit instead of 2's complement to indicate negative numbers

Consider a fixed point representation which can be regarded as a degenerate case of a floating number. It is entirely possible to use 2's complement for negative numbers. But why is a sign bit ...
2
votes
2answers
776 views

Implicit Leading 1 in Binary Floating Point

Is the convention of dropping the leading 1 when storing the significand a given in all binary floating point representations or not necessarily?
3
votes
1answer
234 views

Why a separate ALU is needed, since any integer can be represented as floating point numbers?

Most of the operations in computer are using floating point arithmetic.Put it simply why a Floating Point Unit alone is not sufficient? Can we do away with ALU?Is FP operations are resource intensive ...
3
votes
2answers
776 views

Is the exponent in floating point numbers signed or unsigned

This may be sound like a stupid question, because, of course, it can be negative and, as Wikipedia states: A numeric variable is signed if it can represent both positive and negative numbers, and ...
3
votes
1answer
17k views

Normalizing the mantissa in floating point representation

How to represent $0.148 * 2^{14}$ in normalized floating point arithmetic with the format 1 - Sign bit 7 - Exponent in Excess-64 form 8 - Mantissa $(0.148)_{10} =...
2
votes
0answers
212 views

Why mantissa and exponent are stored differently in a float?

As we know, in IEEE 754 standard, float number's exponent and mantissa are stored differently. While the exponent is stored as an unsigned number, taking advantage of the bias, the mantissa is in sign-...
2
votes
3answers
548 views

Can a unnormalized floating point number be recognized also when exponent is not zero?

From Tanebaum's Structed Computer Organization. Exercise 4 of Appendix B The following binary floating-point number consist of a sign bit, an excess $64$, radix $2$ exponent, and a $16$-bit ...
0
votes
0answers
106 views

How can a Number Represented without Normalization Technique?

Consider the following floating point Representation Mantissa is pure fraction in signed magnitude form . What is the representation of the binary number 1111.1111 $\times 2^{2} $ in hexadecimal ...
0
votes
2answers
186 views

What is meant by “uneven spacing” on number line when dealing with floating point numbers in computers?

I read some examples online on this subject, but none of them really gave an explanation. When I visualize the number line all I can see is evenly spaced numbers, I'm not grasping the notation of "...
1
vote
3answers
821 views

Comparing floating-point numbers as integers

In the article http://floating-point-gui.de/errors/comparison/, a method for comparing floating-point numbers is suggested: There is an alternative to heaping conceptual complexity onto such an ...