Decimal Python vs. float runtime

Question

Just a general question on what sort of runtime differences I should be expecting between using these two different data types.

My test:

test = [100.0897463, 1.099999939393,1.37382829829393,29.1937462874847272,2.095478262874647474]
test2 = [decimal.Decimal('100.0897463'), decimal.Decimal('1.09999993939'), decimal.Decimal('1.37382829829'), decimal.Decimal('29.1937462875'), decimal.Decimal('2.09547826287')]

def average(numbers, ddof=0):
    return sum(numbers) / (len(numbers)-ddof)

%timeit average(test)
%timeit average(test2)

The differences in runtime are:
1000000 loops, best of 3: 364 ns per loop
10000 loops, best of 3: 80.3 µs per loop

So using decimal was about 200 times slower than using floats. Is this type of difference normal and along the lines of what I should expect when deciding which data type to use?

I guess this is because the Python type float is somewhere deeply implemented in C, while decimal looks like a module/package not built into the Python interpreter. — linusg
– linusg, Commented Jan 3, 2017 at 22:24

Robert Hacken · Accepted Answer · 2023-11-01 16:21:11Z

29

Based on the time difference you are seeing, you are likely using Python 2.x. In Python 2.x, the decimal module is written in Python and is rather slow. Beginning with Python 3.2, the decimal module was rewritten in C and is much faster.

Using Python 2.7 on my system, the decimal module is ~180x slower. Using Python 3.5, the decimal module is in only ~2.5x slower.

If you care about decimal performance, Python 3 is much faster.

edited Nov 1, 2023 at 16:21

Robert Hacken

4,7332 gold badges19 silver badges21 bronze badges

answered Jan 4, 2017 at 6:18

casevh

11.5k1 gold badge30 silver badges37 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Community · Accepted Answer · 2017-05-23 12:24:35Z

10

You get better speed with float because Python float uses the hardware floating point register when available (and it is available on modern computers), whereas Decimal uses full scalar/software implementation.

However, you get better control with Decimal, when you have the classical floating point precision problems with the float types. See the classical StackOverflow Q&A Is floating point math broken? for instance.

edited May 23, 2017 at 12:24

CommunityBot

11 silver badge

answered Jan 3, 2017 at 22:26

Jean-François Fabre♦

141k24 gold badges180 silver badges247 bronze badges

1 Comment

WhitneyChia Over a year ago

Yeah, I understand I'll be trading off precision for time, but is this big of a difference typical you think?

Collectives™ on Stack Overflow

Decimal Python vs. float runtime

2 Answers 2

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related