about me



< June 2005 >
    1 2 3 4
5 6 7 8 91011

past articles »

Click for San Francisco, California Forecast

San Francisco, USA


Python's half open index notation

Beginner programmers often wonder about Python's sequence indexing and slicing notation. Array index starts from 0. Slicing uses half open notations, where L[a:b] is a subsequence with index x where a <= x < b.

Why is the endpoint excluded? Isn't it more intuitive if array index starts from 1 and the endpoint is included, so that a 3 elements array is referenced as L[1:3] with items L[1], L[2], L[3]?

It turns out this notation is an elegant and deliberate design and it has some excellent properties.

We write programs to operate on arrays, to find their length, traverse the subsequences, split them or join them. The half open notation always show a simple pattern. But the inclusive notation often requires adding 1 or substracting 1 to the indexes in many operations. Thus it is more vulnerable to off-by-one-error. This article One True Way of array indexing discuss this at length. I have reproduce its example (with corrections) below:

Operation Half open Inclusive
length of a slice L[a:b] b-a (b-a+1)
first n characters of L L[:n] L[1:n]
last n characters of L L[-n:] L[len(L)-n+1:]
The identity slice L == L[0:len(L)] == L[:] L[1:len(L)]
The empty slice L[a:a] is empty for any a. perhaps L[a:a-1]?
A slice of length n, from point a L[a:a+n] L[a:a+n-1]
Split L[a:b] at index c L[a:b] == L[a:c]+L[c:b] L[a:c-1]+L[c:b]

Another important property is an empty sequence can be expressed by L[a:a], while there is no natural way to express an empty sequence with the inclusive notation. But do we really need to care about a special case? Absolutely! In fact failure to account for empty input is one of the most common error. Just like zero is a fundamental concept in mathematics, always think how you program can handle null input. An inferior approach is to represent empty sequence by None or null pointer. This creates a special case so that a variable need to be tested before dereferencing. Failure to do so contributes to unexpected exceptions. It is an elegant design that L[a:b] can also represent sequences with 0 length.

C++'s STL also choose this notation to represent a range. According to the literature this is crucial because "algorithms that operate on n things frequently require n+1 positions. Linear search, for example (find) must be able to return some value to indicate that the search was unsuccessful." I have seen so many people flunked link list or data structure exercises because they have trouble dealing with the end of a list. Often a good solution is shift the focus beyond the n concrete objects to the n+1 positions around them. I hope this help to make sense of the half open notation.

2005.06.16 [, ] - comments



blog comments powered by Disqus

past articles »


BBC News


Nxivm: Sex cult leader Raniere found guilty in New York (19 Jun 2019)


MH17: Four charged with shooting down plane over Ukraine (19 Jun 2019)


Rory Stewart out of race to be UK PM (19 Jun 2019)


Spy satellites reveal extent of Himalayan glacier loss (19 Jun 2019)


Slavery reparations hearing ignites fiery debate in Congress (19 Jun 2019)


Rugby-playing detective tackles intruder (19 Jun 2019)


Egypt Morsi TV gaffe puts spotlight on control of media (19 Jun 2019)


Manslaughter arrest over footballer Sala's death (19 Jun 2019)


Garissa University attack: Three convicted over Kenya massacre (19 Jun 2019)


Nicolas Sarkozy: Former French president loses bid to avoid bribery trial (19 Jun 2019)

more »


SF Gate


Desperation in France’s food delivery gig economy (18 Jun 2019)


The big question for the Fed this week: Did we make a mistake? (17 Jun 2019)


The US has its eye on Big Tech. Will criminal inquiries result? (17 Jun 2019)


The bias embedded in tech (17 Jun 2019)


Watch Tim Cook slam the tech industry in Stanford graduation commencement speech (17 Jun 2019)


Here’s what it’s like to work at Twitch, one of the hottest gaming companies in the U.S. (17 Jun 2019)

more »

Site feed Updated: 2019-Jun-19 15:00