Prev Next

Python / Data Science Essentials Interview Questions

What is NumPy and why is it significantly faster than plain Python lists for numerical work?

NumPy (Numerical Python) is the foundational library for scientific computing in Python. At its core it provides the ndarray — an N-dimensional array of a single, fixed data type stored in a contiguous block of memory. That single design decision is the source of almost all of NumPy's performance advantage over Python lists.

Python lists store references to Python objects scattered around the heap. Each arithmetic operation on a list requires Python to look up each object, check its type, extract the value, compute, and then box the result back into a new Python object. A million-element loop pays that overhead a million times.

NumPy sidesteps the overhead in two ways. First, all elements in an ndarray share the same dtype (e.g., float64, int32), so there is no per-element type check and no boxing. Second, NumPy operations are implemented as compiled C (and sometimes Fortran) routines that operate on the raw memory buffer in tight loops — this is called vectorisation. The Python interpreter is invoked once for the whole array, not once per element.

import numpy as np
import time

n = 10_000_000
py_list = list(range(n))
np_arr  = np.arange(n, dtype=np.float64)

t0 = time.perf_counter()
py_result = [x * 2.5 for x in py_list]
print(f'List loop : {time.perf_counter()-t0:.3f}s')

t0 = time.perf_counter()
np_result = np_arr * 2.5   # vectorised — no Python loop
print(f'NumPy     : {time.perf_counter()-t0:.3f}s')
# Typical ratio: 50x–200x faster for NumPy

Memory is also more compact. A Python integer object takes ~28 bytes; a NumPy int64 element takes exactly 8 bytes. For a million-element array that is the difference between 28 MB and 8 MB.

What is the primary reason NumPy operations are faster than equivalent Python list loops?
How many bytes does a single float64 element occupy in a NumPy array?

Invest now in Acorns!!! 🚀 Join Acorns and get your $5 bonus!

Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!

Earn passively and while sleeping

Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.

Invest now!!! Get Free equity stock (US, UK only)!

Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.

The Robinhood app makes it easy to trade stocks, crypto and more.


Webull! Receive free stock by signing up using the link: Webull signup.

More Related questions...

What is NumPy and why is it significantly faster than plain Python lists for numerical work? What are the main ways to create NumPy arrays? How do NumPy array shape, reshape, and axis work? What is NumPy broadcasting and how does it work? How does NumPy boolean masking and fancy indexing work? What are the most commonly used NumPy mathematical functions in data science? What is a Pandas DataFrame and how does it differ from a NumPy array? How do you read CSV, Excel, and JSON files into a Pandas DataFrame? What is the difference between df.loc[] and df.iloc[] in Pandas? How do you detect, handle, and fill missing values in a Pandas DataFrame? What are the different ways to filter rows in a Pandas DataFrame? How does Pandas groupby work and what aggregation patterns are most useful? How do you merge and join DataFrames in Pandas, and what do the different join types mean? When should you use df.apply() versus vectorised Pandas operations? How do you use pd.pivot_table to summarise data? How do you perform string operations on Pandas DataFrame columns? How do you work with dates and times in Pandas? What is Matplotlib and what are the key components of a figure? What are the most common chart types in Matplotlib and when do you use each? How do you create multi-panel figures with Matplotlib subplots? What is Seaborn and how does it differ from Matplotlib? What are the most important Seaborn plot types for exploratory data analysis? How do you create and interpret a correlation heatmap with Seaborn? What is Seaborn's FacetGrid and how does it enable multi-panel statistical plots? How do you compute descriptive statistics on a Pandas DataFrame? How do you reduce a Pandas DataFrame's memory usage through dtype optimisation? How do you generate reproducible random data with NumPy? How do you use value_counts() and pd.crosstab() to understand categorical data? How do you style Matplotlib figures and save them for reports? What is np.where and how is it used for conditional array creation? What is Pandas method chaining and how does df.pipe() support it? What does a typical exploratory data analysis (EDA) workflow look like in Python? How do you stack, concatenate, and split NumPy arrays? How do you detect and remove duplicate rows in a Pandas DataFrame? How do you control colours and colour palettes in Matplotlib and Seaborn? How do rolling and expanding window functions work in Pandas? How do Seaborn jointplot and pairplot help explore multivariate relationships? What are the key performance tips when using NumPy for large-scale data processing? How do you visualise regression results and residuals using Seaborn and Matplotlib? How do you process large CSV files that don't fit in memory using Pandas? How do you add annotations and text to Matplotlib charts? How do you quickly extract top/bottom rows and random samples from a Pandas DataFrame? How is NumPy linear algebra used in data science applications? How do you compare distributions across categories using Seaborn categorical plots? How do you build an end-to-end data cleaning and visualisation pipeline with NumPy, Pandas, and Seaborn?
Show more question and Answers...

Tools

Comments & Discussions