Prev Next

Python / Data Science Essentials Interview Questions

How do you quickly extract top/bottom rows and random samples from a Pandas DataFrame?

During EDA you often need to inspect extremes (the highest-revenue customers, the worst-performing products) or draw a random sample for quick analysis. Pandas provides concise methods for each of these.

import pandas as pd
import numpy as np

rng = np.random.default_rng(42)
df = pd.DataFrame({
    'product': [f'P{i}' for i in range(100)],
    'revenue': rng.integers(1_000, 100_000, 100),
    'returns': rng.integers(0, 500, 100),
})

# --- Top and bottom N rows ---
df.nlargest(5, 'revenue')   # 5 highest revenue products
df.nsmallest(5, 'revenue')  # 5 lowest revenue products

# Multiple columns — break ties by second column
df.nlargest(5, ['revenue', 'returns'])

# --- Random sampling ---
df.sample(n=10, random_state=42)        # 10 random rows
df.sample(frac=0.1, random_state=42)    # 10% of rows
df.sample(n=10, replace=True)           # with replacement (bootstrapping)

# Stratified sample — same proportion from each category
df['tier'] = pd.cut(df['revenue'], bins=3, labels=['low','mid','high'])
stratified = df.groupby('tier', group_keys=False).apply(
    lambda g: g.sample(frac=0.1, random_state=42)
)

# --- Head, tail, every Nth row ---
df.head(10)       # first 10 rows
df.tail(10)       # last 10 rows
df.iloc[::5]      # every 5th row — useful for large datasets

nlargest and nsmallest are significantly faster than sort_values(...).head(n) for large DataFrames because they use a partial sort (heap) under the hood — O(N log k) instead of O(N log N) for the full sort. Use them whenever you only need the extremes, not a fully sorted result.

Why is df.nlargest(10, 'revenue') faster than df.sort_values('revenue', ascending=False).head(10) on a large DataFrame?
Which argument in df.sample() sets the proportion of rows to return?

Invest now in Acorns!!! 🚀 Join Acorns and get your $5 bonus!

Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!

Earn passively and while sleeping

Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.

Invest now!!! Get Free equity stock (US, UK only)!

Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.

The Robinhood app makes it easy to trade stocks, crypto and more.


Webull! Receive free stock by signing up using the link: Webull signup.

More Related questions...

What is NumPy and why is it significantly faster than plain Python lists for numerical work? What are the main ways to create NumPy arrays? How do NumPy array shape, reshape, and axis work? What is NumPy broadcasting and how does it work? How does NumPy boolean masking and fancy indexing work? What are the most commonly used NumPy mathematical functions in data science? What is a Pandas DataFrame and how does it differ from a NumPy array? How do you read CSV, Excel, and JSON files into a Pandas DataFrame? What is the difference between df.loc[] and df.iloc[] in Pandas? How do you detect, handle, and fill missing values in a Pandas DataFrame? What are the different ways to filter rows in a Pandas DataFrame? How does Pandas groupby work and what aggregation patterns are most useful? How do you merge and join DataFrames in Pandas, and what do the different join types mean? When should you use df.apply() versus vectorised Pandas operations? How do you use pd.pivot_table to summarise data? How do you perform string operations on Pandas DataFrame columns? How do you work with dates and times in Pandas? What is Matplotlib and what are the key components of a figure? What are the most common chart types in Matplotlib and when do you use each? How do you create multi-panel figures with Matplotlib subplots? What is Seaborn and how does it differ from Matplotlib? What are the most important Seaborn plot types for exploratory data analysis? How do you create and interpret a correlation heatmap with Seaborn? What is Seaborn's FacetGrid and how does it enable multi-panel statistical plots? How do you compute descriptive statistics on a Pandas DataFrame? How do you reduce a Pandas DataFrame's memory usage through dtype optimisation? How do you generate reproducible random data with NumPy? How do you use value_counts() and pd.crosstab() to understand categorical data? How do you style Matplotlib figures and save them for reports? What is np.where and how is it used for conditional array creation? What is Pandas method chaining and how does df.pipe() support it? What does a typical exploratory data analysis (EDA) workflow look like in Python? How do you stack, concatenate, and split NumPy arrays? How do you detect and remove duplicate rows in a Pandas DataFrame? How do you control colours and colour palettes in Matplotlib and Seaborn? How do rolling and expanding window functions work in Pandas? How do Seaborn jointplot and pairplot help explore multivariate relationships? What are the key performance tips when using NumPy for large-scale data processing? How do you visualise regression results and residuals using Seaborn and Matplotlib? How do you process large CSV files that don't fit in memory using Pandas? How do you add annotations and text to Matplotlib charts? How do you quickly extract top/bottom rows and random samples from a Pandas DataFrame? How is NumPy linear algebra used in data science applications? How do you compare distributions across categories using Seaborn categorical plots? How do you build an end-to-end data cleaning and visualisation pipeline with NumPy, Pandas, and Seaborn?
Show more question and Answers...

Tools

Comments & Discussions