Index Funds Explained: Why Owning the Market Beats Most Managers

Nobody is choosing the stocks. That is the whole product.

An index fund buys every security on a published list, in the proportions the list specifies. Then it does nothing until the list changes. No analyst is paid to decide which companies look cheap, no committee meets about it, and nobody is trying to be clever, which is why the fund can charge 0.03% a year where an active fund charges 0.75%. That fee gap is the whole edge.

The list, and who writes it

An index is a rule-based list of securities. A company maintains the list and publishes it. The S&P 500 is a list of about 500 large US companies chosen by a committee at S&P Dow Jones Indices. The CRSP US Total Market Index is a far longer list covering nearly every listed US company, and the Bloomberg US Aggregate is a list of investment grade US bonds.

Each list also sets the weights. The weight is your share of each holding. Most stock indexes are capitalization weighted, so a company’s share of the fund equals its market value as a share of the total, and a company worth $3 trillion inside a market worth $50 trillion takes 6% of your money. How the major lists are built, and why the Dow is the odd one out, is covered in stock market indices explained.

The fund commits to holding that list. When the index adds a company, the fund buys it. When a holding’s value rises, its weight in a cap-weighted fund rises on its own with no trading at all, which is a large part of why these funds trade so rarely and cost so little to run.

Sharpe’s subtraction

William Sharpe set it out in a 1991 paper, The Arithmetic of Active Management. It runs in four steps.

Split the market into two piles. The passive pile holds the market in index proportions. The active pile is everyone else. The two piles together are the market. The passive pile matches the market by construction, so the active pile must match it too, before costs, and every active dollar beating the market is funded by another active dollar losing to it.

So the average active dollar earns the market return before costs, and the market return minus its costs afterwards. Active management costs more. You pay for analysts, higher fees, more trading and wider spreads, and in a taxable account you also hand more realized gains to the IRS early.

Here is the subtraction on $10,000 at 7% a year before fees, over 30 years.

Annual fee	Net compounding rate	Value after 30 years	Given up to fees
0.03%	6.97%	$75,485	$638
0.20%	6.80%	$71,968	$4,155
0.50%	6.50%	$66,144	$9,979
0.75%	6.25%	$61,641	$14,482
1.00%	6.00%	$57,435	$18,688

With no fee at all the balance would be $10,000 x 1.07^30 = $76,123. The 0.75% fund keeps $61,641 of that, so the fee took 19% of the final balance without ever appearing as a line item on a statement. Put your own numbers in the expense ratio calculator. The full breakdown is in expense ratios explained.

What the evidence says, carefully

According to S&P’s SPIVA scorecards, which compare active funds with their benchmarks across many categories and countries, most actively managed funds have trailed their benchmark over long periods. The shortfall widens as the measurement window lengthens. It shows up well beyond US large-cap.

Two qualifications I would want if I were reading this. Some managers do beat their benchmarks, sometimes for years, and nothing above says otherwise. Picking them in advance is the hard part.

The scorecards also account for funds that closed or merged partway through, because a fund family can launch a dozen strategies, quietly fold the eight that did badly, and market the four survivors. That matters more than it sounds. Counting only the funds still standing at the end flatters the whole category, and correcting for it is why long-horizon comparisons look so much worse for active management than short ones.

Whether the fund does its job

Tracking difference is the gap between the fund’s return and the index’s return, and it is the real measure of whether a fund did what it promised. It already includes the expense ratio.

A fund tracking the S&P 500 can hold all 500 names, because 500 liquid stocks are easy to own. A fund tracking a 10,000-bond index cannot practically hold all 10,000, so it uses sampling: a representative subset chosen to match the index’s characteristics. Sampling adds a little extra drift, in both directions.

Some funds lend their holdings to short sellers and return part of the fee to the fund, which can offset costs and occasionally lets a fund track its index more closely than the headline fee suggests, and it also brings counterparty risk, disclosed in the prospectus that nobody reads.

Choosing one, and when to stop

Start with the list itself. An S&P 500 fund gives you large US companies. A total US market fund adds mid-caps and small-caps. A total world fund adds everything else. Those are three different bets. A wrong list makes the fee irrelevant.

Then the expense ratio. Under 0.10% is the target for mainstream US exposure. Then the fund’s size and age, because larger funds carry tighter spreads and far less risk of being shut down. Then the wrapper, traditional mutual fund or ETF, which is a question about how you buy it, since the holdings are identical either way. That trade-off is laid out in ETF versus mutual fund.

Now the part you probably need to hear. Two funds tracking the same index are close to interchangeable. A 0.03% fund and a 0.04% fund differ by $1 a year on $10,000, which is less than the spread you pay on a single trade. Do not spend an afternoon on that choice. Spend it on how much you contribute each month and on your split between stocks and bonds, both of which move your outcome by whole percentage points.

The four ways indexing lets you down

Cap weighting means you automatically own more of whatever has already risen. When one sector grows into a third of the index, your index fund holds a third in that sector and rides the whole way back down when the cycle turns. Technology-heavy indexes did exactly that at the end of the 1990s.

An index fund hands you the market return including every bear market in full. No manager will move it to cash for you, and if you do it yourself, on the worst afternoon of the worst month, you will sell at the bottom, sit out the recovery, and come back once prices have already made most of the move. That is where the damage gets done. Diversification across asset classes is what softens a decline.

Narrow indexes wear the indexing label without the diversification underneath. A thematic index holding 25 companies in one niche is a concentrated bet, no safer than the sector funds it sits beside.

Index changes are announced in advance. Everyone knows funds will be buying a particular stock on a particular day, and the cost of that is trivial for broad indexes and real for narrow ones.

Find the expense ratio of the largest fund in your 401(k) this week. Compare it with the table above. If it is above 0.20%, check whether the plan offers an index alternative, and if it does not, contribute anyway, take the match, and put the rest of your saving into a cheap index fund in a brokerage account outside the plan. Then set your monthly amount, read what an ETF is if the wrapper is still fuzzy, and test yourself with the ETFs and index funds quiz.