Most varieties of stone (cobble, concrete, brick, etc.) are very expensive, especially in comparison to lumber in places where tree farms are plentiful.
Also, idk if you’ve seen a modern wood house, but they’re practically hollow, save for fiberglass insulation. They use far less material than stone buildings.
They certainly don’t mean your Amex lol