Oceanic production of calcium carbonate is conventionally attributed to marine plankton (coccolithophores and foraminifera). Here we report that marine fish produce precipitated carbonates within their intestines and excrete these at high rates. When combined with estimates of global fish biomass, this suggests that marine fish contribute 3 to 15% of total oceanic carbonate production. Fish carbonates have a higher magnesium content and solubility than traditional sources, yielding faster dissolution with depth. This may explain up to a quarter of the increase in titratable alkalinity within 1000 meters of the ocean surface, a controversial phenomenon that has puzzled oceanographers for decades. We also predict that fish carbonate production may rise in response to future environmental changes in carbon dioxide, and thus become an increasingly important component of the inorganic carbon cycle.