Buffett's opportunity cost of holding silver was too high. From 1998 to 2008 was the golden decade of the U.S. capital market, also known as the double-zero era. Holding silver would undoubtedly mean missing out on the crazy bull market before the 2008 financial crisis.