The Prediction Problem

Why is it so hard to write stories that accurately predict future science, technology, and societies? Is the future just unknowable, or are writers blinded by gaps in knowledge--such as the basics of human behavior--they could actually fill? When a story accurately predicts some aspect of the future, is it just chance, or did the author have specialized knowledge or a particular perspective that made their idea more likely to come true?