Andrey Karpaty published an analysis of his project that analyzes archived Hacker News threads and, with the help of LLM, checks whether users' predictions have come true after 10 years.
🟢 HOW?
The project uses "hindsight" to compare old comments with reality, identify visionaries, and find the most high-profile mistakes.
Technically, the solution is a pipeline that collects data via the Algolia API and processes them using a structured prompt.
A test run on 930 discussions (a monthly archive of Hacker News articles) took about an hour and cost just $58.
System generates a Static Site at output, with a "Hall of Fame" of analysts and a rating of forecast accuracy.
GitHub • #AI #ML #Karpaty
••••••••••••••••••••••••••••••••••••••••••••••••••••
🤖 Data Science, ML & Big Data with @DataXplore