Uncategorized

Karpathy Deploys Claude to Build HackerTube, a Video Catalog Derived from 40,000 Hacker News Comments

The development is notable not only for its content but for the methodology behind its creation. Karpathy described a workflow where Anthropic’s Claude Opus 5.5 and Claude Sonnet models performed the vast majority of the engineering and data processing tasks. According to Karpathy, the human effort involved was limited to approximately two hours of manual setup, which included creating a Google Cloud API key to retrieve YouTube metadata, provisioning a virtual private server (VPS), and purchasing the domain name.

The underlying data pipeline processed 39,834 comments from Hacker News, a figure Karpathy rounded to approximately 40,000 in some accounts, though other reports cite a broader context of 43 million total comments scanned for relevant links. The two-stage AI process began with Claude Opus 5.5 downloading and filtering the raw comments. Subsequently, Claude Sonnet, operating within a Claude Code workflow, screened the data for spam and identified specific video recommendations. This automated curation sorted the videos into 150 topics, forming the basis of the site’s navigation structure.

Technical telemetry from the project reveals the scale of the AI interaction. Karpathy reported that the project consumed 504 million input tokens, 90% of which were cached, and 7.6 million output tokens. Over 90% of this usage was attributed to Sonnet’s comment-labeling calls, while the initial building and deployment of the site required approximately 1 million Opus 5.5 tokens. Karpathy noted that he was on a subscription plan during this process but did not disclose a specific dollar cost, emphasizing that the primary metric was time efficiency: “This takes ~2 hours now. I can breathe again.”

Photo by Zulfugar Karimov on Pexels

HackerTube’s user interface is designed for minimal friction. The site requires no user login; instead, recommendation state is stored in the local browser session. Visual thumbnails are generated by extracting a frame from the midpoint of each video. Additionally, the platform offers keyboard shortcuts and allows users to export the full dataset, enabling anyone to rebuild the catalog independently. Karpathy explicitly distinguished this human-curated index from YouTube’s engagement-driven algorithm, which he described in a blog post as an “enshittified wall of slop.” He argued that while YouTube’s algorithm may serve the median user, it fails to surface high-quality technical content to specialized audiences, a gap that HackerTube aims to fill.

This project serves as a practical demonstration of what Karpathy has termed the “sharp funnel” of AI access. In a recent interview, he argued that there is a widening gap between the roughly 6 billion people who have barely used large language models (LLMs) and the approximately 5,000 individuals who have access to frontier systems inside AI labs. He posits that casual users, who primarily use chatbots for quick answers, do not understand the sustained technical capabilities available to professional developers.

The HackerTube build exemplifies the upper tier of this funnel. It is not merely a chatbot interaction but a complex agent workflow where models handled infrastructure deployment, code optimization, and data extraction. Karpathy’s experience aligns with broader industry observations, such as those from Box CEO Aaron Levie, who suggests that “agent swarms” capable of dividing complex work among parallel agents represent the next form factor for AI. However, Levie and Karpathy both note that most enterprises and individuals are not yet ready or equipped to utilize these advanced capabilities due to costs, security concerns, and the learning curve required to manage multi-agent workflows.

Photo by Matheus Bertelli on Pexels

For businesses and developers, the launch of HackerTube underscores a shift in how software can be constructed. The division of labor—where humans handle high-level architectural decisions and API provisioning, while AI handles the repetitive tasks of scraping, filtering, and deployment—suggests that the barrier to building sophisticated data products is rapidly lowering. While the two-hour estimate applies specifically to Karpathy’s expertise and the current capabilities of Claude models, it indicates a trend where AI agents are becoming viable partners in full-stack development.

The distinction between announced capabilities and real-world application remains critical. While frontier models like Claude Opus 5.5 are capable of executing such complex pipelines, the “capability gap” means that for the vast majority of users, AI remains a tool for simple queries rather than a powerful engineering assistant. As the technology diffuses, the challenge for regulators, businesses, and users will be to recognize that the AI they encounter in a chat window is a fraction of the power available in professional development environments.

Looking ahead, the primary unresolved question is whether this level of autonomous coding and data processing will become standard practice for individual developers. If the tools become more accessible, the “two-hour” development cycle could become a norm for building niche platforms, fundamentally altering the economics of software creation. For now, HackerTube stands as a proof-of-concept that human taste, when augmented by frontier AI, can still outperform generic algorithmic recommendation engines.

Emma Watson

Emma Watson reports on technology with interests spanning artificial intelligence, consumer technology, online security, digital platforms, and major industry developments. She follows new products and services alongside the policies and business decisions influencing them. Emma's approach emphasizes clear explanations, reliable sourcing, and practical context for readers trying to understand how technology is changing.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button