Scalable Architecture

Engineering stores, infrastructure insights and everything you need to know about building scalable architecture, straight from the Hacker News community.

Latest Discussions

Market Sentiment6d ago

Scaling Challenges Following User Surge

The discussion centers on the recent user growth experienced by a company post major events, leading to increased system errors. Insights highlight the impact of rapid scaling on infrastructure stability and the correlation with significant external factors such as a popular advertisement and recent market developments.

Join the thread - 2 comments

🔗 Elevated Errors in Claude.ai

General Discussion11d ago

Challenges of Scaling Startups

The conversation explores the gap between creating a minimum viable product and the complexities involved in scaling, securing, and supporting it in a large company environment. The participants reflect on how initial ease of development contrasts with the costly demands of operational growth, highlighting a tension between the perception of low barrier startups versus the reality of scaling challenges. This insight suggests that while starting a tech company may be accessible, sustainable success requires addressing significant infrastructure and business challenges.

Join the thread - 3 comments

🔗 Ask HN: Could you create a competitor to your company at 10% of the cost?

Technical Deep Dive13d ago

Load Balancing Architecture and Scalability

The discussion delves into advanced strategies for load balancing, particularly the separation of active healthchecking into dedicated services for client-side load balancing and shard forwarders for server-side load balancing to avoid single points of failure. One user expresses skepticism about added reliability risks from introducing more services and requests industry examples of such architectures. The original commenter highlights trade-offs between centralized proxy fleets and peer-to-peer models, emphasizing the complexity of deployment and maintenance at scale. Actionable insights include considering modular architecture for scalability, carefully evaluating operational overhead for additional services, and exploring shuffle sharding techniques for workload isolation.

Join the thread - 2 comments

🔗 Why Your Load Balancer Still Sends Traffic to Dead Backends

Technical Deep Dive13d ago

Postgres Scaling Strategies

The discussion focuses on database scalability challenges for high-traffic applications using Postgres. It emphasizes practical scaling steps such as adding connection poolers once connections exceed 100, deploying read replicas when CPU usage passes 30% or for workload isolation, vertical scaling limitations, and eventually considering sharding when instance sizes approach the largest available from the cloud provider. The insights provide a clear scaling roadmap for Postgres database administrators handling increasing traffic loads.

Join the thread - 2 comments

🔗 Show HN: PgDog – scale Postgres without changing the app

Industry Analysis13d ago

Challenges in Scaling AI Model Businesses

The discussion addresses the rapid growth of AI companies reaching multi-billion ARR levels, highlighting the financial balancing act between investing in infrastructure and avoiding bankruptcy. A key insight is the risk that companies face as scaling becomes prohibitively expensive, potentially eroding their competitive edge and pricing power once the frontier of model development matures or plateaus.

Join the thread - 2 comments

🔗 AI Added 'Basically Zero' to US Economic Growth Last Year, Goldman Sachs Says

Experience Report5d ago

Engineering trade-offs in large systems

The discussion emphasizes that what may be perceived as overengineering in large systems often reflects deliberate risk management. It highlights that senior engineers are typically recognized for simplicity only when they clearly explain the trade-offs and future costs they aim to mitigate. However, such thoughtful articulation and understanding appear to be uncommon.

Join the thread - 2 comments

🔗 Nobody Gets Promoted for Simplicity