Internet-Scale Service strongInfrastructurestrong Efficiency.pdfVIP

Internet-Scale Service Infrastructure Efficiency International Symposium on System Architecture James Hamilton, 2009/6/23 VP Distinguished Engineer, Amazon Web Services e: James@ w: /jrh/work b: Agenda • High Scale Services – Infrastructure cost breakdown – Where does the power go? • Power Distribution Efficiency • Mechanical System Efficiency • Server Applications Efficiency – Hot I/O workloads NAND flash – Resource consumption shaping – Work done per joule per dollar 2009/6/23 2 Background Biases • 15 years in database engine development – Lead architect on IBM DB2 – Architect on SQL Server • Past 5 years in services – Led Exchange Hosted Services Team – Architect on the Windows Live Platform – Architect on Amazon Web Services • Talk does not necessarily represent positions of current or past employers 2009/6/23 3 Services Different from Enterprises • Enterprise Approach: – Largest cost is people -- scales roughly with servers (~100:1 common) – Enterprise interests center around consolidation utilization • Consolidate workload onto fewer, larger systems • Large SANs for storage large routers for networking • Internet-Scale Services Approach: – Largest costs is server storage H/W • Typically followed by cooling, power distribution, power • Networking varies from very low to dominant depending upon service • People costs under 10% often under 5% (1000+:1 server:admin) – Services interests center around work-done-per-$ (or joule) • Observations: • People costs shift from top to nearly irrelevant. • Expect high-scale service techniques to spread to enterprise