[互联网]豆瓣网技术架构的发展历程.pdf

2009.4 hongqn@ • 20053 • • • • 2.9M1/4 • • 23M/500~600/sec • 23PC(1U*15/2U*8) • 12 • 38G memcached • 1U (frodo) • AMD Athlon 64 1.8GHz • 1G160G SATA*2 • Gentoo Linux • MySQL 5 • Quixote (a Python web framework) • Lighttpd + SCGI (shire) • Memcached (!) Gentoo Linux • • emerge mysql • ebuild patch • • • GLSA(Gentoo Linux Security Advisories) MySQL • The world’s most popular open source database • / == MyISAM • == InnoDB • Replicate for backup Python • • Battery Included • • • CPUG: / Quixote • RESTURL • Django, TurboGears, Pylons ZOPE • /subject/1000001 # luz/subject/__init__.py def _q_lookup(request, name): subject = get_subject(name) return lambda req: subject_ui(req, subject) # luz/subject/subject_ui.ptl def subject_ui [html] (request, subject): site_header(request) “h1%s/h1” % subject.title site_footer(request) Lighttpd • • SCGI • SCGI: FastCGI Quixote • 80lighttpd SCGIlocalhost Quixote Memcache • MySQL • libmemcachepythonPyrex python3x+ def get_subject(subject_id): subject = mc.get(‘s:’+subject_id) if subject is None: store.farm.execute(“select xxx, xxx from subject where id=%s”, subject_id) subject = Subject(*store.farm.fetchone()) mc.set(‘s:’+subject_id, subject) return subject Internet Light