google云计算课程Module 1 - Introduction to Distributed Systems Teaching.ppt

Google Cluster Computing Faculty Training Workshop Module I: Introduction to MapReduce Workshop Syllabus Seven lecture modules Information about teaching the course Technical info about Google tools Hadoop Example course lectures Four lab exercises Assigned to students in UW course Overview University of Washington Curriculum Teaching Methods Reflections Student Background Course Staff Requirements Introductory Lecture Material UW: Course Summary Course title: “Problem Solving on Large Scale Clusters” Primary purpose: developing large-scale problem solving skills Format: 6 weeks of lectures + labs, 4 week project UW: Course Goals Think creatively about large-scale problems in a parallel fashion; design parallel solutions Manage large data sets under memory, bandwidth limitations Develop a foundation in parallel algorithms for large-scale data Identify and understand engineering trade-offs in real systems Lectures 2 hours, once per week Half formal lecture, half discussion Mostly covered systems background Included group activities for reinforcement Classroom Activities Worksheets included pseudo-code programming, working through examples Performed in groups of 2—3 Small-group discussions about engineering and systems design Groups of ~10 Course staff facilitated, but mostly open-ended Readings No textbook One academic paper per week E.g., “Simplified Data Processing on Large Clusters” Short homework covered comprehension Formed basis for discussion Lecture Schedule Introduction to Distributed Computing MapReduce: Theory and Implementation Networks and Distributed Reliability Real-World Distributed Systems Distributed File Systems Other Distributed Systems Intro to Distributed Computing What is distributed computing? Flynn’s Taxonomy Brief history of distributed computing Some background on synchronization and memory sharing MapReduce Brief refresher on functional programming MapReduce slides More detailed version of module I Discussion on MapReduce Net