Stanford University
Computer Science 244b: Spring 2011

Distributed Systems

Announcements | Overview | Details | Materials | Assignments | Exams | Policies

Details

Lectures:
Tuesday and Thursday 11:00am-12:15pm. Gates B03
Instructor:
David Cheriton
Office hours: None - send an email or talk me after class to schedule an appointment)
Teaching assistants:
Tahir Azim (tazim at cs)
Office hours: Tuesday 3-5 pm, Wednesday 1-3pm in Gates B26 (except on May 4th)
Phone Number during office hours: (650)723-6319

Steve Rumble (rumble at cs)
Office hours: Monday/Wednesday 1:30-3:30pm in Gates B24B, Saturday 1-3pm in Gates 444. (No office hours Monday, May 9th or Saturday, June 4th)
   If you don't have weekend access to Gates or would like to call in, just email and Steve will arrange to meet outside or in B24B.
Phone Number during Monday office hours: (650)736-1816
Prerequisites:
Knowledge of C, and C++, and basic programming methodology as developed in cs106b or cs106x, and networking and sockets knowledge at the level of CS144 or CS244A and ideally, CS249.
Units:
3
Schedule:
  • All due dates are at 11:59 pm unless otherwise noted.
  • Friday 4/1: Review session for project 1, 3:15 pm in Skilling Auditorium
  • Tuesday 4/5: Teams due or we will assign them.
  • Thursday 4/14: Protocol specification due.
  • Thursday 4/28: Project 1 due.
  • Friday 4/29: Midterm review session, 3:15 pm in Skilling Auditorium
  • Friday-Saturday 4/29 and 4/30: Project 1 demos
  • Tuesday 5/3: Midterm at 7:30pm - see details below.
  • Friday 5/6: Project 2 review session, 3:15 pm in Skilling Auditorium
  • Friday 5/27: Project 2 due. Final review session, 3:15pm in Skilling Auditorium
  • Tuesday 6/7: Final Exam, 3:30-6:30 pm Gates B03.
  • Overview

    Newsgroup:
    Instead of a newsgroup, we'll be using Piazzza. Just follow the link, create an account, and add CS244B. We encourage you to ask questions through Piazza, but if you need to contact the staff directly, our addresses are above.

    Announcements

    3/26 -- The first discussion session will be during the first week on 4/1. We will talk about the first project, Mazewar.
    4/30 -- Project 2 has been released. See above for the due date. A review session will be held Friday, May 6th to get you jumpstarted.
    5/17 -- Slides for the review sessions on "Naming and Directories" from the week of May 2-6 are available here.

    Overview

    Many systems and applications beyond a relatively modest scale end up being distributed for a variety of reasons, including fault-tolerance, performance, security and the geographical nature of the requirements. Although the common case of a distributed system is separate computers interconnected by the Internet or some networking technology, many of the challenges and solutions come into play as soon as the application consists of two or more processes that do not share a common address space.

    This course explores the issues to address in designing and implementing distributed systems with a particular emphasis on how to deal with the shared state between separate processes within such a system. Topics include: distributed shared memory, object-oriented structuring of distributed systems, real/logical/virtual time, directories and naming, distributed file systems, authentication and security, distributed process scheduling, presentation protocols and communication support for distributed systems. The material complements network-layer courses by building on the transport layer to provide higher-level applications and services.

    Materials

    Lectures

    Most lectures are based on notes by the instructor, typically one chapter per 2 lectures. The chapter for the next week will be posted on-line in postscript and pdf by Sunday night of the week of the lectures, if not before, noted as updated to this year. The last year's version is available now.

    There may be a guest lecture or two that depart from this pattern and will be noted as they arise.

  • Overview 2011 [ps, pdf]
  • Distributed Shared Memory 2011 [ps, pdf]
  • Structuring of Distributed Systems 2011 [ps, pdf]
  • Clocks: Real, Virtual and Logical 2011 [ps, pdf]
    CATOCS slides[ppt]
  • Directories and Naming 2011 [ps, pdf]
  • Accounts and Authentication 2011 [ps, pdf]
  • Transactions, Agreement and Reconiliation 2011 [ps, pdf]
  • Future Directions and Issues 2011 [ps, pdf]
  • Current Events

    Below are a list of current events/readings related to the course. We expect you to have read the articles and understand the basic problems raised, but not specific details.

  • Academic Paper in China Sets Off Alarms in U.S. Posted 4/1/2010
  • FAA exec offers blunt, scary assessment of its network security Posted 5/1/09
  • GhostNet is watching Posted 5/1/09
  • Research Papers

    As augmentation to this material, there may be one or two research papers that are listed as readings at the end of each chapter and/or listed together with the chapter material that you are also responsible for.

    The chapters also list research papers as references, meaning they are optional reading and not required in any way to so well in the course. Students should be able to access these papers online using Stanford's site license for the ACM digital library from any computer with a Stanford IP address. If you have difficulties accessing the papers online, please contact the TA.

  • B. Stone-Gross et al., Your Botnet is My Botnet: Analysis of a Botnet Takeover UCSB Technical Report Note: not covered on final
  • P. Helland, Life beyond Distributed Transactions: an Apostate’s Opinion
    G. DeCandia et al. Dynamo: Amazons Highly Available Key-value Store SOSP 2007
  • Smart Cheaters Do Prosper: Defeating Trust and Reputation Systems AAMAS 2009
    Public Key Certificates Considered Harmful
    This morning's MD5 attack - resolved Article related to Public Key Certificates Considered Harmful from student, Max Martynov, and his comments
  • D.Cheriton and D. Skeen, Understanding the Limitations of Causally and Totally-Ordered Communication, SOSP'93, Dec. 1993.
    D. Mills, Internet Time Synchronization: the Network Time Protocol, IEEE Transactions on Communication.
    D. Jefferson et al, Distributed Simulation and the Time Warp Operating System, SOSP'87.
  • S. Baset and H. Schulzrinne An Analysis of the Skype Peer-to-Peer Internet Telephony Protocol
    B. Lampson, Designing a Global Name Service, 5th PODC, August, 1986.
    Demers et al., Epidemic Algorithms for Replicated Database Maintenance, PODC'87.
  • Textbooks?

    There is no text that really corresponds to the material and focus of this course. However, if you really want a textbook treatment, you can refer to: Distributed Systems: Concepts and Design by George Coulouris, Jean Dollimore, and Tim Kindberg, Addison Wesley, August 2000 (3rd edition).

    Project/Problem Sessions

    Discussion sessions will typically be in Skilling Auditorium on Fridays from 3:15 - 4:05 pm.

    Mazewar Discussion Session - Date: 4/1 Location: Skilling Auditorium Time: 3:15-4:05.

    Midterm Discussion Session - Date: 4/29 Location: Skilling Auditorium Time: 3:15-4:05.
      2011 Midterm Review Slides, (For additional reference: 2009 Midterm Review Slides)

    Replicated Filesystem Discussion Session - Date: 5/6 Location: Skilling Auditorium Time: 3:15-4:05.
      2011 Slides, (For additional reference: 2010 Version)

    Final Review Discussion Session - Date: 5/27 Location: Skilling Auditorium Time: 3:15-4:05.
      2011 Slides, (For additional reference: Previous Year's)

    Assignments

    There is expected to be 2-3 programming assignments with the 3rd possibly morphing into a homework assignment because of time constraints. The first programming assignment is planned to be posted by the first lecture. Details to follow.

    Assignment Details

    Assignment 1: Mazewar

    Mazewar Review Session Slides are here.

    Assignment 2: Replicated Filesystem

    Working on assignments

    You may work on the assignments on any Unix machine with a modern C/C++ compiler and debugger. But since we will evaluate your assignment on one of the Linux machines in the myth cluster in the Gates building, we strongly recommend that you develop and test your code on one of these machines.

    You may find the Unix command ssh -X myth.stanford.edu to be useful at your Linux or OS X prompt.

    Exams

    Exams are closed book, closed notes. The final is normally 45 percent of the grade, midterm 15 percent and assignments the remaining 40 percent.

    The midterm is scheduled for May 3, 7:30-8:45pm, Hewlett 201.

    The final is scheduled for Tuesday, June 7, 3:30-6:30 pm, in Gates B03

    Off-campus students are encouraged to come onto campus for the exams if at all feasible. If necessary, remote SITN/SCPD students may take the exams at their company sites; Stanford SCPD is responsible for distributing exams to proctors as well as returning the completed exams.

    These sample exams should aid you in your studying: Prior Exams

    Policies

    Late assignment policy

    You are allowed 3 late day credits for the quarter which you may use as needed to accommodate your schedule. Otherwise, late assignments may be penalized 10% for each 24-hour period or fraction thereof (including weekends) that they are late. Beyond 3 days, they are graded/credited only at the sole discretion of the TA. Please try to make prior arrangements with the TA or instructor if you anticipate any problem with this policy.

    Since lectures are made available via Stanford Online on the same day they are taped, SITN/SCPD students are expected to follow the same schedule as the rest of the class. This means that the above late assignment policy applies to SITN/SCPD students as well; exceptions are not granted due to students' work obligations.

    Honor code

    It should go without saying, but because computer science project courses have a long and ugly history of honor code violations, we will say it anyway:

    The Stanford honor code applies to all work done in this course. All work you submit must be your own. Suspected violations of the honor code will be investigated and referred to the Office of Judicial Affairs.

    Honor code violations are a serious matter, and being found guilty of one can ruin your academic career. Review the honor code. If you ever find yourself uncertain about how it applies to your situation, ask. Asking what you might think is a silly question is better than risking your career.

    Incomplete policy

    No incompletes are given in this course, so make sure you determine before the drop deadline whether you can complete it satisfactorily.