CS 598: Schedule and Readings

Fall 2018

Week 1

Week 2

Week 3

Week 4

Week 5

Week 6

Week 7

Week 8

Week 9

Week 10

Week 11

Week 12

Week 13

Week 14

Week 15

8/28
8/30

9/4
9/6

9/11
9/13

9/18
9/20

9/25
9/27

10/2
10/4

10/9
10/11

10/16
10/18

10/23
10/25

10/30
11/1

11/6
11/8

11/13
11/15

11/27
11/29

12/4
12/6

12/11

This page conforms to the FERPA policy of disclosure of education records. All the students listed as (co-)presenters provide the written consents.

Course Introduction

Tue
8/28

Course Overview

Availability

Thu
8/30

H. S. Gunawi, M. Hao, R. O. Suminto, A. Laksono, A. D. Satria, J. Adityatama, and K. J. Eliazar, Why Does the Cloud Stop Computing? Lessons from Hundreds of Service Outages, In Proceedings of the 6th ACM Symposium on Cloud Computing (SOCC '16), October 2016.
B. Treynor, M. Dahlin, V. Rau, and B. Beyer, The Calculus of Service Availability, Communications of the ACM (CACM), Vol. 60 No. 9, Pages 42-47, September 2017.
(Optional) related failure studies:
- D. Oppenheimer, A. Ganapathi, and D. A. Patterson, Why do Internet services fail, and what can be done about it?, In Proceedings of the 4th Usenix Symposium on Internet Technologies and Systems (USITS '03), March 2003.
- J. Gray, Why Do Computers Stop and What Can Be Done About It?, Technical Report 85.7, Tandem Computers, June 1985.

Cloud and Datacenter Systems

Tue
9/4

L. A. Barroso, J. Clidaras, and U. Hölzle, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines (2nd Edition), Morgan & Claypool, July 2013.
Read: Chapter 1 (Introduction) and Chapter 7 (Dealing with Failures and Repairs).
B. Maurer, Fail at Scale, Communications of the ACM (CACM), Vol. 58 No. 11, Pages 44-49, November 2015.
Watch the video: J. Dean, Building Software Systems At Google and Lessons Learned, Distinguished Lecture Series (DLS), Stanford, 2010.
(Optional) related papers mentioned in Dean's talk:
- S. Ghemawat, H. Gobioff, and S-. T. Leung, The Google file system, In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP '03), October 2003.
- J. Dean and S. Ghemawat, MapReduce: simplified data processing on large clusters, In Proceedings of the 6th USENIX Symposium on Operating Systems Design and Implementation (OSDI '04), December 2004.
- J. C. Corbett et al., Spanner: Google’s Globally-Distributed Database, In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI '12), October 2012.

Hardware Faults

Thu
9/6

Yifan will share his work at NVIDIA on building reliable GPU drivers.
T. Do, M. Hao, T. Leesatapornwongsa, T. Patana-anake, and H. S. Gunawi, Limplock: Understanding the Impact of Limpware on Scale-Out Cloud Systems, In Proceedings of the 5th ACM Symposium on Cloud Computing (SoCC '13), October, 2013.
A. Kadav, M. J. Renzelmann, and M. M. Swift, Tolerating Hardware Device Failures in Software, In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP '09), October 2009.
(Optional) related papers on limpware and device drivers:
- T. Do and H. S. Gunawi, Impact of Limpware on HDFS: A Probabilistic Estimation, Tech report TR-2013-08, Department of Computer Science, University of Chicago, 2013.
- H. S. Gunawi, et al., Fail-Slow at Scale: Evidence of Hardware Performance Faults in Large Production Systems, In Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST '18), February 2018.
(Optional) the SEDA architecture paper:
- M. Welsh, D. Culler, and E. Brewer, SEDA: An Architecture for Well-Contained Scalable Internet Services, In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), October 2001.
(Optional) related papers on device drivers:
- A. Kadav and M. M. Swift, Understanding Modern Device Drivers, In Proceedings of the 17th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '12), March, 2012.
- M. J. Renzelmann, A. Kadav, and M. M. Swift, SymDrive: Testing Drivers without Devices, In Proceedings of the 12th Symposium on Operating System Design and Implementation (OSDI '12), October 2012.
- M. Swift, M. Annamalai, B. N. Bershad, and H. M. Levy, Recovering Device Drivers, In Proceedings of the 6th ACM/USENIX Symposium on Operating Systems Design and Implementation (OSDI '04), December 2004.

Software Defects

Tue
9/11

D. Yuan, Y. Luo, X. Zhuang, G. R. Rodrigues, X. Zhao, Y. Zhang, P. U. Jain, and M. Stumm, Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-Intensive Systems, In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI '14), October 2014.
H. S. Gunawi, M. Hao, T. Leesatapornwongsa, T. Patana-anake, T. Do, J. Adityatama, K. J. Eliazar, A. Laksono, J. F. Lukman, V. Martin, and A. D. Satria, What Bugs Live in the Cloud? A Study of 3000+ Issues in Cloud Systems, In Proceedings of the 5th ACM Symposium on Cloud Computing (SOCC '14), November 2014.
(Optional) related bug studies:
- L. Lu, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and S. Lu, A Study of Linux File System Evolution, In Proceedings of the 11th USENIX Conference on File and Storage Technologies (FAST '13), February 2013. (bugs in file systems)
- G. Jin, L. Song, X. Shi, J. Scherpelz, and S. Lu, Understanding and Detecting Real-World Performance Bugs, In Proceedings of the 33rd ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI '12), June 2012. (performance bugs)
- S. Lu, S. Park, E. Seo, and Y. Zhou, Learning from Mistakes — A Comprehensive Study on Real World Concurrency Bug Characteristics, In Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '08), March 2008. (concurrency bugs)
- A. Chou, J. Yang, B. Chelf, S. Hallem, and D. Engler, An Empirical Study of Operating Systems Errors, In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), October 2001. (bugs in OS kernels)

Thu
9/13

Saurabh will co-present the distributed storage systems paper and share his experiences on reliability of distributed file and storage systems.
A. Ganesan, R. Alagappan, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau, Redundancy Does Not Imply Fault Tolerance: Analysis of Distributed Storage Reactions to Single Errors and Corruptions, In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST '17), February 2017.
T. Leesatapornwongsa, C. A. Stuardo, R. O. Suminto, H. Ke, J. F. Lukman, and H. S. Gunawi, Scalability Bugs: When 100-Node Testing is Not Enough, In Proceedings of the 16th Workshop on Hot Topics in Operating Systems (HotOS '17), May 2017.
(Optional) related paper on bugs in distributed systems:
- T. Leesatapornwongsa, J. F. Lukman, S. Lu, and H. S. Gunawi, TaxDC: A Taxonomy of Non-Deterministic Concurrency Bugs in Datacenter Distributed Systems, In Proceedings of the 21th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '16), April 2016.
- H. S. Gunawi, C. R-. González, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and B. Liblit, EIO: Error Handling is Occasionally Correct, In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST '08), February 2008.

Project Workshop

Tue
9/18

We will discuss all the project proposals (anonymized):
- what is the technical problem?
- what is the contributions in terms of research or engineering?
- what is their execution plan?
Please give me an email if you want to make your project confidential and exclude from the workshop.

Configuration Errors

Thu
9/20

T. Xu, X. Jin, P. Huang, Y. Zhou, S. Lu, L. Jin, and S. Pasupathy, Early Detection of Configuration Errors to Reduce Failure Damage, In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI '16), November 2016.
C. Tang, T. Kooburat, P. Venkatachalam, A. Chander, Z. Wen, A. Narayanan, P. Dowell, and R. Karl, Holistic Configuration Management at Facebook, In Proceedings of the 25th Symposium on Operating Systems Principles (SOSP '15), October 2015.
(Optional) related papers:
- T. Xu, J. Zhang, P. Huang, J. Zheng, T. Sheng, D. Yuan, Y. Zhou, and S. Pasupathy, Do Not Blame Users for Misconfigurations, In Proceedings of the 24th ACM Symposium on Operating Systems Principles (SOSP '13), November, 2013.
- Y-. Y. Su, M. Attariyan and J. Flinn, AutoBash: Improving configuration management with operating system causality analysis, In Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP '07), October 2007.
- H. J. Wang, J. C. Platt, Y. Chen, R. Zhang, and Y-. M. Wang, Automatic Misconfiguration Troubleshooting with PeerPressure, In Proceedings of the 6th USENIX Conference on Operating Systems Design and Implementation (OSDI '04), December 2004.
- O. Alipourfard, J. Chen, H. Liu, S. Venkataraman, M. Yu, and M. Zhang, CherryPick: Adaptively Unearthing the Best Cloud Configurations, In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI '17), March 2017.

Operation Mistakes

Tue
9/25

A. B. Brown and D. A. Patterson, Undo for Operators: Building an Undoable E-mail Store, In Proceedings of the 2003 USENIX Annual Technical Conference (USENIX ATC '03), June 2003.
K. Nagaraja, F. Oliveira, R. Bianchini, R. P. Martin, and T. D. Nguyen, Understanding and Dealing with Operator Mistakes in Internet Services, In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), December 2004.
Read the postmortem: Summary of the Amazon S3 Service Disruption in the Northern Virginia (US-EAST-1) Region, February 2017. (discussions on Hacker News)
(Optional) related papers:
- D. A. Patterson et al., Recovery Oriented Computing (ROC): Motivation, Definition, Techniques, and Case Studies, Tech Report UCB//CSD-02-1175, University of California Berkeley, March 2002. (the ROC project website)

Resource Issues

Thu
9/27

Rui will lead the discussion of iTask.
L. Fang, K. Nguyen, G. Xu, B. Demsky, and S. Lu, Interruptible Tasks: Treating Memory Pressure As Interrupts for Highly Scalable Data-Parallel Programs, In Proceedings of the 25th ACM Symposium on Operating Systems Principles (SOSP '15), October 2015.
M. Ulrich, Addressing Cascading Failures, Site Reliability Engineering: How Google Runs Production Systems, O'Reilly, April 2016.
(Optional) addressing cascading failures is closely related to handling overload:
- A. F. Cuervo, Handling Overload, Site Reliability Engineering: How Google Runs Production Systems, O'Reilly, April 2016.
(Optional) papers related to GC:
- K. Nguyen, L. Fang, G. Xu, B. Demsky, S. Lu, S. Alamian, and O. Mutlu, Yak: A High-Performance Big-Data-Friendly Garbage Collector, In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI '16), November 2016.
- I. Gog, J. Giceva, M. Schwarzkopf, K. Vaswani, D. Vytiniotis, G. Ramalingan, M. Costa, D. Murray, S. Hand, and M. Isard, Broom: Sweeping out Garbage Collection from Big Data systems, In Proceedings of the 15th Workshop on Hot Topics in Operating Systems (HotOS XV), May 2015.

Bad Performance

Tue
10/2

Le will lead the discussion of PCatch.
J. Li, Y. Chen, H. Liu, S. Lu, Y. Zhang, H. S. Gunawi, X. Gu, X. Lu, and D. Lu, PCatch: Automatically Detecting Performance Cascading Bugs in Cloud Systems, In Proceedings of the 2018 European Conference on Computer Systems (EuroSys '18), April 2018.
M. Attariyan, M. Chow, and J. Flinn, X-ray: Automating Root-Cause Diagnosis of Performance Anomalies in Production Software, In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI '12), November 2012.
(Optional) X-ray and PCatch are built on top of the following papers:
- H. Liu, G. Li, J. F. Lukman, J. Li, S. Lu, H. S. Gunawi, and C. Tian, DCatch: Automatically Detecting Distributed Concurrency Bugs in Cloud Systems, In Proceedings of the 22nd ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '17), April 2017.
- M. Attariyan and J. Flinn, Automating configuration troubleshooting with dynamic information flow analysis, In Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation (OSDI '10), October 2010.

Network Reliability

Thu
10/4

Santhosh will lead the discussion of this class.
R. Govindan, I. Minei, M. Kallahalla, B. Koley, and A. Vahdat, Evolve or Die: High-Availability Design Principles Drawn from Googles Network Infrastructure, In Proceedings of the 2016 ACM SIGCOMM Conference (SIGCOMM '16), August, 2016.
Y-. W. E. Sung, X. Tie, S. H. Y. Wong, and H. Zeng, Robotron: Top-down Network Management at Facebook Scale, In Proceedings of the 2016 ACM SIGCOMM Conference (SIGCOMM '16), August, 2016.
(Optional) Google's network infra mentioned in the "Evolve or Die" paper:
- A. Singh et al., Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google's Datacenter Network, In Proceedings of the 2015 ACM SIGCOMM Conference (SIGCOMM '15), August 2015.
- S. Jain et al., B4: Experience with a Globally-Deployed Software Defined WAN, In Proceedings of the 2013 ACM SIGCOMM Conference (SIGCOMM '13), August 2013.
(Optional) related studies on network failures:
- J. Meza, T. Xu, K. Veeraraghavan, and Y. J. Song, A Large-Scale Study of Data Center Network Reliability, In Proceedings of the 2018 Internet Measurement Conference (IMC '17), Oct. 31 - Nov. 2, 2017.
- R. Potharaju and N. Jain, When the Network Crumbles: An Empirical Study of Cloud Network Failures and their Impact on Services, In Proceedings of the 4th Annual Symposium on Cloud Computing (SOCC '13), October 2013.
- P. Gill, N. Jain, and N. Nagappan, Understanding Network Failures in Data Centers: Measurement, Analysis, and Implications, In Proceedings of the 2011 ACM SIGCOMM Conference (SIGCOMM '11), August 2011.

Hack Day

Tue
10/9

Work on the projects

Network Partitions

Thu
10/11

A. Alquraan, H. Takruri, M. Alfatafta, and S. Al-Kiswany, An Analysis of Network-Partitioning Failures in Cloud Systems, In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI '18), October 2018.
P. Bailis and K. Kingsbury, The Network Is Reliable, Communications of the ACM (CACM), Vol. 57 No. 9, Pages 48-55, September 2014.
(Optional) related papers:
- E. Brewer, CAP Twelve Years Later: How the "Rules" Have Changed, IEEE Computer, 45(2):23-29, February 2012.
- E. Brewer, Spanner, TrueTime & The CAP Theorem, Technical report, Google Inc., 2017.

Project Symposium (Checkpoint 1)

Tue 10/16	Session 1: Each team will do a 6 minute presentation (+ 4 minute QA).
Thu 10/18	Session 2: Each team will do a 6 minute presentation (+ 4 minute QA).

Failure Detection

Tue
10/23

Faria will lead the discussion of FALCON.
Frank will lead the discussion of Panorama.
P. Huang, C. Guo, J. R. Lorch, and L. Zhou, Capturing and Enhancing In Situ System Observability for Failure Detection, In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI '18), October 2018.
J. B. Leners, H. Wu, W. -L. Hung, M. K. Aguilera, and M. Walfish, Detecting failures in distributed systems with the FALCON spy network, In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP '11), October 2011.
(Optional) related papers:
- P. Huang, C. Guo, L. Zhou, J. R. Lorch, Y. Dang, M. Chintalapati, and R. Yao, Gray Failure: The Achilles' Heel of Cloud-Scale Systems, In Proceedings of the 16th Workshop on Hot Topics in Operating Systems (HotOS '17), May 2017.
- J. B. Leners, T. Gupta, M. K. Aguilera, and M. Walfish, Improving Availability in Distributed Systems with Failure Informers, In Proceedings of the 10th USENIX Symposium Networked Systems Design and Implementation (NSDI '13), April 2013.

Failure Recovery

Thu
10/25

Beomyeol will lead the discussion of Albatross.
F. Qin, J. Tucek, J. Sundaresan, and Y. Zhou Rx: Treating Bugs As Allergies -- A Safe Method to Survive Software Failures, In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP '05), October 2005.
J. B. Leners, T. Gupta, M. K. Aguilera, and M. Walfish, Taming uncertainty in distributed systems with help from the network, In Proceedings of the 10th ACM European Conference on Computer Systems (EuroSys '15), April 2015.
(Optional) related papers:
- H. S. Gunawi, T. Do, P. Joshi, P. Alvaro, J. M. Hellerstein, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, K. Sen, and D. Borthakur, FATE and DESTINI: A Framework for Cloud Recovery Testing, In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI '11), March 2011.
- M. Rinard, C. Cadar, D. Dumitran, D. M. Roy, T. Leu, and W. S. Beebee Jr, Enhancing Server Availability and Security Through Failure-Oblivious Computing, In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), December 2004.
- C. Candea, S. Kawamoto, Y. Fujiki, G. Friedman, and A. Fox, Microreboot – A Technique for Cheap Recovery, In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), December 2004.

Deployment

Tue
10/30

E. Zhai, R. Chen, D. I. Wolinsky, and B. Ford, Heading Off Correlated Failures through Independence-as-a-Service, In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI '14), October 2014.
T. Savor, M. Douglas, M. Gentili, L. Williams, K. Beck, and M. Stumm, Continuous Deployment at Facebook and OANDA, In Proceedings of the IEEE/ACM 38th International Conference on Software Engineering (ICSE '16), May 2016.
(Optional) related papers:
- C. Rossi, E. Shibley, S. Su, K. Beck, T. Savor, and M. Stumm, Continuous Deployment of Mobile Software at Facebook, In Proceedings of the ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE '16), November 2016.
- J. Hamilton, On Designing and Deploying Internet-Scale Services, In Proceedings of the 21st USENIX Large Installation System Administration Conference (LISA '07), November 2007.
- Š. Davidovič and B. Beyer, Canary Analysis Service, Communications of the ACM (CACM), May 2018.
- E. Zhai, R. Piskac, R. Gu, X. Lao, and X. Wang, An Auditing Language for Preventing Correlated Failures in the Cloud, In Proceedings of the 32th ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA '17), October 2017.

Software Testing

Thu
11/1

Owolabi Legunsen will give a guest lecture on software testing.
O. Legunsen, W. U. Hassan, X. Xu, G. Rosu, and D. Marinov, How Good Are the Specs? A Study of the Bug-Finding Effectiveness of Existing Java API Specifications, In Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering (ASE '16), September 2016.
Qingrong will present DeepXplore and share his experiences working on ML reliability.
K. Pei, Y. Cao, J. Yang, and S. Jana, DeepXplore: Automated Whitebox Testing of Deep Learning Systems, In Proceedings of the 26th ACM Symposium on Operating Systems Principles (SOSP '17), October 2017.
To grab an overview of industry practices of testing distributed systems, watch the video: C. McCaffrey, The Verification of a Distributed System, goto; conference, May 2016,
or read the article: C. McCaffrey, The Verification of a Distributed System, Communications of the ACM (CACM), Vol. 59 No. 2, pp. 52-55, February 2016.
(Optional) related papers:
- Y. Tian, K. Pei, S. Jana, and B. Ray, DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars, In Proceedings of the 40th International Conference on Software Engineering (ICSE '18), May 2018.

Failure Testing and Chaos Engineering

Tue
11/6

Kartik will co-lead the discussion.
P. Alvaro, K. Andrus, C. S. Casey, R. A. Basiri, and L. Hochstein, Automating Failure Testing Research at Internet Scale, In Proceedings of the 6th ACM Symposium on Cloud Computing (SOCC '16), October 2016.
A. Basiri, M. Behnam, R. d. Rooij, L. Hochstein, L. Kosewski, J. Reynolds, and C. Rosenthal, Chaos Engineering, IEEE Software, Vol. 33, Issue 3, Page 35-41, May 2016.
(Optional) the original Molly paper:
- P. Alvaro, J. Rosen, and J. M. Hellerstein., Lineage-driven Fault Injection, In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD '15), May 2015.
(Optional) related papers on chaos engineering:
- P. Alvaro and S. Tymon, Abstracting the Geniuses Away from Failure Testing, Communications of the ACM (CACM), January 2018.
- A. Tseitlin, The Antifragile Organization, Communications of the ACM (CACM), August 2013.
- V. Heorhiadi, S. Rajagopalan, H. Jamjoom, M. K. Reiter, and V. Sekar, Gremlin: Systematic Resilience Testing of Microservices, In Proceedings of the 36th IEEE International Conference on Distributed Computing Systems (ICDCS '16), June 2016.
- H. S. Gunawi, T. Do, J. M. Hellerstein, I. Stoica, D. Borthakur, and J. Robbins, Failure as a Service (FaaS): A Cloud Service for Large-Scale, Online Failure Drills, Tech Report No. UCB/EECS-2011-87, University of California at Berkeley, July 2011.

Load Tests and Drain Tests

Thu
11/8

K. Veeraraghavan, J. Meza, D. Chou, W. Kim, S. Margulis, S. Michelson, R. Nishtala, D. Obenshain, D. Perelman, and Y. J. Song, Kraken: Leveraging Live Traffic Tests to Identify and Resolve Resource Utilization Bottlenecks in Large Scale Web Services, In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI '16), November 2016.
K. Veeraraghavan, J. Meza, S. Michelson, S. Panneerselvam, A. Gyori, D. Chou, S. Margulis, D. Obenshain, S. Padmanabha, A. Shah, Y. J. Song, and T. Xu, Maelstrom: Mitigating Datacenter-level Disasters by Draining Interdependent Traffic Safely and Efficiently, In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI '18), October 2018.
(optional) DiRT and GameDay:
- K. Krishnan, Weathering the Unexpected, Communications of the ACM (CACM), Vol. 55, No. 11, Pages 48-52, November 2012.
- J. Robbins, K. Krishnan, J. Allspaw, and T. A. Limoncelli, Resilience Engineering: Learning to Embrace Failure, ACM Queue, Vol. 10, Issue 9, Pages 1–9, September 2012.

Project Symposium (Checkpoint 2)

Tue 11/13	Session 1: Each team will do a 7 minute presentation (+ 3 minute QA).
Thu 11/15	Session 2: Each team will do a 7 minute presentation (+ 3 minute QA).

Tracing

Tue
11/27

Ali will lead the discussion of Pivot Tracing.
J. Mace, R. Roelke, and R. Fonseca, Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems, In Proceedings of the 25th ACM Symposium on Operating Systems Principles (SOSP '15), October 2015.
J. Kaldor, J. Mace, M. Bejda, E. Gao, W. Kuropatwa, J. O'Neill, K. W. Ong, B. Schaller, P. Shan, B. Viscomi, V. Venkataraman, K. Veeraraghavan, and Y. J. Song, Canopy: An End-to-End Performance Tracing And Analysis System, In Proceedings of the 26th ACM Symposium on Operating Systems Principles (SOSP '17), October 2017.
(optional) other tracing systems and frameworks
- B. H. Sigelman, L. A. Barroso, M. Burrows, P. Stephenson, M. Plakal, D. Beaver, S. Jaspan, and C. Shanbhag, Dapper, a Large-Scale Distributed Systems Tracing Infrastructure, Google Technical Report dapper-2010-1, April 2010.
- R. Fonseca, G. Porter, R. H. Katz, S. Shenker, and I. Stoica, X-Trace: A Pervasive Network Tracing Framework, In Proceedings of the 4th USENIX Symposium on Networked Systems Design and Implementation (NSDI '07), Apirl 2007.
- Ú. Erlingsson, M. Peinado, S. Peter, and M. Budiu, Fay: Extensible Distributed Tracing from Kernels to Clusters, In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP '11), October 2011.

Diagnosis

Thu
11/29

Y. Zhang, S. Makarov, X. Ren, D. Lion, and D. Yuan, Pensieve: Non-Intrusive Failure Reproduction for Distributed Systems using the Event Chaining Approach, In Proceedings of the 26th Symposium on Operating Systems Principles (SOSP '17), October 2017.
C. Scott, A. Panda, V. Brajkovic, G. Necula, A. Krishnamurthy, and S. Shenker, Minimizing Faulty Executions of Distributed Systems, In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI '16), March 2016.
(optional) related work on failure diagnosis
- D. Yuan, S. Park, P. Huang, Y. Liu, M. M. Lee, X. Tang, Y. Zhou, and S. Savage, Be Conservative: Enhancing Failure Diagnosis with Proactive Logging, In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI '12), November 2012.
- D. Yuan, H. Mai, W. Xiong, L. Tan, Y. Zhou, and S. Pasupathy, SherLog: Error Diagnosis by Connecting Clues from Run-time Logs, In Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS XVI), March 2011.

Systems Research at UIUC

Tue
12/4

We will have a panel on systems research at UIUC.

Final Exam

Thu 12/6	~~Session 1: Each team will do a 10 minute presentation (no QA).~~
Tue 12/11	~~Session 2: Each team will do a 10 minute presentation (no QA).~~
Tue 12/11	(2--6pm) Oral exam: each team shows end products: findings or system demos (5min) and answer questions (10min). Please refer to this post.

(Queuing) Formal Verification

TBD

C. Newcombe, T. Rath, F. Zhang, B. Munteanu, M. Brooker, and M. Deardeuff, How Amazon Web Services Uses Formal Methods, Communications of the ACM (CACM), Vol. 58 No. 4, Pages 66-73, April 2015.
C. Hawblitzel, J. Howell, M. Kapritsos, J. R. Lorch, B. Parno, M. L. Roberts, S. Setty, and B. Zill, IronFleet: Proving Practical Distributed Systems Correct, In Proceedings of the 25th ACM Symposium on Operating Systems Principles (SOSP '15), October 2015.
(Optional) related papers on verified systems:
- P. Fonseca, K. Zhang, X. Wang, and A. Krishnamurthy, An Empirical Study on the Correctness of Formally Verified Distributed Systems, In Proceedings of the 2017 European Conference on Computer Systems (EuroSys '17), April 2017.

(Queuing) Finding Bugs

TBD

H. Liu, X. Wang, G. Li, S. Lu, F. Ye, and C. Tian, FCatch: Automatically Detecting Time-of-fault Bugs in Cloud Systems, In Proceedings of the 23rd ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '18), March 2018.
T. Leesatapornwongsa, M. Hao, P. Joshi, J. F. Lukman, and H. S. Gunawi, SAMC: Semantic-Aware Model Checking for Fast Discovery of Deep Bugs in Cloud Systems, In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI '14), October 2014.
C. Sadowski, E. Aftandilian, A. Eagle, L. Miller-Cushon, and C. Jaspan, Lessons from Building Static Analysis Tools at Google, Communications of the ACM (CACM), Vol. 61 No. 4, Pages 58-66, April 2018.
(Optional) related papers on bug detection:
- C. Cadar, D. Dunbar, D. Engler, KLEE: Unassisted and Automatic Generation of High-Coverage Tests for Complex Systems Programs, In Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI '08), December 2008.
- Z. Li, S. Lu, S. Myagmar and Y. Zhou, CP-Miner: A Tool for Finding Copy-paste and Related Bugs in Operating System Code, In Proceedings of the 6th USENIX Symposium on Operating Systems Design and Implementation (OSDI '04), December 2004.
- D. Engler, D. Y. Chen, S. Hallem, A. Chou, and B. Chelf, Bugs as Deviant Behavior: A General Approach to Inferring Errors in Systems Code, In Proceedings of the the 18th ACM Symposium on Operating Systems Principles (SOSP '01), October 2001.
- S. Savage, M. Burrows, G. Nelson, P. Sobalvarro, and T. Anderson, Eraser: A Dynamic Data Race Detector for Multi-Threaded Programs, In Proceedings of the the 16th ACM Symposium on Operating Systems Principles (SOSP '97), October 1997.