Chap. 6 Part 1. CIS*3090 Fall Fall 2016 CIS*3090 Parallel Programming 1
|
|
- Constance McKenzie
- 6 years ago
- Views:
Transcription
1 Chap. 6 Part 1 CIS*3090 Fall 2016 Fall 2016 CIS*3090 Parallel Programming 1
2 Chap 6: specific programming techniques Languages and libraries Authors blur the distinction Languages: access parallel programming features explicitly or implicitly (under hood) by simply coding in the language Java, Java threads, Go, Scala, Julia Vs. C/C++ no HLL support for threads (till C++11) CUDA, OpenCL for GPU co-processor Most languages are inherently serial Parallel prog. hasn t been important before recently! Introduces many complications Fall 2016 CIS*3090 Parallel Programming 2
3 Libraries Making inherently-serial languages support parallel programming via calls to a library API pthreads.h, good example for C/C++ pilot.h, ditto for C & Fortran Other Pilot ports: C++, Python mpi.h, basis of Pilot Lots of parallel languages, libraries exist Few have caught on Fall 2016 CIS*3090 Parallel Programming 3
4 Starting with pthreads Rationale Already exposed in OS course Thread definition similar to Pilot s process definition, via work function All communication via shared memory Nothing stopping you using msg. passing in shared mem as sound IPC technique! QNX (bought by RIM) has send/receive/reply Fall 2016 CIS*3090 Parallel Programming 4
5 Compare/contrast pthreads API with Pilot s pthread_create Like PI_CreateProcess + PI_StartAll Thread is candidate for execution immediately! pthread_t is handle similar to PI_PROCESS* Like Pilot, one thread function can serve for multiple threads Distinguish instances via void* arg Like Pilot s index & void* args 1st call to pthread_create converts main() from process into a thread itself (PI_MAIN) Fall 2016 CIS*3090 Parallel Programming 5
6 Bound vs. unbound threads May need to set thread attributes Bound each thread gets own core (provided #threads #cores) This is Pthreads system contention scope: every thread is an equal contender for CPU Unbound = process contention scope Process s threads treated as a group (less CPU) Default may be OS-specific: 1 core:1 thread; 1:N; N:M Can also specify scheduling policy like FIFO or RR, and set thread priority Fall 2016 CIS*3090 Parallel Programming 6
7 pthread_join ~ PI_StopMain Wait for thread exit and reap its status Done by master, or any thread with handle on joinee thread Status is specified as a void* Can pass a value cast to (void*) If really passing pointer, make sure doesn t go out of scope when thread exits! Static storage address will still be valid Pointer to stack variable dumb! PI_StopMain does barrier with all processes Fall 2016 CIS*3090 Parallel Programming 7
8 Detached threads Detached thread attribute opposite of joinable Left to finish independently Can t return a status Also, pthread_detach() changes joinable thread to detached Fall 2016 CIS*3090 Parallel Programming 8
9 How main thread ends Can return or call exit() Terminates process and any remaining running threads (including detached) Can call pthread_exit() Leaves other threads running Running unjoined and detached threads keep whole process alive Likely not what you wanted Fall 2016 CIS*3090 Parallel Programming 9
10 How spawned threads end Normal way: work function returns return(status) or call pthread_exit() Waits to join if joinable, or dies if detached Can also be cancelled by other thread Tricky, could leave mess (e.g., locked mutexes) Complex, could be inside a system call (e.g., I/O), which may/not be cancellation point Possible to define cleanup function to be called upon cancellation Best to stay away from this! Fall 2016 CIS*3090 Parallel Programming 10
11 Inter-thread synchronization Mutex: lock, unlock, trylock Should initialize to unlocked via PTHREAD_MUTEX_INITIALIZER No fairness for multiple waiters Not necessarily FIFO queue (organize it yourself) (Counting) Semaphore: Need additional #include <semaphore.h> init(value), wait, post (aka signal), getvalue, trywait Fall 2016 CIS*3090 Parallel Programming 11
12 Condition variables Solves problem of holding onto mutex while waiting for (logical) condition to occur I.e., waiting inside a critical section Associated with a mutex wait, timedwait, signal, broadcast (=signal all waiters) Fall 2016 CIS*3090 Parallel Programming 12
13 Classic producer/consumer How can producer wait for room to open up in full buffer without releasing the buffer s mutex lock? Prevents consumer from removing an item! One solution is for producer to give up the lock and check back after awhile But we don t want it busy-waiting, nor to keep waking up on a timer uselessly when the condition hasn t changed Fall 2016 CIS*3090 Parallel Programming 13
14 The magic of cond_wait Waiters for condition to change call cond_wait covertly gives up associated mutex before blocking When returns, mutex already reacquired! Important: mutex lock is associated with some shared data structure (e.g., buffer) Whoever is accessing data structure needs to use SAME mutex Can be multiple condition variables associated with same mutex Fall 2016 CIS*3090 Parallel Programming 14
15 Condition variable: Basic discipline Waiter first acquires associated mutex finds logical condition false, so calls cond_wait() to wait for condition to become true blocks Any party that wants to signal that condition is now (potentially) fulfilled calls cond_signal() wakes up waiters Signaler only needs to acquire mutex if messing with associated data structure Fall 2016 CIS*3090 Parallel Programming 15
16 Main opportunity for failure Returning from cond_wait does NOT necessarily mean that the condition is true despite having been signaled!!! Library is allowed to wake up multiple waiters from one cond_signal (sorry to say) All have to contend for reacquiring mutex Only one at a time will succeed, and return from its cond_wait call Another one will not return till earlier one releases the mutex, by which time condition may have changed Fall 2016 CIS*3090 Parallel Programming 16
17 What waiter must do So, as a cond_wait caller, upon waking: You DO KNOW that you have exclusive use of the associated data structure But you CAN T ASSUME that the cond_signaled condition is (still) true Ergo, MUST recheck condition Another woken waiter may have changed condition (e.g, re-emptied or re-filled the buffer) Those who assume wakeup from cond_wait means condition good to go have buggy code! Fall 2016 CIS*3090 Parallel Programming 17
18 Unsafe condition variable use Fig 6.4: circular buffer, put/get indexes Shared buffer protected by mutex lock C.v. nonempty for producer to signal Inserting item and signaling non-empty condition must be within same critical section! If not, signal could be missed between waiter finding buffer is empty and waiting for it to fill Consider both 1) modifying the buffer and 2) signaling the change as part of the same locked transaction Fall 2016 CIS*3090 Parallel Programming 18
19 Figure 6.4 Example of why a signaling thread needs to be protected by a mutex. pthread_mutex_lock(&lock); & 1. Consumer (right column) locks mutex 2. Consumer checks if buffer empty (put==get), but before it can call cond_wait 3. Producer (left column) inserts item and calls cond_signal 4. The signal is lost, because no one is waiting yet! 5. Now when consumer calls cond_wait, it will not wake up Solution is for producer to lock mutex around (before/after) insert and cond_signal. This will force the insert to run after cond_wait releases the mutex (arrow), then the signal will wakeup the waiting consumer. Copyright 2009 Pearson Education, Inc. Publishing as Pearson Addison-Wesley 6-19
20 Fig 6.5 needs repairs Meant to show that 3 critical sections (C/S) pertaining to same buffer should use same mutex, then every possible execution sequence safe Even if multiple consumers, this works Test of buffer-empty is in while loop Re-executes test anytime cond_wait returns So test and removal occur w/in same C/S Fall 2016 CIS*3090 Parallel Programming 20
21 lock(&mutex) /* insert item */ pthread_cond_signal(&nonempty) unlock(&mutex) lock(&mutex) while(put==get) pthread_cond_wait(&nonempty,&mutex) /* remove item */ unlock(&mutex) Signaling thread CASE 1: A B C lock(&mutex) /* insert item */ pthread_cond_signal(&nonempty) unlock(&mutex) Fig 6.3 s insert( ) Producer s critical section A Fig 6.3 s remove( ) Consumer s critical section B (waiting for new items gives up mutex) Consumer s critical section C Waiting thread Producer followed by consumer no one waiting for signal, but doesn t matter since consumer will find buffer non-empty lock(&mutex) while(put==get) /* false has data */ pthread_cond_wait(&nonempty,&mutex) /* remove item */ unlock(&mutex) Fall 2016 CIS*3090 Parallel Programming 21
22 CASE 2: B A C lock(&mutex) /* insert item */ pthread_cond_signal(&nonempty) unlock(&mutex) CASE 3: B C A lock(&mutex) /* insert item */ pthread_cond_signal(&nonempty) unlock(&mutex) Consumer finds empty buffer lock(&mutex) while(put==get) /* true no data */ pthread_cond_wait(&nonempty,&mutex) consumer is waiting and gets wakeup /* remove item */ unlock(&mutex) Consumer followed by producer lock(&mutex) while(put==get) /* false has data */ pthread_cond_wait(&nonempty,&mutex) /* remove item */ unlock(&mutex) no one waiting for signal, but doesn t matter since consumer will (later) find buffer non-empty Fall 2016 CIS*3090 Parallel Programming 22
23 Multiple Condition Vars. (p159) See any problem with this? EatJuicyFruit() { pthread_mutex_lock(&lock); while( apples==0 oranges == 0 ) { pthread_cond_wait( &more_apples, &lock ); } pthread_cond_wait( &more_oranges, &lock ); } /* CRITICAL SECTION: eat both an apple and an orange */ pthread_mutex_unlock(&lock); Fall 2016 CIS*3090 Parallel Programming 23
24 Solution Involves proper use of cond_wait Shows how tricky pthreads code is to write correctly! Pilot much less opportunity for deadlocks by comparison Also: message-passing handles both communication and synchronization! Pthreads API only does inter-thread sync (you re using global variables for comm.) Fall 2016 CIS*3090 Parallel Programming 24
25 Thread-specific data (TSD) (lots of typos) Variable that is global in scope (to all functions) but having different values for each thread Identified by key (key_create func) Each TS variable needs its own key Use setspecific and getspecific with key:value pair Benefit: lower-level funcs can access these values without passing them down as args Fall 2016 CIS*3090 Parallel Programming 25
26 Drawbacks to TSD Not terribly efficient since accessed via function call Don t place in inner loops Can set up per-key destructor function Useful for OOP (C++) When thread exits, automatically called C++11 has TSD Fall 2016 CIS*3090 Parallel Programming 26
27 Safety issues Deadlocks (familiar from CIS*3110) Lock hierarchies: When thread needs to acquire more than one mutex at a time Make rule that they be acquired in consistent order (e.g. alphabetical by variable name) Prevents circular wait Unfortunately no easy way to enforce! Fall 2016 CIS*3090 Parallel Programming 27
28 Monitors Very OO encapsulates shared data with methods that manipulate it Methods take care of acquiring needed mutexes, deal with cond. vars. Prevents programmer logic errors leading to deadlock or violation of C/S by hiding mutex/cv s Not provided directly in pthreads.h Build yourself using cond. vars. (pattern in book) Fall 2016 CIS*3090 Parallel Programming 28
29 Next time Look at Successive Over-relaxation case study (p ) to prepare Fall 2016 CIS*3090 Parallel Programming 29
Systèmes d Exploitation Avancés
Systèmes d Exploitation Avancés Instructor: Pablo Oliveira ISTY Instructor: Pablo Oliveira (ISTY) Systèmes d Exploitation Avancés 1 / 32 Review : Thread package API tid thread create (void (*fn) (void
More informationCS 31: Intro to Systems Misc. Threading. Kevin Webb Swarthmore College December 6, 2018
CS 31: Intro to Systems Misc. Threading Kevin Webb Swarthmore College December 6, 2018 Classic thread patterns Agenda Pthreads primitives and examples of other forms of synchronization: Condition variables
More informationOutline. CS4254 Computer Network Architecture and Programming. Introduction 2/4. Introduction 1/4. Dr. Ayman A. Abdel-Hamid.
Threads Dr. Ayman Abdel-Hamid, CS4254 Spring 2006 1 CS4254 Computer Network Architecture and Programming Dr. Ayman A. Abdel-Hamid Computer Science Department Virginia Tech Threads Outline Threads (Chapter
More informationHigh Performance Computing Lecture 21. Matthew Jacob Indian Institute of Science
High Performance Computing Lecture 21 Matthew Jacob Indian Institute of Science Semaphore Examples Semaphores can do more than mutex locks Example: Consider our concurrent program where process P1 reads
More informationPOSIX Threads. Paolo Burgio
POSIX Threads Paolo Burgio paolo.burgio@unimore.it The POSIX IEEE standard Specifies an operating system interface similar to most UNIX systems It extends the C language with primitives that allows the
More informationCondition Variables. Jinkyu Jeong Computer Systems Laboratory Sungkyunkwan University
Condition Variables Jinkyu Jeong (jinkyu@skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu EEE3052: Introduction to Operating Systems, Fall 2017, Jinkyu Jeong (jinkyu@skku.edu)
More informationReview: Processes. A process is an instance of a running program. POSIX Thread APIs:
Review: Processes A process is an instance of a running program - A thread is an execution context - Process can have one or more threads - Threads share address space (code, data, heap), open files -
More informationMore Types of Synchronization 11/29/16
More Types of Synchronization 11/29/16 Today s Agenda Classic thread patterns Other parallel programming patterns More synchronization primitives: RW locks Condition variables Semaphores Message passing
More informationData Races and Deadlocks! (or The Dangers of Threading) CS449 Fall 2017
Data Races and Deadlocks! (or The Dangers of Threading) CS449 Fall 2017 Data Race Shared Data: 465 1 8 5 6 209? tail A[] thread switch Enqueue(): A[tail] = 20; tail++; A[tail] = 9; tail++; Thread 0 Thread
More informationChap. 6 Part 3. CIS*3090 Fall Fall 2016 CIS*3090 Parallel Programming 1
Chap. 6 Part 3 CIS*3090 Fall 2016 Fall 2016 CIS*3090 Parallel Programming 1 OpenMP popular for decade Compiler-based technique Start with plain old C, C++, or Fortran Insert #pragmas into source file You
More informationOperating Systems. Thread Synchronization Primitives. Thomas Ropars.
1 Operating Systems Thread Synchronization Primitives Thomas Ropars thomas.ropars@univ-grenoble-alpes.fr 2017 2 Agenda Week 42/43: Synchronization primitives Week 44: Vacation Week 45: Synchronization
More informationSemaphore. Originally called P() and V() wait (S) { while S <= 0 ; // no-op S--; } signal (S) { S++; }
Semaphore Semaphore S integer variable Two standard operations modify S: wait() and signal() Originally called P() and V() Can only be accessed via two indivisible (atomic) operations wait (S) { while
More informationCSE 333 SECTION 9. Threads
CSE 333 SECTION 9 Threads HW4 How s HW4 going? Any Questions? Threads Sequential execution of a program. Contained within a process. Multiple threads can exist within the same process. Every process starts
More informationreal time operating systems course
real time operating systems course 4 introduction to POSIX pthread programming introduction thread creation, join, end thread scheduling thread cancellation semaphores thread mutexes and condition variables
More informationCondition Variables & Semaphores
Condition Variables & Semaphores Nima Honarmand (Based on slides by Prof. Andrea Arpaci-Dusseau) Review: Concurrency Objectives Mutual Exclusion A & B don t run at the same time Solved using locks Ordering
More informationMotivation and definitions Processes Threads Synchronization constructs Speedup issues
Motivation and definitions Processes Threads Synchronization constructs Speedup issues Overhead Caches Amdahl s Law CS550: Advanced Operating Systems 2 If task can be completely decoupled into independent
More information[537] Locks and Condition Variables. Tyler Harter
[537] Locks and Condition Variables Tyler Harter Review: using and designing basic locks Do it. Problem 1 Lock Evaluation How to tell if a lock implementation is good? Lock Evaluation How to tell if a
More informationCS 162 Operating Systems and Systems Programming Professor: Anthony D. Joseph Spring Lecture 8: Semaphores, Monitors, & Condition Variables
CS 162 Operating Systems and Systems Programming Professor: Anthony D. Joseph Spring 2004 Lecture 8: Semaphores, Monitors, & Condition Variables 8.0 Main Points: Definition of semaphores Example of use
More informationDeadlock and Monitors. CS439: Principles of Computer Systems September 24, 2018
Deadlock and Monitors CS439: Principles of Computer Systems September 24, 2018 Bringing It All Together Processes Abstraction for protection Define address space Threads Share (and communicate) through
More informationCS533 Concepts of Operating Systems. Jonathan Walpole
CS533 Concepts of Operating Systems Jonathan Walpole Introduction to Threads and Concurrency Why is Concurrency Important? Why study threads and concurrent programming in an OS class? What is a thread?
More informationTCSS 422: OPERATING SYSTEMS
TCSS 422: OPERATING SYSTEMS OBJECTIVES Introduction to threads Concurrency: An Introduction Wes J. Lloyd Institute of Technology University of Washington - Tacoma Race condition Critical section Thread
More informationCS 471 Operating Systems. Yue Cheng. George Mason University Fall 2017
CS 471 Operating Systems Yue Cheng George Mason University Fall 2017 1 Review: Sync Terminology Worksheet 2 Review: Semaphores 3 Semaphores o Motivation: Avoid busy waiting by blocking a process execution
More informationCS 537 Lecture 8 Monitors. Thread Join with Semaphores. Dining Philosophers. Parent thread. Child thread. Michael Swift
CS 537 Lecture 8 Monitors Michael Swift Two Classes of Synchronization Problems Uniform resource usage with simple scheduling constraints No other variables needed to express relationships Use one semaphore
More informationCSE 153 Design of Operating Systems
CSE 153 Design of Operating Systems Winter 2018 Lecture 10: Monitors Monitors A monitor is a programming language construct that controls access to shared data Synchronization code added by compiler, enforced
More informationEEE3052: Introduction to Operating Systems. Fall Project #3
EEE3052: Introduction to Operating Systems Fall 2017 Project #3 Project Plan 4 projects 0) Install Xv6 1) Process management 2) Virtual memory 3) Synchronization - Thread (11/13 ~ 11/21) - Mutex & Condition
More informationCondition Variables CS 241. Prof. Brighten Godfrey. March 16, University of Illinois
Condition Variables CS 241 Prof. Brighten Godfrey March 16, 2012 University of Illinois 1 Synchronization primitives Mutex locks Used for exclusive access to a shared resource (critical section) Operations:
More informationCSci 4061 Introduction to Operating Systems. (Threads-POSIX)
CSci 4061 Introduction to Operating Systems (Threads-POSIX) How do I program them? General Thread Operations Create/Fork Allocate memory for stack, perform bookkeeping Parent thread creates child threads
More informationCSci 4061 Introduction to Operating Systems. Synchronization Basics: Locks
CSci 4061 Introduction to Operating Systems Synchronization Basics: Locks Synchronization Outline Basics Locks Condition Variables Semaphores Basics Race condition: threads + shared data Outcome (data
More informationLecture 4. Threads vs. Processes. fork() Threads. Pthreads. Threads in C. Thread Programming January 21, 2005
Threads vs. Processes Lecture 4 Thread Programming January 21, 2005 fork() is expensive (time, memory) Interprocess communication is hard. Threads are lightweight processes: one process can contain several
More informationOperating systems and concurrency (B08)
Operating systems and concurrency (B08) David Kendall Northumbria University David Kendall (Northumbria University) Operating systems and concurrency (B08) 1 / 20 Introduction Semaphores provide an unstructured
More informationAdministrivia. Review: Thread package API. Program B. Program A. Program C. Correct answers. Please ask questions on Google group
Administrivia Please ask questions on Google group - We ve had several questions that would likely be of interest to more students x86 manuals linked on reference materials page Next week, guest lecturer:
More informationThread. Disclaimer: some slides are adopted from the book authors slides with permission 1
Thread Disclaimer: some slides are adopted from the book authors slides with permission 1 IPC Shared memory Recap share a memory region between processes read or write to the shared memory region fast
More informationLecture 8: September 30
CMPSCI 377 Operating Systems Fall 2013 Lecture 8: September 30 Lecturer: Prashant Shenoy Scribe: Armand Halbert 8.1 Semaphores A semaphore is a more generalized form of a lock that can be used to regulate
More informationLocks. Dongkun Shin, SKKU
Locks 1 Locks: The Basic Idea To implement a critical section A lock variable must be declared A lock variable holds the state of the lock Available (unlocked, free) Acquired (locked, held) Exactly one
More informationConcurrent Programming
Indian Institute of Science Bangalore, India भ रत य व ज ञ न स स थ न ब गल र, भ रत SE 292: High Performance Computing [3:0][Aug:2014] Concurrent Programming Yogesh Simmhan Adapted from Intro to Concurrent
More informationSynchroniza+on II COMS W4118
Synchroniza+on II COMS W4118 References: Opera+ng Systems Concepts (9e), Linux Kernel Development, previous W4118s Copyright no2ce: care has been taken to use only those web images deemed by the instructor
More informationCS 470 Spring Mike Lam, Professor. Semaphores and Conditions
CS 470 Spring 2018 Mike Lam, Professor Semaphores and Conditions Synchronization mechanisms Busy-waiting (wasteful!) Atomic instructions (e.g., LOCK prefix in x86) Pthreads Mutex: simple mutual exclusion
More informationSynchronising Threads
Synchronising Threads David Chisnall March 1, 2011 First Rule for Maintainable Concurrent Code No data may be both mutable and aliased Harder Problems Data is shared and mutable Access to it must be protected
More informationConcurrent Server Design Multiple- vs. Single-Thread
Concurrent Server Design Multiple- vs. Single-Thread Chuan-Ming Liu Computer Science and Information Engineering National Taipei University of Technology Fall 2007, TAIWAN NTUT, TAIWAN 1 Examples Using
More informationANSI/IEEE POSIX Standard Thread management
Pthread Prof. Jinkyu Jeong( jinkyu@skku.edu) TA Jinhong Kim( jinhong.kim@csl.skku.edu) TA Seokha Shin(seokha.shin@csl.skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu The
More informationMultithreading Programming II
Multithreading Programming II Content Review Multithreading programming Race conditions Semaphores Thread safety Deadlock Review: Resource Sharing Access to shared resources need to be controlled to ensure
More informationCS 333 Introduction to Operating Systems Class 4 Concurrent Programming and Synchronization Primitives
CS 333 Introduction to Operating Systems Class 4 Concurrent Programming and Synchronization Primitives Jonathan Walpole Computer Science Portland State University 1 What does a typical thread API look
More informationCPS 310 second midterm exam, 11/14/2014
CPS 310 second midterm exam, 11/14/2014 Your name please: Part 1. Sticking points Consider the Java code snippet below. Is it a legal use of Java synchronization? What happens if two threads A and B call
More informationPThreads in a Nutshell
PThreads in a Nutshell Chris Kauffman CS 499: Spring 2016 GMU Logistics Today POSIX Threads Briefly Reading Grama 7.1-9 (PThreads) POSIX Threads Programming Tutorial HW4 Upcoming Post over the weekend
More informationReview: Thread package API
Review: Thread package API tid thread create (void (*fn) (void *), void *arg); - Create a new thread that calls fn with arg void thread exit (); void thread join (tid thread); The execution of multiple
More informationReview: Thread package API
1/39 Review: Thread package API tid thread create (void (*fn) (void *), void *arg); - Create a new thread that callsfn witharg void thread exit (); void thread join (tid thread); The execution of multiple
More informationReal Time Operating Systems and Middleware
Real Time Operating Systems and Middleware POSIX Threads Synchronization Luca Abeni abeni@dit.unitn.it Real Time Operating Systems and Middleware p. 1 Threads Synchronisation All the threads running in
More informationConcurrency: Deadlock and Starvation
Concurrency: Deadlock and Starvation Chapter 6 E&CE 354: Processes 1 Deadlock Deadlock = situation in which every process from a set is permanently blocked, i.e. cannot proceed with execution Common cause:
More informationW4118 Operating Systems. Instructor: Junfeng Yang
W4118 Operating Systems Instructor: Junfeng Yang Outline Semaphores Producer-consumer problem Monitors and condition variables 2 Semaphore motivation Problem with lock: mutual exclusion, but no ordering
More informationEECS 482 Introduction to Operating Systems
EECS 482 Introduction to Operating Systems Winter 2018 Harsha V. Madhyastha Monitors vs. Semaphores Monitors: Custom user-defined conditions Developer must control access to variables Semaphores: Access
More informationLecture 6 (cont.): Semaphores and Monitors
Project 1 Due Thursday 10/20 Lecture 6 (cont.): Semaphores and Monitors CSE 120: Principles of Operating Systems Alex C. Snoeren Higher-Level Synchronization We looked at using locks to provide mutual
More informationPROCESS SYNCHRONIZATION
PROCESS SYNCHRONIZATION Process Synchronization Background The Critical-Section Problem Peterson s Solution Synchronization Hardware Semaphores Classic Problems of Synchronization Monitors Synchronization
More informationConcurrency: Signaling and Condition Variables
Concurrency: Signaling and Condition Variables Questions Answered in this Lecture: How do we make fair locks perform better? How do we notify threads of that some condition has been met? Hale CS450 Thanks
More informationResource management. Real-Time Systems. Resource management. Resource management
Real-Time Systems Specification Implementation Verification Mutual exclusion is a general problem that exists at several levels in a real-time system. Shared resources internal to the the run-time system:
More informationWarm-up question (CS 261 review) What is the primary difference between processes and threads from a developer s perspective?
Warm-up question (CS 261 review) What is the primary difference between processes and threads from a developer s perspective? CS 470 Spring 2019 POSIX Mike Lam, Professor Multithreading & Pthreads MIMD
More informationOperating Systems CMPSCI 377 Spring Mark Corner University of Massachusetts Amherst
Operating Systems CMPSCI 377 Spring 2017 Mark Corner University of Massachusetts Amherst What is a Monitor? Ties data and the synchronization operations together Monitors guarantee mutual exclusion, i.e.,
More informationMultithreaded Programming
Multithreaded Programming The slides do not contain all the information and cannot be treated as a study material for Operating System. Please refer the text book for exams. September 4, 2014 Topics Overview
More informationCMSC421: Principles of Operating Systems
CMSC421: Principles of Operating Systems Nilanjan Banerjee Assistant Professor, University of Maryland Baltimore County nilanb@umbc.edu http://www.csee.umbc.edu/~nilanb/teaching/421/ Principles of Operating
More informationOperating Systems (2INC0) 2017/18
Operating Systems (2INC0) 2017/18 Condition Synchronization (07) Dr. Courtesy of Prof. Dr. Johan Lukkien System Architecture and Networking Group Agenda Condition synchronization motivation condition variables
More informationChapter 6: Process Synchronization
Chapter 6: Process Synchronization Objectives Introduce Concept of Critical-Section Problem Hardware and Software Solutions of Critical-Section Problem Concept of Atomic Transaction Operating Systems CS
More informationCS 2112 Lecture 20 Synchronization 5 April 2012 Lecturer: Andrew Myers
CS 2112 Lecture 20 Synchronization 5 April 2012 Lecturer: Andrew Myers 1 Critical sections and atomicity We have been seeing that sharing mutable objects between different threads is tricky We need some
More informationCS 241 Honors Concurrent Data Structures
CS 241 Honors Concurrent Data Structures Bhuvan Venkatesh University of Illinois Urbana Champaign March 27, 2018 CS 241 Course Staff (UIUC) Lock Free Data Structures March 27, 2018 1 / 43 What to go over
More informationReal-Time and Concurrent Programming Lecture 4 (F4): Monitors: synchronized, wait and notify
http://cs.lth.se/eda040 Real-Time and Concurrent Programming Lecture 4 (F4): Monitors: synchronized, wait and notify Klas Nilsson 2016-09-20 http://cs.lth.se/eda040 F4: Monitors: synchronized, wait and
More informationThis is a talk given by me to the Northwest C++ Users Group on May 19, 2010.
This is a talk given by me to the Northwest C++ Users Group on May 19, 2010. 1 I like this picture because it clearly shows what is private and what is shared. In the message-passing system, threads operate
More informationThe Dining Philosophers Problem CMSC 330: Organization of Programming Languages
The Dining Philosophers Problem CMSC 0: Organization of Programming Languages Threads Classic Concurrency Problems Philosophers either eat or think They must have two forks to eat Can only use forks on
More informationDealing with Issues for Interprocess Communication
Dealing with Issues for Interprocess Communication Ref Section 2.3 Tanenbaum 7.1 Overview Processes frequently need to communicate with other processes. In a shell pipe the o/p of one process is passed
More informationCS 318 Principles of Operating Systems
CS 318 Principles of Operating Systems Fall 2017 Midterm Review Ryan Huang 10/12/17 CS 318 Midterm Review 2 Midterm October 17 th Tuesday 9:00-10:20 am at classroom Covers material before virtual memory
More informationProject 3-2. Mutex & CV
SSE3044 Introduction to Operating Systems Prof. Jinkyu Jeong Project 3-2. Mutex & CV 2018.05.30 (Wed.) TAs 이규선 (gyusun.lee@csl.skku.edu) / 안민우 (minwoo.ahn@csl.skku.edu) Project Plan Total 4 projects 1)
More informationPOSIX Threads. HUJI Spring 2011
POSIX Threads HUJI Spring 2011 Why Threads The primary motivation for using threads is to realize potential program performance gains and structuring. Overlapping CPU work with I/O. Priority/real-time
More informationCMSC 330: Organization of Programming Languages. The Dining Philosophers Problem
CMSC 330: Organization of Programming Languages Threads Classic Concurrency Problems The Dining Philosophers Problem Philosophers either eat or think They must have two forks to eat Can only use forks
More informationSynchronization and Semaphores. Copyright : University of Illinois CS 241 Staff 1
Synchronization and Semaphores Copyright : University of Illinois CS 241 Staff 1 Synchronization Primatives Counting Semaphores Permit a limited number of threads to execute a section of the code Binary
More informationWarm-up question (CS 261 review) What is the primary difference between processes and threads from a developer s perspective?
Warm-up question (CS 261 review) What is the primary difference between processes and threads from a developer s perspective? CS 470 Spring 2018 POSIX Mike Lam, Professor Multithreading & Pthreads MIMD
More informationCMSC 330: Organization of Programming Languages. Threads Classic Concurrency Problems
: Organization of Programming Languages Threads Classic Concurrency Problems The Dining Philosophers Problem Philosophers either eat or think They must have two forks to eat Can only use forks on either
More informationConcurrency, Thread. Dongkun Shin, SKKU
Concurrency, Thread 1 Thread Classic view a single point of execution within a program a single PC where instructions are being fetched from and executed), Multi-threaded program Has more than one point
More informationPthreads. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University
Pthreads Jin-Soo Kim (jinsookim@skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu The Pthreads API ANSI/IEEE POSIX1003.1-1995 Standard Thread management Work directly on
More informationCS 333 Introduction to Operating Systems. Class 3 Threads & Concurrency. Jonathan Walpole Computer Science Portland State University
CS 333 Introduction to Operating Systems Class 3 Threads & Concurrency Jonathan Walpole Computer Science Portland State University 1 Process creation in UNIX All processes have a unique process id getpid(),
More informationCS 261 Fall Mike Lam, Professor. Threads
CS 261 Fall 2017 Mike Lam, Professor Threads Parallel computing Goal: concurrent or parallel computing Take advantage of multiple hardware units to solve multiple problems simultaneously Motivations: Maintain
More informationCOSC 6374 Parallel Computation. Shared memory programming with POSIX Threads. Edgar Gabriel. Fall References
COSC 6374 Parallel Computation Shared memory programming with POSIX Threads Fall 2012 References Some of the slides in this lecture is based on the following references: http://www.cobweb.ecn.purdue.edu/~eigenman/ece563/h
More informationOverview. CMSC 330: Organization of Programming Languages. Concurrency. Multiprocessors. Processes vs. Threads. Computation Abstractions
CMSC 330: Organization of Programming Languages Multithreaded Programming Patterns in Java CMSC 330 2 Multiprocessors Description Multiple processing units (multiprocessor) From single microprocessor to
More informationSemaphores. Jinkyu Jeong Computer Systems Laboratory Sungkyunkwan University
Semaphores Jinkyu Jeong (jinkyu@skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu EEE3052: Introduction to Operating Systems, Fall 2017, Jinkyu Jeong (jinkyu@skku.edu) Synchronization
More informationLecture 7: CVs & Scheduling
Lecture 7: CVs & Scheduling CSE 120: Principles of Operating Systems Alex C. Snoeren HW 2 Due 10/17 Monitors A monitor is a programming language construct that controls access to shared data Synchronization
More informationECE 598 Advanced Operating Systems Lecture 23
ECE 598 Advanced Operating Systems Lecture 23 Vince Weaver http://web.eece.maine.edu/~vweaver vincent.weaver@maine.edu 21 April 2016 Don t forget HW#9 Midterm next Thursday Announcements 1 Process States
More informationOperating Systems ECE344
Operating Systems ECE344 Ding Yuan Announcement & Reminder Lab 0 mark posted on Piazza Great job! One problem: compilation error I fixed some for you this time, but won t do it next time Make sure you
More informationCSE 451: Operating Systems Spring Module 10 Semaphores, Condition Variables, and Monitors
CSE 451: Operating Systems Spring 2017 Module 10 Semaphores, Condition Variables, and Monitors John Zahorjan 2017 Gribble, Lazowska, Levy, Zahorjan, Zbikowski 1 Semaphores Semaphore = a synchronization
More informationThreaded Programming. Lecture 9: Alternatives to OpenMP
Threaded Programming Lecture 9: Alternatives to OpenMP What s wrong with OpenMP? OpenMP is designed for programs where you want a fixed number of threads, and you always want the threads to be consuming
More informationC09: Process Synchronization
CISC 7310X C09: Process Synchronization Hui Chen Department of Computer & Information Science CUNY Brooklyn College 3/29/2018 CUNY Brooklyn College 1 Outline Race condition and critical regions The bounded
More informationLecture 5 Threads and Pthreads II
CSCI-GA.3033-017 Special Topics: Multicore Programming Lecture 5 Threads and Pthreads II Christopher Mitchell, Ph.D. cmitchell@cs.nyu.edu http://z80.me Context We re exploring the layers of an application
More informationParallel Programming with Threads
Thread Programming with Shared Memory Parallel Programming with Threads Program is a collection of threads of control. Can be created dynamically, mid-execution, in some languages Each thread has a set
More informationThread Synchronization: Foundations. Properties. Safety properties. Edsger s perspective. Nothing bad happens
Edsger s perspective Testing can only prove the presence of bugs Thread Synchronization: Foundations Properties Property: a predicate that is evaluated over a run of the program (a trace) every message
More informationLast class: Today: Thread Background. Thread Systems
1 Last class: Thread Background Today: Thread Systems 2 Threading Systems 3 What kind of problems would you solve with threads? Imagine you are building a web server You could allocate a pool of threads,
More informationReal-Time Systems. Lecture #4. Professor Jan Jonsson. Department of Computer Science and Engineering Chalmers University of Technology
Real-Time Systems Lecture #4 Professor Jan Jonsson Department of Computer Science and Engineering Chalmers University of Technology Real-Time Systems Specification Resource management Mutual exclusion
More informationDeadlock and Monitors. CS439: Principles of Computer Systems February 7, 2018
Deadlock and Monitors CS439: Principles of Computer Systems February 7, 2018 Last Time Terminology Safety and liveness Atomic Instructions, Synchronization, Mutual Exclusion, Critical Sections Synchronization
More informationOpera&ng Systems ECE344
Opera&ng Systems ECE344 Lecture 6: Synchroniza&on (II) Semaphores and Monitors Ding Yuan Higher- Level Synchroniza&on We looked at using locks to provide mutual exclusion Locks work, but they have some
More informationCS 333 Introduction to Operating Systems. Class 3 Threads & Concurrency. Jonathan Walpole Computer Science Portland State University
CS 333 Introduction to Operating Systems Class 3 Threads & Concurrency Jonathan Walpole Computer Science Portland State University 1 The Process Concept 2 The Process Concept Process a program in execution
More informationCSE 374 Programming Concepts & Tools
CSE 374 Programming Concepts & Tools Hal Perkins Fall 2017 Lecture 22 Shared-Memory Concurrency 1 Administrivia HW7 due Thursday night, 11 pm (+ late days if you still have any & want to use them) Course
More informationCSCI4430 Data Communication and Computer Networks. Pthread Programming. ZHANG, Mi Jan. 26, 2017
CSCI4430 Data Communication and Computer Networks Pthread Programming ZHANG, Mi Jan. 26, 2017 Outline Introduction What is Multi-thread Programming Why to use Multi-thread Programming Basic Pthread Programming
More informationCMSC 330: Organization of Programming Languages
CMSC 330: Organization of Programming Languages Multithreading Multiprocessors Description Multiple processing units (multiprocessor) From single microprocessor to large compute clusters Can perform multiple
More informationLast Class: CPU Scheduling! Adjusting Priorities in MLFQ!
Last Class: CPU Scheduling! Scheduling Algorithms: FCFS Round Robin SJF Multilevel Feedback Queues Lottery Scheduling Review questions: How does each work? Advantages? Disadvantages? Lecture 7, page 1
More informationStudent: Yu Cheng (Jade) ICS 412 Homework #3 October 07, Explain why a spin-lock is not a good idea on a single processor, single machine.
Student: Yu Cheng (Jade) ICS 412 Homework #3 October 07, 2009 Homework #3 Exercise 1: Explain why a spin-lock is not a good idea on a single processor, single machine. There is a bad side and a good side
More informationConcurrency. Chapter 5
Concurrency 1 Chapter 5 2 Concurrency Is a fundamental concept in operating system design Processes execute interleaved in time on a single processor Creates the illusion of simultaneous execution Benefits
More information