Distributed Systems Operation System Support

Transcription

1 Hajussüsteemid MTAT Distributed Systems Operation System Support slides are adopted from: lecture: Operating System(OS) support (years 2016, 2017) book: Distributed Systems: Concepts and Design, Chapter 7 (Edn ) book: "Operating System Concepts, Ninth Edition ", Chapter 4 1/34

2 Outline Introduction Operating System Layers OS Kernel functionality Virtual Memory OS Process schedulers Threads 2/34

3 Introduction What is the main task of any operating system? 3/34

4 Introduction interface to hardware (CPU, memory, disk, network card, monitor) core services (file systems, network protocols,...) manage resources memory management (virtual memory, memory pages) CPU management (processes, threads) IO resources (sockets, opened files) share resources between processes process is a running program with its set of allocated resources protect processes from each other 4/34

5 Introduction What are the differences between: Network Operating System Distributed Operating System 5/34

6 Introduction What are the differences between: Network Operating System Distributed Operating System Network Operating System Built-in network capability Some resource accessible transparently Remote shell, remote desktop Network File systems (NFS, Samba ) Ssh, VNC, X11, Rdesktop... Still the concept is: Many interconnected physical nodes Many autonomous OS instances 6/34

7 Introduction What are the differences between: Network Operating System Distributed Operating System Distributed Operating System One Instance of Running OS Many interconnected physical nodes Are there any distributed OS nowadays? 7/34

8 Introduction What are the differences between: Network Operating System Distributed Operating System Distributed Operating System One Instance of Running OS Many interconnected physical nodes Are there any distributed OS nowadays? Why aren't they developed? 8/34

9 Introduction What are the differences between: Network Operating System Distributed Operating System Distributed Operating System One Instance of Running OS Many interconnected physical nodes Are there any distributed OS nowadays? Why aren't they developed? Software portability? Architecture complexity, hence lower performance? Users in fact want to preserve autonomy for their PCs! 9/34

10 Operating System Layers A code may be running in different Privilege levels: kernel level (tier 0) allows to access any resource, user level (tier 3) restricts access to resources System calls are kernel functions to be called from user level open() system call...returns a file descriptor, a small, nonnegative integer for use in subsequent system calls (read(2), write(2)... html Memory - the resource a program can access without syscall however, it does not access physical memory but virtual memory mapping from virtual to physical is still controlled from the kernel 10/34

11 Operating System Layers User-Space Applications, Services, Libraries Kernel-Space Process manager Memory manager, Thread manager Communication manager Supervisor 11/34

12 OS Kernel functionality 12/34

13 OS Kernel functionality Process manager: Creation of and operations upon processes. A process is a unit of resource management, including an address space and one or more threads. Thread manager: Thread creation, synchronization and scheduling. Threads are scheduled activities attached to processes Memory manager: Management of physical and virtual memory. Supervisor: Dispatching of interrupts, system call traps and other exceptions; control of memory management unit and hardware caches; processor and floating-point unit register manipulations. (hal32.dll, hal.dll?) 13/34

14 Virtual Memory Why is it called virtual? What in fact happens to the memory when the process is started? What is address space? What is fragmentation? What is paging? 14/34

15 Virtual Memory Every process has its address space e.g. address 42 on processes A and B is Address space is split into regions: text (code), stack, heap memory mapped files e.g. dynamic library (DLL) code *How by the way DLL is different from shared library shared memory regions try cat /proc/<pid>/maps Problem: fragmentation if P2 exits, can we fit something into the green region place in memory? solution: paging 15/34

16 Memory Pages mapping virtual (VM) to physical memory (PM) pages are 4kB (4MB) chunks process Page Table contains the mapping TLB cache speeds up translation allocating VM region does nothing to PM read/write results in page fault page fault handler decides what to do just allocate page in PM and update process page table load data for memory mapped files in case of low memory some pages are offloaded read-only mapped files can be discarded data pages are written into swap VIRT,RES and SHR in top 16/34

17 Processes and Treads Process? Thread? 17/34

18 Processes and Treads Process Unit of Resource Thread - Unit of Execution and Scheduling Detailed definition? Detailed definition? Kernel thread? User-level thread? Green-thread? Thread models (User-Level to Kernel Level) 18/34

19 Process Context What does the typical process consist of? 19/34

20 Process Context Typical process consists of: currently executing command (Program Counter) Stack Pointer (SP) general purpose registers, floating point registers memory management registers point to the information about process memory regions and page tables 20/34

21 Context switch Any ideas what is it? How does it work? Why is it said it is an expensive action? 21/34

22 Context switch Scheduler tries to run M processes on N cores gives each process time slice to execute Switching - can only be done in kernel (privileged) mode requires a system call pre-emptive: as the result of CPU hardware exception side effect of system call, e.g. in blocking in recv() store old process context find new process to execute (kernel contains list of processes) load new process context (where it left the last time) return to user mode TLB cache is invalidated (not with threads) CPU caches are also largely invalidated (unless threads reuse locality) All in all, it is pretty expensive action 22/34

23 Creating Process New processes are created with two system calls: fork() system call creates almost exact copy of the current process information about memory regions is copied page tables are copied however, physical pages are not copied immediately copy-on-write exeve() system call runs another program in the current process memory regions are cleared and replaced from the new executable new code, data, stack regions, opened files and libraries page tables are discarded new information is filled as the program is loaded into physical memory 23/34

24 Process Schedulers What is responsible for? For scheduling eventually :) But what exactly is it doing? What are different kinds of process schedulers? Regarding the number of CPUs or Cores in on CPU? Regarding the scheduling polices? 24/34

25 Process Schedulers Responsible for deciding if current process can continue or it should yield to the next process. Two kinds of schedulers exist Preemptive The decision is usually made based on events: Current process is in waiting state (it issued some blocking I/O request) Current process terminates A timer interrupt is invoking scheduler to put current process from running to ready state Blocking I/O operation is complete and the process may be put back into running state Cooperative scheduler cannot take the CPU away from a process Batch processing systems (run-to-completion) 25/34

26 Threads Traditional ( heavyweight ) processes have a single thread of control - There is one program counter, and one sequence of instructions that can be carried out at any given time. Multi-threaded applications have multiple threads within a single process, each having their own program counter, stack and set of registers, but sharing common code, data, and certain structures such as open files. 26/34

27 Threads 27/34

28 OS Threading Models There are two types of threads to be managed in a modern system: User-space threads and kernel threads. User-space threads are supported above the kernel, without kernel support. These are the threads that application programmers would put into their programs. Kernel threads are supported within the kernel of the OS itself. All modern OS-es support kernel level threads, allowing the kernel to perform multiple simultaneous tasks and/or to service multiple kernel system calls simultaneously. In a specific implementation, the user threads must be mapped to kernel threads, using one of the following strategies. 28/34

29 Many-To-One Model In the many-to-one model, many user-level threads are all mapped onto a single kernel thread. Thread management is handled by the thread library in user space, which is very efficient. However, if a blocking system call is made, then the entire process blocks, even if the other user threads would otherwise be able to continue. Because a single kernel thread can operate only on a single CPU, the many-to-one model does not allow individual processes to be split across multiple CPUs. Green threads for Solaris and GNU Portable Threads implement the many-to-one model in the past, but few systems continue to do so today. 29/34

30 One-To-One Model The one-to-one model creates a separate kernel thread to handle each user thread. One-to-one model overcomes the problems listed above involving blocking system calls and the splitting of processes across multiple CPUs. However the overhead of managing the one-toone model is more significant, involving more overhead and slowing down the system. Most implementations of this model place a limit on how many threads can be created. Linux and Windows from 95 to XP implement the one-to-one model for threads 30/34

31 Many-To-Many Model The many-to-many model multiplexes any number of user threads onto an equal or smaller number of kernel threads, combining the best features of the one-to-one and many-to-one models. Users have no restrictions on the number of threads created. Blocking kernel system calls do not block the entire process. Processes can be split across multiple processors. Individual processes may be allocated variable numbers of kernel threads, depending on the number of CPUs present and other factors. 31/34

32 Two-tier model is the two-tier model, which allows either manyto-many or one-to-one operation. IRIX, HP-UX, and Tru64 UNIX use the two-tier model, as did Solaris prior to Solaris 9. 32/34

33 Threads Libraries POSIX Threads or Pthreads The POSIX standard ( IEEE c ) defines the specification for pthreads, not the implementation. pthreads are available on Solaris, Linux, Mac OSX, Tru64, and via public domain shareware for Windows. Global variables are shared amongst all threads. Windows Threads Similar to pthreads, just the API is different Java Threads JVM runs on top of a native OS, and that the JVM specification does not specify what model to use for mapping Java threads to kernel threads. This decision is JVM implementation dependent, and may be one-to-one, many-to-many, or many to one.. What about Python Threads? What does it in fact using? And what model? 33/34

34 Read at Home Read / work through the Textbook Chapter 8 -- Distributed objects and components Some questions to address: 1. What are the key differences in objects and distributed objects? 2. What are the key concepts of CORBA? 3. What are the issues with object-oriented middle-ware? 4. What has the concept of software components in offer to overcome these issues? 34/34

35 Hajussüsteemid MTAT Distributed Systems Operation System Support slides are adopted from: lecture: Operating System(OS) support (years 2016, 2017) book: Distributed Systems: Concepts and Design, Chapter 7 (Edn ) book: "Operating System Concepts, Ninth Edition ", Chapter 4 1/34

36 Outline Introduction Operating System Layers OS Kernel functionality Virtual Memory OS Process schedulers Threads 2/34

37 Introduction What is the main task of any operating system? 3/34

38 Introduction interface to hardware (CPU, memory, disk, network card, monitor) core services (file systems, network protocols,...) manage resources memory management (virtual memory, memory pages) CPU management (processes, threads) IO resources (sockets, opened files) share resources between processes process is a running program with its set of allocated resources protect processes from each other 4/34

39 Introduction What are the differences between: Network Operating System Distributed Operating System 5/34

40 Introduction What are the differences between: Network Operating System Distributed Operating System Network Operating System Built-in network capability Some resource accessible transparently Network File systems (NFS, Samba ) Remote shell, remote desktop Ssh, VNC, X11, Rdesktop... Still the concept is: Many interconnected physical nodes Many autonomous OS instances 6/34

41 Introduction What are the differences between: Network Operating System Distributed Operating System Distributed Operating System One Instance of Running OS Many interconnected physical nodes Are there any distributed OS nowadays? 7/34

42 Introduction What are the differences between: Network Operating System Distributed Operating System Distributed Operating System One Instance of Running OS Many interconnected physical nodes Are there any distributed OS nowadays? Why aren't they developed? 8/34

43 Introduction What are the differences between: Network Operating System Distributed Operating System Distributed Operating System One Instance of Running OS Many interconnected physical nodes Are there any distributed OS nowadays? Why aren't they developed? Software portability? Architecture complexity, hence lower performance? Users in fact want to preserve autonomy for their PCs! 9/34

44 Operating System Layers A code may be running in different Privilege levels: kernel level (tier 0) allows to access any resource, user level (tier 3) restricts access to resources System calls are kernel functions to be called from user level open() system call...returns a file descriptor, a small, nonnegative integer for use in subsequent system calls (read(2), write(2)... html Memory - the resource a program can access without syscall however, it does not access physical memory but virtual memory mapping from virtual to physical is still controlled from the kernel 10/34

45 Operating System Layers User-Space Applications, Services, Libraries Kernel-Space Process manager Memory manager, Thread manager Communication manager Supervisor 11/34

46 OS Kernel functionality 12/34

47 OS Kernel functionality Process manager: Creation of and operations upon processes. A process is a unit of resource management, including an address space and one or more threads. Thread manager: Thread creation, synchronization and scheduling. Threads are scheduled activities attached to processes Memory manager: Management of physical and virtual memory. Supervisor: Dispatching of interrupts, system call traps and other exceptions; control of memory management unit and hardware caches; processor and floating-point unit register manipulations. (hal32.dll, hal.dll?) 13/34

48 Virtual Memory Why is it called virtual? What in fact happens to the memory when the process is started? What is address space? What is fragmentation? What is paging? 14/34

49 Virtual Memory Every process has its address space e.g. address 42 on processes A and B is Address space is split into regions: text (code), stack, heap memory mapped files e.g. dynamic library (DLL) code *How by the way DLL is different from shared library shared memory regions try cat /proc/<pid>/maps Problem: fragmentation if P2 exits, can we fit something into the green region place in memory? solution: paging 15/34

50 Memory Pages mapping virtual (VM) to physical memory (PM) pages are 4kB (4MB) chunks process Page Table contains the mapping TLB cache speeds up translation allocating VM region does nothing to PM read/write results in page fault page fault handler decides what to do just allocate page in PM and update process page table load data for memory mapped files in case of low memory some pages are offloaded read-only mapped files can be discarded data pages are written into swap VIRT,RES and SHR in top 16/34

51 Processes and Treads Process? Thread? 17/34

52 Processes and Treads Process Unit of Resource Thread - Unit of Execution and Scheduling Detailed definition? Detailed definition? Kernel thread? User-level thread? Green-thread? Thread models (User-Level to Kernel Level) 18/34

53 Process Context What does the typical process consist of? 19/34

54 Process Context Typical process consists of: currently executing command (Program Counter) Stack Pointer (SP) general purpose registers, floating point registers memory management registers point to the information about process memory regions and page tables 20/34

55 Context switch Any ideas what is it? How does it work? Why is it said it is an expensive action? 21/34

56 Context switch Scheduler tries to run M processes on N cores gives each process time slice to execute Switching - can only be done in kernel (privileged) mode requires a system call pre-emptive: as the result of CPU hardware exception side effect of system call, e.g. in blocking in recv() store old process context find new process to execute (kernel contains list of processes) load new process context (where it left the last time) return to user mode TLB cache is invalidated (not with threads) CPU caches are also largely invalidated (unless threads reuse locality) All in all, it is pretty expensive action 22/34

57 Creating Process New processes are created with two system calls: fork() system call creates almost exact copy of the current process information about memory regions is copied page tables are copied however, physical pages are not copied immediately copy-on-write exeve() system call runs another program in the current process memory regions are cleared and replaced from the new executable new code, data, stack regions, opened files and libraries page tables are discarded new information is filled as the program is loaded into physical memory 23/34

58 Process Schedulers What is responsible for? For scheduling eventually :) But what exactly is it doing? What are different kinds of process schedulers? Regarding the number of CPUs or Cores in on CPU? Regarding the scheduling polices? 24/34

59 Process Schedulers Responsible for deciding if current process can continue or it should yield to the next process. Two kinds of schedulers exist Preemptive The decision is usually made based on events: Current process is in waiting state (it issued some blocking I/O request) Current process terminates A timer interrupt is invoking scheduler to put current process from running to ready state Blocking I/O operation is complete and the process may be put back into running state Cooperative scheduler cannot take the CPU away from a process Batch processing systems (run-to-completion) 25/34

60 Threads Traditional ( heavyweight ) processes have a single thread of control - There is one program counter, and one sequence of instructions that can be carried out at any given time. Multi-threaded applications have multiple threads within a single process, each having their own program counter, stack and set of registers, but sharing common code, data, and certain structures such as open files. 26/34

61 Threads 27/34

62 OS Threading Models There are two types of threads to be managed in a modern system: User-space threads and kernel threads. User-space threads are supported above the kernel, without kernel support. These are the threads that application programmers would put into their programs. Kernel threads are supported within the kernel of the OS itself. All modern OS-es support kernel level threads, allowing the kernel to perform multiple simultaneous tasks and/or to service multiple kernel system calls simultaneously. In a specific implementation, the user threads must be mapped to kernel threads, using one of the following strategies. 28/34

63 Many-To-One Model In the many-to-one model, many user-level threads are all mapped onto a single kernel thread. Thread management is handled by the thread library in user space, which is very efficient. However, if a blocking system call is made, then the entire process blocks, even if the other user threads would otherwise be able to continue. Because a single kernel thread can operate only on a single CPU, the many-to-one model does not allow individual processes to be split across multiple CPUs. Green threads for Solaris and GNU Portable Threads implement the many-to-one model in the past, but few systems continue to do so today. 29/34

64 One-To-One Model The one-to-one model creates a separate kernel thread to handle each user thread. One-to-one model overcomes the problems listed above involving blocking system calls and the splitting of processes across multiple CPUs. However the overhead of managing the one-toone model is more significant, involving more overhead and slowing down the system. Most implementations of this model place a limit on how many threads can be created. Linux and Windows from 95 to XP implement the one-to-one model for threads 30/34

65 Many-To-Many Model The many-to-many model multiplexes any number of user threads onto an equal or smaller number of kernel threads, combining the best features of the one-to-one and many-to-one models. Users have no restrictions on the number of threads created. Blocking kernel system calls do not block the entire process. Processes can be split across multiple processors. Individual processes may be allocated variable numbers of kernel threads, depending on the number of CPUs present and other factors. 31/34

66 Two-tier model is the two-tier model, which allows either manyto-many or one-to-one operation. IRIX, HP-UX, and Tru64 UNIX use the two-tier model, as did Solaris prior to Solaris 9. 32/34

67 Threads Libraries POSIX Threads or Pthreads The POSIX standard ( IEEE c ) defines the specification for pthreads, not the implementation. pthreads are available on Solaris, Linux, Mac OSX, Tru64, and via public domain shareware for Windows. Global variables are shared amongst all threads. Windows Threads Similar to pthreads, just the API is different Java Threads JVM runs on top of a native OS, and that the JVM specification does not specify what model to use for mapping Java threads to kernel threads. This decision is JVM implementation dependent, and may be one-to-one, many-to-many, or many to one.. What about Python Threads? What does it in fact using? And what model? 33/34

68 Read at Home Read / work through the Textbook Chapter 8 -- Distributed objects and components Some questions to address: 1. What are the key differences in objects and distributed objects? 2. What are the key concepts of CORBA? 3. What are the issues with object-oriented middle-ware? 4. What has the concept of software components in offer to overcome these issues? 34/34