Kexec: Soft-Reboot and Crash-Dump Analysis for Linux and Xen
|
|
|
- Charles Parrish
- 6 years ago
- Views:
Transcription
1 Kexec: Soft-Reboot and Crash-Dump Analysis for Linux and Xen Linux.Conf.Au, Sydney, Australia Simon Horman (Horms) Magnus Damm VA Linux Systems Japan K.K. 18th January 2007 Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
2 A Tale in Three Parts Part I: Crash-Dump Analysis Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
3 A Tale in Three Parts Part I: Crash-Dump Analysis Part II: Kexec Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
4 A Tale in Three Parts Part I: Crash-Dump Analysis Part II: Kexec Part III: Port of Kexec to Xen Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
5 Part I Crash-Dump Analysis Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
6 Crash-Dump Analysis User-Space Core-Dump When an application crashes it is useful to analyse the state of the programme at the time of the crash Operating systems provide a facility to dump the memory core of applications The core can be analysed using tools such as gdb Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
7 Crash-Dump Analysis User-Space Core-Dump When an application crashes it is useful to analyse the state of the programme at the time of the crash Operating systems provide a facility to dump the memory core of applications The core can be analysed using tools such as gdb Operating System Crash-Dump When an operating system crashes it is also useful to analyse the state of the system at the time of the crash The difficulty arises because it is the operating system that would naturally collect the memory dump, however it has crashed Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
8 Who is Interested In It? Enterprise Users Want deep analysis of crashes Are willing to go to third parties for analysis But they want to use vendor-supplied kernels So a standardised solution is needed Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
9 Who is Interested In It? Enterprise Users Want deep analysis of crashes Are willing to go to third parties for analysis But they want to use vendor-supplied kernels So a standardised solution is needed Kernel Developers If end-users could collect crash dumps, it could be useful for kernel developers to isolate bugs. The facility would need to be provided by distributions. Crash-Dump size may be a problem when transferring between end-users and kernel-developers Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
10 Some Crash-Dump Solutions for Linux LKCD Linux Kernel Crash Dump netdump diskdump Mini Kernel Dump Kexec/Kdump Full Disclosure: Mini Kernel Dump was developed in part by my employer, VA Linux Systems Japan K.K. Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
11 Part II Kexec Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
12 Kexec Kexec is a feature of the Linux kernel that allows a new kernel to run in place of the running kernel Kernel kexec Second Kernel It is named after exec(2), the system call which allows a process to replace a running process Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
13 Motivation for Kexec Allows rebooting to skip the BIOS and hardware initialisation Some hardware has buggy BIOSes that do not allow reboot to occur reliably Some hardware takes a really long time to reboot Rebooting using kexec can be really fast Can be very useful for bootstrapping and rebooting in development environments. Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
14 Performing Kexec The new kernel is loaded into the running kernel from user-space using kexec-tool # kexec -l /boot/vmlinuz The new kernel can then be kexeced using the same tool # kexec -e Kexec is a method of warm or soft-booting machines Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
15 Kexec Flow 1. Kexec Load file system Load Files kexec-tool Segments Command Line Kernel Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
16 Kexec Flow 1. Kexec Load file system Load kexec-tool Kernel Files Segments Command Line 2. Kexec Execute kexec tool Execute Kernel Point of No Return Segments Command Line Boot Param Command Line Second Kernel Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
17 Kdump Kdump is an extension of kexec with allows a crash kernel to be executed in place of a running kernel if the running kernel panics Kernel crash kdump Crash Kernel Kdump and kexec use separate kernel images, which may be loaded independently of each other Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
18 Kexec vs Kdump Kexec Uses (all) system memory as any booting kernel would The second kernel runs when triggered by kexec-tool Kdump Runs the crash kernel in a reserved area of memory, so as to leave the panicked kernel s memory untouched for forensic analysis The crash kernel runs when the running kernel panics Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
19 Kdump Flow 1. Kdump Load file system Load Files kexec-tool Segments Command Line Kernel Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
20 Kdump Flow 1. Kdump Load file system Load kexec-tool Kernel Files Segments Command Line 2. Kdump Execute Kernel Execute Panic! Kernel Point of No Return Segments Command Line Boot Param Command Line Crash Kernel Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
21 Triggering Kdump Usually triggered by the kernel on panic But may be triggered from user-space (for testing purposes? :-) echo c > /proc/sysrq-trigger Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
22 Triggering Kdump Usually triggered by the kernel on panic But may be triggered from user-space (for testing purposes? :-) echo c > /proc/sysrq-trigger sysrq trigger Execute Kernel Point of No Return Segments Command Line Boot Param Command Line Crash Kernel Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
23 VMCore Visible as /proc/vmcore from within a crash kernel run by kdump Includes the entire physical memory, as visible to the panicked kernel crash Kernel kdump Crash Kernel Preamble Crash Notes Physical Memory vmcore Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
24 Core Files Linux core files are generally ELF format Preamble Crash Notes Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
25 Core Files Linux core files are generally ELF format They start with an ELF preamble Preamble Crash Notes Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
26 Core Files Linux core files are generally ELF format They start with an ELF preamble Then there is a crash notes section which includes the pid of the crashing process, cpu registers, and the like Preamble Crash Notes Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
27 Core Files Linux core files are generally ELF format They start with an ELF preamble Then there is a crash notes section which includes the pid of the crashing process, cpu registers, and the like And then there is the memory core of the crashed process Preamble Crash Notes Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
28 Core Files Linux core files are generally ELF format They start with an ELF preamble Then there is a crash notes section which includes the pid of the crashing process, cpu registers, and the like And then there is the memory core of the crashed process Core files may be analysed using tools such as gdb Preamble Crash Notes Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
29 VMCore Files Kexec s vmcore is also ELF format Preamble Crash Notes Physical Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
30 VMCore Files Kexec s vmcore is also ELF format Preamble Preamble Crash Notes Physical Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
31 VMCore Files Kexec s vmcore is also ELF format Preamble Then per-cpu crash notes Preamble Crash Notes Physical Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
32 VMCore Files Kexec s vmcore is also ELF format Preamble Then per-cpu crash notes And then the entire physical memory of the crashed machine Preamble Crash Notes Physical Memory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
33 Using Kexec for Crash-Dump Analysis Kdump can be used to capture the state of a system when a panic occurs Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
34 Using Kexec for Crash-Dump Analysis Kdump can be used to capture the state of a system when a panic occurs VMcore can be used to save this state to disk or a remote host Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
35 Using Kexec for Crash-Dump Analysis Kdump can be used to capture the state of a system when a panic occurs VMcore can be used to save this state to disk or a remote host The resulting image than then be analysed off-line using tools like crash whitepaper/ Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
36 Part III Port of Kexec to Xen Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
37 Motivation for Porting Kexec to Xen Provide a crash-dump facility for both domain 0 and the hypervisor kexec for domain U is being developed separately by Gerd Hoffmann Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
38 Motivation for Porting Kexec to Xen Provide a crash-dump facility for both domain 0 and the hypervisor kexec for domain U is being developed separately by Gerd Hoffmann Kexec is a strong solution for hypervisor crash-dump Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
39 Motivation for Porting Kexec to Xen Provide a crash-dump facility for both domain 0 and the hypervisor kexec for domain U is being developed separately by Gerd Hoffmann Kexec is a strong solution for hypervisor crash-dump And for free it can also provide crash-dump for domain 0 Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
40 Motivation for Porting Kexec to Xen Provide a crash-dump facility for both domain 0 and the hypervisor kexec for domain U is being developed separately by Gerd Hoffmann Kexec is a strong solution for hypervisor crash-dump And for free it can also provide crash-dump for domain 0 It is has an active developer community (for Linux) Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
41 Motivation for Porting Kexec to Xen Provide a crash-dump facility for both domain 0 and the hypervisor kexec for domain U is being developed separately by Gerd Hoffmann Kexec is a strong solution for hypervisor crash-dump And for free it can also provide crash-dump for domain 0 It is has an active developer community (for Linux) And as a further bonus, provides a method of soft-booting Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
42 Implementation in Brief Linux s kexec code has a generic core and architectures implement several hooks Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
43 Implementation in Brief Linux s kexec code has a generic core and architectures implement several hooks The implementation of these hooks have been moved into the hypervisor Accessed via a hypercall Only the hypervisor has access to the machine s physical memory which is a requirement for implementing kexec Allows the hypervisor to trigger kdump if it panics Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
44 Implementation in Brief Linux s kexec code has a generic core and architectures implement several hooks The implementation of these hooks have been moved into the hypervisor Accessed via a hypercall Only the hypervisor has access to the machine s physical memory which is a requirement for implementing kexec Allows the hypervisor to trigger kdump if it panics Additional hooks were added to load and unload kernels into the hypervisor Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
45 Xen Kexec Flow 1. Kexec Load file system Load Files Hypervisor Image* kexec-tool Segments Hypervisor Image* Command Line Domain 0 Kernel Segments Hypervisor Image* Command Line Hypervisor * Hypervisor Image is only needed if kexecing into Xen, it should be omitted when kexecing into Linux Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
46 Kexec Flow 1. Kexec Load file system Load Files Hypervisor Image* kexec-tool Segments Hypervisor Image* Command Line Domain 0 Kernel Segments Hypervisor Image* Command Line Hypervisor 2. Kexec Execute * Hypervisor Image is only needed if kexecing into Xen, it should be omitted when kexecing into Linux kexec tool Execute Domain 0 Kernel Hypervsior Segments Hypervisor Image* Boot Param Hypervisor Image* Linux or Xen Point of No Return Command Line Command Line Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
47 Xen Kdump Flow 1. Kdump Load file system Files kexec-tool Segments Command Line Domain 0 Kernel Segments Command Line Hypervisor Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
48 Xen Kdump Flow 1. Kdump Load file system Files kexec-tool Segments Domain 0 Kernel Segments Hypervisor Command Line Command Line 2a. Kdump Execute - Domain 0 Panics Domain 0 Kernel Execute Panic! Domain 0 Kernel Hypervsior Segments Boot Param Crash Kernel Point of No Return Command Line Command Line Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
49 Xen Kdump Flow 1. Kdump Load file system Files kexec-tool Segments Domain 0 Kernel Segments Hypervisor Command Line Command Line 2a. Kdump Execute - Domain 0 Panics Domain 0 Kernel Execute Panic! Domain 0 Kernel Hypervsior Segments Boot Param Crash Kernel Point of No Return Command Line Command Line 2b. Kdump Execute - Hypervisor Panics Hypervisor Execute Panic! Hypervsior Segments Boot Param Crash Kernel Point of No Return Command Line Command Line Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
50 VMCore Files for Xen The same as Linux s (for now) memory includes the hypervisor, domain 0 and domain U Kazuo Moriwaka is working on dumpread, which allows the memory of the hypervisor, or any of the domains to be extracted from the vmcore Itsuro Oda is working on xencrash, a fork of crash for handling xen crash-dumps. Preamble Crash Notes Physical Memory Note that domain memory is not linear Hypervisor Domain 0 Domain 1 Domain N * Full Disclosure: Both Kazuo Moriwaka and Itsuro Oda are colleagues of mine Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
51 Implementation Problems: Constants Some constants differ between Linux and Xen e.g. PAGE OFFSET (ia64) Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
52 Implementation Problems: Constants Some constants differ between Linux and Xen e.g. PAGE OFFSET (ia64) Compile time constants in kexec-tool: purgatory Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
53 Implementation Problems: Constants Some constants differ between Linux and Xen e.g. PAGE OFFSET (ia64) Compile time constants in kexec-tool: purgatory Compile time constants in the Kernel: relocate kernel() Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
54 Implementation Problems: Constants Some constants differ between Linux and Xen e.g. PAGE OFFSET (ia64) Compile time constants in kexec-tool: purgatory Compile time constants in the Kernel: relocate kernel() Globals the Kernel: relocate kernel() Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
55 Implementation Problems: Constants Some constants differ between Linux and Xen e.g. PAGE OFFSET (ia64) Compile time constants in kexec-tool: purgatory Compile time constants in the Kernel: relocate kernel() Globals the Kernel: relocate kernel() In practice this has not been a problem for the i386 and x86 64 implementations, but it does manifest in ia64 Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
56 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
57 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Crash note mapping for VMcore is set up at kexec-load time /sys/devices/system/cpu/cpu*/crash notes Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
58 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Crash note mapping for VMcore is set up at kexec-load time /sys/devices/system/cpu/cpu*/crash notes Written to at crash-time for each cpu Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
59 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Crash note mapping for VMcore is set up at kexec-load time /sys/devices/system/cpu/cpu*/crash notes Written to at crash-time for each cpu When using xen, the domain U kernels see virtual cpus May only be a subset of physical cpus Physical to virtual mapping may change at any time Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
60 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Crash note mapping for VMcore is set up at kexec-load time /sys/devices/system/cpu/cpu*/crash notes Written to at crash-time for each cpu When using xen, the domain U kernels see virtual cpus May only be a subset of physical cpus Physical to virtual mapping may change at any time Solution Leave crash notes as-is in the domain 0 kernel The virtual cpus at the time of kexec-load will be visible in the VMCore The virtual cpus at the time of crash will be saved, if the domain 0 kernel crashes Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
61 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Crash note mapping for VMcore is set up at kexec-load time /sys/devices/system/cpu/cpu*/crash notes Written to at crash-time for each cpu When using xen, the domain U kernels see virtual cpus May only be a subset of physical cpus Physical to virtual mapping may change at any time Solution Leave crash notes as-is in the domain 0 kernel The virtual cpus at the time of kexec-load will be visible in the VMCore The virtual cpus at the time of crash will be saved, if the domain 0 kernel crashes A separate area is reserved by the hypervisor to save per-cpu crash-note-like information Saved regardless of if it is the hypervisor or domain 0 kernel that crash Visible as ELF sections in the VMCore But a customised tool is needed anyway Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
62 Implementation Problems: Crash Notes Problem Per-cpu memory reserved at kernel boot time Crash note mapping for VMcore is set up at kexec-load time /sys/devices/system/cpu/cpu*/crash notes Written to at crash-time for each cpu When using xen, the domain U kernels see virtual cpus May only be a subset of physical cpus Physical to virtual mapping may change at any time Solution Leave crash notes as-is in the domain 0 kernel The virtual cpus at the time of kexec-load will be visible in the VMCore The virtual cpus at the time of crash will be saved, if the domain 0 kernel crashes A separate area is reserved by the hypervisor to save per-cpu crash-note-like information Saved regardless of if it is the hypervisor or domain 0 kernel that crash Visible as ELF sections in the VMCore But a customised tool is needed anyway N.B: This is probably broken if cpus are hotpluged, regardless of Xen Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
63 Status of the Xen Port Working with the port, all combinations of Xen/Linux Xen/Linux transitions possible Without the port, only Linux Xen/Linux transitions are possible Status x86 32 included in Xen x86 64 included in Xen ia64 work in progress Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
64 Questions? Horms (VA Linux Systems Japan K.K.) Kexec 18th January / 34
Kernel Debugging with netdump and crash Worcester Linux Users Group January 13th, 2005
Kernel Debugging with netdump and crash Worcester Linux Users Group January 13th, 2005 Presenter: Jeff Moyer Overview Kernel debugging tools Kernel crash dump implementations Netdump
2006/7/22. NTT Data Intellilink Corporation Fernando Luis Vázquez Cao. Copyright(C)2006 NTT Data Intellilink Corporation
Evaluating Linux Kernel Crash Dumping Mechanisms 2006/7/22 NTT Data Intellilink Corporation Fernando Luis Vázquez Cao 1 Who am I? LKDTT (Linux Kernel Dump Test Tool) maintainer MKDump (Mini Kernel Dump)
kdump: usage and internals
kdump: usage and internals CFP, #LinuxCon, Beijing, June 19-20, 2017 (panand@redhat.com) Agenda kdump from user perspective Kernel system calls When Kernel crashes vmcore structure makedumpfile kdump:
PVHVM Linux guest why doesn't kexec work? Vitaly Kuznetsov Red Hat Xen Developer Summit, 2015
PVHVM Linux guest why doesn't kexec work? Vitaly Kuznetsov Red Hat Xen Developer Summit, 2015 Why? We support Red Hat Enterprise Linux. Bare hardware, virtualized and cloud environments,... Kernel issues
Kdump on the Mainframe
LinuxCon Europe 2012 Kdump on the Mainframe Michael Holzheu VMDUMP! Stand-alone dump! Kdump! 2012 IBM Corporation Trademarks & Disclaimer The following are trademarks of the
Kdump on the Mainframe
LinuxCon Europe 2012 Kdump on the Mainframe Michael Holzheu VMDUMP! Stand-alone dump! Kdump! 2012 IBM Corporation Trademarks & Disclaimer The following are trademarks of the
Virtualization with XEN. Trusted Computing CS599 Spring 2007 Arun Viswanathan University of Southern California
Virtualization with XEN Trusted Computing CS599 Spring 2007 Arun Viswanathan University of Southern California A g e n d a Introduction Virtualization approaches Basic XEN Architecture Setting up XEN Bootstrapping
Maintaining Linux Long Term & Adding Specific Features in Telecom Systems. Keika Kobayashi NEC Communication Systems Sep 29, Japan2010
Maintaining Linux Long Term & Adding Specific Features in Telecom Systems Keika Kobayashi NEC Communication Systems Sep 29, 2010@LinuxCon Japan2010 OUTLINE 1. Background 2. What we did 1. Keep kernel stable.
HPE Knowledge Article
HPE Knowledge Article Red Hat Enterprise Linux 6 - Successful Kdump Triggered from ilo NMI Article Number mmr_sf-en_us000012354 Environment Red Hat Enterprise Linux 6 HP ProLiant DL980 G7 ilo NMI Issue
Oracle Linux 7: Advanced Administration Ed 1
Oracle University Contact Us: +33 15 7602 081 Oracle Linux 7: Advanced Administration Ed 1 Duration: 5 Days What you will learn This Oracle Linux 7: Advanced Administration training is ideal for experienced
Virtual Server Management
Virtual Server Management with KVM for IBM z Systems Viktor Mihajlovski 1 Agenda KVM virtualization components Managing virtual servers Managing virtual resources Migrating running
SystemTap for Enterprise
SystemTap for Enterprise SystemTap for Enterprise Enterprise Features in SystemTap 2010/09/28 Hitachi Systems Development Laboratory Linux Technology Center Masami Hiramatsu SystemTap Overview Tracing
Software Guide for PRIMEQUEST
J2UZ-9310-12ENZ0(00) Red Hat Enterprise Linux 5 Software Guide for PRIMEQUEST - Basic - Preface This book is a manual to use Red Hat Enterprise Linux 5 on PRIMEQUEST. It describes important information
Oracle Linux 5 & 6 Advanced Administration
Oracle University Contact Us: +27 (0)11 319-4111 Oracle Linux 5 & 6 Advanced Administration Duration: 5 Days What you will learn This Oracle Linux Advanced Administration training is ideal for experienced
Oracle Linux 7: Advanced Administration Ed 1 LVC
Oracle University Contact Us: Local: 1800 103 4775 Intl: +91 80 67863102 Oracle Linux 7: Advanced Administration Ed 1 LVC Duration: 5 Days What you will learn This Oracle Linux 7: Advanced Administration
CS61 Scribe Notes Date: Topic: Fork, Advanced Virtual Memory. Scribes: Mitchel Cole Emily Lawton Jefferson Lee Wentao Xu
CS61 Scribe Notes Date: 11.6.14 Topic: Fork, Advanced Virtual Memory Scribes: Mitchel Cole Emily Lawton Jefferson Lee Wentao Xu Administrivia: Final likely less of a time constraint What can we do during
An Introduction to Asymmetric Multiprocessing: when this architecture can be a game changer and how to survive it.
An Introduction to Asymmetric Multiprocessing: when this architecture can be a game changer and how to survive it. Nicola La Gloria, Laura Nao Kynetics LLC Santa Clara, California Hybrid Architecture:
RAS Enhancement Activities for Mission-Critical Linux Systems
RAS Enhancement Activities for MissionCritical Linux Systems Hitachi Ltd. Yoshihiro YUNOMAE 01 MissionCritical Systems We apply Linux to missioncritical systems. Banking systems/carrier backend systems/train
COS 318: Operating Systems. Overview. Andy Bavier Computer Science Department Princeton University
COS 318: Operating Systems Overview Andy Bavier Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall10/cos318/ Logistics Precepts: Tue: 7:30pm-8:30pm, 105 CS
What Tool Is Used To Manually Analyze A Crash Dump
What Tool Is Used To Manually Analyze A Crash Dump What tool is used to manually analyze a crash dump? Debugging Tools for By default, Windows stores crash dumps in what folder? C:/Windows/minidump. Dump
Crashes, Panics and Other Oddities. Imed Chihi, Red Hat February 2008
Crashes, Panics and Other Oddities Imed Chihi, Red Hat February 2008 Agenda Defining some terms Analogy with User Space The BUG() Macro Bad Pointer Handling The NMI Watchdog Machine Check Exceptions EDAC
Linux on Sun Logical Domains
Linux on Sun Logical Domains linux.conf.au, MEL8OURNE, 2008 Outline 1 Background SUN4V and Niagara Sun s Logical Domains 2 Userland Simulator 3 Implementation LDC: Logical Domain Channels VIO: Virtual
Device Passthrough to Driver Domain in Xen
Device Passthrough to Driver Domain in Xen Passthrough. List of terms. Passthrough: the process of passing access to DomD via Dom0 Dom0: Domain 0, a privileged domain DomD: Driver Domain, a domain with
CS-580K/480K Advanced Topics in Cloud Computing. VM Virtualization II
CS-580K/480K Advanced Topics in Cloud Computing VM Virtualization II 1 How to Build a Virtual Machine? 2 How to Run a Program Compiling Source Program Loading Instruction Instruction Instruction Instruction
PROCESS VIRTUAL MEMORY. CS124 Operating Systems Winter , Lecture 18
PROCESS VIRTUAL MEMORY CS124 Operating Systems Winter 2015-2016, Lecture 18 2 Programs and Memory Programs perform many interactions with memory Accessing variables stored at specific memory locations
Seiji Aguchi. Development Status of Troubleshooting Features, Tracing, Message Logging in Linux Kernel 5/20/2014
Development Status of Troubleshooting Features, Tracing, Message Logging in Linux Kernel 5/20/2014 Seiji Aguchi Information & Telecommunication Systems Company IT Platform Division Group, IT Platform R&D
Oracle Linux 5 & 6 Advanced Administration
Oracle Uni Contact Us: 08 Oracle Linux 5 & 6 Advanced Administration Durat5 Da What you will learn This Oracle Linux Advanced Administration training is learn more about advanced features of Oracle Linux.
Memory Analysis. CSF: Forensics Cyber-Security. Part II. Basic Techniques and Tools for Digital Forensics. Fall 2018 Nuno Santos
Memory Analysis Part II. Basic Techniques and Tools for Digital Forensics CSF: Forensics Cyber-Security Fall 2018 Nuno Santos Previous classes Files, steganography, watermarking Source of digital evidence
Why lock down the kernel? Matthew Garrett
Why lock down the kernel? Matthew Garrett What are we trying to do? There s a barrier between users and root Should there be a barrier between root and the kernel? Some prior art CONFIG_MODULE_SIG_FORCE
CS 390 Chapter 2 Homework Solutions
CS 390 Chapter 2 Homework Solutions 2.1 What is the purpose of... System calls are used by user-level programs to request a service from the operating system. 2.5 What is the purpose of... The purpose
Introduction CHAPTER. Review Questions
1 CHAPTER Introduction Review Questions Section 1.1 1.1 What are the four components of a computer system? 1.2 Provide at least three resources the operating system allocates. 1.3 What is the common name
The State of Kernel Debugging Technology. Jason Wessel - Product Architect for WR Linux Core Runtime - Kernel.org KDB/KGDB Maintainer
The State of Kernel Debugging Technology Jason Wessel - Product Architect for WR Linux Core Runtime - Kernel.org KDB/KGDB Maintainer August 12 th, 2010 Agenda Brief history of kernel.org kernel debuggers
Interrupt Coalescing in Xen
Interrupt Coalescing in Xen with Scheduler Awareness Michael Peirce & Kevin Boos Outline Background Hypothesis vic-style Interrupt Coalescing Adding Scheduler Awareness Evaluation 2 Background Xen split
Increase KVM Performance/Density
Increase KVM Performance/Density with Hyper-V Memory Enlightenments Interface Chao Peng (chao.p.peng@intel.com) Contributors: Chao Gao, Yi Sun Expectations in Memory Virtualization Space Time High Performance
WHITE PAPER New Fujitsu High-End Dual-Core Itanium 2-Based PRIMEQUEST Servers Offer Mission-Critical Hosting for Linux and Windows Applications
WHITE PAPER New Fujitsu High-End Dual-Core Itanium 2-Based PRIMEQUEST Servers Offer Mission-Critical Hosting for Linux and Windows Applications July 2006 PREPARED FOR Fujitsu TABLE OF CONTENTS Executive
Chapter 2: Operating-System Structures
Chapter 2: Operating-System Structures Chapter 2: Operating-System Structures Operating System Services User Operating System Interface System Calls Types of System Calls System Programs Operating System
Postmortem Debugging with Coresight HKG18-TR14. Leo Yan, Linaro Support and Solutions Engineering
Postmortem Debugging with Coresight HKG18-TR14 Leo Yan, Linaro Support and Solutions Engineering Introduction This session discusses postmortem debugging techniques in the Linux kernel. Firstly we will
Enhance your Cloud Security with AMD EPYC Hardware Memory Encryption
Enhance your Cloud Security with AMD EPYC Hardware Memory Encryption White Paper October, 2018 Introduction Consumers and enterprises are becoming increasingly concerned about the security of their digital
Xen VT status and TODO lists for Xen-summit. Arun Sharma, Asit Mallick, Jun Nakajima, Sunil Saxena
Xen VT status and TODO lists for Xen-summit Arun Sharma, Asit Mallick, Jun Nakajima, Sunil Saxena R Outline VMX Guests Status Summary Status Domain0 restructuring PCI/IOAPIC X86-64 VMX guests enhancements
Memory Management 9th Week
Department of Electrical Engineering and Information Technology Faculty of Engineering Universitas Gadjah Mada, Indonesia Operating System - TIF 206 Memory Management 9th Week Sunu Wibirama Copyright 2011
System Wide Tracing User Need
System Wide Tracing User Need dominique toupin ericsson com April 2010 About me Developer Tool Manager at Ericsson, helping Ericsson sites to develop better software efficiently Background
Operating systems Architecture
Operating systems Architecture 1 Operating Systems Low level software system that manages all applications implements an interface between applications and resources manages available resources Resource
Xen and the Art of Virtualization. Nikola Gvozdiev Georgian Mihaila
Xen and the Art of Virtualization Nikola Gvozdiev Georgian Mihaila Outline Xen and the Art of Virtualization Ian Pratt et al. I. The Art of Virtualization II. Xen, goals and design III. Xen evaluation
Need To Manually Uninstall Vmware Tools Hyper
Need To Manually Uninstall Vmware Tools Hyper V The first thing to understand when you think of a VMware to Hyper-V transition is that Do you need your tool to make a VMware backup/snapshot? to take several
Dan Noé University of New Hampshire / VeloBit
Dan Noé University of New Hampshire / VeloBit A review of how the CPU works The operating system kernel and when it runs User and kernel mode Device drivers Virtualization of memory Virtual memory Paging
Invirt: A Technical Overview
Evan Broder and Greg Price invirt@mit.edu December 9, 2008 What is Invirt? Invirt is software to let users create and manage virtual machines, independently. Invirt powers SIPB s XVM service (http://xvm.mit.edu),
COS 318: Operating Systems
COS 318: Operating Systems Overview Kai Li Computer Science Department Princeton University (http://www.cs.princeton.edu/courses/cos318/) Important Times Lectures 9/20 Lecture is here Other lectures in
Virtual Machines Disco and Xen (Lecture 10, cs262a) Ion Stoica & Ali Ghodsi UC Berkeley February 26, 2018
Virtual Machines Disco and Xen (Lecture 10, cs262a) Ion Stoica & Ali Ghodsi UC Berkeley February 26, 2018 Today s Papers Disco: Running Commodity Operating Systems on Scalable Multiprocessors, Edouard
The Challenges of X86 Hardware Virtualization. GCC- Virtualization: Rajeev Wankar 36
The Challenges of X86 Hardware Virtualization GCC- Virtualization: Rajeev Wankar 36 The Challenges of X86 Hardware Virtualization X86 operating systems are designed to run directly on the bare-metal hardware,
The Kernel Abstraction. Chapter 2 OSPP Part I
The Kernel Abstraction Chapter 2 OSPP Part I Kernel The software component that controls the hardware directly, and implements the core privileged OS functions. Modern hardware has features that allow
Helping Developers Help You. Tom Caputi
Helping Developers Help You Tom Caputi tcaputi@datto.com The ZFS Code Base 2 The ZFS on Linux* Code Base: Statistics Source code 641 files 383950 lines of code ZFS Test suite (not including ztest) 1327
A visitation of sysdig Project Report
A visitation of sysdig Project Report Jan-Willem Selij, Eric van den Haak June 1, 2014 Abstract This research focuses on using sysdig, a tool that caotures system calls, for a forensic purpose. First,
Mission-Critical Enterprise Linux. April 17, 2006
Mission-Critical Enterprise Linux April 17, 2006 Agenda Welcome Who we are & what we do Steve Meyers, Director Unisys Linux Systems Group (steven.meyers@unisys.com) Technical Presentations Xen Virtualization
Xen and the Art of Virtualization
Xen and the Art of Virtualization Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, Andrew Warfield Presented by Thomas DuBuisson Outline Motivation
Todd Deshane, Ph.D. Student, Clarkson University Xen Summit, June 23-24, 2008, Boston, MA, USA.
Todd Deshane, Ph.D. Student, Clarkson University Xen Summit, June 23-24, 2008, Boston, MA, USA. Xen and the Art of Virtualization (2003) Reported remarkable performance results Xen and the Art of Repeated
Lecture 5: February 3
CMPSCI 677 Operating Systems Spring 2014 Lecture 5: February 3 Lecturer: Prashant Shenoy Scribe: Aditya Sundarrajan 5.1 Virtualization Virtualization is a technique that extends or replaces an existing
LightVMs vs. Unikernels
1. Introduction LightVMs vs. Unikernels Due to the recent developments in technology, present day computers are so powerful that they are often times under-utilized. With the advent of virtualization,
University of Pennsylvania Zachary Goldberg. CIS c. More Kernel Bits. 10/03/09 Slide 1
More Kernel Bits 10/03/09 Slide 1 Rebooting Why would one ever need to reboot on Linux? Installing new driver?... (No) Installing new applications?... (No) Installing new... Anything?... (No) Reconfiguring...
CS 326: Operating Systems. Process Execution. Lecture 5
CS 326: Operating Systems Process Execution Lecture 5 Today s Schedule Process Creation Threads Limited Direct Execution Basic Scheduling 2/5/18 CS 326: Operating Systems 2 Today s Schedule Process Creation
Spring 2017 :: CSE 506. Introduction to. Virtual Machines. Nima Honarmand
Introduction to Virtual Machines Nima Honarmand Virtual Machines & Hypervisors Virtual Machine: an abstraction of a complete compute environment through the combined virtualization of the processor, memory,
Xen and the Art of Virtualization. CSE-291 (Cloud Computing) Fall 2016
Xen and the Art of Virtualization CSE-291 (Cloud Computing) Fall 2016 Why Virtualization? Share resources among many uses Allow heterogeneity in environments Allow differences in host and guest Provide
Virtualization. Michael Tsai 2018/4/16
Virtualization Michael Tsai 2018/4/16 What is virtualization? Let s first look at a video from VMware http://www.vmware.com/tw/products/vsphere.html Problems? Low utilization Different needs DNS DHCP Web
Chapter 2: System Structures. Operating System Concepts 9 th Edition
Chapter 2: System Structures Silberschatz, Galvin and Gagne 2013 Chapter 2: System Structures Operating System Services User Operating System Interface System Calls Types of System Calls System Programs
Processes and Threads
COS 318: Operating Systems Processes and Threads Kai Li and Andy Bavier Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall13/cos318 Today s Topics u Concurrency
Evaluating Linux Kernel Crash Dumping Mechanisms
Evaluating Linux Kernel Crash Dumping Mechanisms Fernando Luis Vázquez Cao NTT Data Intellilink fernando@intellilink.co.jp Abstract There have been several kernel crash dump capturing solutions available
CSCE 410/611: Virtualization
CSCE 410/611: Virtualization Definitions, Terminology Why Virtual Machines? Mechanics of Virtualization Virtualization of Resources (Memory) Some slides made available Courtesy of Gernot Heiser, UNSW.
OS Structure. Kevin Webb Swarthmore College January 25, Relevant xkcd:
OS Structure Kevin Webb Swarthmore College January 25, 2018 Relevant xkcd: One of the survivors, poking around in the ruins with the point of a spear, uncovers a singed photo of Richard Stallman. They
Enhancement Activities on the Current Upstream Kernel for Mission-Critical Systems
Enhancement Activities on the Current Upstream Kernel for MissionCritical Systems Hitachi Ltd. Yoshihiro YUNOMAE 01 MissionCritical Systems We apply Linux to missioncritical systems. Banking systems/carrier
PL-I Assignment Broup B-Ass 5 BIOS & UEFI
PL-I Assignment Broup B-Ass 5 BIOS & UEFI Vocabulary BIOS = Basic Input Output System UEFI = Unified Extensible Firmware Interface POST= Power On Self Test BR = Boot Record (aka MBR) BC =Boot Code (aka
CS370 Operating Systems
CS370 Operating Systems Colorado State University Yashwant K Malaiya Fall 2017 Lecture 27 Virtualization Slides based on Various sources 1 1 Virtualization Why we need virtualization? The concepts and
SNS COLLEGE OF ENGINEERING
SNS COLLEGE OF ENGINEERING Coimbatore. Department of Computer Science and Engineering Question Bank- Even Semester 2015-2016 CS6401 OPERATING SYSTEMS Unit-I OPERATING SYSTEMS OVERVIEW 1. Differentiate
SUSE Linux Enterprise Server: Supported Virtualization Technologies
Technical White Paper Enterprise Linux SUSE Linux Enterprise Server: Supported Virtualization Technologies Table of Contents page Comprehensive Virtualization Support Overview... 2 Upgrade Guidelines...4
NVDIMM Overview. Technology, Linux, and Xen
NVDIMM Overview Technology, Linux, and Xen Who am I? What are NVDIMMs? A standard for allowing NVRAM to be exposed as normal memory Potential to dramatically change the way software is written But.. They
Authors : Ruslan Nikolaev Godmar Back Presented in SOSP 13 on Nov 3-6, 2013
VirtuOS: An operating sytem with kernel virtualization Authors : Ruslan Nikolaev Godmar Back Presented in SOSP 13 on Nov 3-6, 2013 Presentation by Bien Aime MUGABARIGIRA Process Isolation and protection
Kernel Support for Paravirtualized Guest OS
Kernel Support for Paravirtualized Guest OS Shibin(Jack) Xu University of Washington shibix@cs.washington.edu ABSTRACT Flexibility at the Operating System level is one of the most important factors for
Dynamic Probes - Debugging by Stealth
Dynamic Probes - Debugging by Stealth Update and Work-in-Progress Linux.conf.au Australia Suparna Bhattacharya suparna@in.ibm.com IBM Linux Technology Centre 23 January, 2003 Overview 1. What and Why?
THE phenomenon that the state of running software
TRANSACTION ON DEPENDABLE AND SECURE COMPUTING 1 Fast Software Rejuvenation of Virtual Machine Monitors Kenichi Kourai, Member, IEEE Computer Society, and Shigeru Chiba Abstract As server consolidation
An introduction to Docker
An introduction to Docker Ing. Vincenzo Maffione Operating Systems Security Container technologies on Linux Several light virtualization technologies are available for Linux They build on cgroups, namespaces
Parallels Workstation 4.0 Extreme Read Me
Parallels Workstation 4.0 Extreme Read Me Welcome to Parallels Workstation Extreme build 4.0.6740. This document contains the information you should know to successfully install Parallels Workstation Extreme
IA32 OS START-UP UEFI FIRMWARE. CS124 Operating Systems Fall , Lecture 6
IA32 OS START-UP UEFI FIRMWARE CS124 Operating Systems Fall 2017-2018, Lecture 6 2 Last Time: IA32 Bootstrap Computers and operating systems employ a bootstrap process to load and start the operating system
CS Operating Systems
CS 447 - Operating Systems Syllabus Assignments -- Uses Blitz (facultyweb.cs.wwu.edu/~phil/classes/blitz) Environment UNIX (Linux, OS X, NetBSD, FreeBSD...) Should be the same since Blitz is a Virtual
B. V. Patel Institute of Business Management, Computer &Information Technology, UTU
BCA-3 rd Semester 030010304-Fundamentals Of Operating Systems Unit: 1 Introduction Short Answer Questions : 1. State two ways of process communication. 2. State any two uses of operating system according
Monthly Specification Update
Monthly Specification Update Intel Visual Compute Accelerator VCA1283LVV Feb 2017 Intel Server Boards and Systems 2 Monthly Specification Update Revision History Intel Server Boards and Systems Date Modifications
Virtualization. ...or how adding another layer of abstraction is changing the world. CIS 399: Unix Skills University of Pennsylvania.
Virtualization...or how adding another layer of abstraction is changing the world. CIS 399: Unix Skills University of Pennsylvania April 6, 2009 (CIS 399 Unix) Virtualization April 6, 2009 1 / 22 What
Fall 2015 COMP Operating Systems. Lab #3
Fall 2015 COMP 3511 Operating Systems Lab #3 Outline n Operating System Debugging, Generation and System Boot n Review Questions n Process Control n UNIX fork() and Examples on fork() n exec family: execute
T A B L E O F C O N T E N T S
Linux driver - Binary rpm/source rpm user guide and known limitation T A B L E O F C O N T E N T S 1. OVERVIEW... 2 2. DRIVER COMPILATION STEPS... 2 3. OS SUPPORT MATRIX... 2 4. RELEASE CONTENTS... 5 5.
Red Hat Enterprise Linux 7 Kernel Crash Dump Guide. Kernel Crash Dump Configuration and Analysis
Red Hat Enterprise Linux 7 Kernel Crash Dump Guide Kernel Crash Dump Configuration and Analysis Jaromír Hradílek Petr Bokoč Red Hat Enterprise Linux 7 Kernel Crash Dump Guide Kernel Crash Dump Configuration
ECE 550D Fundamentals of Computer Systems and Engineering. Fall 2017
ECE 550D Fundamentals of Computer Systems and Engineering Fall 2017 The Operating System (OS) Prof. John Board Duke University Slides are derived from work by Profs. Tyler Bletsch and Andrew Hilton (Duke)
Testing System Virtual Machines
Testing System Virtual Machines Lorenzo Martignoni 1 Roberto Paleari 2 Giampaolo Fresi Roglia 2 Danilo Bruschi 2 1 Università degli Studi di Udine 2 Università degli Studi di Milano International Conference
Meltdown and Spectre - understanding and mitigating the threats (Part Deux)
Meltdown and Spectre - understanding and mitigating the threats (Part Deux) Gratuitous vulnerability logos Jake Williams @MalwareJake SANS / Rendition Infosec sans.org / rsec.us @SANSInstitute / @RenditionSec
Multi-tenancy Virtualization Challenges & Solutions. Daniel J Walsh Mr SELinux, Red Hat Date
Multi-tenancy Virtualization Challenges & Solutions Daniel J Walsh Mr SELinux, Red Hat Date 06.28.12 What is Cloud? What is IaaS? IaaS = Infrastructure-as-a-Service What is PaaS? PaaS = Platform-as-a-Service
No Crash Dump? No Problem! Light-weight remote kernel crash reporting for settop boxes
No Crash Dump? No Problem! Light-weight remote kernel crash reporting for settop boxes David VomLehn, Technical Leader CELF 2010 Imagine It's the last five minutes of the Superbowl... The game is tied...
Red Hat Enterprise Linux 8.0 Beta
Red Hat Enterprise Linux 8.0 Beta Managing, monitoring and updating the kernel A guide to managing the Linux kernel on Red Hat Enterprise Linux 8 Last Updated: 2018-11-16 Red Hat Enterprise Linux 8.0
The failure of Operating Systems,
The failure of Operating Systems, and how we can fix it. Glauber Costa Lead Software Engineer August 30th, 2012 Linuxcon Opening Notes I'll be doing Hypervisors vs Containers here. But: 2 2 Opening Notes
Performance Tuning Guidelines for Low Latency Response on AMD EPYC -Based Servers Application Note
Performance Tuning Guidelines for Low Latency Response on AMD EPYC -Based Servers Publication # 56263 Revision: 3.00 Issue Date: January 2018 Advanced Micro Devices 2018 Advanced Micro Devices, Inc. All
Chapter 2 Operating-System Structures
This chapter will discuss the following concepts: 2.1 Operating System Services 2.2 User Operating System Interface 2.3 System Calls 2.4 System Programs 2.5 Operating System Design and Implementation 2.6
Virtual Machine Monitors!
ISA 673 Operating Systems Security Virtual Machine Monitors! Angelos Stavrou, George Mason University! Virtual Machine Monitors 2! Virtual Machine Monitors (VMMs) are everywhere! Industry commitment! Software:
Project 3 Improved Process Management
Project 3 Improved Process Management Introduction This project will modernize process management in xv6. All process management will be impacted. New console control sequences will be implemented to support
The only open-source type-1 hypervisor
Monika Danikáková What is Xen? The only open-source type-1 hypervisor For Unix and Unix-like OS Linux, NetBSD and OpenSolaris From ancient greek term Xenos (ξένος), guest-friends Developed by the University
Chapter 2: Operating-System Structures. Operating System Concepts Essentials 8 th Edition
Chapter 2: Operating-System Structures Operating System Concepts Essentials 8 th Edition Silberschatz, Galvin and Gagne 2011 Chapter 2: Operating-System Structures Operating System Services User Operating