A quick overview of METIS v1.2.1

Similar documents
An APEX Dashboard for Energy Trading

TSO-DSO RELATIONS IN THE FUTURE EUROPEAN POWER SYSTEM

General User Manual. Copyright , Better Days Enterprises, LLC West Main Street #119 Rapid City, SD

CORESO A CENTRALIZED REGIONAL SECURITY COORDINATION INITIATIVE. Leading coordination for enhanced reliability of supply

CGM and Energy Data Architecture a TSO Perspective

E.ON UK plc Group Consolidated Segmental Report. for the year ended 31 December 2011

Exhibit to Agenda Item #1a

Eurostat Regions and Cities Illustrated: Usage guide

Construction IC User Guide

DecisionPoint For Excel

Creating labels in Ticket 2000.

OpenESSENCE Quick Start Guide

you choose and by the roles the users are allowed to fulfill within the system. Finances Enter the monthly savings and costs for the project.

GIS DATA SUBMISSION USER GUIDE. Innovation and Networks Executive Agency

USER MANUAL. Contents. Advanced Reporting Tool PRO for vtiger

We appreciate your feedback

Appraisal Module. 1. Introduction 1.01 Changes in this Version. 2. Start Page 2.1 Survey details.

Data Miner 2 Release Notes Release 18.09

MicroStrategy Desktop

Impact of Distributed Generation on the Cost Effectiveness of Large Power Plants

Table of Contents. Preface. SECTION 1 Introduction 1. SECTION 3 Operating Reserve 65. SECTION 2 Energy Market 17

Product Documentation SAP Business ByDesign August Analytics

ESPON Online Mapping Tool. RIMAP User's Manual

Topics Covered. Create and format a column chart Create and format a pie chart Create and format a line chart Use a trendline Insert a sparkline

07/20/2016 Blackbaud Altru 4.91 Reports US 2016 Blackbaud, Inc. This publication, or any part thereof, may not be reproduced or transmitted in any

AMP User Manual Reports

Technology Assignment: Scatter Plots

DASHBOARD PERFORMANCE INDICATOR DATABASE SYSTEM (PIDS) USER MANUAL LIBERIA STRATEGIC ANALYSIS TABLE OF CONTETABLE OF CONT. Version 1.

Reporting Center. Primary (Stand-Alone) Interface

MindSphere. Fleet Manager. Introduction to "Fleet Manager" 1. User interface for "Fleet Manager" 2. User rights in "Fleet Manager" 3.

SolarSpeed Calculator INSTRUCTION MANUAL

User guide for access to DengueNet using Global Atlas

HP Service Manager. Software Version: 9.41 For the supported Windows and UNIX operating systems. SM Reports help topics for printing

Modelling approach and tool

INDEX. A) Various functionalities of the chart 2. B) The Menu Bar 4. C) How to create a portfolio 5. Quick Reference 1) Adding a new chart 7

Supplier Engagement (HE): Dashboard Guidance

Excel 2013 PivotTables and PivotCharts

Getting Started with Crazy Talk 6

On the Road to a Common Market: The European Electricity Market and the Role of Regional Cooperation. Mark Copley 27/05/14

MindSphere. Fleet Manager. Introduction to "Fleet Manager" 1. User interface for "Fleet Manager" 2. User rights in "Fleet Manager" 3

Quick Reference Your Portfolios/SCORECARDs

SmartECR Business Value Through Real-Time Data

Quick Start Guide to Dynamic Templates

Day 1 Agenda. Brio 101 Training. Course Presentation and Reference Material

Chart Winner (Version 1.01)

Excel 2007 New Features Table of Contents

MS Excel Advanced Level

IHS Enerdeq Desktop International Training Guide

GOBENCH IQ Release v

OBIEE. Oracle Business Intelligence Enterprise Edition. Rensselaer Business Intelligence Finance Author Training

SaxoTraderPRO Intro guide

Global Model Workstation Release Log

Electricity Market Development in the Energy Community. Janez Kopač, Energy Community Secretariat 1 st SEERC Power Conference Portorož, 7 June 2016

Microsoft EXAM Analyzing and Visualizing Data with Microsoft Excel. m/ Product: Demo File

BusinessObjects Frequently Asked Questions

EMCO Ping Monitor Free 6. Copyright EMCO. All rights reserved.

MT+ Beneficiary Guide

Podium Plus Data Analysis Software. User Manual. SWIS10 Version

Midwest ISO Overview - ATC Customer Meeting. February 26, 2009

Information Technology and Media Services. Office Excel. Charts

Procedures for cross-border transmission capacity assessments PROCEDURES FOR CROSS-BORDER TRANSMISSION CAPACITY ASSESSMENTS.

Quick Start Guide for Administrators and Operators Cyber Advanced Warning System

User s Guide for California PATHWAYS model version 2.3.2

This document describes the various enhancements and modifications to DRM Windows that occurred between versions and

OPTIMA Data Logging Module - Manual. 1. Data Logging Module Manual. Version 2.0 REV

Models for Nurses: Quadratic Model ( ) Linear Model Dx ( ) x Models for Doctors:

Chronodat Help Desk. (User Manual) By CHRONODAT, LLC

DNS Server Status Dashboard

Chronodat Help Desk (Lite)

Chronodat Issue Tracker Add-in. User Manual CHRONODAT, LLC. February 15, 2017 Version P age

All Excel Topics Page 1 of 11

QST Mobile Application for Android

USER MANUAL. Contents. Analytic Reporting Tool Basic for SUITECRM

Nintex Reporting 2008 Help

Hands-On Lab. Lab: Developing BI Applications. Lab version: Last updated: 2/23/2011

Quality Gates User guide

2. This is a cell; this cell is designated as A1.

Latvijas Banka Statistical Database

RMS Monitoring Software System Operation

Table of Contents 2 QST MOBILE APPLICATION FOR IPHONE

PV-ezDesign Introduction training for Residential project

Excel 2010 Charts and Graphs

Project 4 Financials (Excel)

European regime for interconnection

Customer Release Note

XBID Launch Information Package Published February 2018

Excel. Spreadsheet functions

Monitoring and Evaluation Tool

GIS DATA SUBMISSION USER GUIDE. Innovation and Networks Executive Agency

MicroStrategy Analytics Desktop

FxPro MT4 for Mac User Guide. FxPro MT4. Version 1.0

Operation Manual for Real Time Quotes Service

RL6 - WORKING WITH REPORTS

FOTEMP AssistAnt 2 MAnuAl

WhatsUp Gold 2016 Application Performance Monitoring

How to use the Instant Atlas tools

Working with Prime Network Vision Maps

Business Intelligence for MYOB User Manual v3.3

Terms of Reference. Project: Establishment of Energy Agencies in Ukraine (BMUB, IKI) PN

Cross-Border participation in the GB Capacity Market. Elaine O Connell 15 th January 2015

Transcription:

A quick overview of METIS v1.2.1 SYSTEM MODULE FOR GAS AND POWER POWER MARKET MODULE www.artelys.com

SUMMARY 1. METIS windows 2. Options of generic data visualization window 3. Actions 4. METIS workflow 5. METIS maintenance

METIS SYSTEM MODULE Advanced model of EU power and gas systems Multiple scenarios Minimization of asset variable costs under asset technical contraints For hourly supply demand-equilibrium On multiple zones Data analysis and visualization Maps, Key primary indicators (tables, charts, on a map) Cumulatives, detailed results Scenario modification and aggregation Geographical zone selection and aggregation Modification of parameters

METIS POWER MARKET MODULE Advanced model of power markets Day-ahead, intra-day, balancing Forecasted values at h-1, h-2, h-24 included in database For demand and variable renewables Reserve sizing and unplanned outages Unplanned outages random generator for thermal units Reserve sizing module with different options (hourly, cooperation ) Bidding strategies module Simulation of several bidding behaviors

METIS WINDOWS

STUDY MANAGEMENT WINDOW Use the buttons to manage the studies Double-click to open a study

MAP VIEW Selecting contexts and map navigation Click and drag the mouse to move around the map Switch between different contexts Zoom by using the mouse scroll wheel

LONG TERM STUDY WINDOW Open the long term study window

LONG TERM STUDY WINDOW Handling contexts of the study Timeline : all the contexts are ordered regarding to the year they refer to Select the contexts you want to work with, they will appear in blue here. You can then select them in the upper bar in the map view Right-click on a context to open the context management window

GEOGRAPHICAL INDICATORS To visualize KPIs on the map

GEOGRAPHICAL INDICATORS Select the corresponding decorator. Decorators show their associated KPI for each zone Search for a decorator

GEOGRAPHICAL INDICATORS Decorators options Click on an item to open the pull-down menu Select the view type : Circle : Square : Pie chart : Bar chart : Reset default options Check this option to stop synchronizing options between different decorators (cross filtering) Check the pie icon to add this property to the data used into pie/bar chart

GEOGRAPHICAL INDICATORS To compare the production of two contexts, select the decorator of your choice and turn on the context comparison mode Select the two contexts to compare in the top banner. The reference context is colored purple.

KPI WINDOW To visualize KPIs on a graph or in a table, open the KPI window

KPI WINDOW KPI : key performance indicators KPI search : type a part of the KPI name, select the KPI in the list, type Enter Selection of the KPI View window (see Generic Data Visualization slides for futher details on options)

COMPUTE KPI VIEW KPIs are computed one by one if you select them in the KPI view To compute a group of KPIs, open the compute KPI view : Compute KPI view Filter the KPIs Select KPIs by clicking on them Compute the selected KPIs

COMPARE KPI VIEW To select the KPIs you want to compare and export : Compare KPIs view Filter the KPIs Select KPIs by clicking on them Compare the selected KPIs (see next slide to export them afterward)

REPORTING MODULE : COMPARE KPI VIEW To export KPIs in the compare KPIs view : To avoid refreshing the view while configurating, hold «Ctrl» Choose the «table» graph type Configure files : in this example, - One file for each context and scope («Y»option) - One line for each other value Export to excel Create a pivot table

STASTISTICAL VIEW To visualize the distribution and the quantiles of a given KPI Select distribution chart as graph type Select the number of distribution classes Bar chart or line chart for the distribution Statistical indicators

ZONE WINDOW To open the zone window to access zone data (e.g. cumulative generation curves) Double-click on a zone to open the zone window

ZONE WINDOW or open zone window from another decorator view From any other decorator, double-click on a chart to open the associated zone window

ZONE WINDOW Visualize the energy mix, the cumulative generation, net demand, marginal prices and stocks Selection of the view

ASSET OR MODEL OBJECT WINDOWS To visualize the parameters or the results of a specific asset, open the asset window from the map view Double-click on an asset to open the asset window Use the search button to open a specific asset or a model object such as market parameters

ASSET OR MODEL OBJECT WINDOW Select the view : parameters or detailed asset view Select scopes Click on parameters or results to see them on the graph Visualization window (see Generic Data Visualization slide)

DETAILED ASSET RESULTS WINDOW Detailed analysis : production view, stocks, transmissions, contracts (choose in top banner)

BIDDING MODULE Modelled bidding strategies: Marginal costs strategy (reference) Competitive strategy Fixed-operating costs strategy Oligopoly strategy Results analysis: Dedicated KPI: Production revenue (with strategic bidding) by assets Bid prices visualization over time in zone-associated results window Assumptions: Available on a power system simulation without reserve modelling

BIDDING MODULE: OLIGOPOLY BIDDING STRATEGY Oligopoly bidding strategy depends on ownership distribution and its order Bidding strategy differs with different ownership percentages Bidding strategy differs if, for a given technology, an operator comes after another in the merit order specific to this technology (real marginal costs differ slightly between operators) METIS users can specify their own assumptions on ownership distribution and its order Search for «Ownership distribution» model object in the search window The distribution parameter gives the percentages of ownership The distribution order parameter gives the merit order of operators For each technology, the order starts with 1 (0 corresponds to operators with no ownership in the technology)

BIDDING MODULE: OLIGOPOLY BIDDING STRATEGY Modifying the ownership distribution: Double click on the parameter Import data from a CSV file CSV file format with asset,operator in A1 One column per operator One line per asset Ownership distribution must be specified in % Exemple below : asset,operator edf enbw engie eon rwe CCGT_medium_BE 0 70 0 0 30 CCGT_medium_CH 34 0 0 43 23 CCGT_medium_DE 0 14 85 0 1 CCGT_medium_GB 0 0 0 100 0

OPTIONS OF GENERIC DATA VISUALIZATION WINDOW It is shared by: The asset window The zone window The KPI window

GENERIC DATA VISUALIZATION View tab Add your own configuration (save the current state of all view parameters) Change the configuration : - Default : last known change - METIS : factory settings Table view : Data values Chart view : - Zoom-in : click + drag to the right - Zoom-out : click + drag to the left

GENERIC DATA VISUALIZATION Graph options tab : various settings to change the aspect of a graph Graph type : Bar Chart + Stacked Chart Graph type : PieChart Graph type : Temporal

GENERIC DATA VISUALIZATION Time tab : how to time-aggregate data (not for kpis) Duration of the desired aggregation Operator used to aggregate Monthly + Mean

GENERIC DATA VISUALIZATION Indexes tab To avoid refreshing the view while configurating, hold «Ctrl» Item selection for the given property Data organisation and graph property tools Refresh the selection Create a new group including the selected items Aggregation of selected items

GENERIC DATA VISUALIZATION Indexes tab data organisation and graph properties View validity General function Specific function Comments Alphabetical order Table and charts Order the items Inverse alphabetical order Default order Charts Give different colours to the different item lines One colour Different colours Only works when "Line" is selected Table and charts view the data for all items and the aggregation, or only the aggregation Items + aggregation Aggregation only Table switch between horizontal and vertical display vertical horizontal Charts Change the way items are displayed each item is represented by a different line (or bar, depending on the settings) A new graph is created for each item, ordered horizontally A new graph is created for each item, ordered vertically each item is represented by a new point on the X axis, in one graph - The aspect of the line or the point representing each item may vary regarding graph settings - With "line", the name of the item is not printed on the X label - If there is only one item in the selection, all the choices are equivalent, but X or Y remove undesired information on the X axis

GENERIC DATA VISUALIZATION Indexes tab data organisation and graph properties - Colours Detailed production with : - 3 zones (ES, FR, PT) - 3 technos (CCGT, solar, wind onshore) - Graph type : bar chart

GENERIC DATA VISUALIZATION Indexes tab data organisation and graph properties - Aggregation Detailed production with : - 3 zones (ES, FR, PT) - 3 technos (CCGT, solar, wind onshore) - Graph type : bar chart + +

GENERIC DATA VISUALIZATION Indexes tab data organisation and graph properties Bar chart structure Detailed production with : - 3 zones (ES, FR, PT) - 3 technos (CCGT, solar, wind onshore) - Graph type : bar chart

GENERIC DATA VISUALIZATION Indexes tab data organisation and graph properties Graphs layout Detailed production with : - 3 zones (ES, FR, PT) - 3 technos (CCGT, solar, wind onshore) - Graph type : bar chart

ACTIONS Modify your context by: Changing parameters of an asset or a model object Computing new results Launching action scripts Create new contexts

MODIFYING PARAMETERS To modify an asset parameter open the asset view by double-clicking on the asset on the map Double-click on its value: Type in a new constant value Select a new time series

MODIFYING PARAMETERS To modify a model object parameter Search for it by name in the research view ( parameters view will open on the map), click on it and the Double-click on its value: Change boolean Open the matrix editor Edit matrix values Click «OK» to validate changes

MARKET MODEL OBJECTS AND THEIR PARAMETERS Cluster commitment plan - Coal and lignite running capacities are committed on day-ahead (boolean) Exchange auction - Specify if transmission reservation is explicit or implicit (boolean per country pair) - If explicit, number of hours before actual usage must be specified (number of hours per country pair) National reserve symmetry requirements - Activate symmetry requirements (boolean): assets must procure up and down reserve in equal amounts. Can only be used if there is no reserve procurement regional cooperation (see below). - Requirement per zone (boolean by zone): specify for which zones this requirement applies Europe regional cooperation - Cooperation for reserve procurement. Can only be used if the reserve is hourly - Enable regional cooperation (boolean) - Regions definition (region number by zone): zones in the same cooperation region have the same number Reserve sizing - Reserve is annual / hourly (boolean) - Forecast horizon (in hours) Ownership distribution - Distribution among operators and their merit order for each individual asset (for bidding module) Balancing parameters - Balancing activation fee ( /MWh)

CREATING AND DELETING ASSETS To create new assets or delete others (warning: results are deleted upon such operations) Right-click on the map to open the asset management window

SIMULATION WINDOW To compute results, open the Simulation Window

SIMULATION WINDOW Select the desired test cases and start the simulation Select the test cases in the right scope and the right context Run the simulation Choose the number of processors for simulation

ACTION WINDOW Right-click on the context in the top banner of the map to open the Context actions vindow Add an action - Name your action - Choose between available action scripts - The action will link the current context and the chosen linked context. Launch the action script

ACTION SCRIPTS : RESERVE SIZING Imbalances generation - Creates imbalances according to context demand and renewable capacities - Imbalances files are stocked in database - No linked context Outages generation - Generates outages and puts them in the «Outages» parameter of each thermal asset - If imbalances have been generated, creates new imbalances files including outages - No linked context Reserve sizing - Reads imbalances in database - Computes the sizing according to user options in the model objects : see slide 45 - Sets the reserve parameters in all Reserve assets : - Total requirement - National procurement minimum (if cooperation) - Generates reserve activation to be used by the balancing (in database) - No linked context

ACTION SCRIPTS : LONG TERM TO MARKET, MARKET TO BALANCING Save long term storage - Set linked context to current context - Long term storage levels for hydro reservoir and pumped storage assets are saved to be used in market simulation - To be called after a system simulation and before the market simulation TransferForAfrrBalancing - Set linked context to afrr balancing context - All data and results will be transfered from current (market) context to targeted balancing context TransferForMfrrBalancing - Set linked context to mfrr balancing context - All data and results will be transfered from current (market) context to targeted balancing context

NEW STUDY To create a new study, choose «New study» in the Study menu. After creating a study, a window to create a context will appear : close it without creating a context and see the next slide.

CREATING NEW CONTEXTS To create new contexts (without duplicating others), open the scripting console

CREATING NEW CONTEXTS Import scripts are available to the user to create new contexts Open a script from a Python file Run the currently opened script After the script has finished running, select the new context in the top banner of the map Console window

IMPORT SCRIPTS Free memory.py This script can be used to clear the data in cache memory after importing contexts with other import scripts. Use it only after importing all your scripts as data can be used in several import scripts. For all the following scripts, open them in the console and change their parameters according to comments in the script. In all scripts, countries can be filtered or aggregated. Import_power_system_template.py Use this script to create a system simulation without markets Import power market template.py Use this script to create a market simulation Import_balancing.py Use this script to create a balancing simulation

IMPORT SCRIPTS Import-MDI_1b.py Import-MDI_1c.py Import-MDI_2.py - Import scripts to recreate contexts from the MDI IA, from options 1b, 1c and 2. - Import scripts are based on import_power_market_template.py where parameters have been set according to the various MDI options.

IMPORT SCRIPTS importgas_entsog2030grey.py importgas_entsog2030green.py - Import scripts to create gas system contexts based on ENTSO-G s 2015 GREY and GREEN scenario Import_S5.py - Import script to recreate contexts from METIS S5 study (PCI). ImportGas_NUTS2.py - Import script to create a context of gas infrastructure at the NUTS2 geographical level Import_Nordstream2-Usecase.py - Import script to recreate demo context: assessment of Nordstream2 interconnector project

STOCHASTICITY How to create a context with several test cases Open an import script in the scripting console Choose several climatic years in database by setting a list in the temporalrealizations parameter. To replace values with other stochastic values, open the parameters window for the corresponding Demand and Renewable assets (Availibility). Note : the imbalances generation module will use the original test cases imported from database and can not be used with data from other sources

WORKFLOW

WORKFLOW AROUND THE VARIOUS WINDOWS Data Management Asset window Results Analysis Study management window Import script console Long term study window Opening and map view Main window KPI window Zone window Action window Simulation window

DETAILED WORKFLOW: SYSTEM SIMULATIONS System simulation : data and results analysis KPI window Asset or model object parameters window Map view Zone window Detailed asset results window A system simulation has a unique set of results : Scope «Simulation» : system simulation results All other scopes do not contain any results In all analysis views, results are indexed by their scope. Select one or several scopes Map view : Indicator options KPI window / Detailed asset production window / Zone window : indexes tab Asset or model object parameters : scopes list

DETAILED WORKFLOW: SYSTEM SIMULATIONS Power or Gas System simulation : new system context method 1 1 Long term study window 2 Asset or model object parameters window Map view 3 Action window + Simulation window 4 Results analysis windows To create a new system simulation : Create a new study in Study menu In the long term study window, duplicate a system context from the reference study Modify asset parameters or market options If reserve is modelled, launch imbalances generation, then launch reserve sizing in action window Compute the «Simulation» scope If reserve is modelled and outages should be considered in reserve sizing, launch outages generation, then relaunch full reserve sizing in action window and recompute the «Simulation» scope Analyse results

Power or Gas System simulation : new system context method 2 1 Long term study window 2 Asset or model object parameters window DETAILED WORKFLOW: SYSTEM SIMULATIONS Map view 3 Action window + Simulation window 4 Results analysis windows To create a completely new system simulation from a METIS Database scenario: Create a new study in Study menu Open the import script import_power_system_template.py in the scripting console Specify options of your choosing and launch the script In the newly created context, modify asset parameters If reserve is modelled, launch imbalances generation, then launch reserve sizing in action window Compute the «Simulation» scope If reserve is modelled and outages should be considered in reserve sizing, launch outages generation, then relaunch full reserve sizing in action window and recompute the «Simulation» scope Analyse results

EXAMPLE USING SYSTEM SIMULATIONS: ASSESSING THE ECONOMIC INTEREST OF A NEW INFRASTRUCTURE Assuming you already have a reference context created in your study Otherwise, see earlier slides Three-step process: 1. In the long-term window, duplicate the reference context 2. Modify the parameters of the infrastructure asset 3. Run your System simulation You are ready to analyze your results

Market simulation : data and results analysis DETAILED WORKFLOW: MARKET SIMULATIONS KPI window Asset or model object parameters window Map view Zone window Detailed asset results window A market simulation has several sets of results or «scopes» : «Simulation» : system simulation «Day-ahead» : simulation on day-ahead market «Intraday» : simulation on intraday market «Balancing» :simulation on balancing market 1 Market context (1h steps) 2 Balancing contexts (5 min steps) In all analysis views, results are indexed by their scope. Select one or several scopes Map view : Indicator options KPI window / Detailed asset production window / Zone window : indexes tab Asset or model object parameters : scopes list

DETAILED WORKFLOW: MARKET SIMULATIONS Market simulation : new market context method 1 1 Long term study window 2 Asset or model object parameters window Map view 3 Action window + Simulation window 4 Results analysis windows To create a new market simulation : Create a new study in Study menu In the long term study window, duplicate a market context from the reference study Modify asset parameters or market options Launch imbalances generation, then launch reserve sizing in action window Compute the «Simulation» scope If outages should be considered in reserve sizing, launch outages generation, then re-launch full reserve sizing in action window Launch «Save long term storage» in the action window Compute the «Intra-day» scope (day-ahead will be computed automatically) Analyse results

DETAILED WORKFLOW: MARKET SIMULATIONS Market simulation : new market context method 2 1 Long term study window 2 Asset or model object parameters window Map view 3 Action window + Simulation window 4 Results analysis windows To create a completely new market simulation : Create a new study in Study menu Open the import script import_power_market_template.py in the scripting console Specify options of your choosing and launch the script In the newly created context, modify asset parameters Launch imbalances generation, then launch reserve sizing in action window Compute the «Simulation» scope If outages should be considered in reserve sizing, launch outages generation, then re-launch full reserve sizing in action window Launch «Save long term storage» in the action window Compute the «Intra-day» scope (day-ahead will be computed automatically) Analyse results

DETAILED WORKFLOW: BALANCING SIMULATIONS Market simulation : new balancing context 1 Create new contexts in scripting menu 2 Action window Map view 3 Simulation window 4 Results analysis windows To complete your new market simulation on balancing market : Open «import_balancing.py» in the scripting console and check the zones you want to import. Two new contexts will be created. In your market context, launch «TransferForAfrrBalancing» on the afrr context and «TransferForMfrrBalancing» on the mfrr context from the action window Compute the Balancing scope in the two balancing contexts Analyse results. In these contexts, only balancing results are available

REPORTING BUGS OR MAKING SUGGESTIONS

A WEB-BASED CONNECTION TO THE SUPPORT TEAM Go to: redmine.artelys.com Create an account and send us an email at metis.contact@artelys.com to add you to the METIS European Commission project

HOW TO REPORT A BUG OR A FEATURE Report a new bug for each issue Title uniquely identifies problem In the description Identify if you can reproduce the bug at will, occasionnally, or never Specify precise steps to reproduce bug Describe observed results Explain expected results Add supporting documents Screen shots A copy of the command window Create ticket