VARIATIONS IN CAPACITY AND DELAY ESTIMATES FROM MICROSCOPIC TRAFFIC SIMULATION MODELS

Similar documents
ENHANCED PARKWAY STUDY: PHASE 3 REFINED MLT INTERSECTION ANALYSIS

The negative effects of homogeneous traffic on merging sections

National Roundabout Conference 2005 DRAFT High-Capacity Roundabout Intersection Analysis: Going Around in Circles David Stanek, PE & Ronald T. Milam,

APPENDIX E TRANSPORTATION

Microscopic Traffic Simulation Model Calibration & Validation

Operation of Closed Loop Signal Systems

Microscopic Traffic Simulation

Chapter 16. Microscopic Traffic Simulation Overview Traffic Simulation Models

2/4/2008 S:\TRAFFIC\Modeling\01 Support Materials\Documents\CORSIMcal.doc CORSIM Calibration Parameters

PERFORMANCE EVALUATION OF MOHAKHALI FLYOVER BY USING VISSIM SIMULATION SOFTWARE

An Integrated Model for Planning and Traffic Engineering

Microscopic Simulation Model Calibration and Validation: A Case Study of VISSIM for a Coordinated Actuated Signal System

Ioannis Psarros Department of Civil Engineering and Intermodal Freight Transportation Institute, Memphis, TN

Chapter 5. Track Geometry Data Analysis

ESTIMATING PARAMETERS FOR MODIFIED GREENSHIELD S MODEL AT FREEWAY SECTIONS FROM FIELD OBSERVATIONS

Urban Road Traffic Simulation Techniques

Transport and traffic management by micro simulation models: operational use and performance of roundabouts

Traffic Impact Analysis Shotwell Road Residential Clayton, NC

McTrans. McByte FLORIDA UNIVERSITY OF. TSIS-CORSIM 6.0 Release is Imminent. Analyzing Congested Signalized Intersections. McTrans

Creating transportation system intelligence using PeMS. Pravin Varaiya PeMS Development Group

1.4.3 OPERATING SPEED CONSISTENCY

Microscopic Traffic Simulation

Another Look at the Safety Effects of Horizontal Curvature on Rural Two-Lane Highways

SIMULATION AND ANALYSIS OF ARTERIAL TRAFFIC OPERATIONS ALONG THE US 61 CORRIDOR IN BURLINGTON, IOWA FINAL REPORT

Development and Evaluation of a Procedure for the Calibration of Simulation Models

CORSIM User's Guide. Version 6.0

APPLICATION OF AERIAL VIDEO FOR TRAFFIC FLOW MONITORING AND MANAGEMENT

Real-time Adaptive Control System. Technical White Paper. September 2012 Trafficware SynchroGreen Technical White Paper

DEVELOPMENT OF CALIBRATING MICROSCOPIC SIMULATION MODEL FOR NON-LANEBASED HETEROGENIOUS TRAFFIC OPERATION

Automatically Balancing Intersection Volumes in A Highway Network

Student Guide. Product P2. Validation of TxDOT Flexible Pavement Skid Prediction Model: Workshop

Combined Ranking Method for Screening Collision Monitoring Locations along Alberta Highways

FINAL REPORT THE FLORIDA DEPARTMENT OF TRANSPORTATION SYSTEMS PLANNING OFFICE. on Project. Improvements and Enhancements to LOSPLAN 2007

Fast Automated Estimation of Variance in Discrete Quantitative Stochastic Simulation

NISS. Technical Report Number 109 November, 2000

Ad Hoc Distributed Simulation of Surface Transportation Systems

Evaluation of Seed Selection Strategies for Vehicle to Vehicle Epidemic Information Dissemination

EVALUATION OF ALTERNATIVE DATE DISPLAYS FOR ADVANCE NOTIFICATION MESSAGES ON PORTABLE CHANGEABLE MESSAGE SIGNS IN WORK ZONES

Slides 11: Verification and Validation Models

INPUT DATA PROCEDURES

APPLYING THE TRANSIMS MODELING PARADIGM TO THE SIMULATION AND ANALYSIS OF TRANSPORTATION AND TRAFFIC CONTROL SYSTEMS

MODELS FOR QUEUING SYSTEMS

* Hyun Suk Park. Korea Institute of Civil Engineering and Building, 283 Goyangdae-Ro Goyang-Si, Korea. Corresponding Author: Hyun Suk Park

Detection spacing of DSRC-based data collection system for real-time highway travel time estimation

Enabling Efficient and Accurate Large-Scale Simulations of VANETs for Vehicular Traffic Management

Airside Congestion. Airside Congestion

Section G. POSITIONAL ACCURACY DEFINITIONS AND PROCEDURES Approved 3/12/02

Evaluating the Performance of a Vehicle Pose Measurement System

MIDAS: Proactive Traffic Control System for Diamond Interchanges. Viswanath Potluri 1 Pitu Mirchandani 1

Lecture 5: Performance Analysis I

Optimization of the ALINEA Ramp-metering Control Using Genetic Algorithm with Micro-simulation

Visualization of Internet Traffic Features

EVALUATING EMBEDDED DECISION PROCESSES OF MANUFACTURING SYSTEMS THROUGH SIMULATION. S. Cem Karacal

An Analysis of TDM Impacts on a Corridor Segment Research Findings

TRAFFIC INFORMATION SERVICE IN ROAD NETWORK USING MOBILE LOCATION DATA

1. Estimation equations for strip transect sampling, using notation consistent with that used to

Guidelines for Traffic Counting. May 2013

Performance Evaluation of Non-Intrusive Methods for Traffic Data Collection. Kamal Banger, Ministry of Transportation of Ontario

OR 217,I-5 Experience Portland, OR

Lecture: Simulation. of Manufacturing Systems. Sivakumar AI. Simulation. SMA6304 M2 ---Factory Planning and scheduling. Simulation - A Predictive Tool

The Freeway Performance Measurement System (PeMS) (PeMS Version 3)

Analysis of Air Transportation Network Delays Using Stochastic Modeling

Muresan, Hossain, Fu, Jiang 1. A Trajectory-Clustering Based Method for Integrating Microscopic Traffic Simulation and Emission Estimation Models

EVALUATION OF THE EFFECT OF VMS IN REDUCING CONGESTION USING AIMSUN TOOL: A CASE STUDY OF ARTERIAL ROAD NETWORKS WITHIN THE CBD OF KADUNA

Pavement Surface Microtexture: Testing, Characterization and Frictional Interpretation

Basic Concepts And Future Directions Of Road Network Reliability Analysis

TRAFFIC FLOW SIMULATION USING CORSIM

Simulation with Arena

Bellevue s Traffic Adaptive Signals

Verification Plan: Mitchell Hammock Road. Adaptive Traffic Signal Control System. Prepared by: City of Oviedo. Draft 1: June 2015

Simulation Models for Manufacturing Systems

Rural Expressway Intersection Characteristics that Contribute to Reduced Safety Performance

Fixed Time v Single Stream MOVA Control on a signalled roundabout Helen Simmonite - JCT Consultancy Ltd.

Validation of Simulation Models Using Vehicle Trajectories. TRB Annual Meeting January 11, 2015

Exploring Pavement Texture and Surface Friction Using Soft Computing Techniques

Optimal Detector Locations for OD Matrix Estimation

A Dynamic Shortest Path Algorithm Using Multi-Step Ahead Link Travel Time Prediction

McGill University - Faculty of Engineering Department of Electrical and Computer Engineering

Synchro Studio 10. with Warrants Release Notes

Introduction to Dynamic Traffic Assignment

Estimation of Suitable Grade Value for Stopping Sight Distance Computation on Vertical Curves

SHRP2 Project L07 Analysis Tool for Design Treatments to Address Nonrecurrent Congestion

Synchro Studio 10. with Warrants and TripGen Release Notes

CHAPTER 5 PROPAGATION DELAY

Cpk: What is its Capability? By: Rick Haynes, Master Black Belt Smarter Solutions, Inc.

CITY OF KIRKLAND TRAFFIC IMPACT ANALYSIS GUIDELINES

TRAFFIC SAFETY FACTS. Young Drivers Report the Highest Level of Phone Involvement in Crash or Near-Crash Incidences. Research Note

Spatial Interpolation & Geostatistics

Technical Report of ISO/IEC Test Program of the M-DISC Archival DVD Media June, 2013

Data Analysis and Solver Plugins for KSpread USER S MANUAL. Tomasz Maliszewski

Introducing Network Delays in a Distributed Real- Time Transaction Processing System

Calipatria Solar Farm TIA

Coupled Evaluation of Communication System Loading and ATIS/ATMS Efficiency

HONORS ACTIVITY #2 EXPONENTIAL GROWTH & DEVELOPING A MODEL

OPTIMAL MERGE LAYOUT ARRANGEMENTS FOR THE M50: A MICROSIMULATION MODELLING APPROACH

PTV VISUM - BASE. Introduction to macroscopic network modelling with PTV Visum. PRICE: ####,- DHS plus VAT SHORT DESCRIPTION TARGET GROUP

You ve already read basics of simulation now I will be taking up method of simulation, that is Random Number Generation

Treating Potential Back- of-queue Safety. Developed By:

IMPUTATION OF RAMP FLOW DATA FOR FREEWAY TRAFFIC SIMULATION

Dynamic Traffic Pattern Classification Using Artificial Neural Networks

Transcription:

VARIATIONS IN CAPACITY AND DELAY ESTIMATES FROM MICROSCOPIC TRAFFIC SIMULATION MODELS (Transportation Research Record 1802, pp. 23-31, 2002) Zong Z. Tian Associate Transportation Researcher Texas Transportation Institute The Texas A&M University System 3135 TAMU College Station, TX 77843-3135 Tel: 979-862-2458 Fax: 979-845-9873 E-mail: z-tian@tamu.edu Thomas Urbanik II Professor Department of Civil and Environmental Engineering University of Tennessee Knoxville, TN 37996-2010 Tel: 865-974-7709 Fax: 865-974-2669 Email: turbanik@utk.edu Roelof Engelbrecht Associate Transportation Researcher Texas Transportation Institute The Texas A&M University System Kevin Balke Center Director, Translink Texas Transportation Institute The Texas A&M University System Total Words: 3915 Total Figures: 12 Total Tables:2 Total Combined: 7415

Tian, Urbanik, Engelbrecht, Balke 1 VARIATIONS IN CAPACITY AND DELAY ESTIMATES FROM MICROSCOPIC TRAFFIC SIMULATION MODELS Zong Z. Tian, Tom Urbanik, Roelof Engelbrecht, Kevin Balke Abstract One of the issues involved in using microscopic simulation models is the variation in the simulation results. This study examines some of the more popular microscopic traffic simulation models, CORSIM, SimTraffic, and VISSIM, and investigates the variations in the performance measures generated by these models. The study focuses on the capacity and delay estimates at a signalized intersection. The effect of link length, speed, and vehicle headway generation distribution are also investigated. The study finds that CORSIM yields the lowest variations in performance measures while SimTraffic yields the highest variations in performance measures. The highest variation in each simulation model normally occurs when the traffic demand approaches capacity. The study also finds that delays are affected by the link length and speed in simulation models. Such an impact on delays is closely related to the range of speed variations. In general, shorter links and higher link speeds result in lower delays. There is no strong evidence that the headway distribution used to generate vehicles in the simulated network has any effect on the capacity and delay estimates. Multiple simulation runs are necessary to achieve an accurate estimate on the true system performance measures. With a 10 percent error range in estimated delay, 2 to 5 runs may be enough for under-capacity conditions, but more than 40 multiple runs may be necessary to accurately estimate delay at, near, or over capacity. Key Words: Simulation, Capacity, Delay, Variation

Tian, Urbanik, Engelbrecht, Balke 2 Introduction With advances in computing technology and the ever-increasing power of personal computers, many sophisticated stochastic microscopic simulation models have been developed in the area of transportation engineering. Improved user interfaces have significantly reduced the effort needed to code and interpret the results of these simulation models. As a result, more traffic engineers are relying on microscopic simulation models to analyze complex transportation problems where analytical methods cannot provide satisfactory solutions. On the other hand, the easy-to-use features of many simulation models also present a number of challenges, one of which is that non-experienced users are not aware of the potential variations in the output of stochastic simulation models. While some users may have realized the importance of reporting results from multiple runs, time and budget often constrains them from doing so. An important aspect of stochastic simulation modeling is that each simulation run produces different results. Therefore, it is important to understand what factors contribute to the variations. It is the purpose of this paper to examine three commonly used traffic simulation models, and to investigate the range of results these models produce, and the conditions affecting the variability A number of studies [1,2,3] have compared the results of various traffic simulation models to analytical models, such as the Highway Capacity Manual (HCM) [4]. These studies usually focus on comparing the results produced by different models and make recommendations on which simulation model better replicates the results of either the HCM or field data. The results from simulation models are usually based on the average values from an arbitrary number of runs and simulation times, e.g. 10 runs with a one-hour simulation time. No studies, however, have investigated how the performance measures vary between different simulation models. Traffic engineers and researchers need to know when it is necessary to perform multiple runs and how many runs are needed in order to yield reasonable estimates in the performance measures. The scope of this paper is limited to signalized intersection operations. First, a simple case with a single-lane approach and 100% through traffic is presented. Another case considers a single-lane approach with a right-turn pocket, where the variations depend not only to general driver and vehicle characteristics, but also on the stochastic process of queue blocking occurrences. Three of the most popular simulation models currently being used in the U.S. are examined: CORSIM [5], SimTraffic [6], and VISSIM [7]. Finally, a summary and some conclusions are provided, and

Tian, Urbanik, Engelbrecht, Balke 3 recommendations are then made for general applications of simulation models in practice. Simulation Model vs. Analytical Model Delay is one of the major performance measures for transportation systems. However, different methodologies are usually used to calculate delay in simulation models and analytical models, such as the HCM. Detailed results and discussions on this issue can be found in several studies [1,2]. While the focus of this paper is on the variations in performance measures, it might still be useful to illustrate what results are expected when the default parameters of each simulation model are used. The differences between the delays produced from simulation and those calculated using the HCM methodology for signalized intersections is summarized below. The HCM reports an average control delay, which includes the deceleration, queue moving time, stopped time, and the acceleration. However, the length of an approach as well as the speed that may contribute to the acceleration and deceleration portions of control delay is not specifically considered. For example, higher speeds may require longer deceleration and acceleration times. Most simulation models report average total delay, which is measured as the difference in travel time at a lower speed compared to the travel time at the free-flow speed. Therefore, total delay includes control delay and other delays resulting from conditions such as normal congestion and car following. CORSIM (Version 4.32 and earlier) and SimTraffic report total delay on a link basis. Therefore, the delay associated with accelerating to free-flow speed, which typically occurs on the downstream link, is not accounted for in the delay computations. In VISSIM, however, the user can define segments on which to collect delay statistics. Therefore, delay from VISSIM can be collected to account for the acceleration by defining the correct travel time segment. A newly released version of CORSIM (5.0) incorporates a methodology to take into account the acceleration so that it is consistent with the HCM s delay definition [1]. Since CORSIM 5.0 was still under beta testing at the time of conducting simulation runs in this research, CORSIM 4.32 was used in this study. However, the major conclusions of this study still remain valid. The HCM reports delay for the vehicles arriving during the analysis period, while simulation models only report delay for the vehicles departing during the analysis period. When under-

Tian, Urbanik, Engelbrecht, Balke 4 saturated, the input demand equals the throughput flow, and the difference is usually negligible when using a relatively long simulation period (e.g., 15 minutes). However, the difference can be significant if over-saturated conditions exist. Simulation models automatically take into account the residual queues from the previous time period. Although the HCM provides guidelines on how to consider the residual queue effect, most HCM-based analytical software packages, for example the HCS software, do not compute the delay associated with residual queues. Unlike deterministic analytical models, simulation models are driven by samples of random variables from probability distributions. These random variables may have large variances. As a result, these estimates could, in a particular simulation run with a particular random seed, differ greatly among different runs of the model. The net effect is that there could be a significant probability of making erroneous inferences about the system under study if this variability is not taken into account. Several factors may affect the range of variations. In general, the variation can be reduced by using a longer simulation period or increasing the number of multiple runs. On the other hand, some simulation models, such as CORSIM may have adopted Variance Reduction Techniques (VRTs) in the model structure [8]. The purpose of VRTs in simulation is to somehow reduce the variance of an output random variable of interest such as delay without disturbing its expectation (the average). Such techniques, if properly used, can normally obtain greater precision, e.g., smaller confidence intervals, for the same amount of simulation effort. The Study Cases Case 1: A Single-Lane Approach with 100% Through Traffic The first case studied involves a single-lane approach at a signalized intersection. The following assumptions are made for further analyses: The length of the approach is 760 meters (2500 feet). The free-flow speed is 73 km/hr (45 mi/hr). The traffic flow consists of through vehicles only, all of which are passenger cars with 6.1 meters (20 feet) bumper-to-bumper spacing. The signal timing has a 90 second cycle, and a 50 second effective green.

Tian, Urbanik, Engelbrecht, Balke 5 All other default parameters of each simulation model are used, including driver characteristics and car-following characteristics. In microscopic simulation models, vehicles are usually generated based on a certain headway distribution. CORSIM provides three types of vehicle generation distributions: uniform distribution, normal distribution, and Erlang distribution. Both VISSIM and SimTraffic use a negative exponential distribution, a special case of the Erlang distribution. The default distribution in CORSIM is uniform distribution, and is used for the analysis in Case 1. The effect of different vehicle distributions is addressed in a later section of the paper. A range of traffic flow conditions is investiaged, and the HCM methodology is used to derive the delay and capacity results for each condition, using the HCM default saturation flow rate of 1900 passenger cars per hour green. These traffic flow conditions are included in Table 1. The capacity of the approach is obtained from Equation (1): c = g / C s = 50 / 90 1900 = 1056 ( vph ) (1) where c g C s = approach capacity, vph = length of effective green, sec = cycle length, sec = saturation flow rate, vph (Table 1) The traffic conditions defined in Table 1 are simulated using CORSIM, SimTraffic, and VISSIM. A total of 30 multiple runs are conducted for each traffic flow condition. A 30-minute total simulation time is used for each run, and the results from the second 15-minute interval are reported. Using a 15-minute interval in the simulation is consistent with the 15-minute analysis period used in the HCM. The same simulation settings are applied for all the study scenarios throughout this study. Both the throughput flow rates and the delays from the simulation models are analyzed.

Tian, Urbanik, Engelbrecht, Balke 6 Figures 1 to 3 illustrate the throughput flow rates from the three simulation models based on different levels of traffic demands (simulation input). The results from each individual run, the average of 30 runs, and the range of variations are depicted. The average throughput flow rates should match the traffic demand input for under-capacity conditions. Each simulation model produces a maximum throughput flow rate, which can be used as an estimate of the capacity condition for that particular model. Please note that each model produces a different capacity value than the HCM, since the default model settings were used in this study. In other words, no effort was made to calibrate the models to the capacity predicted by the HCM Different levels of variation can be observed for the three models. CORSIM produces the lowest variations, while SimTraffic produces the highest variations. The highest variations for each model are observed when traffic demand is close to the capacity condition. For example, at the HCM demand level of (v/c) HCM = 1.1 (1162 vph), the throughput flow rates in CORSIM range between 1088 vph and 1160 vph. For SimTraffic, the highest variation occurs at (v/c) HCM = 0.9 (950 vph), where the throughput flow rates range between 780 vph and 1028 vph. In VISSIM the highest variation occurs at (v/c) HCM = 1.05 (1109 vph), where the throughput flow rates range between 1060 vph and 1132 vph. The variations tend to decrease once the traffic demand is significantly higher than the capacity. (Figures 1 3) Figure 4 illustrates the average of the throughput flow rates from the simulation models along with the input traffic demand curve. For under-capacity conditions, the average throughput flow rates from the simulation models all match closely to the input traffic demands. The capacity conditions that each simulation model produces are also demonstrated, which vary from the HCM values depending on the model. SimTraffic yields the lowest capacity value at approximately 1025 vph, and VISSIM yields the highest capacity value at approximately 1145 vph. The estimated capacity from CORSIM is about 1130 vph. (Figure 4)

Tian, Urbanik, Engelbrecht, Balke 7 Similarly, the delay results from each individual run are illustrated in Figures 5 to 7. A similar pattern can be observed in the variations from each simulation model. Again, CORSIM yields the lowest variation in delays, while SimTraffic yields the highest variation in most of the simulation runs. The highest variations occur at the capacity level and slightly beyond. For example, the delays in CORSIM range between 23.4 sec/veh and 71.5 sec/veh close to its capacity condition (at (v/c) HCM = 1.1, or 1162 vph), and the delays in SimTraffic range between 27.9 sec/veh and 248.4 sec/veh at the (v/c) HCM ratio of 1.0 (1056 vph). For VISSIM the delays range from 20.8 sec/veh to 79.7 sec/veh at the (v/c) HCM ratio of 1.1 (1162 vph). (Figures 5 7) It is suspected that the lowest variations in CORSIM may be due to the use of the uniform distribution in generating vehicles. However, a further investigation to be conducted later in this section indicates that the same level of variations is achieved in CORSIM when other types of vehicle distributions are used. Figure 8 illustrates the average delays from the three models along with the results from the HCM. Recognizing the differences among the delays produced by different models and the specific conditions assumed in the simulation models (link length of 760 m and speed of 73 km/h), the results indicate that the delays from CORSIM match closely the HCM results for under-capacity conditions. SimTraffic results in slightly higher delays and VISSIM results in slightly lower delays than the HCM. A dramatic increase on delay can be observed once the capacity condition is reached. Keep in mind that each model produces slightly different capacity results when the default parameters are used. (Figure 8) Figure 8 indicates that the delays reported from the simulation models somewhat deviate from the HCM results, especially when the capacity condition is reached. Besides the differences in delay calculations in each model discussed earlier, the results from simulation may be specific to the conditions assumed in the models. The length of the link and the travel speed are the two elements that the HCM does not specifically consider in its methodology. With this in mind,

Tian, Urbanik, Engelbrecht, Balke 8 another set of simulation runs was conducted using a different link length and travel speed. Figure 9 shows the results from these runs with the CORSIM model. As can be observed from the figure, link length and travel speed do affect the delay results. For the cases studied, lower delays result from using shorter link length, and higher delays result from using lower speed. However, the capacity values appear to remain the same. Similar results are also found in SimTraffic. However, the delays are identical in VISSIM when different speed and link length are used. There are two possible explanations for the above results. The first reason is that a portion of the delay occurs while traveling on the link following a slower leading vehicle. Longer links provide more opportunity to accrue additional, non-control delay in this manner. The second reason is associated with the speed distribution assumed in each model. Both CORSIM and SimTraffic assume 10 different driver types, each has a specified speed relative to the link s free-flow speed. For example, driver type 1 has a speed that is 75% of the free-flow speed, and driver type 10 has a speed that is 127% of the free-flow speed. In VISSIM, however, there is no such a default speed distribution, and the user has to define a speed distribution profile. In our study, the speed distribution is defined in such a way that the 85 th percentile speed is taken as the free-flow speed, and the minimum and maximum speeds are obtained by subtracting from and adding 10 km/hr to the 85 th percentile speed. As a result, both CORSIM and SimTraffic would result in higher speed variations than VISSIM. Larger speed variations result in larger potential delays to following vehicles. Since CORSIM and SimTraffic define speed variation as a percentage of free flow speed, higher free-flow speed leads to larger speed variations and a larger amount of non-control delay accrued on a link. (Figure 9) The effect of different headway distributions is further investigated using CORSIM, where the three types of headway distributions are applied to Case 1 presented earlier. Figure 10 illustrates the delay results based on the three headway distributions: uniform, normal, and negative exponential. The standard errors on the delays are also shown in the figure. In conducting the study, the default saturation headway of 1.8 second is replaced by 2.0 second to achieve better correlation with the HCM results. It can be seen that different headway distributions yield negligible differences on the delays. The capacity values are also almost identical. The same low level of delay variations is obtained under the low traffic volume conditions. When traffic

Tian, Urbanik, Engelbrecht, Balke 9 demand approaches capacity, the exponential distribution does result in different levels of variations compared to the normal and uniform distributions, but no consistent conclusions can be drawn. It is also interesting to note that a non-monotonic trend is observed on the variations for all the three models tested. It is suspected that when a link is highly saturated, drivers tend to behave more uniformly, resulting in less variation on the capacity and delays. (Figure 10) Case 2: A Single-Lane Approach with a Right-Turn Pocket This case is derived from a real-world application. At a signalized intersection, the projected traffic volume is 1150 vph on the eastbound approach with 230 right-turn vehicles and 920 through vehicles (all passenger cars). The current HCM procedure only considers a shared lane situation or an exclusive lane situation. The effect of queue blocking on the right-turn pocket is not modeled specifically. Based on the HCM methodology, the capacities and LOS for the approach with a single shared lane and with an exclusive right-turn lane can be obtained. Using a 90-second cycle length and a 50-second effective green (identical to that in Case 1), the approach would operate at LOS F with a v/c ratio at 1.25 if the approach has a single shared lane configuration. With an exclusive right-turn lane, the through movement, the critical movement of the approach would operate at LOS C with a v/c ratio at 0.87. The result indicates that a rightturn pocket is needed to handle the projected traffic demand. Due to the topography and the right-of-way constraints, constructing a longer-than-necessary right-turn pocket can be costly. The purpose of the investigation is to determine the minimum length of the right-turn pocket to accommodate the projected traffic demand. Traffic operations based on different length of right-turn pocket (long enough to store N vehicles) are analyzed using CORSIM. Figure 11 illustrates the estimated capacity values for the eastbound approach based on various lengths of right-turn pockets. The capacities in this case are estimated based on the throughput flow rates where the input traffic demands in the simulation are set high enough to block the right-turn pocket every cycle at the beginning of the green phase. It can be seen that the standard error ranges between 5 to 8 veh/hr, which is higher than that in Case 1. Such an increase on the variations is primarily due to the added random elements on traffic flow. It can be observed that the capacity for the eastbound approach is reached at

Tian, Urbanik, Engelbrecht, Balke 10 approximately N = 4 cars (the throughput flow rate is approximately 1150 vph), although each individual run may still vary significantly. (Figure 11) Figure 12 illustrates the delay results associated with the length of the right-turn pocket. It can also be observed that high variations exist for at or over-capacity conditions (with N less than 4 cars). Once N reaches 5 cars or longer, the approach will function under capacity, and the variation in delay is significantly reduced. Although over-capacity conditions also exist with N between 2 and 4, the variation in delay are not as high as that in Case 1, and the average delays are still within range between LOS C and D. Based on the results of the analysis, it may be recommended that the right-turn pocket be designed with a length of 2 or 3 vehicles to minimize the construction cost while still maintaining acceptable operations most of the time. However, occasional breakdowns may be expected with this design (Figure 12) Number of Simulation Runs Due to the variations in results of micro-simulation models, multiple runs must be conducted in order to provide an accurate estimate on the true performance measures. Based on the theory of probability and statistics, Equation 2 can be used to estimate the required number of runs to provide an estimate of the mean with a specified confidence interval and an error range. 2 zα / 2σ n = E (2) where n = required number of simulation runs s = sample standard deviation (based on 30 multiple runs from this study) z a/2 = the threshold value for a 100(1-a) percentile confidence interval. With a 95% confidence interval, z a/2 = 1.96 E = the allowed error range Using the above equation and the delay results presented in Case 1, the required number of runs

Tian, Urbanik, Engelbrecht, Balke 11 are calculated with a 95% confidence interval and a 10% error range, as presented in Table 2. A 10% error range is considered acceptable for general practice, since it provides sufficient accuracy to predict the correct LOS about 60% of the time over a delay range between 0 and 80 seconds. For the remaining 40% the predicted LOS would be within one level of service of the actual level of service. (Table 2) As the results in Table 2 indicate that the highest number of runs is required for at and over capacity conditions due to the high variations. For example, a total of 45 runs are necessary for CORSIM at the level of (v/c) HCM = 1.1. An even higher number of runs are necessary for SimTraffic and VISSIM due to high variation of the resulting delay measures. Both SimTraffic and VISSIM also indicate a higher number of runs at the lower traffic demand levels. Because the delay values are usually small for low traffic demand conditions, a biased estimate based on a fewer number of runs may not be a concern in general practice. In general, 2 or 5 multiple runs may be sufficient for under-capacity conditions. However, when the traffic demand is at or over the capacity level, at least 40 runs may be necessary depending on the model to be used. The number of runs may be reduced by using a longer simulation time, as shown by the VISSIM 15- minute and 1-hour results in Table 2. However, only a 15-minute period would be consistent with the HCM procedures. A dilemma situation occurs in practical applications, however, in that the capacity condition is usually an unknown parameter. As a general guideline, it is recommended that at least 2 runs be conducted under any conditions. Whenever a capacity condition is suspected (a high delay is obtained from an individual run), more runs are necessary to achieve more accurate estimates. Summary and Conclusions This paper presents the results of an investigation into the variation produced by three commonly used microscopic traffic simulation models: CORSIM, SimTraffic, and VISSIM. Variations in both the delay and the throughput traffic flow rates are examined based on different traffic flow conditions. The following conclusions are reached this study:

Tian, Urbanik, Engelbrecht, Balke 12 For the three models tested, CORSIM produces the lowest variation in both delay and throughput flow rates, while SimTraffic produces the highest variations. The highest variations occur when capacity conditions are reached. The lower variations in CORSIM may due to the variance reduction techniques applied in the CORSIM model. When the average values are considered from multiple runs, the throughput flow rates from all the three models match the input demand closely for under-capacity conditions. The three simulation models tested produced different results when using the default traffic flow parameters from each simulation model. In general, VISSIM produces the highest capacity and lowest delay estimates, while SimTraffic produces the lowest capacity and highest delay estimates. All the three simulation models tested in this study illustrate a non-monotonic trend in the variations of the performance measures. It is suspected that when a link is highly saturated, drivers tend to behave more uniformly, resulting in reduced variations on the performance measures. While link length and speed are not factors in the HCM methodology for delay calculation, the study found that the link length and the link speed directly affect the delays in microsimulation models. In general, the simulation models would produce lower delays with shorter links or with higher speeds. Such an impact is mainly due to the speed variability and car-following behavior. The headway distribution used to generate the vehicles does not show a significant effect on delay and capacity estimates as well as on the variations, based on a test performed with CORSIM. Variations can be reduced by either using a longer simulation period or conducting more runs. It is also important to realize the differences between simulation and analytical method when reporting the performance measures, such as delay. While longer runs are desired to reduce the variations, only a 15-min period would be consistent with the HCM procedure. This is especially important when modeling varied traffic demand over time. To produce a reasonable estimate of the average conditions, it is recommended that at least 2 runs be conducted for low to medium traffic demand level. For near and over capacity conditions, at least 20 runs are recommended. This recommendation is based on the simplest case tested in this study. Higher variations are expected for most practical applications, therefore, more simulation runs may be necessary. Simulation models should include

Tian, Urbanik, Engelbrecht, Balke 13 automated utilities to perform multiple runs and aggregate the results. Alternatively, simulation models should be designed to allow users to develop such utilities. References: 1. Zhang, Y., Zhang, L., and Owen, L. Control Delay Definition, Modeling and Calculation in CORSIM. 80 th Annual TRB Meeting, CD-ROM Preprint, Washington, D.C., January, 2001 2. Milam, RT;Choa, FRT. HCM & CORSIM - Resolving the Differences. Compendium of Papers. Institute of Transportation Engineers 2000, District 6 Annual Meeting, San Diego, California. 3. Bloomberg, L;Dale, J. Comparison of VISSIM and CORSIM Traffic Simulation Models on a Congested Network. Transportation Research Record 1727. 4. Transportation Research Board, Highway Capacity Manual 2000. Washington, D.C., 2000. 5. Federal Highway Administration. CORSIM User s Manual, Version 4.32. Office of Safety and Traffic Operations R&D, Intelligent Systems and Technology Division, McLean, Virginia, June 1999. 6. Trafficware Corporation. Synchro 4, Traffic Signal Coordination Software. Albany California, 1999. 7. PTV Planung Transport Verkehr AG. User Manual, VISSIM 3.50. Stumpfstraße 1, D-76131 Karlsruhe, Germany, 2001. 8. Rathi, AK;Venigalla, MM. Variance Reduction Applied to Urban Network Traffic Simulation. Transportation Research Record 1365, 1992.

Tian, Urbanik, Engelbrecht, Balke 14 1200 1100 20.0 Throughput Flow Rate, veh/hr 1000 900 800 700 600 500 400 300 200 100 0 15.0 HCM Capacity 10.0 5.0 Standard Error 0.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Standard Error, veh/hr Figure 1 Throughput Flow Rates from CORSIM

Tian, Urbanik, Engelbrecht, Balke 15 1200 20.0 1100 1000 Throughput Flow Rate, veh/hr 900 800 700 600 500 400 300 HCM Capacity Standard Error 15.0 10.0 5.0 Standard Error, veh/hr 200 100 0 0.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 2 Throughput Flow Rates from SimTraffic

Tian, Urbanik, Engelbrecht, Balke 16 1200 20.0 1100 1000 Throughput Flow Rate, veh/hr 900 800 700 600 500 400 300 200 HCM Capacity Standard Error 15.0 10.0 5.0 Standard Error, veh/hr 100 0 0.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 3 Throughput Flow Rates from VISSIM

Tian, Urbanik, Engelbrecht, Balke 17 1300 Demand 1200 VISSIM Throughput Flow Rate, veh/hr 1100 1000 900 HCM Capacity SimTraffic CORSIM 800 700 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 4 Average Throughput Flow Rates

Tian, Urbanik, Engelbrecht, Balke 18 1000.0 20.0 Average Delay, sec/veh 100.0 10.0 15.0 10.0 5.0 Standard Error, sec/veh 1.0 Standard Error 0.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 5 Delay Results from CORSIM

Tian, Urbanik, Engelbrecht, Balke 19 1000.0 20.0 Average Delay, sec/veh 100.0 10.0 15.0 10.0 5.0 Standard Error, sec/veh Standard Error 1.0 0.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 6 Delay Results from SimTraffic

Tian, Urbanik, Engelbrecht, Balke 20 1000.0 20.0 Average Delay, sec/veh 100.0 10.0 15.0 10.0 5.0 Standard Error, sec/veh Standard Error 1.0 0.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 7 Delay Results from VISSIM

Tian, Urbanik, Engelbrecht, Balke 21 1000.0 Average Delay, sec/veh 100.0 10.0 HCM CORSIM SimTraffic VISSIM 1.0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 8 Average Delays from Different Models

Tian, Urbanik, Engelbrecht, Balke 22 100.0 Average Delay, sec/veh 90.0 80.0 70.0 60.0 50.0 40.0 30.0 20.0 10.0 0.0 HCM Base - 760 m/73 km/h Shorter Link - 305 m/73 km/h Lower Speed - 760 m/48 km/h 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 9 Effect of Link Length and Speed on Delay

Tian, Urbanik, Engelbrecht, Balke 23 100.0 20 90.0 Uniform - Delay Average Delay, sec/veh 80.0 70.0 60.0 50.0 40.0 30.0 20.0 Normal - Delay Exponential - Delay Uniform - S.E. Normal - S.E. Exponential - S.E. 15 10 5 Standard Error, sec/veh 10.0 0.0 0 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1.1 1.2 Traffic Demand Based on HCM v/c Ratio Figure 10 Effect of Vehicle Generating Distribution

Tian, Urbanik, Engelbrecht, Balke 24 1400 20 Estimated Capacity, vph 1300 1200 1100 y = 19.128x + 1067.7 R 2 = 0.9741 15 10 5 Standard Error, veh/hr Standard Error 1000 0 0 1 2 3 4 5 6 7 8 9 10 11 Length of Right-Turn Pocket, Cars Figure 11 Capacity Estimates with Regard to Length of Right-Turn Pocket

Tian, Urbanik, Engelbrecht, Balke 25 160.0 140.0 LOS Average Delay, sec/veh 120.0 100.0 80.0 60.0 40.0 20.0 0.0 0 1 2 3 4 5 6 7 8 9 10 11 Length of Right-Turn Pocket, Cars F E D C B A Figure 12 Delay Estimates with Regard to Length of Right-turn Pocket

Tian, Urbanik, Engelbrecht, Balke 26 Table 1 Traffic Flow Conditions Traffic Demand, veh/hr HCM v/c Ratio Uniform Delay, d 1, sec/veh Incremental Delay, d 2, sec/veh Average Control Delay, d, sec/veh 106 0.1 9.4 0.2 9.6 211 0.2 10.0 0.4 10.4 317 0.3 10.7 0.7 11.4 422 0.4 11.4 1.1 12.6 528 0.5 12.3 1.7 14.0 633 0.6 13.3 2.5 15.9 739 0.7 14.5 3.9 18.4 844 0.8 16.0 6.4 22.4 950 0.9 17.8 12.1 29.9 1056 1.0 20.0 27.7 47.7 1108 1.05 20.0 41.8 61.8 1161 1.1 20.0 59.2 79.2 1214 1.15 20.0 78.7 98.7 1267 1.2 20.0 99.3 119.3

Tian, Urbanik, Engelbrecht, Balke 27 Table 2 Required Number of Simulation Runs Traffic Demand (Based on HCM v/c Ratio) CORSIM SimTraffic VISSIM- 15min VISSIM-1hr 0.1 2 18 56 6 0.2 3 15 18 2 0.3 4 13 10 2 0.4 2 8 9 1 0.5 2 4 7 1 0.6 1 6 8 2 0.7 1 5 7 1 0.8 1 11 6 1 0.9 1 58 4 1 1.0 2 137 13 2 1.1 45 25 57 18 1.2 14 18 1 1 Note: Traffic demand is determined based on the v/c ratio from the HCM. Each simulation has a different capacity condition. The HCM v/c ratio at 1.0 does not necessarily mean the capacity condition for a particular model.