USE OF AUGMENTED REALITY IN THE CONSTRUCTION INDUSTRY ANOOP SATTINENI Auburn University Abstract- The role of visualization in the construction industry is extremely crucial in communicating the intent of the design team to the various stakeholders on a project including the construction team. This paper considers the use of Augmented Reality (AR) technology to aid the construction team on the jobsite. The role of ARin various circumstances within the construction industry is explored. The Epson BT-200 device was used in the conduct of this research. The need for contextual 3D models on a jobsite is examined. Other applications for AR in the construction industry, including remote assistance, confined space usage, facility maintenance and management are explored. Preliminary studies of using AR on a construction site is explored. A review of the EpsonMoverio BT-200 for usage in a construction environment is also presented. A discussion of upcoming devices is considered. Keywords- Augmented Reality, Construction, Epson BT-200, Confined Spaces, Remote Assistance, Contextual 3D Models I. INTRODUCTION Visualization in the Architecture, Engineering and Construction (AEC) domain has always been a crucial element [1] Digital visualization tools such as Building Information Models (BIM) have become the norm in the industry to transfer information between various stakeholders in a construction project.. Due to the fragmented nature of the construction industry, interpretations of the physical site characteristics often vary based on each specific trade contractor. For example, an HVAC contractor looks at a space above the ceiling and develops an HVACspecific construction plan to fulfil contractual requirements. The HVAC contractor does not necessarily consider the work of other trades in the same space. Recent technologies such as Building Information Modelling (BIM) provide the general contractor the means to digitally coordinate the work of various trades in that space through clash-detection procedures. However, the foreman & construction workers in-charge of installing the equipment/materials cannot immediately visualize the physical space and consider the work of all the other trades while they are working. AR devices are capable of producing contextual images, that when viewed in real-time can guide the HVAC contractor (in this example) to the proper places within a space to install their equipment. Augmented Reality technology involves a live direct or indirect view of a real world object/environment and supplementing it with contextual computer generated information [2]. AR technology has the potential to improve the processes on a construction site by providing rich contextual information to project superintendents, foremen and subcontractors [3]. 1.1 Future of Wearable AR Devices The use of AR is increasing across multiple industries. The AR sector is expected to be $130 billion in size by the year 2020 [4]. These devices are increasingly used by technology enthusiasts in multiple industries. The applications being developed for the industry are also increasing at a fast pace, in an effort to catch up with user demand for industry specific applications. With the advent of technology giants such as Microsoft, Facebook and Sony creating devices for this sector, it is without a doubt the next big innovation that is about to become mainstream.the use of AR based images has been on the rise in the construction industry since the advent of mobile devices such as tablets and smart phones. In this research, a wearable mobile device specifically to use in conjunction with AR technology is proposed for the construction industry. For the conduct of this research, the Epson Moverio BT-200 glasses were used to test AR device based visualizations for various construction related applications. II. AR DEVICE OVERVIEW The Moverio (headset only) weighs approximately 90 grams and was found to be comfortable to wear, as discovered in the course of this research. The view itself is comprised of 960x540 pixels on each screen of the binocular headset, equivalent to a 40-inch television from approximately 8ft. The interface itself is an Android based home screen that can be customized by installing new applications and placing them in appropriate locations, as shown in Figure 1. Not all Android applications are capable of running on the Moverio as several applications available through the Google Play store are created for specific devices. The Moverio itself has a built-in app store that can be used by software developers to create and distribute apps. The Android controller easily fits in the palm of the user so that it can be operated by using the thumb, therefore requiring only one hand to operate the device. The device is capable of connecting to any Wi-Fi network enabling online connectivity. The headset has a camera capable of 1
taking pictures and video, as shown in Figure 1. The built-in camera can also be used to have video conferences and can be used by software developers to create interactive applications. However, the pictures taken by the Moverio camera were found to be very grainy. The device can also be connected to headphones or other devices for sound. environment and also visualize BIM models, as shown in Figure 3. The figure shown is a Smart Reality Application developed by JB Knowledge, specifically for use in the construction industry through the Moverio glasses. Figure 1: Moverio BT-200 AR Glasses, Android Controller and the Head Mount Camera III. AR APPLICATIONS FOR THE CONSTRUCTION INDUSTRY The use of AR was first introduced in the construction industry by Vela Systems, a company that was later acquired by Autodesk [5]. The application developed by Vela Systems was capable of showing contextual 3D models using a tablet device, as shown in Figure 2. In the course of this research, several applications of AR in the construction were considered. Several construction industry professionals who are currently engaged in the Virtual Design and Construction arena volunteered to try the BT-200 and provided feedback regarding the usability of the device in the construction industry. The following are some applications that were found to be promising for use in the construction industry. The following sections discuss these issues in greater detail. Figure 2: Use of Augmented Reality in Construction [5] 1.2 Contextual 3D Models Since the use of pioneering applications of AR in construction, such as Vela Systems, it was always considered useful to be able to view contextual 3D images to visualize relevant information[6]. The BT- 200 is an upgrade from early AR devices used in the construction industry, chiefly because the device can be used hands-free. Construction field personnel are reluctant to carry too many devices around on a jobsite. The Moverio allows the user to be connected, be able to see their immediate surrounding Figure 3. Use of Smart Reality App for construction Since the Moverio glasses are also capable of tracking the head movements of the user, the 3D models shown in the user experience can be dynamically changed, based on the context. Construction field personnel such as project managers, superintendents and foremen can potentially walk the jobsite, see what the completed product would look like or move closer to an area to see the 3D model in greater detail. The Moverio BT- 200 is capable of providing these contextual 3D views as shown in Figure 3. However, the caveat is that for a construction professional, a steep learning curve and significant software programming experience is needed to develop these contextual 3D models. 1.3 Remote Assistance The Moverio BT-200 is capable of allowing the user to be connected interactively to another user s desktop computer, as shown in Figure 10, using the MirrorOp application. The MirrorOp has a sender and a receiver application, designed for the desktop and the Moverio device respectively. This free app allows the Moverio user to be invited by the desktop user and both users interact with any application on the desktop side of the conversation. Additionally, perhaps more critically, the Moveriouser also has the capability of remotely taking control of the desktop and interact with the various programs running on the desktop. In the example shown in Figure 4, the principal investigator is manipulating a Revit Model on the desktop via the Moverio. This application has the potential for construction field personnel to be on the jobsite and connected to any other user in the world, without having to sit in front of a computer. One can easily imagine several situations where project stakeholders can carry on conversations with field personnel to answer questions. An example could be a superintendent having a conversation with an architect regarding an issue in the drawings and the architect walking the superintendent through the issue. All while, the superintendent did not have to 2
leave the jobsite to get an answer to the question at hand. barcodes. The Moverio device allows the user to perform FM related duties hands-free. Along with customized applications, there are several free applications that allow them to view documents on the device, documents such as customized user manuals that include, text, images and videos. Figure 4. Remote Collaboration using AR Technolog 1.4 Use of AR in Confined Spaces Often times in construction, workers are required to be in confined spaces. These are generally considered hazardous situations for the worker from a safety perspective. Workers are carefully trained to be in those spaces, complete the work and exit the area safely. The supervisors do not have any way of seeing what the worker sees or for the worker to show the supervisors any issue within the confined space requiring them to intervene. The video conferencing application in the Moverio glasses can allow the worker to share what they see with the supervisors, but be able to do so hands-free. Further, a free application called Telepresence can allow the supervisor to illustrate on top of the visual image seen by the worker, as shown in Figure 5. The images shown in Figure 5 were obviously not taken in a confined space. However, they were screenshots on an Android tablet through which the researcher was able to see what was represented through the camera of the Moverio and annotate on top of the images. Here again, the Telepresence application, which was developed for the medical community so that doctors can see patients in remote locations, demonstrates how it can be used for various applications in the construction industry. Figure 6. Use of FieldBit AR Application using Epson Moverio BT-200 device for Facility Maintenance and Management [7] 1.6 User Experience from Field Studies of Using AR in Construction The use of AR was explored by HOAR Construction, based in Birmingham Alabama, on a large public university building construction project. The Smart Reality application was used for the creation of AR views. The app was created for multiple platforms including the IOS and Android. The app was designed to work in conjunction with mobile phones and tablet devices and was made freely available through the respective app stores. The Smart Reality application was designed to work on the iphone, Android phones, ipads and Android tablets. An app was also created to work on the Moverio BT-200 device. Some of the visuals created for the project were created for the general public and the university community at large, as shown in Figure 7. This was used to inform the various university stakeholders about the traffic congestion issues on campus during the construction processes. The displays provided instructions to the users on how to install the app and see the AR visualizations. The response from the students was generally positive, as evidenced in Figure 6. However, the owner requested the contractor to take down the interactive visualizations as they received complaints from older users of technology who could not get the visualizations to work on their devices. Figure 5: Video Conferencing using Telepresence Application 1.5 Use of AR for Facility Maintenance and Management The Moverio BT-200 camera is capable of reading QR codes and barcodes, as shown in Figure 6. The device was used by FieldBit, an AR tech company based in Israel to develop an app for facility management (FM) [7]. Several FM software programs already take advantage of QR codes and Figure 7. Students use AR technology to visualize campus construction 3
Other AR visualizations used were created specifically for the project team on site, as shown in Figure 8. The project team found the visualizations useful in the sense that they were able to see 3D visualizations of 2D data. However, the project team did not refer to these visualizationsbeyond the demonstration phase of AR technologies. Many reasons exist for this attitude towards AR technology on a construction site. The researcher concluded that the primary reason was the lack of a champion on the construction site. Figure 8. AR Visualizations Developed for Construction Field Operations CONCLUSIONS This section contains some concluding remarks regarding the use of the Epson Moverio BT-200 for construction related applications. Conclusions for the use of AR technology in construction are also discussed. 1.7 Review of Epson Moverio BT-200 Glasses for Construction Upon completion of the research, the following conclusions can be made regarding the ergonomic and user friendliness of the Moverio device. 1.7.1 Favorable o The device is surprisingly comfortable to wear and walk around while in use. o Users are less likely to feel motion sickness when used in 3D mode as the background environment is still visible due to the transparent glasses. o The brightness of the glasses is well suited for use in an outdoor sunny environment. o By separating the controller and the glasses, the device is capable of being worn for extended hours as it does not overheat very easily. o The 6-hour battery life is very useful as it can be used throughout a workday. o The video conference capabilities are useful to communicate in an environment that may require the wearer of the glasses to be communicate hands free. o Several useful applications are freely available through the Moverio Apps Market Store 1.7.2 Needs Improvement o Whereas, the device has a 1.2 Ghz processor, however, it must be further improved as it 4 tends to get slow with even medium size BIM models. o It would improve the ergonomics if the glasses could be connected to the controller without the use of a wire. o The camera takes rather grainy pictures and this could be further improved in the Moverio BT- 200. o There is no built-in speech recognition on the device and it is extremely cumbersome to type one character at a time using a virtual on-screen keyboard. o The software interface for the device requires a higher level of technical capability than that required for using a smartphone or a tablet. o It is not easily possible to emulate the device screen on a computer for demonstration purposes. This makes it hard to teach new users the features and capabilities of the device. o Users must be cautious of walking with the device as it is nearly impossible to pay attention to the display screen and the surrounding environment simultaneously. The onboard camera can be used to identify hazardous conditions and warn the user. o The device does not have a depth sensor and cannot estimate the approximate distances to objects. o It is currently painfully slow, tedious and cumbersome to develop AR based applications. Users also experience a steep learning curve in transferring simple 3D models to the device. o The glasses are cumbersome and complicated for people wearing vision corrective eyeglasses. 1.8 AR for Construction There are some obvious benefits for the use of AR technologies for the construction industry. These include visualization of contextual information, use for remote collaboration & assistance, use in confined spaces and use in facility maintenance and management. However, for the technology to be successfully adopted in the construction industry, more mainstream applications must be available to develop AR visualizations. It is also necessary for the construction team to have a champion who can troubleshoot technical issues in the adoption phase of the technology. REFERENCES [1] A. G. P. Brown, Visualization as a common design language: connecting art and science, Autom. Constr., vol. 12, no. 6, pp. 703 713, Nov. 2003. [2] J. Carmigniani and B. Furht, Augmented Reality: An Overview, in Handbook of Augmented Reality, B. Furht, Ed. Springer New York, 2011, pp. 3 46. [3] S. Zollmann, C. Hoppe, S. Kluckner, C. Poglitsch, H. Bischof, and G. Reitmayr, Augmented Reality for Construction Site Monitoring and Documentation, Proc. IEEE, vol. 102, no. 2, pp. 137 154, Feb. 2014. [4] Fortune Magazine, AR, VR will generate $150 billion in the next five years - Fortune. [Online]. Available: http://fortune.com/2015/04/25/augmented-reality-virtualreality/. [Accessed: 01-Dec-2015].
[5] D. Campbell, Augmented reality comes to the job site, Building Design + Construction, 01-Feb-2012. [Online]. Available: http://www.bdcnetwork.com/%e2%80%98augmentedreality%e2%80%99-comes-job-site. [Accessed: 01-Dec- 2015]. [6] J. Yoders, How Is Augmented Reality Being Used in Construction, Line//Shape//Space, 21-Mar-2014. [Online]. Available: http://lineshapespace.com/what-is-augmentedreality/. [Accessed: 01-Dec-2015]. [7] O. Young, FieldBit Develops AR App for Enterprise, Augmented Reality Trends, 06-Nov-2014.. 5