Table of contents. LIPScan 3D Manual

Transcription

1

2 Table of contents SPECIFICATION & SYSTEM REQUIREMENTS... 1 FEATURES... 2 LIPSCAN 3D PACKAGE... 3 HARDWARE DESCRIPTION AND SETUP... 4 INSTALLATION... 6 UNINSTALLATION... 9 LIPSCAN 3D OPERATION AFTER SOFTWARE INSTALLATION How to start it? BEFORE SCANNING What to set up? READY TO SCAN Online scanning Offline scanning AFTER SCANNING, READY TO EDIT You can check the settings and make adjustment in advance.. 19 (1) Display (2) Light Setting (3) Pen Brush (4) Fill Hole Size (5) Language If you only want to edit part of the object Step 1 Selection: Single Triangle/ Regional/ Box/ Continuous. 29 (1) Single Triangle (2) Regional (3) Box (4) Continuous Step 2 Edit : Delete/ Keep/ Fill/ Smooth (1) With selected area: Delete/ Keep (2) Without selected area: Fill/ Smooth If you want to edit or transform the entire object Edit : Smooth All/ Erode All/ Fill All (1) Smooth All (2) Erode All (3) Fill All Transformation : Shift/ Rotation/ Scale (1) Shift (2) Rotation (3) Scale APPENDIX-LIPSCAN 3D PARAMETERS... 50

3 Specification & System Requirements Spec Minimum Hardware Requirement Recommended Hardware -Depth Camera: LIPS M5 Depth Camera -Power Consumption: 1.2W -Light Source: 850nm -Maximum Scan Volume (WxDxH): 70cm x 70cm x 180cm -Minimum Scan Volume (WxDxH): 8cm x 8cm x 8cm -Operating Range: 30~60cm -Scan Resolution: 2~4mm (1% of scanning distance) -Depth Image Size: 30FPS -Color Image Size: 30 FPS -Camera Interface: USB 3.0 -Dimension: 76.5 x 17.5 x 6.3mm (device only) -Weight: 30g (device only) -Supported File formats:.tgl,.stl,.obj,.ply -Bundled with 3D editing software: functions for example, smooth, fill, delete and more -Operating System: Windows 10 (64-bit) -CPU: 4th Generation Intel Core i5 Processor -RAM: 4G RAM or more -CPU: Intel Core i7 7500U or above -RAM: 8G RAM or more 1

4 Features LIPScan 3D is based on LIPS own tiny and portable depth camera LIPSedge M5 with high speed USB3.0 interface and extremely low power consumption design. On top of the hardware performance, it s also bundled with a powerful editing 3D editing software allowing user to conduct final finish or touchup before it s sent for 3D printing or simply kept as your unique 3D digital copy of your favorite physical collectables. M5 resembles the slimmest form factor and lightest body so camera mobility is significantly increased for any scenario and objects the users would like to scan. Compared to other existing 3D scanning systems, LIPScan 3D clearly offers much richer functions and more user-friendly and intuitive interface based on extensive beta-test feedback and in-house UX tuning. As a result, it s very easy to get your hands around the system in minutes. Moreover, the software effectively suits a great variety of users with different purposes with its built-in powerful 3D editing capabilities. Users from entry level to the professional can all benefit from this added value usually not supported by similar systems in the market. The scanning process performs in near real-time speed with minimum latency. User basically sees the progress through sub windows on the right along the way. Rather than automatically removing surface details compromised by low scan quality as done by some other systems, LIPScan 3D keeps the original surface details. Users are free to use its powerful 3D editing function to further smoothen it as needed. Unique offline scanning feature allows for low-power computer without compromising the scanning result. 2

5 LIPScan 3D package LIPS M5 USB3.0 Cable (Length: 2M) USB Storage Application: LIPScan 3D 3

6 Hardware Description and Setup IR Camera RGB Camera Projector IR Camera USB3.0 interface 4

7 Step 1 Insert the micro USB connector to LIPS M5 depth camera. Step 2 Insert the USB connector to your host computer

8 This section will guide you through the installation process. Installation Step 1 We store the software in the USB, please plug in and double click the installer <lips_3dscanner_setup>. Step 2 Click Next to install LIPScan 3D and LIPS HL1 Driver. 6

9 Step 3 Click Install to setup OpenNI 1.5. After installation, the pop-up window will remind you to reconnect the sensor. Click OK then reconnect the USB connector of the camera to your computer. Step 4 Successful installation must restart your computer. Click Yes, restart the computer now then Finish. 7

10 Step 5 Follow the folder structure as below then you can find links: C:\Program Files\LIPS\LIPScan 3D Folder also on the desktop. 8

11 Uninstallation Once we release new version of LIPScan 3D, please remember to uninstall the previous one in your computer first, and then you can install the latest version. This section will guide you through the uninstallation process. Step 1 Go to Control Panel > Programs > Programs and Features. Choose LIPScan 3D and click the right mouse button to uninstall. Step 2 Click Remove and Next to uninstall OpenNI 1.5 9

12 Step 3 Click Yes to remove InuDev and InuDriver. Step 4 Click Yes to remove LIPS HL1 Driver. Finally, LIPScan 3D was successfully removed. 10

13 LIPScan 3D Operation This chapter describes how to use LIPScan 3D system to scan and edit, which allows you to configure and control all of 3D scanner features and system parameters in a user-friendly UI. How to start it? AFTER SOFTWARE INSTALLATION Step 1 Make sure you connect well your 3D depth camera to the computer. Step 2 Open software LIPScan 3D

14 Step 3 Click graphic toolbar On or the upper toolbar Scanner > On (Ctrl+1) to turn on your 3D depth camera. In this page, you will see 3 sub windows shown on the right side, from top to bottom are RGB, Depth and 3D Model. 12

15 BEFORE SCANNING What to set up? Click upper toolbar Scanner > configure (Ctrl+3) to know the current settings and also for specific alteration based on individual requirements. Scanner Configuration Depth Range/ Camera Frame Interval/ Replay Frame Interval. Depth Range is for you to define how far the object is away from the camera. Ensure your object is in your preset depth range. The rest are Camera Frame Interval and Replay Frame Interval. The default settings are 0. (For more detail information please refer to Appendix) 13

16 READY TO SCAN This section includes simple steps to do online and offline scanning. Online scanning Step 1 Click graphic toolbar Scan and make the camera capture the whole figure. You can easily tell the depth from the color shown in the depth window, the color warmer, the nearer. Note: If the 3D Model sub window is surrounded by yellow square frame, it means the failure of surface matching. Sometimes it happens when you hold the camera not that firm or the object moves, but it will disappear after the system estimates the camera/ object is back on track. 14

17 Step 2 Click Stop Scan to finish the process. If you want to take a new scan, click Scan and repeat the process. The object automatically stored in preset folder. Note: You can also click File > Clear (Ctrl+E) to erase the object and then rescan. Step 3 Click graphic toolbar Off or the upper toolbar Scanner > Off (Ctrl+2) to turn off the camera. All three sub windows shown on the right side will be closed. 15

18 Step 4 The latest scanning file will be generated to overwrite the previous one, you can check the toolbar File > Open Model (Ctrl+O) or just click the graphic toolbar Open Model. Find the file saved as default name res.tgl. (C:\Program Files\LIPS\LIPScan 3D) Note If you have any scanning files to open just through the same way, the software supports 4 file formats: TGL, OBJ, STL and PLY. 16

19 Offline scanning Step 1 Click graphic toolbar Rec to start recording and click Stop Rec to finish. If you want to record a new one, just click Rec and repeat the process. Step 2 Click the upper toolbar File > Open Oni File (Ctrl+N) to check the file saved as default name recoder.oni. (C:\Program Files\LIPS\LIPScan 3D) 17

20 Step 3 During the replay mode, click graphic toolbar Scan to proceed and wait for the object formation, then click Stop Scan to finish. Step 4 After clicking Stop Scan, the main window will display the scanned object. Click the upper toolbar File > Close Oni File (Ctrl+M) to close the replay mode and 3 sub windows shown on the right side. 18

21 AFTER SCANNING, READY TO EDIT You can check the settings and make adjustment in advance. Click the graphic or upper toolbar Settings (1) Display Surface Line Points Color World Coordination Description The overall outline of the object. Object covered by triangle meshes. Object covered by point cloud. Shows real color captured by depth camera. The green lattice shown on the screen represents the position of the camera. 19

22 Surface This is automatically set. You can show the overall outline of the object. Line The object is covered by triangle meshes. 20

23 Points The object is covered by point cloud. Color The depth camera capture from the object 21

24 World coordination The green lattice shown on the screen represents the position of the camera. The followings are 4 circumstances, you can adjust the position of your object and green lattice (camera) accordingly. A. Object rotates, green lattice rotates. It is the normal mode in the system. Just use the mouse to drag the object to rotate, the green lattice will rotate accordingly. 22

25 B. Object rotates, green lattice fixed. Click Object > Move (Ctrl+W) to fix the position of the green lattice while you still can drag the object to rotate. 23

26 C. Object shifts, green lattice fixed. Click Object > Move (Ctrl+W) to fix the position of green lattice. Then press Shift and drag the object in the meantime. Or press PgUp to drag, finish the function press Esc. 24

27 D. Object shifts, green lattice shifts Press Shift and drag the object in the meantime. Or press PgUp to drag, the green lattice will be shifted accordingly. Finish the function press Esc. Note: Aside from dragging object by your mouse, you can also scroll the mouse wheel to zoom in/out the object. During the zooming process, your cursor will stick to the point it originally aims at. 25

28 (2) Light Setting Light source is automatically set to enable your object to look undulate with shadows. The page shown on the right is the object displayed without light source. (3) Pen Brush You can adjust the brush size here when you use your mouse as a pen brush to do regional selection. Pen brush size: 30 By using thicker pen brush, you can easily select a larger area. 26

29 Pen brush size: 5 By using thinner pen brush, you can also make a delicate selection. (4) Fill Hole Size This represents the number of pixels. Minimum 80, maximum which is the default setting. You can determine how large the hole you would like to fill. 27

30 (5) Language Choose the language and click Confirm. Once you switch to another language, the pop-up window will remind you to restart the application. Click File > Exit (ALT+F4) to close the system and start it again. 28

31 If you only want to edit part of the object Step 1 Selection: Single Triangle/ Regional/ Box/ Continuous Here are 4 types of selections. You can click from the upper and graphic toolbars. (1) Single Triangle Click Selections > Single (Ctrl+L), tap on the object as a small single triangle. 29

32 (2) Regional Click Selections > Regional (Ctrl+U), your mouse is as a pen brush to paint the area you want to edit. (3) Box Click Selections > Box (Ctrl+B), click and drag on the object to generate a cubic area that you want to edit. 30

33 (4) Continuous Click Selections > Continuous (Ctrl+A), if the object displays as two parts and you only want to select one of it to edit. The part you choose will turn blue as the page shown on the right. Note: If you would like to finish the selection function or want to drag the object, click graphic toolbar Cancel (Esc) to end it. 31

34 Step 2 Edit : Delete/ Keep/ Fill/ Smooth (Introduce 2 ways to edit (1) with selected area (2) without selected area) (1) With selected area: Delete/ Keep A. After selecting area, click upper toolbar Selections > Delete (Ctrl+D), or graphic toolbar Delete to erase. (The selected area in the example is made by Selections > Regional (Ctrl+U)) 32

35 B. After selecting area, click upper toolbar Selections > Keep (Ctrl+K), or graphic toolbar Keep to save. (The selected area in the example is made by Selections > Box (Ctrl+B)) Note: If you want to re-edit or return back to the last step, click upper toolbar Object > Undo (Ctrl+Z). (Maximum 10 times.) 33

36 (2) Without selected area: Fill/ Smooth A. You can easily edit with your mouse as pen brush. Click upper toolbar Object > Fill (Ctrl+F) or graphic toolbar Fill to fill the cracks. Warning The part chosen to be filled on the object should be a CLOSED AREA, or the edge will be erased. 34

37 B. You can still easily edit with your mouse as a pen brush. Click upper toolbar Object > Smooth (Ctrl+J) to make the edge smoother. (The original one is on the left side. The doll s head is edited to look smoother by this function on the right side.) Note: If you would like to finish the pen brush function or want to drag the object, click graphic toolbar Cancel (Esc) the function. 35

38 If you want to edit or transform the entire object Edit : Smooth All/ Erode All/ Fill All Here are 3 types of editing. You can click from the upper toolbars. (1) Smooth All Click upper toolbar Object > Smooth All (Ctrl+T) to make the object overall smoother. (The original one is on the left side. The entire doll body is edited to look smoother by this function on the right side.) 36

39 (2) Erode All Click upper toolbar Object > Erode All (Ctrl+I) to break up the object gradually (The original one is on the left side. From left to right, we increase the degree of erosion by this funtion.) 37

40 (3) Fill All Click upper toolbar Object > Fill All (Ctrl+G) to seal up the empty bottom of the object. The camera is unable to capture the whole figure because the bottom part cannot be scanned from the fixed shooting angle. Thus, this function is designed to solve this problem in a simple way to be well-prepared for 3D printing or any other purposes. After editing, click File > Save Model (Ctrl+S) to save. 38

41 Transformation : Shift/ Rotation/ Scale Click upper toolbar Object > Transformation Here are 3 effects with 3 dimensions X, Y and Z which you can put in digits to customize. Note: For your better understanding, please kindly adjust the position of green lattice (camera) and the object same as the following. 39

42 (1) Shift The degree of the movement depends on the number. For X axis, put a positive/negative number, the object will shift rightwards/ leftwards. 40

43 Note: There is another quick way to shift the object. Click Object > Move to make the position of the green lattice (camera) fixed then press Shift and drag the object in the meantime. Or press PgUp to drag it, finish the function press Esc. 41

44 For Y axis, put a positive/ negative number, the object will shift upwards/ downwards. 42

45 For Z axis, put a positive/ negative number, the object will move backwards/ towards. 43

46 (2) Rotation The extent of spin based on the degree. (±1~360 degree) For X axis, put a positive/negative number, the object will spin leftwards/ rightwards. Note: There is another quick way to rotate the object. Click Object > Move to fixed the position of the green lattice (camera) then drag the object. 44

47 For Y axis, put a positive/ negative number, the object will rotate backwards/ forwards. 45

48 For Z axis, put a positive/ negative number, the object will rotate counterclockwise/ clockwise. 46

49 (3) Scale You can put in numbers by three dimensions to customize respectively. For X axis, put a Number>1/ 0>Number>1, the object will expand/ shrink parallelly with the X axis. 47

50 For Y axis, put a Number>1/ 0>Number>1, the object will stretch/ shorten parallelly with the Y axis. 48

51 For Z axis, put a Number>1/ 0>Number>1, the object will thicken/ thin parallelly with the Z axis. 49

52 Appendix-LIPScan 3D Parameters LIPScan 3D uses a set of 3D scanning parameters to optimize its overall performance. The UI notation next to some parameters indicates a corresponding setting UI for the parameters is available. Those without setting UIs are for professional purpose hence their changes are usually not recommended unless its purpose and meaning are fully understood. Users can refer to C:\Program Files\LIPS\LIPScan 3D config file named Scanner.cfg to check if needed. [WorkerThreads] Set the number (> 0 in integer) of parallel-processing threads in the program for surface matching during scanning process. Bigger number can be set for faster CPU. [VolumePitch] This is the grid resolution of the reconstructed 3D model of scanned object. The decimal value should be greater than 0. (e.g. 1 = 1mm) [DepthAccuracy] Set the accuracy of depth data (z-direction) which is a multiple of measured z distance. The decimal value should be greater than 0. [SearchRange] Set the searching range of the surface matching in 3D space. The decimal value should be greater than 0 for the system to be able to proceed with continuous surface registration. 50

53 [ColorSpreadRange] This is the color-spreading capability. The decimal value should be greater than 0. Smaller value indicates better colorspreading capability. [RenderingPitch] This is only to set the real-time rendering size for the re-constructed 3D model inside the 3D Model floating window located at the lower-right corner of the screen. The decimal value should be greater than 0. The smaller the value, the closer the object looks in the window. [RegistrationMinimalPoints] The surface matching will fail when the number of points cloud matching the previous frame is less than the setting. [RegistrationMaxDeviation] This is the maximum error of surface matching. Error during the scanning process greater than this threshold will be considered matching failure. When this happens, the real-time registration window at the lower-right corner will display yellow borders. The decimal value should be greater than 0. [RegistrationMinDeviation] This is the minimum error of surface matching. Error during the scanning process smaller than this threshold will be considered invalid result hence skipped. The decimal value should be greater than or equal to 0. [DepthRange] UI The depth range (mm) set for 3D scanning operation. Depth values outside this range will be filtered out. 51

54 [AverageTimes] This is to set the number of times the system performs surface smoothening before surface matching is processed. Value is integer greater than or equal to 0. [PeelOffTimes] This is to set the number of times the system performs surface erosion before surface matching is processed. Value is integer greater than or equal to 0. [RemoveExternalNoise] This is to set a threshold value whereby the depth values will be removed if vertically accumulated depth sum lower than this setting. Value is integer greater than or equal to 0 with 0 meaning ignored. [SearchBiggerObjectReserve] This is to set a threshold value whereby a block depth values will be removed if triangular mesh count in the block lower than this setting. Value is integer greater than or equal to 0 with 0 meaning ignored. [CameraFrameInterval] UI This is to set the number of frames to be skipped for every frame processed during real-time scanning. [RecoderFrameInterval] UI This is to set the number of frames to be skipped for every frame processed during offline scanning. 52