State University of Campinas Faculty of Engineering, Architecture and Urban Design PhD Program Architecture, Technology and Cities.

Advance Methods of Research Dr. Lucila Labaki

Authors: Arq. Msc. Maycon Sedrez, Arq. Msc. Letcia Teixeira Mendes Coauthors: Dr. Gabriela Celani

Comparing 3D digitizing software using photogrammetry in the survey of architectural heritage

Abstract: This paper aims to present the use of 3D digitization for data collection and preparation of technical documents to supplement the inventory of heritage and restoration. The object defined as a case study was a window of the Metropolitan of Lisbon, designed by Norte Junior, located at the intersection of Fontes Pereira de Melo Avenue and Andrade Corvo Street, in Lisbon. The methodology was based on the comparison between two distinct approaches: 1.the use of the software Autodesk 123D Catch to produce a final 3D model and 2. the generation of the same object through a more complex process the use of the online software My 3D Scanner to obtain the point cloud and MeshLab to obtain the texturized mesh.

Keywords: 3D digitization; heritage; Autodesk 123D Catch; My 3D Scanner; MeshLab.

Submitted to SIGRADI 2014.

Presentation: http://prezi.com/vfdeckjxv6wu/digitalizacao-3d/

1. Introduction

The use of new technologies for data collection and preparation of technical documents that complement the heritage inventories tend to be extremely effective in a field where the existing information and details are scarce and difficult to access. According Celani and Cancherini (2009), the use of photographs to obtain three-dimensional data by the method of reverse perspective is a very old technique, which allows to extract dimensions from objects photographs which at least some dimensions and angles are known. In 1992, Streilein, Beyer and Kersten were researching a method to substitute filmbased cameras for video cameras. They were discussing the usage of the software DIPAD (Digital Photogrammetry and Architectural Design) to fasten the process of digitize architecture with a CAD (computer-aided design) system. Today, digital technology cameras are accessible and Kersten, Pardo and Lindstaedt (2004) demonstrate that commercial digital SLR (single-lens reflex) cameras are suitable for detailed 3D evaluation and reconstruction of large complex historical buildings. So, with the availability of digital optical equipment and precision of computer vision techniques, this area has taken great momentum, giving rise to what is now called 3D digitization. However, there are few research explaining the practical methods comparing software for digitization of architectural heritage. Its important to observe the difference between the terms Digitization and Digitalization. The first one is the image of an object by a set of its points in space resulting in a digital representation. Digitalization is the integration of digital technologies into everyday life. According to Mikhail et al (2001) the photogrammetry technique is considered science and art, which studies the processes that allows derive information, in general metric, from an object by measurements made on objects photographs. The fundamental task of photogrammetry is to establish rigorously the geometric relationship between photography and the subject at the time this was achieved. The 3D photogrammetric methods always assume the existence of two or more images obtained by different viewpoints and overlapping, in other words, the elements present in the scene must be represented by at least two images (Mateus, 2012). The methods of digitization are diverse and require specific equipments. Pavlidis et al (2007b) summarize the different techniques of digitalization of buildings and monuments:

empirical, topographic, laser scanning and photogrammetry. Photogrammetry was selected to this research because it is a simple technique to digitize complex objects producing models of reliability and accuracy. The information digitized can be exported as a stereolitography file (*.stl) wich is recognized by 3D printers software. Nowadays, digital procedures are recurrent in documentation and historical survey because of its convenience and relatively low cost (Pavlidis et al, 2007a; 2007b). The 3D digitalization techniques optimize the process of obtain metric data of objects, buildings, ornaments, among others, thus minimize the step from traditional measurements (Oliveira, 2008). Thereby, we used multiple flat images, properly oriented, which allow the construction of a 3D model and the graphic restitution of the object, enabling the use of the model to extract areas, lengths and volumes with spatial distributions. This technique still allows the use of the 3D model for visualization in virtual environments or as an element of databases. Considering the importance of contemporary documentation techniques in the survey of architectural heritage, what are the differences between software to digitize buildings as part of technical documents?

2. Objectives

This paper aims to compare the use of two distinct approaches for data collection from a heritage building, in particularly the 3D digitalization of a window. The tools used are: 1. the online software Autodesk 123D Catch to produce a final 3D model and 2. the generation of the same object through a more complex process the use of the online software My 3D Scanner to obtain the point cloud and MeshLab to generate the texturized mesh.

3. Methodology

3.1 Methodology for 3D reconstruction using photogrammetry Previous to the choice of the heritage building`s object to digitize, several tests were run with different objects and textures. Also objects of different scales were tested, like a small wood statue and faade of a Brazilian neocolonial buildings. The tests contribute to analyze the results obtained in according to the variation of material, brightness and

scale of each object. This first step of investigation is important to understand how photos need to be taken, for instance, camera angles and photographer positioning. Some software are available to make an automatic 3D points reconstruction of architecture from photos: Autodesk 123D Catch, My 3D Scanner, Rhinophoto and Photomodeler. Since Rhinophoto and Photomodeler are not freeware, in this initial stage of the research, we have decided to work with 123D Catch and My 3D Scanner. The choice of the window to apply two distinct tools of 3D digitalizing was based on the best quality characteristics in the previous tests - opaque texture, rough, rich in detail and ornaments - thus helping to evaluate the technologies tested and more likely to obtain satisfactory results.

3.2 Acquire a set of images Image acquisition occurred on cloudy days for best results due to less interference of light and recognition of the images. The chosen object contributed to the analysis of technologies, it presents opaque surface, roughness and although it is symmetric as well as wealth of details (figure 1). The photographs need to be taken from different angles, spatially arranged in a circle or arc around the object and each photo must contain about 70-80% of previously captured image content.

Figure 1 Acquire a set of images from the window. (Authors, 2012)

3.3 Generate a point cloud data from the images. The tools selected to compare the process of generating a point cloud data are: 123D Catch and My 3D Scanner (figure 2). 123D Catch (http://apps.123dapp.com/catch/) is part of a project named Photofly from Autodesk that can be used online, by Apple devices and installed on a PC. It allows to process automatic up to 70 photos. We downloaded and worked with the standalone version. The data (collection of photos) is transmitted to Autodesk database to process the information returning a Photo Scene

Data File (*.3dp). The user can edit and send to 123D Make or a CNC Utility or export as *.dwg, *.fbx, *.rzi, *.obj, *.ipm, *.las. The final result consists of the reconstruction process contains the point cloud, 3D mesh and texture. The My 3D Scanner tool (www.my3dscanner) is a free web service and allows process up to 100 images to generate a point cloud. The result delivery by the application consists in a 3D mesh file (*.obj) and a point cloud file (*.ply extension).

Figure 2 Interface printscreens of My 3D Scanner and Autodesk 123D Catch tools. (Authors, 2012)

4. Case study

The case study consisted is a window of the Registered Office of the Lisbon Metropolitan, designed by architect Norte Junior in 1910, located at the intersection of Fontes Pereira de Melo Avenue and Andrade Corvo Street, Picoas, in Lisbon (Figure 3).

Figure 3 Location and building facade. (Google Earth, 2012)

The building, popularly known as the "wedding cake" - because the exuberant decoration of the faade, was sold to the City Council in Lisbon in 1950, then leased to the Lisbon Metropolitan, in 1954, where it is currently installs the administrative headquarters of the transportation company (Figure 4). The faade decoration is eclectic

with diverse architectural styles: classical columns, neo-baroque elements and motifs and art nouveau metal works (Vale, Ferreira, 1997).

Figure 4 Window detail and building. (Authors, 2012)

In this section is presented the methodology described in the previous topic used to reconstruct in a virtual environment the exterior surfaces of a window based on a set of pictures and the software Autodesk 123D Catch and My 3D Scanner to obtain a point cloud. The first step was to take 68 pictures of the considered object from different angles, so the two software can be able to apply the reconstruction algorithms. In order to load the pictures in the server an account has to be created for each tool.

4.1 Test #1: Autodesk 123D Catch The steps to generate a 3D model in 123D Catch are: create a new project and upload the photos. The 123D Catch service will create a capture, this process can take several minutes, the user can wait for the end of the process or receive an automatic email from the server when it is completed. The number of photos depends of the object that is going to be digitized, we use as parameter around 70 photos. After that the model is ready to be edited by adding more photos, adjusting photos that were ignored by the server or removing unneeded parts. There are some differences between the online version and the standalone version. 123D Catch standalone version have some extra tools as define mesh quality, create reference points or lines, define the world coordinate system and see the photos path. To edit, both versions have the tools selection, orbit, zoom and pan. The online version has the tools invert selection, smooth surfaces, create a plane cut and inspect the model (to help close holes in the object).

Figure 5 Editing unneeded parts (left image) smoothing surfaces with materials and outlines visualization (right image). (Authors, 2012)

4.2 Test #2: My 3D Scanner + MeshLab In this section is presented the steps to generate a 3D model from the use of My 3D Scanner web-based service to obtain the point cloud and MeshLab software to generate the mesh and texture of the window. The first step was to upload the 68 pictures to My 3D Scanner website, after some hours we receive a message by e-mail informing each process step. Because is a computer intensive process, a better solution is the usage of a cloud of web service solution. The next step was to open in Meshlab the *.obj file, then edit the point cloud by removing unneeded points and clean around the cloud point (figure 5).

Figure 6 Cloud point without clean unneeded points (left image) and clean cloud point (right image). (Authors, 2012)

The MeshLab software was used for the filtering commands and the reconstruction of the 3D surfaces from the point clouds. The points that were not part of the reconstructed window were deleted by using the commands: Select Vertexes (for selecting the points) and Delete current set of selected vertexes (for deleting the points). The next step was the generation of mesh and texturing (figure 6).

Figure 7 Mesh created and texturized. (Font: Authors, 2012)

5. Discussion

The tested freeware options are sufficiently capable of providing complete 3D models. The technique is simple and low cost, comparing to others like laser scanning, requiring only a photograph camera and a computer connected to internet. Both software generate similar 3D results, and they have qualities that must be taken in consideration when chosen and that will depend of the object to be digitize. My 3D Scanner provides a more detailed model. It takes several hours to upload the file, and its necessary work with MeshLab to edit the model. Although they are more appropriate for large scale model. My 3D Scanner and MeshLab has a controlled process of generating mesh. User can define parameters of the mesh based on the point cloud, that doesnt occur with 123D catch. 123D Catch works better with small scale models. The upload time is short and it is a single platform to operate. 123D Catch export the point cloud to different extensions and its simple to use. Previous tests are necessary to understand the logic of the software and that could take a week investigation. Online version and standalone version are able to save *.stl file or send the model to a 3D printer, others file types can be generated. Photos need to be taken in especial conditions of illumination, the number of photos needs to be consistent with the object. There are key factors that must be considered, like photographer positioning, physical obstacles and precision of photos overlap. Next step of research are: produce 3D models using 3D printers and test the others paid software of photogrammetry.

Thanks to the agencies that helped funding the thesis research of Letcia Mendes: FAPESP/CNPq, and thesis research of Maycon Sedrez: CNPq - CAPES.

6. References CELANI, G. CANCHERINI, L. Digitalizao tridimensional de objetos: um estudo de caso. Anais do Sigradi 2009. So Paulo, p. 309-311. 2009. GROETELAARS, N. J., AMORIM, A. L. Levantamento fotogramtrico digital da capela de Nossa Senhora da Escada. SIGraDI. In: Proceedings of the 8th Iberoamerican Congress of Digital Graphics. Porto Alegre. p. 313 - 316. 2004. HEUVEL, F. V. D. Reconstruction from a single architectural image from the Meydenbauer archives. In: Proceedings do XVIII CIPA Symposium - Postdam, Germany. p. 18-21. 2001. HANKE, K., GRUSSENMEYER, P. Architectural photogrammetry: basic theory, procedures, tools. In: KASSER, M., EGELS, Y. Digital Photogrammetry. New York: Taylor & Francis, 2002. KERSTEN, T., PARDO, C. A., LINDSTAEDT, M. 3D acquisition, modelling and visualization of north german castles by digital architectural photogrammetry. In: International Society for Photogrammetry and Remote Sensing - SPRS Congress. V. XXXV. p. 126-131. 2004. MATEUS, L. M. C. Contributos para o projecto de conservao, restauro e reabilitao: uma metodologia documental baseada na fotogrametria digital e no varrimento laser 3D terrestres. Tese de Doutorado. Faculdade de Arquitetura. Universidade Tcnica de Lisboa, 2012. MIKHAIL, E.; BETHEL, J.; McGLONE, J. Introduction to modern

photogrammetry. EUA: John Willey & Sons, 2001. OLIVEIRA, M. M. A documentao como ferramenta de preservao da memria. Braslia, DF: IPHAN / Programa Monumenta (Cadernos Tcnicos; n. 7). 2008. PAVLIDIS, G., KOUTSOUDIS, A., ARNAOUTOGLOU, F., TSIOUKAS, V., CHAMZAS, C. Methods for 3D digitization of Cultural Heritage. In: Journal of Cultural Heritage. N. 8, p. 93-98. 2007a. PAVLIDIS, G., TSIAFAKIS, D., TSIOUKAS, V., KOUTSOUDIS, A.,

ARNAOUTOGLOU, F., CHAMZAS, C. Preservation of Architectural heritage through 3D digitization. In: International Journal of Architectural Computing. V. 5, n. 2. p. 222-237. 2007b. STREILEIN, A., BEYER, H., KERSTEN, T. Digital photogrammetric techniques for architectural design. International Society for Photogrammetry and Remote Sensing SPRS Congress. V. XXIX. p. 825-831. 1992.

VALE, T., FERREIRA, M. Palacete na Av. Fontes Pereira de Melo, 28. Portugal Lisboa. Sistema de Informao para o Patrimnio Arquitetnico. 1997. Disponvel em: <http://www.monumentos.pt/Site/APP_PagesUser/SIPA.aspx?id=5619> Acesso em: 21/06/2013.