Professional Documents
Culture Documents
0
Proposed Projects at Brno University of Technology
Jiri Kovar*, Katerina Mouralova**, Filip Ksica***, Jiri Kroupaƍ, Ondrej AndrsƎ and Zdenek Hadasே
Faculty of Mechanical Engineering, Brno University of Technology, Technicka 2896/2, Brno, Czech Republic
e-mail: *kovar@fme.vutbr.cz, **mouralova@fme.vutbr.cz, ***144901@vutbr.cz, ƍkroupa@fme.vutbr.cz, Ǝandrs@fme.vutbr.cz,
ே
hadas@fme.vutbr.cz
Abstract—This paper deals with virtual reality in context of between the virtual reality and the AFM can also be used for
Industry 4.0 projects. Due to sufficient computing power, virtual educational purposes, since it can show complex microsystems
reality allows visualization of virtual objects in both professional in 3D with the possibility of direct interaction between the
and public spheres. With virtual reality, solving complex projects displayed object and the observer. The user of the special
has become much easier, especially of those based on Industry 4.0 fittings is an observer who is able to rotate the object in any
standards. Industry 4.0 projects require connection between all way, or move it otherwise in real time and thus to get a better
systems of modern machines (physical systems, embedded idea about objects in virtual reality.
systems, sensors, actuators, electronic hardware, software etc.)
via integrated data chains and these links are used, among other
things, for monitoring operating conditions and share virtual II. VIRTUAL REALITY – STATE-OF-THE-ART
models in the development cycle, both of which can be visualized The virtual reality technologies could be divided to two
via virtual reality. Our virtual reality lab has the CAVE and groups: Semi-Immersive virtual reality and full-immersive
Powerwall virtual reality technologies and several examples of its virtual reality.
application are presented.
Semi-Immersive virtual reality includes devices like a
Keywords-Virtual Reality; Industry 4.0; Factory of Future; PowerWall (Fig. 1), ImmersaDesk or monocular headsets.
Dynamics; FEM; Atomic Force Microscopy; Microstructures Binocular headsets and CAVE VR (Fig. 2) are full-immersive
devices. The difference between these two categories is in the
I. INTRODUCTION rate of immersion to the virtual environment. Full-Immersive
devices provide three-dimensional projection with a large field
Latest advances in computing technology (Moore's Law)
of view to the user, compared to semi-immersive device.
due to sufficient computing power allowed virtual reality to be
used for both professional and public applications.. For
example, in the area of design and construction of cars, the
virtual reality significantly accelerated the development
process of a new car from several years to less than a year. It
can also be used in architecture and civil engineering for design
of buildings, residential areas, interiors as well as educational
purposes [1]. In practice, an elaborated software and hardware
are sufficient for a designer or architect to compare several
concepts and present them to their customers, who can see the
results with their own eyes, making decisions much easier
before the construction process starts[2], [3].
The Industry 4.0 is one of the Future Projects established
by German government in early 2010s and new challenges in
manufacturing industry have arisen. Industry 4.0 deals with a
connecting of all parts of machines (physical systems,
embedded systems, sensors, actuators, electronic hardware,
Figure 1. Production Machine on PowerWall
software etc.) via integrated data chains and the operation,
reporting and monitoring data could be visualized in the virtual
reality. A. Automotive Engineering
Other of our project uses the combination of the virtual Automotive engineering is one of the area where the virtual
reality with advanced imaging methods (e.g. atomic force reality is used the most [4]. The design, virtual prototyping,
microscopy, AFM) and can be used for instance for magnifying virtual assembly, training and manufacturing are the most
the quality of the machined surface by the equipment attractive areas for its application. A car design is a process
performing finishing operations due to nanometre (nm) which require a lot of modification and reviews before the car
accuracy or to display microstructures. This connection reaches production. The virtual reality can reduce costs and
time necessary for creating virtual prototypes. It also allows
designers to better assess the design of whole car [5]. Full- Virtual reality can also be used for surgery training.
Immersive virtual reality is suitable for inspecting visibility Researchers from National Research Council Canada in
from the inside of the car. For example, it can be used for collaboration with surgeons developed a virtual simulator for
investigating the influence of veiling glare from the instrument cranial microneurosurgery training named NeuroTouch. It
panels onto the driver’s side window or how the size and provides full-immersive virtual environment with stereovision
placement of pillars influence of driver’s view. Engineers from system and haptic feedback for the acquisition and assessment
New Holland use virtual reality for evaluating the reachability of technical skills involved in craniotomy-based procedures
of door handles within a vehicle [6]. [15].
Virtual training can be more effective than traditional Multiple studied provide evidence about positive effect of
training. For example, Virtual reality system (VTS) for virtual reality on treating mental health problems. One of them
assembly training developed for OPEL was tested at the is a study where four subject with claustrophobia were tested.
University of Nottingham. Four factors were specified during Reduction of claustrophobia symptoms during the three month
the comparison of VTS and traditional training: completion treatment was observed [16]. In another project, researchers
time, self-corrected error, trainee corrected error and overall observed the effects of multiple context exposure on renewal in
error. It was found out that there were no significant spider phobia in another study. The study had two results. The
differences between completion time and self-corrected errors. treatment with the help of a virtual reality can decrease fear
However, the results showed the VTS trained group made less factor and multiple context exposure is more effective than
trainee corrected errors and overall errors. Although the results single context exposure for treating a spider phobia [17]. A
for VTS are better than traditional training, several issues with virtual reality may also be used to treat other phobias, such as
the quality of the virtual instruction were identified [7]. fear of flying [18], social phobia [19], acrophobia [20] with the
same positive results.
B. Aerospace Engineering
A virtual reality also frequently used in an aerospace D. Mechanical engineering
engineering. Full scale virtual prototypes allow designers to Virtual reality can be used to reduce time necessary for
study ergonomics of interior, e.g. cockpit, flight deck, crew developing machine tools and therefore reduce the costs.
workstation and comfort of passenger seat [8]. Virtual reality Virtual prototype of machine, Fig. 2, can help validating
can be used for evaluating accessibility in aircraft cabin [9]. functionality of the designed solution and obtain results of
simulations (e.g. stress analysis, kinematics, and dynamics)
As a part of air traffic system simulation, virtual [21].
environment is used for monitoring airplane noise emissions in
the vicinity of airports The purpose of this solution is improve A virtual factory is a simulation model where its sub-
communication during the approval of infrastructure projects models represent production cells of a factory. This simulation
[10] model is used for testing of manufacturing system design and
control. [22]. The model of virtual factory can be used for
Training is the primary intervention strategy to improve the investigating intensity and sound propagation at the workplace.
quality and reliability of aircraft inspection during the aircraft The results of this simulation can be used to improve layout of
maintenance [11]. The research team of the University of machines in the workplace. Effective layout may lead to
Salerno in cooperation with CIRA developed a system of reduction of noise emissions and therefore to lower exposure of
haptic feedback for first-person maintenance tasks targeted to workers in the environment [23].
the aerospace industry. This system includes hand-based force-
feedback haptic device and real-time VR simulation engine
[12].
Virtual reality can be also used to improve the planning
phase of each space mission. Scientists from COSE (Center in
Thales Alenia Space) in Italy developed a virtual reality
application which can realistically represent Martian terrain.
This 3D model is created from elevation maps for the purpose
of projecting space exploration missions [13].
C. Medicine
Borget etc. al. used a virtual reality for visualization of the
body muscle activation in their paper. They developed a real-
time system named HBM for analyzing human movement and
muscle function. Joints kinematic and kinetics for full body
model, dimensions estimations and forces in muscle elements
are computed by this software in real time. The Software in Figure 2. Virtual Production Machine (model created by Cvejn, J, Matejka
J., Neumann O.; supervisors Blecha P., Novotny T., Pavlik J.)
conjunction with a virtual reality offers opportunities to interact
in real-time with biomechanical data during patient Virtual environment also can be used for virtual machining,
examination or treatment [14]. Fig. 2, during which the process of milling, turning, drilling
and grinding is simulated. The results of this simulation phase, same approach can be used to monitor operating
provide information about factors affecting the quality and conditions (e.g. vibrations, fatigue, heat transfer, sound
machining time [24]. For example, orthogonal process forces, emission etc.) for diagnostics purposes and further optimization
the roughness of the machined work piece, energy of the product.
requirements and tool wear can be determined on the base of
input parameters like a cutting speed, feed or cutting depth
[23].
Training of manufacturing processes is another application
of virtual reality in mechanical engineering. The main
advantage is eliminating the risk of use for both users and the
machines [25]. For example, it can be used for learn to use of
the CNC machine [26]. The trainee program can also contain
real-time material removal process simulation [27].
F. Advanced Visualization Techniques The display of the surface using atomic microscope from
Bruker Company provides one of the most accurate
When working with State-Space models, it is important to information about the real surface morphology. This accuracy
not forget about the fact, that they do not contain information is achieved through a combination of scanning speed and the
about geometry. Transfer functions only describe response tip radius, which varies between 2 nm and 10 nm. The atomic
between the points of interest, but the information about their microscope accuracy depends on the measurement setup and
location is not contained in the transfer function itself. can be between 300 nm per pixel up to 0.25nm per pixel. The
Therefore, we need to combine two models together, where size of the scanning field varies from 89 um up to 10 nm. The
one represents the data for visualization (e.g. amplitudes of time duration of the one scan depends on the desired accuracy.
vibrations etc.) and the other contains information about the When selecting the examined sample, it is necessary to take
location of the points of interest (e.g. measured points, into account the minimum and maximum height of the profile,
connections, excitation points etc.) which can be approximately12.5 um.
The model for describing geometry can be either based on
simple wireframe, connecting all the points of interest with B. Measurements and Visualization
lines. Other approach could use CAD or FEM model. In both Despite any restriction concerning the maximum size of the
cases, a technique for imprinting the required data for scan, the AFM method in combination with the virtual reality
visualization is necessary. is the best way to present the quality and structure of individual
surfaces based on a type of finishing process, affecting the
IV. II. ATOMIC FORCE MICROSCOPY quality of the surface in terms of topography and morphology.
Possible applications of virtual reality in combination with
The aim of our team is to observe the microstructure of
AFM are visualization of the surface after grinding or the
produced solar cells with anti-reflection coating. This
antiglare coating of a solar cell formed by dry etching of the
connection between the virtual reality and the AFM can also be
silicon through a temporary polymer mask, shown in Fig. 7 and
used for educational purposes, since it can show complex
Fig. 9. Both measurements could be visualized in the CAVE
microsystems in 3D with the possibility of direct interaction of
and the technical person could evaluate the quality of
the displayed object with the observer. The user of the special
microstructure in the virtual reality environment, as is shown in
fittings is an observer who is able to rotate the object in any
Fig. 8 and Fig. 10.
way, or move it otherwise in real time and thus to get a better
idea of microstructure shape [4].
Figure 7. The surface of the workpiece after grinding in 3D.
V. CONCLUSIONS
The virtual reality environment is very useful tool for future
projects like smart machines, factory of future, etc. All these
projects are based on the idea of Industry 4.0. The virtual
Figure 8. The surface of the workpiece after grinding in Virtual Reality reality is very useful tool for development tasks and can cause
effective reduction of costs and time during design of new
machines. The outline and visualization of the design and
consequent dynamic analyses are presented.
The combination of Atomic-force microscopy and virtual
reality has a big potential for propagation, visualization and
education of professional or layman audience. Connection of
virtual reality and AFM can be used for comparison of
finishing operations, which have an impact on the topography
and morphology of the machined surface. Virtual reality and
AFM provide another dimension for interpretation of
curriculum which inclusive a structure smaller than the
diameter of a human hair. They also provide visualization of
electrical, magnetic and thermal properties of a sample in
conjunction with information about structure of surface.
Our virtual reality lab at Brno University of Technology
solves apart from presented tasks other particular virtual reality
Figure 9. Topography of solar cells with antiglare 3D.
projects. With the exception of presented results our team deals
with the visualization of medium and energy flow. It could be
very interesting for Smart City projects and for example
dynamics of a water-supply network will be visualized in the
future [33], [34].
ACKNOWLEDGMENT multiple-baseline design,” Behav. Ther., vol. 31, no. 3, pp. 583–595,
2000.
This work is an output of research and scientific activities [17] Y. Shiban, P. Pauli, and A. Mühlberger, “Effect of multiple context
of NETME Centre, supported through project NETME exposure on renewal in spider phobia,” Behav. Res. Ther., vol. 51, no. 2,
CENTRE PLUS (LO1202) by financial means from the pp. 68–74, 2013.
Ministry of Education, Youth and Sports „National [18] M. Rus-Calafell, J. Gutiérrez-Maldonado, C. Botella, and R. M. Baños,
Sustainability Programme I“. “Virtual reality exposure and imaginal exposure in the treatment of fear
of flying: a pilot study.,” Behav. Modif., vol. 37, no. 4, pp. 568–90,
2013.
REFERENCES [19] E. K. Yuen, J. D. Herbert, E. M. Forman, E. M. Goetter, R. Comer, and
[1] Dusan Magaௗ; Juraj Dudakௗ; Sona Pavlikovaௗ; Jiri Hajekௗ; Boris Simak, J. C. Bradley, “Treatment of Social Anxiety Disorder Using Online
“Support of technical education at primary and secondary level,” in Virtual Environments in Second Life,” Behav. Ther., vol. 44, no. 1, pp.
MECHATRONIKA, 2012 15th International Symposium, 2012, pp. 51–61, 2013.
195–198. [20] C. M. Coelho, A. M. Waters, T. J. Hine, and G. Wallis, “The use of
[2] Q. Peng, “Virtual reality technology in product design and virtual reality in acrophobia research and treatment,” J. Anxiety Disord.,
manufacturing,” in Proceedings of the Canadian Engineering Education vol. 23, no. 5, pp. 563–574, 2009.
Association, 2007. [21] Y. Altintas, C. Brecher, M. Weck, and S. Witt, “Virtual Machine Tool,”
[3] L. P. Berg and J. M. Vance, “Industry use of virtual reality in product CIRP Ann. - Manuf. Technol., vol. 54, no. 2, pp. 115–138, Jan. 2005.
design and manufacturing: a survey,” Virtual Real., Sep. 2016. [22] S. Jain, N. Fong Choong, K. Maung Aye, and M. Luo, “Virtual factory:
[4] J. Novak-Marcincin, V. Fecova, L. Novakova-Marcincinova, J. Torok, an integrated approach to manufacturing systems modeling,” Int. J.
and J. Barna, “Verification of Machine Position in Production Plant with Oper. Prod. Manag., vol. 21, no. 5/6, pp. 594–608, May 2001.
Use of Virtual Reality Technology,” Appl. Mech. Mater., vol. 308, pp. [23] X. Yang, R. C. Malak, C. Lauer, C. Weidig, H. Hagen, B. Hamann, J. C.
171–174, Feb. 2013. Aurich, and O. Kreylos, “Manufacturing System Design with Virtual
[5] G. Lawson, D. Salanitri, and B. Waterfield, “Future directions for the Factory Tools,” Int. J. Comput. Integr. Manuf., vol. 3052, no. March
development of virtual reality within an automotive manufacturer,” 2014, pp. 1–16, 2013.
Appl. Ergon., vol. 53, pp. 323–330, 2016. [24] T. S. Mujber, T. Szecsi, and M. S. J. Hashmi, “Virtual reality
[6] L. P. Berg and J. M. Vance, “Industry use of virtual reality in product applications in manufacturing process simulation,” J. Mater. Process.
design and manufacturing: a survey,” Virtual Real., 2016. Technol., vol. 155–156, no. 1–3, pp. 1834–1838, 2004.
[7] A. Langley, G. Lawson, S. Hermawati, M. D’Cruz, J. Apold, F. Arlt, [25] A. Sanz Lobera, I. González, A. J. Castejón, and J. L. Casado, “Using
and K. Mura, “Establishing the Usability of a Virtual Training System Virtual Reality in the Teaching of Manufacturing Processes with
for Assembly Operations within the Automotive Industry,” Hum. Material Removal in CNC Machine-Tools,” Mater. Sci. Forum, vol. 692,
Factors Ergon. Manuf. Serv. Ind., vol. 16, no. 1, pp. 61–81, Aug. 2016. pp. 112–119, 2011.
[8] J. Sanjog, S. Karmakar, T. Patel, and A. Chowdhury, “Towards virtual [26] H. A. El-mounayri, C. Rogers, E. Fernandez, and J. C. Satterwhite,
ergonomics: aviation and aerospace,” Aircr. Eng. Aerosp. Technol., vol. “Assessment of STEM e-Learning in an Immersive Virtual Reality ( VR
87, no. 3, pp. 266–273, 2015. ) Envi- ronment,” Am. Soc. Eng. Educ., 2016.
[9] X. Li and H. Liu, “Accessibility evaluation in aircraft cabin based on [27] T. Yu, X. Zhang, W. Liang, and W. Wang, “A web-based virtual system
virtual reality,” Appl. Mech. Mater., vol. 651–653, pp. 1511–1514, for turn-milling center,” Int. J. Adv. Manuf. Technol., vol. 67, no. 9–12,
2014. pp. 2395–2409, 2013.
[10] S. Pick, F. Wefers, B. Hentschel, and T. Kuhlen, “Virtual air traffic [28] M. R. Malte Brettel, Niklas Friederichsen, Michael Keller, “How
system simulation - Aiding the communication of air traffic effects,” Virtualization, Decentralization and Network Building Change the
Proc. - IEEE Virtual Real., pp. 133–134, 2013. Manufacturing Landscape: An Industry 4.0 Perspective,” Int. J. Mech.
Aerospace, Ind. Mechatron. Manuf. Eng., vol. 8, no. 1, pp. 37–44, 2014.
[11] J. Vora, S. Nair, A. K. Gramopadhye, A. T. Duchowski, B. J. Melloy,
and B. Kanki, “Using virtual reality technology for aircraft visual [29] L. Ljung, “State of the Art in Linear System Identification: Time and
inspection training: Presence and comparison studies,” Appl. Ergon., Frequency Domain Methods,” in Proceeding of the 2004 American
vol. 33, no. 6, pp. 559–570, 2002. Control Conference, 2004, pp. 650–660.
[12] A. F. Abate, M. Guida, P. Leoncini, M. Nappi, and S. Ricciardi, “A [30] D. Rixen and D. De Klerk, “Dynamic Substructuring Concepts,” pp. 1–
haptic-based approach to virtual training for aerospace industry,” J. Vis. 17, 2008.
Lang. Comput., vol. 20, no. 5, pp. 318–325, 2009. [31] Z. Hadas, T. Brezina, O. Andrs, J. Vetiska, and L. Brezina, “Simulation
[13] L. Piovano, M. M. Brunello, I. Musso, L. Rocci, and V. Basso, “Virtual modelling of mechatronic system with flexible parts,” 2012 15th Int.
reality representation of Martian soil for space exploration,” Pattern Power Electron. Motion Control Conf., p. LS2e.1-1-LS2e.1-7, Sep.
Recognit. Image Anal., vol. 23, no. 1, pp. 111–129, 2013. 2012.
[14] A. J. van den Bogert, T. Geijtenbeek, O. Even-Zohar, F. Steenbrink, and [32] A. Requicha, “Nanomanipulation with the Atomic Force Microscope,”
E. C. Hardin, “A real-time system for biomechanical analysis of human in Nanotechnology, Weinheim, Germany: Wiley-VCH Verlag GmbH &
movement and muscle function,” Med. Biol. Eng. Comput., vol. 51, no. Co. KGaA, 2010.
10, pp. 1069–1077, Oct. 2013. [33] J. Kovar, J. Rucka, and O. Andrs, “Simulation modelling of water-
[15] S. Delorme, D. Laroche, R. Diraddo, and R. F. Del Maestro, supply network as mechatronic system,” in Proceedings of the 16th
“NeuroTouch: A physics-based virtual simulator for cranial International Conference on Mechatronics - Mechatronika 2014, 2014,
microneurosurgery training,” Neurosurgery, vol. 71, no. SUPPL.1, pp. pp. 697–700.
32–42, 2012. [34] J. Rucka and J. Kovar, “Prevention of Discoloration Events in Water
[16] C. Botella, R. M. Baños, H. Villa, C. Perpiñá, and A. García-Palacios, Distribution Systems,” Procedia Eng., vol. 70, pp. 1441–1449, 2014.
“Virtual reality in the treatment of claustrophobic fear: A controlled,