MOBILE TESTING SYSTEM

tefan Bele, Katarna Jelemensk, Matej Jurikovi, Peter Pitek, Tom Polk, Jozef Zeman, Marin ucha Slovak University of Technology, Faculty of Informatics and Information Technologies, Slovakia e-mail: Merlin2@centrum.sk; jelemenska@fiit.stuba.sk Abstract. The purpose of this contribution was to present an application for mobile laboratory. Application will be used for testing of practical knowledge of students in digital systems modeling with VHDL and SystemC languages. Communication in mobile lab works using wireless technology (Wi-Fi) together with self designed communication protocol. One of the goals was also to implement protection against plagiarism during the process of testing of students knowledge. Application uses an external compiler taken over from ModelSim SE software. It creates a complete solution optimized for Specification and description languages course.

6th

Int. Conference on

Emerging e-learning Technologies and Applications

The High Tatras, Keywords: skills assessment, virtual classroom, wireless communication technology, mobile Slovakia network, applications, VHDL, language September 11-13, 2008

1. INTRODUCTION Today it is very common to use Content Management Systems (CMS)-type e-learning tools for education purposes; however, most such systems test students knowledge only at the theoretical level. When we analyzed our options, we were unable to find an online solution, which would test practical knowledge in the field of design, modelling, verification and simulation of circuits. The goal of our project was to create this missing link in the chain by using modern options in the form of Hewlett-Packards mobile laboratory, in which we can see a big potential to contribute to education. Our ambition was to create an application, which would make it easier for instructors to evaluate tests and for students more effective to write the source code. Traditional education
Availability Costs of courses and education development Achieved skills and knowledge Costs of course delivery Costs of attendance on a course or education Testing and evaluation Hardly accessible needed transport, timely specified, difficult to determine deadlines Rather high- preparation of presentations and training materials, preparation of trainings High the most effective interactive education, verification, trainings High- investment into a class and equipment, lectors transport accommodation fees High-costs of transport, accommodation, time Not effective, time demanding, monothematic

2. TRADITIONAL FORMS OF EDUCATION, ELEARNING AND OUR APPLICATION E-Learning is an educational process, which uses information and communication technologies for the creation of courses, distribution of educational content, communication between students and instructors, and for study control. Traditional form of education under instructors lead is irretrievable nowadays. Its important to realize, traditional form of education and e-learning represent 2 different forms of attitude to educational content and therefore its convenient to combine these forms. Both forms of education, the traditional form of education and e-learning, are compared in Table 1. For better comparison a possibility of education using virtual class Virtual class
Conveniently accessible, timely specified, needed to determine the deadline Medium - preparation of presentations Rather high effective, partially interactive education. Lower continuous verification Rather low- need of a PC and a lease of virtual class Low- internet and phone connection Immediate feedback and self testing

e-Learning
Highly available anytime and anywhere High- preparation of large groundwork for all eventuality, programming Medium limited interactive education, mostly only final verification 1. low- need for a PC 2. middle with an investment into LMS Low- internet and phone connection Timely less demanding, automatic evaluation, test is created only once

Tab. 1. Comparison of particular forms of education is added, combining best both approaches [1]. In the proposed application for checking of correct VHDL language syntax we use external components borrowed 3. MODELSIM

from the ModelSim SE [2] software environment compiler VCOM, and simulator VSIM. Compiler VCOM VCOM manages the syntax checking and source code compilation described by VHDL, Verilog and SystemC languages (after including all related libraries). It is a command line tool, which displays the loading of libraries, compilation of entities, and in case of error an error message is generated showing the line number and error type. The compiler output can be easily written to a file. Simulator VSIM Using of this tool is not as simple as using the VCOM compiler. When running VSIM, we are presented with its internal command line interface, in which it is important to set simulation parameters. The input of parameters can be automated using *.do scripts, which are handed over to VSIM during its running. After a successful completion of each simulation, VSIM saves its output, which consists of signal flows, to a file with *.wlf extension. In VSIM we can compare two *.wlf files (tested and referenced) and save the comparison in a text form. We analyzed the possibilities of saving the comparison in the form of a picture, which would provide a better and more comprendious picture of simulation. 4. APPLICATION PART Securing the communication During the step by step creation of this product we met various important factors. Product is a 2 layer client-server application, which communicates with the instructors server via a Wi-Fi network. For the Wi-Fi solution we decided to secure the network using the WPA2 protocol, which had to be supported by the network cards on clients and also by the Wi-Fi router. To increase the communication security, we designed our own communication protocol, for which the special frame format was designed. Testing system Processing of the hardware description languages source code has two phases - syntax checking and simulation. Syntax checking. Syntax checking is accessible for the student already during the test, so that the student is able to submit source code without syntax errors. We have created a database of VHDL language reserved words. We took over the system of syntax highlight from ModelSim, because students are familiar with it. Syntax of source code key words is automatically highlighted in periodic time intervals. Simulation (transfer of inputs to outputs). For the simulation checking a sample reference is prepared, which the instructor creates for each assignment wording. Also

prepared is a testbench, which will be connected to the submitted code. It is necessary to exactly specify names and number of inputs and outputs and the name of entity and architecture on the highest level of hierarchy. Violation of these expectations will result in incorrect connection of the testbench to a model created by a student and therefore also a loss of continuous points. The testbench is connected to the code after the submission, so that the system is not exploitable, and the student is not able to prepare data in-step with the reference sample. After adding the testbench, final compilation and simulation takes place, where a sample of signal flows is created for the student. The students sample and the reference sample are compared. Resolution match ratio with a reference sample can be a source of continuous evaluation. Output comparison is accessible to the instructor together with the submitted source code. The work-flow of the application is illustrated in Fig.1.

Fig. 1. Scheme of the testing principle and evaluation of source code 5. APPLICATION STRUCTURE We have designed a testing system with the structure displayed on the Fig. 2. Both client and server have access to the ModelSim compiler (VCOM) and to the ModelSim simulator (VSIM).

Fig. 2. Component diagram Server side Server is used specially for teacher during practical testing of students and it has full access to the network due to license server. Input. Server has two inputs. The first is a testing data file, which consists of assignment wording for the particular test and a reference sample of simulation. The second input is a data file, which consists of a list of students, who will do the test. Both inputs are entered by instructor before the test starts. Output. Server output is a data file, which includes the samples of signal flows and the source codes of respective students. There also is an option to export the evaluation to a file. System functions. The main functions of server are as follows: External running of a compiler and simulator of the ModelSim software, Loading of inputs, Displaying the list of connected clients, specifically first and last name of the student and his ID number, Sending assignment wording to clients, Setting the time for completion of the test, Connection of the testbench to the received source code from a client, Display of the source code in a text editor or in the ModelSim editor, Display of simulation comparisons between the reference code sample and the submitted code sample in the ModelSim environment, Submission of compilation and simulation results to the client, Saving of outputs, Disconnection of clients after the allowed test completion time expires, Automated weighted test evaluation according to specified criteria.

Graphical interface. A graphical interface is used for interaction between the user and the program. It is created based on the user needs and gives simple and a wellarranged menu with functions, which are accompanied by help. An example of server screen is given in Fig. 3. Client side The client is the only allowed application for students during processing of a practical test. Input. Client has more inputs. The primary input is identification data (first name, last name, student ID) of a student. Assignment wording and test evaluation sent from the server and the text, entered into a special component using the keyboard, are other inputs on the client side.

Fig. 3. Server screen example

Fig. 4. Client screen example Outputs. Output is the source code of a student sent to a server as well as a compilation result or simulation from the server side. Functions. The main functions of client are as follows: Students log-in,

Sending of a source code to a server side, Syntax highlight, Display results of compilation and simulation, Display assignment wording sent from a server side, Display the test remaining time, Display the primary test evaluation (automaticaly generated and sent from a server side), Plagiarism protection, Protection against use of forbidden special keys (WINkey, ALT-TAB).

with International Participation, Tatransk Zruby, 23.25. 11. 2005, pp. 201-204. [6] ik, P., Mostafa, H., E.: Early registration: Criterion to Improve Communication-Inter Agents in Mobile- IP Protocol, International Journal of Information Technology, Vol. 3, No. 3, 2006, ISSN 1305-2403, pp. 173 179. THE AUTHORS Bc. Matej Jurikovi He obtained his bachelor degree from Faculty of informatics and information technology STU with specialization Computer systems and nets. He publicised as a co author two contributions on IIT.SRC conference published in almanac Informatics and Information Technologies Student Research Conference, Vydavatestvo STU Bratislava, 2008, ISBN 978-80-227-2848-5 and won the Deans award for Remote control of a cell phone by computer via Bluetooth interface and IEEE award for Mobile education classroom. At the present time he is engaged with his Master thesis: Remote control of a cell phone by computer via Bluetooth interface. Bc. Tom Polk He obtained his bachelor degree from Faculty of informatics and information technology STU with specialization Computer systems and nets. He publicised as a co author one contribution on IIT.SRC conference published in almanac Informatics and Information Technologies Student Research Conference, Vydavatestvo STU Bratislava, 2008, ISBN 978-80-227-2848-5 and won the IEEE award for Mobile education classroom. At the present time he is engaged with his Master thesis: Specialized functions of networking adapter realized in PLD. Bc. Marin ucha He obtained his bachelor degree from Faculty of informatics and information technology STU with specialization Computer systems and nets. He publicised as a co author one contribution on IIT.SRC conference published in almanac Informatics and Information Technologies Student Research Conference, Vydavatestvo STU Bratislava, 2008, ISBN 978-80-227-2848-5 and won the IEEE award for Mobile education classroom. At the present time he is engaged with his Master thesis: Programming support of GPS applications. Bc. Jozef Zeman He obtained his bachelor degree from Faculty of informatics and information technology STU with specialization Software engineering. He publicised as a co author one contribution on IIT.SRC conference published in almanac Informatics and Information Technologies Student Research Conference, Vydavatestvo STU Bratislava, 2008, ISBN 978-80-227-2848-5 and won the IEEE award

Graphical interface. Graphical interface works similarly to the server side. An example of client screen is given in Figure 4. Communication protocol As already mentioned, the communication protocol we created based on Ethernet II frame is an unique one[3][4]. The type of communication between the server and the client is specified in this protocol. Type of data transfer and requests, and its format is up to each request. 6. CONCLUSIONS During the creation of the application we considered all requirements for the final product. Our application makes it possible to examine a large set of jobs in VHDL language. All participants of the examination have at their disposal a source code editor, syntax highlight, VHDL language compiler and simulator outputs. It offers to the instructor a comfortable management of the testing system and a supervision of all examined participants at the same time. The server used by the instructor makes it possible to manage requests from multiple clients in parallel. External use of compiler and simulator of ModelSim software is suitable mainly for its complexity - it offers an option to work in language VHDL, Verilog and SystemC. Other advantages are in the simple control of the compiler and the simulator from the command line and the support for scripting. It is possible to compile and simulate even more complicated combination and sequential circuits with the solution because libraries of ModelSim software are used. Verification of students results is done by comparing the simulation results. Primary test evaluation is automaticaly generated by the system. 7. REFERENCES [1] Kimk P., Nagy A., ucha M.: Projektovanie aplikci potaov - Virtulna kninica, 52s, 2007 [2] ModelSim SE, available at: http://www.model.com [3] Dostlek, L., Kabelov,.A.: Velk prvodce protokoly TCP/IP a systmem DNS. Computer Press, 2002, 3. aktualizov a rozen vydn, s. 438. [4] Transmission Control Protocol, RFC 793, 1981, s. 83 [5] ik, P., Mostafa, H., E.: Handling the Connection Interruption in Mobile Internet In: Communication an Information Technologies, 3rd Scientific Conference

for Mobile education classroom. At the present time he is engaged with his Master thesis: GIS and his usage in regional tourism. Bc. Peter Pitek He obtained his bachelor degree from Faculty of informatics and information technology STU with specialization Computer systems and nets. He publicised as a co author two contributions on IIT.SRC conference published in almanac Informatics and Information Technologies Student Research Conference, Vydavatestvo STU Bratislava, 2008, ISBN 978-80-227-2848-5 and won the Deans award for Remote control of a cell phone by computer via Bluetooth interface and IEEE award for Mobile education classroom. At the present time he is engaged with his Master thesis: Automatic design of logical combinational circuits with multiplexers and SSI integrated circuits. Bc. tefan Bele He obtained his bachelor degree from Faculty of informatics and information technology STU with specialization Computer systems and nets. He publicised as a co author one contribution on IIT.SRC conference published in almanac Informatics and Information Technologies Student Research Conference, Vydavatestvo STU Bratislava, 2008, ISBN 978-80-227-2848-5 and won the IEEE award for Mobile education classroom. At the present time he is engaged with his Master thesis: VOIP attacks generator. Dipl. Ing. Katarna Jelemensk, PhD. She received her Msc. and PhD. degree from Slovak University of Technology Bratislava. Her scientific interests include digital system design and modelling, faulttolerance and reliability, means of hardware specification. She co-authored several scientific papers including: Schwarz J.J., Jelemenska K., Huang Z., Aubry R., Babau J.P.: From CRSM to a Tasking Design, Journal of Computing and Information Technology - CIT, vol. 8, pp. 207-219, Sept. 2000. and Schwarz J.J., Jelemenska K., Huang Z., Aubry R., Babau J.P.: From CRSM Specification to a Real-Time Multitasking Execution Model, ISIE'99, Bled - Slovenia 1999. ACKNOWLEDGEMENTS This work was partially supported by Slovak Science Grant Agency (VEGA VG 1/3104/06 Grid computing systems and its components) and HP Technology for Teaching grant 2007 Mobile Education Center.