A PAPER PRESENTATION ON

TELE GRAFFITI
A Pen and Paper-Based Remote Sketching System

R.V.R & J.C COLLEGE OF ENGINEERING GUNTUR.

PAPER PRESENTED BY A.SUDHEER BABU Y10EC803 III/IV B.Tech-ECE RVR & JC College of Engineering. Guntur. sudheer.ambati1@gmail.com Ph no:8712269323 K.HANUMA REDDY Y10EC851 III/IV B.Tech-ECE RVR & JC College of Engineering. Guntur. hanumareddy181@gmail.com Ph no:9490313987

Abstract
Tele-Graffiti is a system allowing two or more users to communicate remotely with hand-drawn sketches. A person writing at one site is captured using a video camera, transmitted to the other site, and displayed there using an LCD projector. Such a system has a variety of applications in

fixture to hold these devices in position and a writing pad to fix the sheet of paper on the top of the table at every participants station. You can write on a regular piece of paper with a pen at your work. When you impose your ideas or sketch on a paper, then your doodling is captured by a camera and the digitized image is transmitted to the receiving end through a data link. This data is transmitted to other user using LAN connection .The projector on other side handles the transmitted video. The projector beams the image on recipients paper. The sender and recipient can now interact as if they are both writing on the same piece of paper while sitting many miles apart. Tele- Graffiti is a newly developed remote sketching system with the following three features : (1) real-time paper tracking to

Teleconferencing and Remote education. It also has potential applications in humancomputer interaction, using the paper as a combined display and input device.The advantage of this system over other

intelligent desktops and white-boards is that the users are free to move the pieces of paper on which they are writing. The system consists of a digital camera, a high resolution LCD projector to project the received image, a mirror to reflect the project image onto a blank paper sheet,

allow the users to move their paper during

system operation, interface, and

(2) a hand based user (3) automatic session

one site is captured using a video camera, transmitted to the other site(s), and displayed there using an LCD projector. A Pen and Paper-Based Remote Sketching System is shown below.

summarization and playback. In this paper, the design, implementation, and performance of Tele-Graffiti is described

1.Introduction
There are several ways of building a remote sketching system.One way is to use a tablet and a stylus to input the sketch and a computer monitor to display the sketch at the remote site. Such systems have a number of disadvantages. Changing colour means using the computer to select a new colour rather than way using of a different a Figure 1: Right: real system. Left one is a detailed view of the system. Figure shown right is real system. Tele-Graffiti is a camera projector based camera to image the sketch at one end, remote sketching system transmit the video to the other end, and recently display . Although the Xerox Double Digital-Desk is Tele-Graffiti is a system allowing two or more users to communicate remotely via handdrawn sketches. What one person writes at an elegant idea, there are a number of technical problems that need to be solved to designed and implemented. that has been Left: system diagram.

pen.Another

building

remote sketching system is to use a video

implement such a real-time system and to make it both practical and usable. Real-Time Paper Tracking:

orientation of the paper is ambiguouswithout the clipboard.

To solve these problems we have developed a paper detection algorithm that takes The users of a remote sketching system will advantage of the facts that (a) the paper is want to move the pieces of paper on which bounded by four long edges roughly they are writing during operation of the perpendicular to each other, (b) we know the system. To allow this capability a cameraapproximate location of the projected image projector based remote sketching system from the previous time-step and therefore its must track the paper in real-time. Such edges can be removed, and (c) the functionality is not available in current asymmetry between the top and the bottom systems, As the paper may move during the of the clipboard can be used to resolve the time lag between image projection and ambiguity capture, we also need to disambiguate the paper from the projected image at previous Video Transmission: To allow real-time time-step. Finally, the two-fold ambiguity in interaction between two people, it is also the paper orientation has to be resolved. necessary that the video transmission between the remote sites be fast enough for smooth Suitable communication. User Providing a in the paper orientation

Interface:A

remote sketching system would be much more useful if it could be controlled without
Figure Paper detection. (1) The camera sees the paper and the projected image from the previous step. (2) The

using the keyboard or mouse. Instead it

would be best if the user could control the system just using their hands.

Stand:We constructed 2 different prototype stands to hold the camera and projector in a compact configuration. In the projector is mounted horizontally on plate Network: The two Tele-Graffiti sites are connected by a localarea network. We have experimented running the system over both 100Base-T and 10Base-T networks.

2.Hardware
Tele-Graffiti Hardware and Calibration In this section we briefly describe the TeleGraffiti hardware and the geometric

calibration of the camera and projector. A schematic diagram of a 2-site TeleGraffiti system is contained in shows photos of 2 real Tele- Graffiti systems. Each TeleGraffiti site components: contains the following

Hand Tracking There are several possible ways of tracking the users hands. One possibility is to use a color based hand tracking algorithm .We chose not to use a color-based algorithm because such

Computer: Each Tele-Graffiti site has a

PC with dual 450MHz Pentium-II

algorithms are generally not sufficiently robust to the variation in the color of the processors, an NVidia GeForce2 GTS video users hand and to the lighting condition. card, and an OrangeLink Firewire Another way of detecting the users hands is (IEEE1394) card. to use an infrared camera .The color Projector: We use an XGA resolution projected by the projector is then not (1024*768 pixels) Panasonic PT-L701U important because the camera primarily only LCD projector. images the heat radiated by the users hands.

Camera: We use a Firewire (IEEE1394)

We base our hand tracking algorithm on Sony DFW-VL500 camera, which we run at background subtraction because it is fast, VGA (640*480 pixels) resolution.

robust, and does not require any special hardware

Sending thread is actually implemented in a second process due to TCP/IP constraints), and the Receiving threads

4.Uses
(1) It gives graphic articles a global reach Architects can tem up with experts abroad to work on designs simultaneously . (2) Distance education will be benefited as students and teacher can interact in their Fig: hardware of A Pen and Paper-Based own handwritings and get minute points and Remote Sketching System doubts classified.
3 . Tele-Graffiti System

Software

(3) It can be considered as a substitute for internet chat as en chat for many could be more interesting than key board exercise. News, information, alerts, warnings can be exchanged in an attractive way. (4) Forms can be filled u in your own hand writing without the need to download, scan and submit the same. Such a system has a variety of applications in teleconferencing and remote education. It also has potential applications in human-computer interaction, using the paper as combined display and

Each Tele-Graffiti site must continuously capture video from the camera, track the paper in the video, warp the video from the other site so that it is aligned with the paper, and communicate with the other site. The following describes the system software that performs all of these tasks. For example. System Architecture Tele-Graffiti runs

under Linux (RedHat 7.1) and consists of 4 threads: the Drawing thread, the Paper Detection thread, the Sending thread (the

input

device

6.

Conclusion

We have described Tele-Graffiti, a cameraprojector based remote sketching system. The major contributions of Tele- Graffiti over existing systems are: Real-Time Paper Tracking: We have developed a real-time The advantage of our system over other intelligent desktops and white-boards [1] is that the users are free to move the pieces of paper on which they are writing. In TeleGraffiti, paper detection and tracking is based on real-time paper boundary paper tracking algorithm that allows the users of Tele-Graffiti to move the paper during operation of the system. Real-Time Video Transmission: We have developed a software architecture for Tele-Graffiti and implemented realtime video transmission over IP networks on standard 450MHz PCs. Hand-Based User Interface: We have added

detection.

5Future

Prospects

a user interface to Tele-Graffiti based on handtracking. The system requires no extra

Researchers are trying to add audio signals hardware, and operates with the Teleand face-tracking mechanism to develop a Graffiti cameras. Infra-red cameras are not remote sketching teleconferencing required. The user interface detects when the system.Efforts are also going on to shrink user has their hand over the paper and the size of the system to the size of table processes their interaction with UI objects lamp such as buttons and sliders. Automatic Summarization: We have developed an

automatic summarization system for TeleGraffiti based on detecting when the users have their hands over the paper. Such a system can automatically summarize a several minute long sketching session into a few frames. The complete Tele-Graffiti system operates at 30Hz on a PC with dual 450MHz Pentium-II processors. With

typical network parameters a video rate of around 10 frames per second is achieved.

Referrences:
1)www.wikipedia.org 2)From books.google.co.in D. Hall, C. L. Gal, J. Martin, T.Kapuscinski, and J. Crowley MagicBoard: A contribution to an intelligent office environment.In Proc. of the 7th Intl. Symp.on Intell. Rob. Sys., 1999. 3) http://www.ri.cmu.edu/research_project_det ail.html 4) http://www.youtube.com/user/TeleGraffiti