Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 561

Declaration in Support of #559 Declaration in Support, filed byApple Inc.. (Attachments: #1 Exhibit 3.02, #2 Exhibit 3.03, #3 Exhibit 3.04, #4 Exhibit 3.05, #5 Exhibit 3.06, #6 Exhibit 3.07, #7 Exhibit 3.08, #8 Exhibit 3.09, #9 Exhibit 3.10, #10 Exhibit 3.11, #11 Exhibit 3.12, #12 Exhibit 3.13, #13 Exhibit 3.14, #14 Exhibit 3.15, #15 Exhibit 3.16, #16 Exhibit 3,17, #17 Exhibit 3.18, #18 Exhibit 3.19, #19 Exhibit 3.20, #20 Exhibit 3.21, #21 Exhibit 3.22, #22 Exhibit 3.23, #23 Exhibit 3.24)(Related document(s) #559 ) (Jacobs, Michael) (Filed on 12/29/2011)

Download PDF
EXHIBIT 3.02 Page 2 of 2 Preliminary Class 345 LICENSE FOR FOREIGN FILING UNDER Title 35, United States Code, Section 184 Title 37, Code of Federal Regulations, 5.11 & 5.15 GRANTED The applicant has been granted a license under 35 U.S.C. 184, if the phrase "lF REQUIRED, FOREIGN FILING UCENSE GRANTED" followed by a date appears on this form. Such licenses are issued in all applications where the conditions for issuance of a license have been met, regardless of whether or not a license may be required as set forth in 37 CFR 5.15. The scope and limitations of this license are set forth in 37 CFR 5.15(a) unless an earlier license has been issued under 37 CFR 5.15(b). The license is subject to revocation upon written notification. The date indicated is the effective date of the license, unless an earlier license of similar scope has been granted under 37 CFR 5.13 or 5.14. This license is to be retained by the licensee and may be used at any time on or after the effective date thereof unless it is revoked. This license is automatically transferred to any related applications(s) filed under 37 CFR 1.53(d). This license is not retroactive. The grant of a license does not in any way lessen the responsibility of a licensee for the security of the subject matter as imposed by any Government contract or the provisions of existing laws relating to espionage and the national security or the export of technical data. Licensees should appnse themselves of current regulations ecially with respect to certain countries, of other agencies, particularly the Office of Defense Trade Controls, eDsep artment of State (with respect to Arms, Munitions and Implements of War (22 CFR 121-128)); the Office of Expport Administration, Department of Commerce (15 CFR 370.10 (j)); the Office of Foreign Assets Control, Department of Treasury (31 CFR Parts 500+) and the Department of Energy. NOT GRANTED No license under 35 U.S.C. 184 has been granted at this time, if the phrase "lF REQUIRED, FOREIGN FILING LICENSE GRANTED" DOES NOT appear on this form. Applicant may still petition for a hcense under 37 CFR 5.12, if a license is desired before the expiration of 6 months from the filing date of the application. If 6 months has lapsed from the filing date of this application and the licensee has not received any indication of a secrecy order under 35 U.S.C. 181, the licensee may foreign file the apphcation pursuant to 37 CFR 5.15(b). APLNDC00025540 PE IN THE UNITED STATES PATENT AND TRADEMARK OFFICE e application of: Hotelling et al. Attorney Docket No.: APL1P305/P3266 Application No.: 10/840,862 Examiner: Unassigned Filed: May 6, 2004 Group: 2673 Title: MULTIPOINT TOUCHSCREEN CERTIFICATE OF MAILING I hereby certify that this correspondence is being deposited with the U.S. Postal Service with sufficient postage as first-class mail on August 23, 2005 in an envelope addressed to the Commissioner for Patents, P.O. Box 1450 AleLxadndria, V 2313-1450. Linda L. Pollock INFORMATION DISCLOSURE STATEMENT 37 CFR §§1.56 AND 1.97(b) Mail Stop Amendment Commissioner for Patents P.O. Box 1450 Alexandria, VA 22313-1450 Dear Sir: The references listed in the attached PTO Form 1449, copies of non-U.S. references are attached, may be material to examination of the above-identified patent application. Applicants submit these references in compliance with their duty of disclosure pursuant to 37 CFR §§1.56 and 1.97. The Examiner is requested to make these references of official record in this application. This Information Disclosure Stato,cut is not to be construed as a representation that a search has been made, that additional information material to the examination of this application does not exist, or that these references indeed constitute prior art. This Information Disclosure Statement is: (i) filed within three (3) months of the filing date of the above-referenced application, (ii) believed to be filed before the mailing date of a first Office Action on the merits, or (iii) believed to be filed before the mailing of a first Office Action after the filing of a Request for Continued Examination under §1.114. Accordingly, it is APL1P305/P3266 1 APLNDC00025541 believed that no fees are due in connection with the filing of this Information Disclosure Statement. However, if it is determined that any fees are due, the Commissioner is hereby authorized to charge such fees to Deposit Account 500388 (Order No. APL1P305). Respectfully submitted, BEYER WEAVER & THOMAS, LLP Quin C. Hoellwarth Registration No. 45,738 P.O. Box 70250 Oakland, CA 94612-0250 APLlP305/P3266 2 APLNDC00025542 Form 1449 (Modifi Information Disclosure Statement By Applicant (Use Several Sheets if Necessary) Atty Docket No. APLlP305/P3266 Applicant: Hotelling et al. Filing Date May 6, 2004 Application No.: 10/840,862 Group 2673 U.S. Patent Documents Exarniner Initial Examiner Initial SubNo. Al A2 A3 A4 A5 A6 A7 A8 A9 A10 Al l Al2 Patent No. 2002/0015024 Al 3,662,105 3,798,370 5,825,351 6,188,391 B1 6,323,846 Bl 6,570,557 B1 6,593,916 B1 6,650,319 B1 6,677,932 B1 6,856,259 B1 6,888,536 B2 Date 02-07-02 05-09-72 03-19-74 10-20-98 02-13-01 11-27-01 05-27-03 07-15-03 11-18-03 01-13-04 02-15-05 05-03-05 Patentee Westerman Hurst et al. Hurst Tam Seely et al. Westerman Westerman Aroyan Hurst et al. Westerman Sharp Westerman Class Filing class Date 07-31-01 05-21-70 04-17-72 11-15-95 07-09-98 01-25-99 02-10-01 11-03-00 03-05-99 01-28-01 02-06-04 07-31-01 et al. et al. et al. et al. Foreign Patent _or Published Foreign Patent Application Document Publication Country or SubNo. No. Date Patent Office Class class A13 A14 A15 A16 A17 Translation Yes No Other Documents Examiner Initial No. Al8 A19 A20 Author, Title, Date, Place (e.g. Journal) of Publication U.S. Patent Application No. 10/654,108 filed September 2, 2003. U.S. Patent Application No. 10/789,676 filed February 27, 2004. U.S. Patent Application No. 10/903,964 filed July 30, 2004. A21 A22 U.S. Patent Application No. 11/015,978 filed December 17, 2004. U.S. Patent Application No. 11/038,590 filed January 18, 2005. A23 A24 A25 U.S. Patent Application No. 11/048,264 filed January 31, 2005. "Touch Technologies Overview," 2001, 3M Touch Systems, Massachusetts. "Touchscreen Technology Choices," http://www.elotouch.com/products/detech2.asp, downloaded August 5, 2005. APL1P305/P3266 Pg. 1 of 2 APLNDC00025543 A26 A27 A28 A29 A30 A31 Jun Rekimoto, "SmartSkin: An Infastructure for Freehand Manipulation on Interactive Surfaces," CHI 2002, April 20-25, 2002, Minneapolis, Minnesota. "Wacom Components -- Technology," http:. /www.wacomomponents.com/english/tech.asp., downloaded October 10, 2004. "Comparing Touch Technologies," http;//www.touçhsçreens.çomfintrouclgyge.sjtng downloaded October 10, 2004. "GlidePoint®," http;//www.cirgue=çom/technology/technology gg.htm downloaded August 5, 2005. "Captive Position Sensing," http://www.svnapticaçom/teghpology/cys efin, downloaded August 5, 2005. "How do touchscreen monitors know where you're touching?," http;//electronics.howstuffworks.çom/guestion?lé.htm, downloaded August 5, A32 A33 A34 A35 A36 A37 A38 A39 A40 2005. "How Does a Touchscreen Work?," htty//www.touchscreens..com/introanatomy.html, downloaded August 5, 2005. "4-Wire Resistive Touchscreens," http://www.touçhsçreens.com/introtouchtypesggistive.html, downloaded August 5, 2005. "5-Wire Resistive Touchscreens," htteillwww.topçhgçreças,com/intro- touchtypes-resistive.html, downloaded August 5, 2005. "Capacitive Touchscreens," httW//www.touçhscreens.com/intro-touchtypescapacitive htmL downloaded August 5, 2005. "PenTouch Capacitive Touchscreens," httg//www.touchscreens.com/ ntrotouchtypes-pentouch.html, downloaded August 5, 2005. "Surface Acoustic Wave Touchscreens," httg://www.touçhsçreens.com/introtou.c types-saw.html downloaded August 5, 2005. "Near Field Imaging Touchscreens," htty;//www.touçhsçreens com/ ntrotouchtypes-nfi.html, downloaded August 5, 2005. "Infrared Touchscreens," htta://www.touchscreens.com/intro-touchtvpesinfrared.html, downloaded August 5, 2005. "Watershed Algorithm," htto://rsb.info.nih.gov/ii/nlumins/watershed html, downloaded August 5, 2005. Examiner Date Considered Examiner: Initial citation considered. Draw line through citation if not in conformance and not considered. Include copy of this form with next co ication to applicant. APL1P305/P3266 Pg. 2 of 2 APLNDC00025544 BEST AVAILABLE COPY TOUCH TECHNO.LOGI . UV€YVl€W Touch is everywhere Touch screens are fast becoming the preferred interface between users and their personal, professional,yrid public access technology. The intuit veness of touch screens combined with the spic ease-of-use, and extreme durability. òÀ popul äie esta st a few reasons why touch is so ntshbars, and casinos, touch In indust'rial environments like assembly lines and factories ouch screens are simplifying process automatio'nä In museums, hotel lobbies, and shopping malls touc enabled kiosks provide easy access to information. nd for children involved in educational training, touc'h-is an instinctive way to interact with computers. a d entertainment. There are several types of touch screen technologies offered by various worldwide manufacturers. Each technology has its own set of characteristics and depending on your touch application, these differences may be viewed as benefits or disadvantages. Consider the following questions. The answers to these questions will help you begin to understand your touch needs. Activation Cost What type of touch activation do you need - finger only, gloved finger, or stylus input. What are your cost requirements? Options Do you need touch buttons, drag and drop, or signature capture? Image Clarity Is optical clarity the most important requirement? Space Reliability Will the touch screen have to stand up to dust, grease, or shock vibrations. Durability Will your touch screen be exposed to harsh environments? Will it need to be impact resistance? Vandal Resistant Do you need a compact screen size? Will the touch screen be in an unattended public environment and subject to abuse? Sealability Power Will your touch screen be exposed to Do you have specific power requirements liquids, chemicals, or fluxtuating weather or constraints? extremes. APLNDC00025545 BEST AVAl .ABLE COPY TOUD H TECHNOLOGIES Overview Most touch solutions have a touch screen attached to a video display unit. The touch screen works with a controller and a software device driver to sense a touch, determine its location, and transmit the information to the computer's operating system. Touch solutions primarily use one of five technologies, each with characteristics that make it best suited for specific applications. RESISTIVE PET film Spacer dot ITO conductive coating Top circuit layer ITO conductive coating Bottom circuit layer Glass or acrytic backing panel Touch creates contact between resistive circuit layers, closing a switch Resistive technology is versatile and economical for applications such as food service and retail point-of-sale, industrial process control and Instrumentation, portable and handheld products, and communication devices. Resistive touch screens have a flexible Advantages top layer and a rigid bottom layer • Value solution separated by insulating dots, with the • Activated by any stylus inside surface of each layer coated with • High touch point resolution a transparent conductive coating. • Low power requirements Voltage applied to the layers produces a gradient across each layer. Pressing the Disadvantages flexible top sheet creates electrical • Reduced optical clarity contact between the resistive layers, • Polyester surface can be essentially closing a switch in the damaged circuit. Controller determines between layers to get touch coordinates CAPACITIVE Capacitive technology offers durability, reliability, and optical clarity. Popular applications include gaming machines, ATM installations, kiosks, industrial equipment, and point-of-sale. Advantages • Extremely durable • Very accurate • Good optical clarity • Good resolution Disadvantages • Requires bare finger or capacitive stylus • Severe scratch can affect operation within the damaged area Capacitive touch screens are curved or flat glass substrates coated with a transparent metal oxide. A voltage is applied to the corners of the overlay creating a minute uniform electric field. A bare finger draws current from each corner of the electric field, creating a voltage drop that is measured to determine touch location. ,applied Uniform electrictield Touch draws current kom each comer of electric field creating a voltage drop which is calculated by the controller. APLNDC00025546 BEST AVAI .ABLE COPY NEAR FIELD IMAGINGTM Image processing controller Near Field imaging, a projected capacitive technology, is extremely rugged, yet sensitive to touch, making it perfect for harsh industrial environments and unsupervised klosks. Continuous re-imaging of touch profile Image of changes in electrostatic fleid caused by touch Touch screer (sensor) Contoller ol actual touch point Advantages Near Field Imaging (NFI) touch screens consist of two laminated glass sheets with a patterned coating of transparent metal oxide between. An AC signal is applied to the patterned conductive coating, creating an electrostatic field on the surface of the screen. When a finger gloved or ungloved - or other conductive stylus comes into contact with the sensor, the electrostatic field is disturbed. • Good optical clarity • Extremely durable - scratch and debris resistant glass front • Operates with fingers, gloves or or conductive stylus • Accurate - even under harsh conditions Disadvantages • Slightly less touch resolution Coordinates fed back to operating system ACOUSTIC WAVE Because of its high optical clarity and accuracy, acoustic wave technology is typically used in kiosk applications. Advantages • Good optical clarity • Z-axis capability • Durable glass front Disadvantages • Requires finger or sound absorbing stylus • Difficult to industrialize • Signal affected by surface liquids or other contaminants Sound wave reflector Transducers emit sound waves along sides Acoustic wave touch screens use transducers mounted at the edge of a glass overlay to emit ultrasonic sound waves along two sides. These waves are reflected across the surface of the glass and received by sensors. A finger or other soft tipped stylus absorbs some of the acoustic energy and the controller measures the amplitude change of the wave to determine touch location. 1 Sensor Sensor Touch absorbs some acoustic energy from sound waves Controller measures wave amplitude change to determine touch location NFRARED Infrared touch screens are primarily used for large displays, banking machines, and in military applications. Light emitting diodes , Touch screen Light beams de rs Light emitting diodes L ght detectors Touch interrupts light beam and causes drop în signal received by light detectors Infrared touch screens are based on light-beam interruption technology. Instead of an overlay on the surface, a frame surrounds the display. The frame has light sources, or light emitting diodes (LEDs) on one side and light detectors on the opposite side, creating an optical grid across the screen. When an object touches the screen, the invisible light beam is interrupted, causing a drop in the signal received by the photosensors. Advantages • 100% light transmission (not an overlay) • Accurate Disadvantages • Costly • Low reliability (MTBF for diodes) • Parallax problems • Accidental activation • Low touch resolution • No protection for display surface APLNDC00025547 BEST AVAILABLE COPY 3M TOUCH SOLUTIONS Now that you've thought about the touch requirements and limitations of your application, and the advantages and disadvantages of each technology, give us your most challenging touch application and we'll give you a solution. MicroTouch"' Touch Screens Your satisfaction is our success. Purchase off-the-shelf components for quick and easy touch product development or work with our engineers to create custom solutions. You can choose from our capactive product line, known for exceptional clarity and durability, with ClearTek'" capacitive for public-use applications, and Near Field Imaging"' projected capacitive for those extremely harsh touch environments. For resistive solutions, we'll assist you in choosing from FG and PL constructions, using 4-, 5-, or 8-wire designs to help you get the best resistive product for your application. Notice: Given the variety of factors that can affect the use and performance of a 3M Touch Systems product, including that solid state equipment has operation characteristics different from electromechanical equipment, some of which factors are uniquely within Usefs knowledge and control, it is essential that User evaluate the 3M Touch Systems product to determine whether it is suitable for Usets particular purpose and suitable for Users method of application. 3M Touch Systems' statements, engineering/technical information, and recommendations are provided for Users convenience, but their accuracy or completeness is not warranted. 3M Touch Systems products are not specifically designed for use in medical devices as defined by United States federal law. 3M Touch Systems products should not be used in such applications without 3M Touch Systems' express written consent. User should contact its sales representative if Users opportunity involves a medical device application. IMPORTANT NOTICE TO PURCHASER: Specifications are subject to change without notice. 3M Touch Systems Products are warranted to meet their published specifications from the date of shipment and for the period stated in the specification. 3M Touch Systems makes no additional warranties, express or Implied, including but not ilmited to any impiled warranties of merchantability or fitness for a particular purpose. User is responsible for determining whether the 3M Touch Systems products are fit for Users particular purpose and suitable for its method of production, including intellectual property liability for Users application. If a Product is proven not to have met 3M Touch Systems' warranty, then 3M Touch Systems' sole obligation and Users and Purchasefs exclusive remedy, will be, at 3M Touch Systems' option, to repair or replace that Product quantity or to refund its purchase price. 3M Touch Systems has no obligation under 3M Touch Systems' warranty for any Product that has been modified or damaged through misuse, accident, neglect, or subsequent manufacturing operations or assemblies by anyone other than 3M Touch Systems. 3M Touch Systems shall not be liable in any action against it in any way related to the Products for any loss or damages, whether non-specified direct, Indirect, special, Incidental or consequential (including downtime, toss of profits or goodwill) regardless of the legal theory asserted. (11/01R2) 3M 3M Touch Systems 3M Optical Systems Division 300 Griffin Brook Park Drive Methuen, MA 01844 U.S.A. www.3Mtouch.com Worldwide Manufacturing Plants: Austin, Texas Methuen, Massachusetts Milwaukee, Wisconsin Vancouver, BC Canada Abingdon, UK For more information on 3M touch products, visit 3Mtouch.com or call toll-free 1-866-407-6666 m 10% post-consumer W waste paper printed in USA MicroTouch, Near Field Imaging, and ClearTek are trademarks of 3M. ©2001 3M TOUCHOV-0502 APLNDC00025548 This Page is Inserted by IFW Indexing and Scanning Operations and is not part of the Official Record BEST AVAIL A RLE IMA GES Defective images within this document are accurate representations of the original documents submitted by the applicant. Defects in the images include but are not limited to the items checked: O BLACK BORDERS AGE CUT OFF AT TOP, BOTTOM OR SIDES FADED TEXT OR DRAWING BLURRED OR ILLEGIBLE TEXT OR DRAWING S WEDISLANTED IMAGES COLOR OR BLACK AND WHITE PHOTOGRAPHS O GRAY SCALE DOC•--NTS O LINES OR M- ON ORIGINAL DOCUMENT O REFERENCE(S) OR EXHIBIT(S) SUBMITTED AR POOR QUALITY OTHER: I rvi A GES A Im BEST AVAILABLE COPY. As rescanning these documents will not correct the image problems checked, please do not report these problems to the I¥ w Image Problem Mailbox. APLNDC00025549 4Watershed Algorithm Page 1 of 2 Watershed Algorithm Author: History: Requires: Source: Installation: Christopher Mei (christopher.mei at sophia.inria.fr) 2003/12/15 : First version ImageJ l.31p or later, which adds the ability to package plugins in JAR files Contained in Watershet Algorithm-lar, which can be opened using a ZIP utility Download Watershed Algorithm.jar to the plugins folder, or subfolder, restart Imag there will be a new Plugins/Filters/Watershed Algorithm... con,msd. See Also: Watershedalugin by Daniel Sage Process/Binag/Watershed command Description: This algorithm is an implementation of the watershed immersion algorithm written VincentandSoille(1991). @Article{Vincent/Soille:1991, author = "Lee Vincent and Pierre Soille", year = "1991", keywords = "IMAGE-PROC SKELETON SEGMENTATION GIS", institution = "Harvard/Paris+Louvain", title = "Watersheds in digital spaces: An efficient algc based on immersion simulations", journal = "IEEE PAMI, 1991", volume = "13", number = "6", pages = "583--598", annote = "Watershed lines (e.g. the continental divide) « boundaries of catchment regions in a topographic The height of a point on this map can have a dir correlation to its pixel intensity. WIth this an the morphological operations of closing (or open can be understood as smoothing the ridges (or fi in the valleys). Develops a new algorithm for ot the watershed lines in a graph, and then uses th developing a new segmentation approach based on {"}depth of immersion{"}.", } A review of Watershed algorithms can be found at : http://www.cs.rug.nl/~roe/publications/parwshed.pdf @Article{RoeMeiOO, author = "Roerdink and Meijster", title = "The Watershed Transform: Definitions, Algoritha Parallelization Strategies", journal = "FUNDINF: Fundamenta Informatica", volume = "41", publisher = "IOS Press", year = "2000", } http://rsb.info.nih.gov/ij/plugins/watershed.html 8/5/2005 APLNDC00025550 Watershed Algorithm , Page 2 of 2 e e e e The image on the left represents the type of result obtained from the thresholding of classical images where Watershed segmentation is efficient. This could be a picture of coffee beans, blood cells, sand ... The segmentation on the right was obtained with the following operations : invert image (Edit/Invert), calculate the distance transform (Process/Binary/Distance Map), invert result, apply Watershed. Plugins | Home | BEST AVAgeLE COPY http://rsb.info.nih.govlij/plugins/watershed.html 8/5/2005 APLNDC00025551 Infrared Touchscreens introduction Page 1 of 1 Product Catalog Sales Tech Support Our Con Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies > Infrared Infrared Touchscreens We offer Infrared touchscreen technology with the Plasma display solutions that we offer. This is the only type of touch technology that we have available for large displays such as Plasma screens. It is a durable technology that offers high image clarity. Responds to any input device or stylus. Please contact us for more information. TouchScreens.com is owned and operated by Mass Multimedia, Inc È Call:1-800-348-8610 E-mail: info@touchscreen BEST AVAI..ABLE COPY http://www.touchscreens.com/intro-touchtypes-infrared.html 8/5/2005 APLNDC00025552 Near Field Imaging Touchscreens Introduction Product Catalog Page 1 of 1 Sales Tech Support Our Con Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies > Near Field Imaging Near Field Imaging Touchscreens We offer Near Field Imaging touchscreen technology as one of the custom LCD touch monitor solutions that we can provide. It is an extremely durable screen that is suited for use in industrial control systems and other harsh environments. This rugged screen type is not affected by most surface contaminants, scratches, or vibration. Responds to finger or gloved hand. Please contact us for more information. TouchScreens,com is owned and operated by Mass Multimedia, Inc È Call: 1-800-348-8610 E-mail: info@touchscreen: BEST AVAl .ABLE COPY http://www.touchscreens.com/intro-touchtypes-nfi.html 8/5/2005 APLNDC00025553 Surface Acoustic Wave Touchscreens BEST AvAtemote ,.se y gammä©niiri.; Introduction Product Catalog Page 1 of2 BEST AVAI .ABLE COPY Sales Tech Support Our Con Now at: Home > introduction > Comparing Technologies > Comparing Touch Technologies > Surface Acoustic Wave Surface Acoustic Wave Touchscreens Surface Acoustic Wave technology is one of the most advanced touch screen types. It is based on sending acoustic waves across a clear glass panel with a series of transducers and reflectors. When a finger touches the - n, the waves are absorbed, causing a touch event to be detected at that point. Because the panel is all glass there are no layers that can be worn, giving this technology the highest durability factor Transducer Reilectors and also the highest clarity. This technology is recommended for public information kiosks, computer based training, or other high traffic indoor environments. Advantages • High touch resolution e Highest image clarity e All glass panel, no coatings or layers that can wear out or damage Disadvantages • Must be touched by finger, gloved hand, or softtip stylus. Something hard like a pen won't work • Not completely sealable, can be affected by large amounts of dirt, dust, and / or water in the environment. Touchscreen Specifications Touch Type: Elo IntelliTouch Surface Acoustic Wave Cable Interface: PC Serial/COM Port or USB Port Touch 4096 x 4096 Resolution: Activation Force: less than 3 ounces Light Transmission: 90% Expected Life: 50 million touches at one point Temperature: Operating: -20°C to 50°C Storage: -40°C to 71°C Humidity: Operating: 90% RH at max 40°C, non-condensing Chemical The active area of the touchscreen is resistant to all chemicals that do not affect glass, such as: Acetone, Resistance: Regulations: Toluene, Methyl ethyl ketone, Isopropyi alcohol, Methyl alcohol, Ethyl acetate, Ammonia-based glass cleaners, Gasoline, Kerosene, Vinegar UL, CE, TUV, FCC-B Software Drivers: Windows XP, 2000, NT, ME, 98, 95, 3.1, DOS, Macintosh OS, Linux, Unix (3rd Party) TouchScreens.com is owned and operated by Mass Multimedia, Inc http://www.touchscreens.com/intro-touchtypes-saw.html È Call: 1-800-348-8610 E-mail: info@touchscreen: 8/5/2005 APLNDC00025554 Surface Acoustic Wave Touchscreens http://www.touchscreens.com/intro-touchtypes-saw.html Page 2 of 2 8/5/2005 APLNDC00025555 PenTouch Capacitive Touchscreens BEST AVAILABLE COPY Page 1 of 2 Introduction Product Catalog Sales Tech Support Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies > PenTouch Capacitive Our Con PenTouch Capacitive Touchscreens capacitive Technology -Now it works 2. Electrodes are spread uniformly across thefield 1. Voltageis applied to each conier 4 Controiter calculates position, of the finger from. the current The PenTouch Capacitive screen is a durable Capacitive type touchscreen with an attached pen stylus. The PenTouch screen can be set to respond to finger input only, pen input only, or both. A capacitive touch screen consists of a glass panel with a capacitive (charge storing) material coating its surface. Circuits located at corners of the screen measure the capacitance of a person touching the overlay. Frequency changes are measured to determine the X and Y coordinates of the touch event. i Touch of &ger draws current from each side prépodionally Capacitive type touch screens are very durable, and have a high clarity. They are used in a wide range of applications, from restaurant and POS use to industrial controls and information kiosks. Advantages • High touch resolution • High image clarity Disadvantages • Must be touched by finger or attached pen stylus, will not work with any non-conductive input • Not affected by dirt, grease, moisture. • Attached pen stylus for precise input Touchscreen Specifications Touch Type: 3M PenTouch Capacitive Cable Interface: PC Serial/COM Port (9-pin) or USB Port Touch Resolution: 1024 x 1024 Activation Force: less than 3 ounces Light Transmission: 88% at 550 nm wavelength (visible light spectrum) Durability Test: 100,000,000 plus touches at one point Temperature: Operating: -15°C to 50°C Storage: -50°C to 85°C Humidity: Chemical Operating: 90% RH at max 40°C, non-condensing The active area of the touchscreen is resistant to all chemicals that do not affect glass, such as: Acetone. Regulations: Gasoline, Kerosene, Vinegar UL, CE, TUV, FCC-8 Resistance: Toluene, Methyl ethyl ketone, Isopropyl alcohol, Methyl alcohol, Ethyl acetate, Ammonia-based glass cleaners. Software Drivers: WindowsXP, 2000, NT, ME, 98, 95, 3 1, DOS, Macintosh OS, Linux, Unix (3rd Party) http://www.touchscreens.com/intro-touchtypes-pentouch.html 8/5/2005 APLNDC00025556 F PenTouch Capacitive Touchsc TouchScreens.com is owned and operated by Mass Multimedia, Inc. Page 2 of 2 È Call: 1-800-348-8610 http://www.touchscreens.com/intro-touchtypes-pentouch.html E-mail: info@touchscreen: 8/5/2005 APLNDC00025557 apacitive Touchscreens BEST AVAILABLE COPY Page 1 of 2 Introduction Product Catalog Sales Tech Support Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies > Capacitive Our Con Capacitive Touchscreens Capacitive Technology - How it Works i Electrodes are spread uniformly across the field Voltage is applied tn éactrcainer 4. Controller calculates position. of the finger from. the oùrrent i Touch of finger draws curerit fromeach side próportionälly Advantages e High touch resolution e High image clarity • Not affected by dirt, grease, moisture. Touch Type: Cable Interface: A capacitive touch screen consists of a glass panel with a capacitive (charge storing) material coating its surface. Circuits located at corners of the screen measure the capacitance of a person touching the overlay. Frequency changes are measured to determine the X and Y coordinates of the touch event. Capacitive type touch screens are very durable, and have a high clarity. They are used in a wide range of applications, from restaurant and POS use to industrial controls and information kiosks. Disadvantages • Must be touched by finger, will not work with any non-conductive input Touchscreen Specifications 3M ClearTek Capacitive PC Serial/COM Port (9-pin) or USB Port Touch Resolution: 1024 x 1024 Activation Force: Light Transmission: Durability Test: Temperature: less than 3 ounces 88% at 550 nm wavelength (visible light spectrum) Humidity: Chemical Resistance: Operating: 90% RH at max 40°C, non-condensing The active area of the touchscreen is resistant to all chemicals that do not affect glass, such as: Acetone, Toluene, Methyl ethyl ketone, Isopropyl alcohol, Methyl alcohol, Ethyl acetate, Ammonia-based glass cleaners, Gasoline, Kerosene, Vinegar 100,000,000 plus touches at one point Operating: -15°C to 50°C Storage: -50°C to 85°C Regulations: UL, CE. TUV, FCC-B Software Drivers: WindowsXP, 2000, NT, ME, 98, 95, 3.1, DOS, Macintosh OS, Linux, Unix (3rd Party) TouchScreens.com is owned and operated by Mass Multimedia, Inc Û Call: 1-800-348-8610 http://www.touchscreens.com/intro-touchtypes-capacitive.html E-mail: info@touchscreen: 8/5/2005 APLNDC00025558 Gapacitive Touchscreens http://www.touchscreens.com/intro-touchtypes-capacitive.html Page 2 of 2 8/5/2005 APLNDC00025559 T4ouchscreen technology options - Elo TouchSystems Page 1 of 3 BEST AVA1..ABLE COPY Touchscreen Technology Choices PAarNERS SUPPORT ow To BuY av.icES COMPANY IN Products , AccuTouch Five-Wire Resistive AccuTouch five-wire resistive technology is the workhorse of resistive touchscreens, providing unsurpassed performance. When activated with a finger, gloved hand, fingernail, or object such as a credit card, the AccuTouch touchscreen delivers a fast, accurate response every time. It is impervious to environmental conditions such as liquid spills and splashes, humidity, and washdown-the most contamination-resistant touchscreen available. AccuTouch is widely used in point-of-sale, industrial, and medical applications and is available for both flat panel and CRT solutions. Read more about AccuTouch technology. AT4 Four-Wire Resistive Elo TouchSystems' AT4 four-wire resistive technology is the entrylevel touch solution. Its benefits include stable operation, quick touch response, input flexibility, narrow border width, less weight, and low power consumption. AT4 resistive touchscreens are ideal for industrial applications, portable medical and field automation devices, access control terminals, office equipment, home appliances, and wearable computers-almost anywhere a small display is used. Read more about AT4 technology. CarrollTouch Infrared CarrollTouch infrared technology is the survivor of harsh applications. It's the only technology that does not rely on an overlay or substrate to register a touch, so it's impossible to physically "wear out" the touchscreen. CarrollTouch technology combines superior optical performance with excellent gasketsealing capabilities, so it's an excellent choice for harsh industrial and outdoor kiosk applications. Touched with a finger, gloved hand, fingernail, or stylus, it delivers a fast, accurate response every time. CarrollTouch infrared technology is available for flat panel solutions. Read mom about CarrollTouch technology. IntelliTouch Surface Wave IntelliTouch surface wave is the optical standard of touch. Its pure glass construction provides superior optical performance and makes it the most scratch-resistant technology available. It's nearly impossible to physically "wear out" this touchscreen. IntelliTouch is widely used in kiosk, gaming, and office automation applications and is available for both flat panel and CRT solutions. Read more about IntelliTouch technology. http://www.elotouch.com/products/detech2.asp 8/5/2005 APLNDC00025560 Touchscreen technology options - Elo TouchSystems Page 2 of 3 SecureTouch Surface Wave SecureTouch provides all the features of IntelliTouch along with tempered glass construction for superior resistance to breakage and vandalism. It's nearly impossible to physically break or "wear out" these touchscreens. SecureTouch is widely used in kiosk, gaming, and office automation applications and is available for flat panel solutions. Read more about SecureTouch technology. iTouch Touch-on-Tube Surface Wave For CRT-based applications, iTouch touch-on-tube technology provides superior optical and image quality. The surface wave technology is applied directly to the faceplate of the CRT, so 100% of the image's original brightness and clarity comes through. The CRT faceplate is extremely strong and resistant to scratches, breakage, and vandalism. iTouch is widely used in kiosk, gaming, and office automation applications and is available for CRT solutions. Read more about iTouch technology. Projected Capacitive Projected capacitive technology enables touches to be sensed through a protective layer in front of a display, allowing touchmonitors to be installed behind store windows or vandalresistant glass. DirectTouch consists of a 7.8 mm sensor with tempered glass outer layer, and ThruTouch works through a customer-installed outer layer. The complete system resists impacts, scratches, and vandalism and is also unaffected by moisture, heat, rain, snow and ice, or harsh cleaning fluids, making it ideal for outdoor applications. The solid-state touchscreen and controller provide increased levels of reliability and longer life expectancy, resulting in a drift-free response and a lowmaintenance unit that requires no recalibration. Read more about projected capacitive technology. Surface Capacitive Surface capacitive touchscreens provide a solution for customers who want an alternative to their capacitive options available today. Elo's narrow, patented Z-borders yield an inherently linear sensor. The transparent protective coating makes the sensor resistant to scratches and abrasions. Touch performance is unaffected by everyday abuse and mishaps such as dirt, dust, condensation, liquid spills, contaminants or cleaning solutions. Yet the surface capacitive touchscreens respond quickly and easily with excellent dragging performance. And the Elo-designed controller responds to quick, light touches, and operates drift-free even in areas of poor grounding. Read more about surface capacitive technology. tLome | Contact Us | Search | Rita Man http://www.elotouch.com/products/detech2.asp Neweinnor 8/5/2005 APLNDC00025561 Touchscreen technology options - Elo TouchSystems Page 3 of 3 © 1999-2005 Elo TouchSystems, Inc. All rights reserved. http://www.elotouch.com/products/detech2.asp 8/5/2005 APLNDC00025562 SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces Jun Rekimoto Interaction Laboratory Sony Computer Science Laboratories, Inc. 3-14-13 Higashigotanda Shinagawa-ku, Tokyo 141-0022, Japan Phone: +81 3 5448 4380 Fax: +81 3 5448 4273 Mail: rekimoto@acm.org http://www.csl.sony.co.jp/person/rekimoto.html ABSTRACT This paper introduces a new sensor architecture for making interactive surfaces that are sensitive to human hand and finger gestures. This sensor recognizes multiple hand positions and shapes and calculates the distance between the hand and the surface by using capacitive sensing and a mesh-shaped antenna. In contrast to camera-based gesture recognition systems, all sensing elements can be integrated within the surface, and this method does not suffer from lighting and occlusion problems. This paper describes the sensor architecture, as well as two working prototype systems: a table-size system and a tablet-size system. It also describes several interaction techniques that would be difficult to perform without using this architecture. Keywords Interactive surfaces, gesture recognition, augmented tables, two-handed interfaces, touch-sensitive interfaces. INTRODUCTION Many methods for extending computerized workspace beyond the computer screen have been developed. One goal of this research has been to turn real-world surfaces, such as tabletops or walls, into interactive surfaces [23, 21, 16, 20, 9]. The user of such a system can manipulate, share, and transfer digital information in situations not associated with PCs. For these systems to work, the user's hand positions often must be tracked and the user's gestures must be recognizable to the system. Hand-based interaction offers several advantages over traditional mouse-based interfaces, especially when it is used in conjunction with physical interactive surfaces. While camera-based gesture recognition methods are the most commonly used (such as [24, 13, 9]), they often suffer from Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. CHI 2002, April 20-25, 2002, Minneapolis, Minnesota, USA. Copyright 2001 ACM 1-58113-453-3/02/0004...$5.00. Figure 1: An interactive surface system based on the SmartSkin sensor. occlusion and lighting condition problems. To correctly capture hand images on a surface, a camera must be mounted above the table or in front of the wall. As a result, the system configuration becomes complex, making it difficult to implement the system as a portable (integrated) unit. The use of magneto-electric sensors (e.g., Polhemus [15]) is another possible sensing method, but it requires attaching a tethered magneto-electric sensor to each object being tracked. This paper introduces a new sensing architecture, called SmartSkin, which is based on capacitive sensing (Figure 1). Our sensor accurately tracks the position of the user's hands (in two dimensions) and also calculates the distance from the hands to the surface. It is constructed by laying a mesh of transmitter/receiver electrodes (such as copper wires) on the surface. As a result, the interactive surface can be large, thin, or even flexible. The surface does not need to be flat - i.e., virtually any physical surface can interactive. By increasing the density of the sensor mesh, we can accurately determine the shape of the hand and detect the different positions of the fingers. These features enable interaction techniques that are beyond the scope of normal mouse-based interactions. BEST AVAl ABLE COPY APLNDC00025563 To host PC wave signal receiver receiver - reference sigrial signal from amp electrode - -Ireceiver o Figure 3: Interactive table with an 8 × 9 SmartSkin sensor: A sheet of plywood covers the antennas. The white squares are spacers to protect the wires from the weight of the plywood cover. analõg s itch rg i er to ADC amp v v Figure 2: The SmartSkin sensor configuration: A meshshaped sensor grid is used to determine the hand's position and shape. We describe the sensing principle of SmartSkin and two working systems: an interactive table system and a handgesture sensing tablet. We also describe new interaction techniques of these systems. SMARTSKIN SENSOR ARCHITECTURE Figure 2 shows the principle of operation of the SmartSkin sensor. The sensor consists of grid-shaped transmitter and receiver electrodes (copper wires). The vertical wires are transmitter electrodes, and the horizontal wires are receiver electrodes. When one of the transmitters is excited by a wave signal (of typically several hundred kilohertz), the receiver receives this wave signal because each crossing point (transmitter/receiver pairs) acts as a (very weak) capacitor. The magnitude of the received signal is proportional to the frequency and voltage of the transmitted signal, as well as to the capacitance between the two electrodes. When a conductive and grounded object approaches a crossing point, it capacitively couples to the electrodes, and drains the wave signal. As a result, the received signal amplitude becomes weak. By measuring this effect, it is possible to detect the proximity of a conductive object, such as a human hand. The system time-dividing transmitting signal sent to each of vertical electrodes and the system independently measures values from each of receiver electrodes. These values are integrated to form two-dimensional sensor values, which we called "proximity pixels". Once these values are obtained, algorithms similar to those used in image processing, such as peak detection, connected region analysis, and template matching, can be applied to recognize gestures. As a result, the system can recognize multiple objects (e.g., hands). If the granularity of the mesh is dense, the system can recognize the shape of the objects. The received signal may contain noise from nearby electric circuits. To accurately measure signals only from the transmitter electrode, a technique called "lock-in amplifier" is used. This technique uses an analogue switch as a phasesensitive detector. The transmitter signal is used as a ref--- signal for switching this analog switch, to enable the system to select signals that have the synchronized frequency and the phase of the transmitted signal. Normally, a control signal needs to be created by phase-locking the incoming signal, but in our case, the system can simply use the transmitted signal, because the transmitter and the receiver are both on the same circuit board. This feature greatly simplifies the entire sensor design. We chose a mesh-shaped electrode design for our initial experiment because of its simplicity and suitability for sensing hand shapes as pixel patterns. Other layouts are possible, depending on the application requirements. For example, the density of the mesh can be adjusted. In addition, since the electrodes are simply thin copper wires, it is possible to create a very thin interactive surface such as interactive paper, which can even be flexible. rnus w. x PE 1: AN INTERACTIVE TABLE Based on the principle described above, we developed two interactive surfaces: a table-size system that can track multiple hand positions, and a smaller (and more accurate) system that uses a finer electrode layout. The table system is constructed by attaching sensor elements to a wooden table. A mesh-like antenna, made of polyurethanecoated 0.5 mm-thick copper wire, is laid on the tabletop. The number of grid cells is 8×9, and each grid cell is 10×10 cm. The entire mesh covers an 80×90 cm area of the tabletop APLNDC00025564 a potential field created by bicubic sensor values peak position Figure 4: top: A bicubic interpolation method is used to detect the peak of the potential field created by hand proximity. bottom: arms on a table and a corresponding potential field. Figure 6: Mouse emulation by using calculated hand position. The distance between the hand and the surface is used to determine button-press and button-release states. Figure 7: Two-handed operation is used to concatenate two objects. Figure 5: Relationship between distance between hand and sensor and sensed values. The diameter of the circle represents the amplitude of the sensed value. (Figure 3). A plywood board covers the antennas. A signal transmitter / receiver circuit is attached to the side of the table. Two Atmel AVR microprocessors control this circuit. One microprocessor generates square-wave signals (400 KHz) with firmware that directly controls the I/O port, and the other microprocessor with a built-in A/D converter measures the values of the received signals and transmits them to the host computer. A projector is used to display information on the table. The current implementation is capable of processing 8×9 sensor values 30 times per second. When the user's hand is placed within 5-10 cm from the table, the system recognizes the effect of the capacitance change. A potential field is created when the hand is in the proximity to the table surface. To accurately determine the hand position, which is the peak of the potential field, a bicubic interpolation method is used to analyze the sensed data (Figure 4). By using this interpolation, the position of the hand can be determined by finding the peak on the interpolated curve. The precision of this calculated position is much finer than the size of a grid cell. The current implementation has an accuracy of I cm, while the size of a grid cell is 10 cm. As for the distance estimation, although there is no way to directly measure the precise distance between the hand and the table surface, we can estimate relative distance. Figure 5 shows the relationship between the hand position and obtained A/D-converted values. Our system enables detecting various levels of hand proximity, which is difficult to do with other technologies such as computer vision. Since each point on the grid can independently measure the proximity of an object, the system can simultaneously track more than one hand. This feature is important because many table-based applications are used by more than one user. Interaction techniques We studied two types of basic interaction techniques for this platform. One is 2D-position control with distance measurement, and the other uses a sensor potential field as input. Mouse emulation with distance measurement The first interaction technique is the simple emulation of a mouse-like interface. The estimated 2D position is used to emulate moving the mouse cursor, and the hand-surface distance is used to emulate pressing the mouse button. A threshold value of the distance is used to distinguish between pressed and released states that the user can activate "mouse press" by touching the table surface with the palm, and move the cursor without pressing the mouse button by touching the table surface with the fingers. Normally, touch-sensitive panels cannot distinguish between these two states, and many interaction techniques developed for the mouse (such as "mouse over") cannot be used. In contrast, an interactive table with a SmartSkin sensor can emulate most mouse-based interfaces. Figure 6 shows how the user "drags" a displayed object. APLNDC00025565 Figure 8: Shape-based object manipulation. The potential field created by the hand's proximity to the table is used to move objects. The user can use both hands or even entire arms to manipulate objects. Figure 9: A gesture-recognition pad made up of a 32×24 grid mesh. A sheet of plastic insulating film covers Sensor electrodes. A notable advantage of SmartSkin over traditional -,,--based systems is its natural support for multiple-hand, multipleuser operations. Two or more users can simultaneously interact with the surface at the same time. The multiple-hand capability can also be used to enhance object manipulation. For example, a user can independently move objects with one hand. He or she can also "concatenate" two objects by using both hands, as shown in Figure 7, or can take objects apart in the same manner. Shape-basedmanipulation The other interaction technique, which we call "shape-based manipulatio", does not explicitly use the 2-D position of the hand. Instead, a potential field created by sensor inputs is used to move objects. As the hand approaches the table surface, each intersection of the sensor grid measures the capacitance between itself and the hand. By using this field, various rules of object manipulation can be defined. For example, an object that "descend" to a lower potential area repels from the human hand. By changing the hand's position around the object, the direction and speed of the object's motion can be controlled. We implemented this interface and observed how users tried to control objects. Overall, the reaction to the interface was quite encouraging. The people were quickly able to use this interface even though they did not fully understand the underlying dynamics. Many users naturally used two hands, or even arms. For example, to move a group of objects, one can sweep the table surface with one's arm. Two arms can be used to "trap" and move objects (Figure 8). PROTOTYPE 2: A GESTURE-RECOGNITION PAD The table prototype demonstrates that this sensor configuration can be used to create interactive surfaces for manipulating virtual objects. Using a sensor with a fmer grid pitch we should be able to determine the position and shape of the hand more accurately. In addition, if the sensor can sense more than one finger position, several new interaction Figure 10: Gestures and corresponding sensor values. (top: a hand on the . mesh, middle: raw input values, bottom: after bicubic interpolation) techniques are possible. For example, a 3D-modeling system often requires manipulation of multiple control points such as curve control points. Normally, a user of traditional mouse-based interfaces has to sequentially change these control points one by one. However, it would be more efficient and more intuitive if the user could control many points simultaneously. The second prototype uses a finer mesh pitch compared to that of the table version (the number of grid cells is 32 × 24, and each grid is 1 × l cm). A printed circuit board is used for the grid electrodes (Figure 9). The prototype uses the bicubic interpolation algorithm of the interactive table sys- APLNDC00025566 Figure 14: A palm is used to trigger a corresponding action (opening menu items). The user then taps on one of these menu items. Figure 11: Fingertip detection. Figure 12: Examples of uses of multiple-finger interfaces: left: curve editing. right: a map browsing system. The user can use one finger for panning, or two or more fingers for simultaneous panning and scaling. electrodes (copper film) Figure 15: The "capacitance tag": a conductive pattern attached at the bottom of an object is used to identify this object. the motion (consisting of moving, rotating, and scaling) that best satisfies the constraints given by the fingers. Another simple example is the expression of attributes during manipulation. For example, the user normally drags a scroll bar with one finger, but to increase the scrolling ratio, he or she could use two or more fingers. Figure 13: Two-finger gestures can be used to "pick-up" objects. tem, and it can determine the human hand shape as shown in Figure 10. The peak detection algorithm can also be used, and in this case, the algorithm can track multiple positions of the fingertips, not just one position of the hand (Figure 11). Interactions by using fingers and hand gestures We studied three possible types of interaction for this platform. The first one is (multiple) finger tracking. Here, the user simultaneously controls several points by moving his or her fingertips. The second is using hand or fmger shape as input, and the third is identifying and tracking physical objects other than the user's hands. A typical example of a situation in which the multi-finger interface is useful is diagram manipulation. A user can simultaneously move and rotate a displayed pictogram on the surface with two fingers. If three or more fingers are used, the system automatically uses a least-squares method to find Figure 12 shows a map browsing system. The user scrolls the map by sliding a finger along the sensor surface. The scrolling speed increases with the number of fingers in contact with the surface. If the user touches the surface with two or more fingers, by changing the distance from the fingers to the surface, he/she can control the map scale. Simultaneous control of scrolling and zooming is intuitive, because the user feels as if his or her fingers are fixed to the map's surface. Other possibilities we have explored include gesture commands. For example, two fingers moving toward the center of an object represent a "picking up" action (Figure 13), while a similar outward motion represents a "dropping" action. There are probably many other actions or functions representable by multi-finger gestures, for example, those based on the geographical relations between tapped fingers. An example of using a hand shape as input is shown in Figure 14. In this example, the user places a hand on the surface, its shape is recognized by the system, and a corresponding action, in this case, "showing menu item", is triggered. The action is selected by template matching. The system first lists up connected regions (a group of sensor values that are APLNDC00025567 connected), and then calculates the values of correlation between the stored templates. The system selects the region with the highest correlation value, and if this value exceeds a predetermined threshold value, the corresponding action is activated. In Figure 14, the user first touches the surface with his/her palm, then selects one of the displayed menu items. Capacitance tags While exploring several hand-based interaction techniques, we also found a way to make the SmartSkin sensor interact with objects besides than the hand. This feature can support graspable / tangible user interfaces [2, 8]. The principle of this method, called "capacitance tags", is shown in Figure 15. The capacitance tag block is made of a dielectric material such as wood or plastic. Some parts of this tag block are coated with a conductive material such as copper-film. These-conductive-areas-are-connected-to each other (by a copper wire, for example). This wire also connects the conductive areas at the bottom and at the top of the block. When this block is placed on the SmartSkin surface, the sensor does not detect the capacitance change because the block is ungrounded. However, when a user grasps it (and touches the conductive area at the top), all the conductive areas become grounded, and areas corresponding to the conductive parts coated at the bottom of the block can be detected. Since the geometrical relationship (e.g., the distance between conductive areas) is predetermined, the system can distinguish these patterns from other patterns created when the user moves his/her hands or fingers. Essentially, the combination of conductive areas works like a barcode. In addition, the geometry of the patterns indicates the position and orientation of the tag block. Simultaneous object identification and position tracking is a key technology for many postGUI user interface systems (such as [21, 22, 16]), and this method should be a new solution for such systems. Another advantage of this capacitance tag method is its ability to support simultaneous hand gestures, For example, a user places a capacitance tag block on an interactive surface, and then issues a "data transfer" command by hand-dragging the displayed object toward the block. DISCUSSIONS Design issues Most computers now use mice as input devices. With a mouse, the user controls one 2D position on the screen, and uses various interaction techniques, such as clicking or dragging. Although the mouse is a popular input device, its 'way' of interaction is different from the way manipulate objects in our daily lives. In the real world, we often use multiple fingers or both hands to manipulate a physical object. We control several points on the object's surface by touching, not by using "one position of the cursor" as in GUI systems. Consequently, with mouse-based interfaces, we have to unnaturally decompose some tasks into primitive operations. In addition, our ability to interact with the physical environment is not limited to the control of multiple points. Hands and fingers can also create various phenomena, such as pressure. As a result, interaction becomes more subtle and analogue. Related work Capacitivesensingforhuman-computerinteraction The idea of using capacitive sensing in the field of human-computer interfaces has a long history. Probably the earliest example is a musical instrument invented by Theremin in the early 20th century, on which a player can control the pitch and volume by changing the distance between the hand and the antenna. Other examples include a "radio drum" [11], which is also an electric musical instrument, and Lee et al.'s multifinger touch panel, which has a sub-divided touch-sensitive surface [10]. Zimerrman et al.'s work [26] pioneered the sensing of an electric field as a method for hand tracking and data communication (e.g., "personal area network" [25]). Although there has been a lot of research in this area, interaction techniques, like the ones described in this paper, have not been studied extensively. Our other contributions to this field are the new electrode design that enables accurate and scalable interactive surfaces, and the creation of tagged physical objects that can be used in combination with hand gestures. Hinkely et al. showed how a simple touch sensor (which is also based on a simple capacitive sensor) can enhance existing input devices such as a mouse or a trackball [6]. Vision-based gesture recognition There have been a number of studies on using computer vision for human gesture recognition [7]. However, achieving robust and accurate gesture recognition in unconditioned environments, such as the home or office, is still difficult. The EnhancedDesk [9] uses a thermo-infrared camera mounted above the table to extract the shape of the hand from the background. In contrast to these vision-based approaches, our solution does not rely on the use of external cameras, and all the necessary sensors are embedded in the surface. As a result, our technology offers more design flexibility when we implement systems. Other types of vision-based systems include HoloWall [13] and Motion Processor [14]. Both systems use a video camera with an optical infrared filter for recognition, and infrared lights are used to illuminate objects in front of the camera. While Motion Processor directly uses this infrared reflection, HoloWall uses a diffuser surface to eliminate the background image. "Barehand" [19] is an interaction technique for a large interactive wall. It enables recognizing hand shapes by using a sensor similar to that of HoloWall, and it uses the shapes to trigger corresponding actions. Using infrared reflection, the system can detect not only the shape of the hand, but also its distance from the camera. As a result, gestures that cannot be recognized by other vision-based systems, such as moving a finger vertically over a surface (i.e., APLNDC00025568 tapping), can be detected. However, like other vision-based systems, these systems also require the use of external cameras and lights, and thus they cannot be integrated into a single unit. Bimanualinterfaces Various types ofbimanual (two-handed) interfaces (for example, see [1, 5, 17] and [4] for physiological analysis of these interfaces) have been studied. With such an interface, the user normally holds two input devices (e.g., a trackball and a mouse), and controls two positions on the screen. For example, the user of ToolGlasses [1] controls the tool-palette location with his/her non-dominant hand, while the cursor position is controlled by the user's dominant hand. Some bimanual systems [5, 17] provide higher-degree-offreedom control by using motion- or rotation-sensitive input devices. With the SmartSkin sensor, the user can also control more than two points at the same time, and the shape of the arm or hand can be used as input. This is another approach to achieving higher-degree-of-freedom manipulation. In contrast to two-handed interfaces, interaction techniques that are based on the use of multiple fingers have not been well explored. DualTouch [12] uses a normal touch panel to detect the position of tow fingers. Its resistive touch panel gives the middle position between two fingers when two positions are pressed, and assuming that the position of one finger is known (i.e., fixed to the initial position), the position of the other finger can be calculated. DualTouch can perform various interaction techniques such as "tapping and dragging", but due to this assumption of the initial position, most multiple-finger interfaces described in this paper are not possible. CONCLUSION AND DIRECTIONS FOR FUTURE WORK Our new sensing architecture can turn a wide variety of physical surfaces into interactive surfaces. It can track the position and shape of hands and fingers, as well as measure their distance from the surface. We have developed two working interactive surface systems based on this technology: a table and a tablet, and have studied various interaction techniques for them. This work is still at an early stage and may develop in several directions. For example, interaction using multiple fingers and shapes is a very new area of human-computer interaction, and the interaction techniques described in this paper are just a few examples. More research is needed, in particular, focusing on careful usability evaluation. Apart from investigating different types of interaction techniques, we are also interested in the following research directions. Using a non-flat surface as an interaction medium: Places of interaction are not limited to a tabletop. Armrests or table edges, for example, can be good places for interaction, but have not been studied well as places for input devices. Placing SmartSkin sensors on the surface of 'pet' robots, such as Sony's AIBO, is another possibility. The robot would behave more naturally when interacting with humans. Similarly, if a game pad were "aware" of how the user grasps it, the game software could infer the user's emotions from this information. Combination with tactile feedback' Currently, a SmartSkin user can receive only visual feedback, but if SmartSkin could make the surface vibrate by using a transducer or a piezo actuator, the user could "feel" as if he/she were manipulating a real object (the combination of a touch panel and tactile feedback is also described by Fukumoto [3]). 1 Use of transparent electrodes: A transparent SmartSkin sensor can be obtained by using Indium-Tin Oxide (ITO) or a conductive polymer. This sensor can be mounted in front of a flat panel display or on a rear-projection screen. Because most of today's flat panel displays rely on active-matrix and transparent electrodes, they can be integrated with SmartSkin electrodes. This possibility suggests that in the future, display devices that will be interactive from the beginning, and will not require "retrofitting" sensor elements into them. We also want to make transparent tagged objects by combining transparent conductive materials with the use of capacitance tags as shown in Figure 15. This technology will enable creating interface systems such as "DataTiles" [18], a user can interact with the computer via the use of tagged physical objects and hand gestures. Data communication between the sensor surface and other objects: Because the SmartSkin sensor uses a wave signal controlled by software, it is possible to encode this signal with data. For example, location information can be transmitted from a SmartSkin table, and a digital device such as a PDA or a cellular phone on the table can recognize this information and trigger various context-aware applications. The table could also encode and transmit a "secret key" to mobile devices on the table, and these devices can establish a secure network with this key. ACKNOWLEDGEMENTS We thank our colleagues at Sony Computer Science Laboratories for the initial exploration of ideas described in this paper. We also thank Shigeru Tajima for the valuable technical advice, Takaaki Ishizawa and Asako Toda for their contribution to the implementation of the prototype system. We also would like to thank Toshi Doi and Mario Tokoro for their continuing support of our research. REFERENCES 1. Eric A. Bier, Maureen C. Stone, Ken Pier, William Buxton, and Tony DeRose. Toolglass and Magic Lenses: The see-through interface. In James T. Kajiya, edOne interesting but unasked question is "Is it possible to provide tactile or similar feedback to a user whose hand is in the proximity of the surface, but not directly touching the surface?". APLNDC00025569 itor, Computer Graphics (SIGGRAPH '93 Proceedings), volume 27, pages 73-80, August 1993. 15. Polhemus, Inc., Colchester, Vermont. 3SPACE ISOTRAK User's Manual, 1987. 2. George W. Fitzmaurice, Hiroshi Ishii, and William Buxton. Bricks: laying the foundations for graspable user interfaces. In CHI'95 Conference, pages 442-449, 1995. 16. Jun Rekimoto and Masanori Saitoh. Augmented Surfaces: A spatially continuous workspace for hybrid computing environments. In Proceedings of ACM CHI'99, pages 378-385, May 1999. 3. Masaaki Fukumoto and Toshiaki Sugimura. ActiveClick: Tactile feedback for touch panels. In CHI 2001summary, pages 121-122, 2001. 17. Jun Rekimoto and Eduardo Sciammarella. ToolStone: Effective use of the physical manipulation vocabularies of input devices. In Proc. of UIST2000, 2000. 4. Y. Guiard. Asymmetric divisoin of labor in human skilled bimanual action: the kinematic chain as a model. Journal of Motor Behavior, pages 485-517, 1987. 18. Jun Rekimoto, Brygg Ullmer, and Haruo Oba. DataTiles: a modular platform for mixed physical and graphical interactions. In CHI2001 proceedings, pages 269-276, 2001. 5. Ken Hinckley, Randy Pausch, John C. Goble, and Neal F~KäWell. Passive reaMvoHd iiitëffacTprops for neurosurgical visualization. In CHI'94 Proceedings, pages 452-458, 1994. 19. Meredith Ringel, Henry Berg, Yuhui Jin, and Terry Winograd. Barehands: implement-free interaction with a wall-mounted display. In CHI 2001 summary, pages 6. Ken Hinckley and Mike Sinclair. Touch-sensing input devices. In CHI'99 Proceedings, pages 223-230, 1999. 7. IEEE. Proceedings of the fourth ieee international conference on automatic face and gesture recognition, 2000. 20. Norbert A. Streitz, Jorg Geisler, Torsten Holmer, Shin'ichi Konomi, Christian Muller-Tomfelde andWolfgang Reischl, Petr Rexroth, Peter Seitz, and Ralf Steinmetz. i-LAND: An interactive landscape for creativity and innovation. In CHI'99 Proceedings, pages 120-127, 1999. 8. Hiroshi Ishii and Brygg Ullmer. Tangible Bits: Towards seamless interfaces between people, bits and atoms. In CHI'97 Proceedings, pages 234-241, 1997. 21. Brygg Ullmer and Hiroshi Ishii. The metaDESK: models and prototypes for tangible user interfaces. In UIST'97 Pmceedings, pages 223-232, 1997. 9. Hideki Koike, Yoichi Sato, Yoshinori Kobayashi, Hiroaki Tobita, and Motoki Kobayashi. Interactive textbook and interactive venn diagram: natural and intuitive interfaces on augmented desk system. In CH12000 Proceedings, pages 121-128, 2000. 22. John Underkoffler and Hiroshi Ishii. Illuminating Light: An optical design tool with a luminous-tangible interface. In CHI'98 Pmceedings, pages 542-549, 1998. 10. S.K. Lee, William Buxton, and K. C. Smith. A multitouch three dimensional touch-sensitive tablet. In CHI '85 Proceedings, pages 21 - 25, 1985. 11. M. Mathews and W. Schloss. The radiodrum as a synthesis controller. In Proceedings international computer music conference, 1989. 12. Nobuyuki Matsushita, Yuji Ayatsuka, and Jun Rekimoto. Dual Touch: a two-handed interface for penbased PDAs. In ACM UIST 2000 Poceedings, pages 211-212, 2000. 13. Nobuyuki Matsushita and Jun Rekimoto. HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In Proceedings ofUIST'97, October 1997. 367-368, 2001. 23. Pierre Wellner. The DigitalDesk calculator: Tangible manipulation on a desk top display. In ACM UIST'91 Proceedings, pages 27-34, November 1991. 24. Pierre Wellner. Interacting with paper on the DigitalDesk. CommunicationoftheACM, 36(7):87-96, August 1993. 25. Thomas Zimmerman. Personal area networks: Nearfield intrabody communication. IBMSystems Journal, 35(3-4):609-417, 1996. 26. Thomas G. Zimmerman, Joshua R. Smith, Joseph A. Paradiso, David Allport, and Neil Gershenfeld. Applying electric field sensing to human-computer interfaces. In CHI'85 Proceedings, pages 280--287, 1995. 14. Shunichi Numazaki, Akira Morshita, Naoko Umeki, Minoru Ishikawa, and Miwako Doi. A kinetic and 3D image input device. In Proceedings of the conference on CHI98summary, pages 237-238, 1998. APLNDC00025570 This Page is Inserted by IFW Indexing and Scanning Operations and is not part of the Official Record BEST AVAIL ARLE IMAGES Defective images within this document are accurate representations of the original documents submitted by the applicant. Defects in the images include but are not limited to the items checked: O BLACK BORDERS TMAGE CUT OFF AT TOP, BOTTOM OR SIDES FADED TEXT OR DRAWING D BLURRED OR ILLEGIBLE TEXT OR DRAWING KEWED/SLANTED IMAGES COLOR OR BLACK AND WHITE PHOTOGRAPHS O GRAY SCALE DOCUMENTS O LINES OR MARKS ON ORIGINAL DOCUMENT REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY OTHER: IMAGES ARY BEST AVAIL ARLE COPY. As rescanning these documents will not correct the image problems checked, please do not report these problems to the IFW Image Problem Mailbox. APLNDC00025571 WACOM Components - Technology Page 1 of 4 WACOA --- for smartphones | pc Technology WACOM patented its EMR (Electro-Magnetic Resonance) send and position sensing technology over 14 years ago. We also call it the Electro-Magnetic Send and Receive method, as we will explain below. WACOM has recently invested in re-branding it's EMR Send and Receive method and renamed it Penabled . Penabled by WACOM is the new technology brand for our novel EMR technology, and it is identical in terms of the core technology we have being using over the last decade and a half. How it's made A component-less printed circuit board where the copper tracks provide a multitude of overlapping antenna coils in both the x and y directions. The p.c.b. is manufactured from glass epoxy or PET film. Underneath the sensor is a magnetic reflector used to enhance and shield the magnetic field. The sensor is placed underneath and penetrates the display. Hence there is no transmission loss of the display, and also since the sensor is embedded behind the display it is not prone to damage. How it works The sensor Each antenna coil is energized in turn. This generates a close coupled field in the h-domain at a very low energy level (< -25dbuA) and resonant frequency. The pen This energy couples with a tank circuit which is located in the pen. The pen is battery-less. It is the simplest type of EMR pen, and contains just an inductor & capacitor in its simplest embodiment. The inductance and capacitance values of the tank circuit are selected to match the resonant frequency of the antenna coil. http://www.wacom-components.com/english/tech.asp 10/10/2004 APLNDC00025572 WACOM Components - Technology Page 2 of 4 Getting the position Transmitting Co Coll Switching) v The coupled energy resonates with the tank circuit and reflects back towards the sensor board by forming a shaped h-domain field at the tip of the pen. As this happens the same antenna coil is switched to receive this reflected energy and provide an analogue signal. This process is repeated in rapid succession with all antenna coils. All of this analogue data is then collected and converted into digital signals that can be postprocessed to give x, y and z position information. Shleid Plate The pen has to be a maximum of 14mm from the sensor surface for it to be acquired. The sensor can track the pen in 3 dimensions as it hovers above it. The sensor only detects a "pen down" signal when pressure is applied to the pen tip. Additional data Pressure Depending on the technology in the pen we can also provide varying levels of pressure up to 1024. There are two main systems we employ. One uses a change in the phase angle part of the inductance at the pen tip. The other uses the same philosophy but on the capacitance part. http://www.wacom-components.com/english/tech.asp 10/10/2004 APLNDC00025573 WACOM Components - Technology Page 3 of 4 The MP-200-00 or "Slim Pen" above, uses inductive change and gives up to 256 levels of pressure. By using this method the pen diameter can be as thin as 5 mm. The UP-813E uses capacitive change by virtue of another proprietary WACOM component, the "C-Switch". This allows up to 1024 levels of pressure. Other functions Also by having a switch in the pen to alter slightly the resonance frequency, you can detect additional tools such as a side-switch or eraser. Another unique feature of our EMR technology is the ability to detect pen tilt up to 50 degrees in any direction. Wher does the data go7 Once the raw data is gathered from the sensor board, by our custom W8001 ASIC it is relayed to a low cost standard 8-bit MCU by a synchronous serial interface. Calculations are then performed using complex algorithms developed by us over many years. A significant amount of these algorithms are based on our undisclosed proprietary know-how. These calculations http://www.wacom-components.com/english/tech.asp 10/10/2004 APLNDC00025574 'WACOM Components - Technology Page 4 of 4 transform the raw data into x, y, z, pressure, and tilt data. We also perform error correction calculations to counteract distortions in the electromagnetic field caused by external influences. Distortions can occur especially at the edge of the sensor when combined with an LCD, because many LCD's have metal frames around them. LCD LCD Sensor - (Motherboard, Shield LCD Sensor, Also inductive components, such as switching transformers used in backlights and DC-DC convertors. Penabled This corrected data is then transferred to the host microprocessor through either an asynchronous serial interface (e.g. UART) or a synchronous serial interface (e.g. SSI, SPI, I2C). This data can then be read by the pen driver resident in the host OS. © WACOM 2002 http://www.wacom-components.com/english/tech.asp 10/10/2004 APLNDC00025575 .,., ,,, Home smartphones pdal tablet pc Company ! Product Technology News i Cantact i Search i Technoicgy WACOM its EMR (Electro-Magnetic Resonance) send and position sensing technology over 14 years ago. We also call it the Electro-Magnetic Send and Receive method, as we wdt explain below. WACOM has recently invested in re-branding it s EMR Send and Receive method and renamed it Penablede Penabled by WACOM is the new technology brand for our novel EMR technology, and it îs identical in terms of the Core technology we have being using over the last decade and a half. How it's made A component-less printed circuit board where the Copper tracks provide a multitude of over•lapping antenna coils in both the x and y directions. The p.c.b. is manufactured from glass epoxy or PET film. Underneath the sensor is a magnetic reflector used to enhance and shield the magnetic field. The sensor is placed undemeath and penetrates the display. Hence there is no transmission loss of the display, and also since the sensor is embedded behind the display it is not prone to damage. How it works The sensor Each antenna coil is energized in turn. This generates a close coupied fleid in the h-domain at a very low energy level (< -25dbuA) and resonant frequency. The pen This energy couples with a tank drcuit which is located in the pen. The pen is battery-less. It is the simplest type of EMR pen, and contains just an inductor & capacitor in its simplest embodiment. The inductance and capacitance values of the tank circuit are selected to match ttte resonant frequency of the antenna coil. Getting the position The coupled energy resonates with the tank circuit and reflects back towards the sensor board by forming a shaped h-domain field at the tip of the pen. As this happens trie same antenna coil is switched to receive this reflected energy and provide an analogue signaL This process is repeated in rapid succession with all antenna coils. A!! of this analogue data is then Collected and converted into digital signals that can be post-processed to give x, y and I position information. CO . -a--saa--me inewWMelti APLNDC00025576 The pen has to be a maximum of 14mm from the sensor surface for it to be acquired. The sensor can track the pen m 3 dimensions as it hovers above st. The sensor only detects a "pen down? signatwhen pressure rs applied to ttle pen tip Additional data Pressure Depending on the technology in the pen we can also provide varying levels of pressure up to 1024. There are two mam systems we employ. One uses a change en the phase angte part of the inductance at the pen Op. The other uses the same Phil0500AY but On the Cap3CitanCe part. e The MP-200-00 or "Slim Pen above, uses inductive change and gives up to 256 fevels of pressure. By usmg this method the pen diameter can be as thin as 5 mm. The UP-813E uses caoacitive change by virtue of another proprietary WACOM component, the "C-Switch". This allows up to 1024 levels of pressure. Other functions Also by having a switch in the pen to alter slightly the resonance frequency, you can detect additional tools such as a side-switch or eraser. Another unique feature of our EMR technology is the ability to detect pen tilt up to 50 degrees in any direction. Wher does the data go? Once the raw data is gathered from the sensor board, by our custom WSOO1 ASIC it is relayed to a low cost standard 8-bit MCU by a synchronous serial interface. Calculations are then performed using complex algorithms developed by us over many years. A significant amount of these algorithms are based on our disclœ0sed pmprietag know-how. These calculations transform the raw data into x, y, z, pressure, and We also perform error correction calCulations to Counteract distortions in the electromagnetic field Caused by external influences. Distortions can occur especiallY of the edge of the sensor when combined with an t.CD, because many LCD*t have metal frames around them, APLNDC00025577 BilgWBWMMINIInil mmmmmmmmesa Also inductive components, such as switching transionners used in backlights and DC-DC Convertors. This corrected data is then transferred to the host microprocessor through either an asynchronous serial interface (e.g. UART) or a synchronous senai interface (e.g. SSI, SPI, [2C). This data can then be read by ene bien v^COM i the pen driver resident in the host 05. 2 APLNDC00025578 This Page is Inserted by IFW Indexing and Scanning Operations and is not part of the Official Record BEST AVAILABLE IV A GES Defective images within this document are accurate representations of the original documents submitted by the applicant. Defects in the images include but are not limited to the items checked: O BLACK BORDERS O IMAGE CUT OFF AT TOP, BOTTOM OR SIDES O FADED TEXT OR DRAWING O BLU=-D OR ILLEGIBLE TEXT OR DRAWING O KEWED/SLANTED IMAGES COLOR OR BLACK AND WHITE PHOTOGRAPHS LG YS SOCRA EA O EONR INAL DOCUMENT O REFERENCE(S) OR EXHIBIT(S) SUBMITTED A R POOR QUALITY O OTHER: IMAGES w 0; BEST AVAILABLE COPY. As rescanning these documents will not correct the image problems checked, please do not report these problems to the IFW Image Problem Mailbox. APLNDC00025579 Comparing Touch Technologies Introduction BEST AVAl .ABLE COPY Product Catalog Sales Page l of 2 Tech Support Our Con Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies Comparing Touch Technologies Comparing Touch Technologies: + 4-Wire Resistive S-Wire Resistive We offer touchscreen products with several of the most widely used touchscreen technologies. Each type of screen has unique characteristics that can make it a better choice for certain applications. Follow the links below for information on the different touch technologies that we offer and recommend. Please contact us if you have any QUBSÍiOns or would like assistance selecting a touch technology for your application. Capacitive eap c . Suavaece Acoustic > Near Field Imaging . Infrared 4-Wire Resistive Touchscreens 4-Wire Resistive touchscreen technology is used in the touch add-ons that we offer for PC monitors and notebooks. It is a reliable and affordable technology that is widely used by individuals and in less demanding workplace appliCSÍiODS. It is pressure sensitive so it responds to any input device, including finger, gloved hand, or pen stylus. Follow this link for more information. 5-Wire Resistive Touchscreens We offer 5-Wire Resistive touchscreen technology with the CRT and LCD touch monitors that we offer. It is a durable and accurate technology that is widely used in demanding workplace applications such as point-of-sale systems, industrial controls, and medical systems. It is pressure sensitive so it responds to any input device, including finger, gloved hand, or pen stylus. Follow this link for more information. Capacitive Touchscreens We offer Capacitive touchscreen technology with the CRT and LCD touch monitors that we offer. It is a durable technology that is used in a wide range of applications including point-of-sale systems, industrial controls, and public information kiosks. It has a higher clarity than Resistive technology, but it only responds to finger contact and will not work with a gloved hand or pen stylus. Follow this link for more information. PenTouch Capacitive Touchscreens We offer PenTouch Capacitive touchscreen technology with the CRT and LCD touch monitors that we offer. This screen combines durable Capacitive technology with a tethered pen stylus. The screen can be set to respond to finger input only, pen input only, or both. The pen stylus is a good choice for signature capture, on-screen annotations, or for applications requinng precise input. Follow this link for more information. Surface Acoustic Wave Touchscreens We offer Surface Acoustice Wave touchscreen technology with the CRT and LCD touch monitors that we offer. It is a very durable screen that is widely used in applications such as computer based training and information kiosk displays. The SAW screen is a good choice for applications where image clarity is important, but it may not perform well in extremely dirty or dusty environments. Responds to finger or soft rubber tipped stylus. Follow this link for more information. Near Field Imaging Touchscreens http://www.touchscreens.com/intro-touchtypes.html 10/10/2004 APLNDC00025580 Comparing Touch Technologies Page 2 of 2 We offer Near Field imaging touchscreen technology as one of the custom LCD touch monitoF solutions that we can provide. It is an extremely durable screen that is suited for use in industrial control systems and other harsh environments. The NFI type screen is not affected by most surface contaminants or scratches. Responds to finger or gloved hand. Follow this link for more information. Infrared Touchscreens We offer Infrared touchscreen technology with the Plasma display solutions that we offer. This is the only type of touch technology that we have available for large displays such as 42-inch Plasma screens. It is a durable technology that offers high image clarity. Responds to any input device or stylus. Follow this link for more information. TouchScreens.com is owned and operated by Mass Multimedia, Inc http://www.touchscreens.comlintro-touchtypes.html Call:1 800 318-8610 E-mail: info@touchscreen: 10/10/2004 APLNDC00025581 Cirque: GlidePoint technology for touch navigation. Home Site Map Page 1 of 2 Contact CIROUE input sokuiens at yourfinger¢iµ¾ August 5, 2005 ' TECHNOLOGY PRODUCTS SALES SUPPORT COMPAN't Why GlidePoi! Gi ide P oint Consultations. Cirque's Sales Team guide you through tt of touch input. GlidePoint® Custom Options. Take advantage of o we'll custom-design suit your needs, FE ATU RE S Immune to dirt & moisture. Casoufaled DetaB A Reliable & durable. Easy to install. Uses power efficiently. protectswo tnsuladag Cover Layer DetaM A Compact, thin, lightweight. Comfortable to operate. Simple to understand. Detects pixel-point control. Requires no maintenance. lt Cirque's original GlidePoint technology can be found in laptops, keyboards, PDAs and countless more computing devices all over the world. It provides complete navigation control of any graphical interface, packed in a space-saving, low-friction, extremely durable touchpad. Based upon a mutual balanced capacitance design, the touchpad is mounted onto a Printed Circuit Board (PCB) where the user's finger gIldes. Below the electrically-insulating surface lies a sophisticated sensor system which responds to the most precise finger movements. This allows for a wide range of capacitance while providing the ability to detect small imbalances. GlldePoint sensor dimensions can vary greatly. At any size, it will maintain excellent resolution and tracking capability, providing unparalleled flexibility in product designs. Additionally, GIldePoint technology can detect grounded and ungrounded objects, and distinguish between the two types because of the balanced capacitive method. This eliminates Interference between the user and the interface. About GlideSensor'" A variation on GlidePoint technology, GlideSensor products typically consist of a thin, polyester or plastic flexible printed sensor array and a separate rigid PCB controller assembly (see product e×ample). This unique two-part design allows it to be readily integrated into a variety of OEM products, particularly those that require isolation from harsh environments (such as marine applications, public kiosks, phones). GlideSensor is not limited to flat, solid-surface use; it can be mounted onto screens and contours, and can even sense through irregular surfaces and wide gaps. Plus, it can be mounted BEST AVAILABLE COPY http://www.cirque.com/technology/technology gp.htm 8/5/2005 APLNDC00025582 Cirque: GlidePoint technology for touch navigation. Page 2 of 2 underneath nonconductive surfaces, eliminating the need for a bezel opening and providing a cornpletely sealed interface system. Technology Products Sales Support Company Documents Software Home AII contents copyright © 1990-2005 Cirque Corporation, see legal and privacy policies. BEST AVAl .ABLE COPY http://www.cirque.com/technology/technology gp.htm 8/5/2005 APLNDC00025583 ynaptics Technologies :: Capacitive Position Sensing 0.o About Synaplics Page 1 of 2 Enriching the Interaction :: Products :: Home TECHNOLOGIES Capacitive Position Sensing Capacitive Force Sensing Transparent Capacitive Position Sensing Inductive Position Sensing Pattern Recognition Mixed Signal VLSI Proprietary Microcontroller Briefs & Whitepapers :: Technologies :: News & Events :: Investor Relations ;; Support & Drivi Capacitive Position Sensing Synaptics is a world leader in capacitive touch sensing technology. This technology is at the industry-standard TouchPad products. Since the introduction of the TouchPad, we have exp technology in a variety of directions including pen sensors, force sensors, and flexible touch How the TouchPad Works Synaptics TouchPad devices work by sensing an electrical property called capacitance. Wh electrically conductive objects come near to each other without touching, their electric fields form capacitance. The surface of a TouchPad sensor is an array of conductive metal electrc by a protective insulating layer. The human finger is also an electrical conductor, and when : finger on a TouchPad, a tiny capacitance forms between your finger and the metal electrode TouchPad. The insulating layer protects the TouchPad sensor from wear by preventing your actually touching the sensor, and is textured to help your finger move smoothly across the s Synaptics ASIC The TouchPad sensor's sensitive analog electronics measure the amount of capacitance in electrodes. By sensing when the capacitance increases, the TouchPad can tell when your fi touching. By measuring which electrodes have the most capacitance, the TouchPad can als finger to an accuracy of better than 1/1000th of an inch. The capacitive sensing ASIC chip ir proprietary microprocessor that computes the finger's position and speed and reports them 1 computer in the form of cursor motion. On a PC, the TouchPad can work with any mouse driver, but it works best with the Synaptic driver. When used with the Synaptics driver, the TouchPad reports not just the mouse-like n finger, but also the absolute position of the finger on the TouchPad surface as well as the ar pressure. The driver uses this extra information to enhance the user interface in a variety of example, if the finger moves up and down along the right-hand edge of the pad, the driver a patented Virtual Scrolling feature. http://www.synaptics.com/technology/cps.cfm BEST AVAl .ABLE COPY 8/5/2005 APLNDC00025584 ynaptics Technologies :: Capacitive Position Sensing Page 2 of 2 In addition, a general purpose TouchPad Application Programming Interface (API) is availat Customer Support-Developer's Support sectiertof the web site, which allows adaptation of c into othäryödü tä. The underlying capacitive technology in the TouchPad can be develope variety of devices, such as cell phones, MP3 players, PDAs, touchscreens, and remote cont Synaptics capacitive sensing technology has been used to provide 2D cursor control, 1D sc functionality, and replace electrical switches in many types of electronic devices. Synaptics' capacitive sensing technology has numerous advantages over competing techno membrane switches and resistive sensors. Its solid-state construction makes it extraordinari because our capacitive sensor is so versatile, it can be made extremely thin, lightweight, fle: transparent. The proprietary microprocessor makes it possible to build custom capacitive so special applications. ©2004 Synaptics Inc. All Rights Reserved. http://www.synaptics.com/technology/cps.cfm - Legal - Careers -Sitemap 8/5/2005 APLNDC00025585 3ynaptics Technologies :: Transparent Capacitive Force Sensing Page 1 of 2 Enriching the interaction :: About Synaptics :: Products :: Technologies :: News & Events :: Investor Relations :: Suppod 8 Drivs :: Home TECHNOLOGIES Capacitive Position Sensing Capacitive Force Sensing TransparentCapacitive Position Sensing TranSparent Capacitive Position Sensing inductive Position Sensing Pattern Recognition Mixed Signal VLSI The versatility of Synaptics' transparent capacitive sensing technology makes it suitable for applications, including PCs, cell phones, and touch screens, which require transparent, and Proprietary Microcontroller Briefs & Whitepapers even flexible sensors. Synaptics' transparent capacitive sensors provide all the functionality and performance of St TouchPad devices for both small and large touch screen applications. Compared to resistivt screens, Synaptics capacitive sensors offer superior durability and higher light transmissività stays brighter and clearer, while consuming less power. Our transparent capacitive position sensing technology operates in a manner very similar to capacitive sensing technology. To capacitively locate a finger, sense wires are formed usinc conductors. Most commonly, indium tin oxide (ITO) is used, and can be placed over polyest, polycarbonate, glass or any viewable surface. Our two-dimensional transparent capacitive position sensing technology utilizes a grid of the accurately locate the X, Y and "pressure" of a finger on a sensor. Typically, ITO-coated PET form arrays of wires. This provides a strong, simple, and flexible sensor that can be placed i display. (Figure 1) PET Adhes ITO PET Adhes LCD Figure 1 The most common alternative to transparent capacitive sensing is resistive technology. In a resistive touch screen, two layers of ITO-coated PET are separated by an air gap. When the pressed, the top layer bends to make contact with the bottom layer (Figure 2). The point of < calculated by placing a voltage gradient across the top ITO layer, and then measuring the vt bottom layer. http://www.synaptics.com/technology/tcps.cfm 8/5/2005 APLNDC00025586 Synaptics Technologies :: Transparent Capacitive Force Sensing Page 2 of 2 Air ga; and sg Figure 2 Advantages of Synaptics' Transparent Capacitive Position Sensing Technology Synaptics' capacitive solution offers several fundamental technical advantages. Capacitive : completely solid state, with no moving parts-this contributes to its high reliability and durab contrast, resistive screens are physical switches that must flex and rub in use, decreasing tt lifetime. Because capacitance can be sensed through most materials, designers are not limited to pli materials as required by resistive sensing technology. Capacitive sensing operates even wh is placed undemeath a durable surface, such as polycarbonate or acrylic. In this situation, tt sensor has the environmental durability of its rigid overlay, allowing it to function in environn other technologies fail. Synaptics' transparent capacitive sensors are optically simpler than resistive touch screens. index-matched adhesives, and the lack of an air gap and spacer dots, provide for fewer inte reflections. Absorption of light is also minimized, since very thin conductive layers are used. the physical stack-up of a resistive panel requires the use of an air gap, and steps must be t minimize the loss of light as it passes through layers with differing refractive indices. Lastly, unlike resistive sensors, Synaptics' capacitive sensors don't need to maintain a critica between the sensor layers. Flexing or deforming a resistive sensor can affect the spacing be in contrast, Synaptics sensors can be attached to curved surfaces without loss of functionali these differences, the Synaptics technology allows designers to add inexpensive and simple sensing in applications that other technologies cannot approach. © 2004 Synaptics Inc. All Rights Reserved. http://www.synaptics.com/technology/tcps.cfm - Legal - Careers -Sitemap 8/5/2005 APLNDC00025587 This Page is Inserted by I¥ w Indexing and Scanning Operations and is not part of the Official Record BEST AVAILABLE IMAGES Defective images within this document are accurate representations of the original documents submitted by the applicant. Defects in the images include but are not limited to the items checked: O BLACK BORDERS O IMAGE CUT OFF AT TOP, BOTTOM OR SIDES O FADED TEXT OR DRAWING O BLURRED OR ILLEGIBLE TEXT OR DRAWING OS EWEDISLANTED IMAGES COLOR OR BLACK AND WHITE PHOTOGR A PHS O GRAY SCALE DOCUMENTS O LINES OR MARKS ON ORIGINAL DOCUMENT O REFERENCE(S) OR EXHIBIT(S) SUBMITTED A POOR QUALITY O OTHER: IMAGES ARE BEST AVAILABLE COPY. As rescanning these documents will not correct the image problems checked, please do not report these problems to the IFW Image Problem Mailbox. APLNDC00025588 Howstuffworks "How do touchscreen monitors know where you're touching?" Page 1 of 3 BEST AVAILABLE COPY Search HowStuf fWorks and the Auto Stuff Science Stuff Health Stuff Entertainment Stuff People St Computer Stuff Electronics Stuff Home Stuff Money Stuff Travel Stuff vtech Top Subjects Main > Electronics > ShortStuff > Batteries > CDs > Cell Phones > Digital Cameras > Home Networking How do touchscreen monitors know where you're touching? brow the aue on •drc ve freg 5 newsletter - .a.« shop or compare •• paces .What is o 80 CKÌ€Your B Touchscreen monitors have become more and more commonplace as their ¡ steadily dropped over the past decade. There are three basic systems that a recognize a person's touch: • Resistive • Capacitive . Surface acoustic wave The resistive system consists of a normal glass panel that is covered with i and a resistive metallic layer. These two layers are held apart by spacers, a resistant layer is placed on top of the whole setup. An electrical current runs two layers while the monitor is operational. When a user touches the screen, layers make contact in that exact spot. The change in the electrical field is nt coordinates of the point of contact are calculated by the computer. Once the are known, a special driver translates the touch into something that the op_en can understand, much as a computer mouse driver translates a mouse's mo click or a drag. In the capacitive system, a layer that stores electrical charge is placed or panel of the monitor. When a user touches the monitor with his or her finger, charge is transferred to the user, so the charge on the capacitive layer decre decrease is measured in circuits located at each corner of the monitor. The calculates, from the relative differences in charge at each corner, exactly wh. event took place and then relays that information to the touchscreen driver s advantage that the capacitive system has over the resistive system is that it sponsored By: almost 90 percent of the lig_ht from the monitor, whereas the resistive system transmits about 75 percent. This gives the capacitive system a much clearer http://electronics.howstuffworks.com/question716.htm 8/5/2005 APLNDC00025589 Howstuffworks "How do touchscreen monitors know where you're touching?" Page 2 of 3 the resistive system. Digital made simple with Click & Leam articles On the monitor of a surface acoustic wave system, two transducers (one one sending) are placed along the x and y axes of the monitor's glass plate. on the glass are reflectors -- they reflect an electrical signal sent from one ti the other. The receiving transducer is able to tell if the wave has been disturl event at any instant, and can locate it accordingly. The wave setup has no n on the screen, allowing for 100-percent light throughput and perfect image ci makes the surface acoustic wave system best for displaying detailed graphic systems have significant degradation in clarity). Another area in which the systems differ is in which stimuli will register as a A resistive system registers a touch as long as the two layers make contact, that it doesn't matter if you touch it with your finger or a rubber ball. A capaci on the other hand, must have a conductive input, usually your finger, in orde touch. The surface acoustic wave system works much like the resistive syste touch with almost any object - except hard and small objects like a pen tip. As far as price, the resistive system is the cheapest; its clarity is the lowest o and its layers can be damaged by sharp objects. The surface acoustic wave usually the most expensive. Here are some interesting links: • Elo Touchsystems e . • • Touchscreens.com Troll Touch Touchscreens How PDAs Work How computer Monitors Work Great gifts for back-to-schoot & Question Archive NO SHIPPING FEES* HowStuffWorks Stuff Related Ad Categories > Resistive Touch Screen > Touch Screen Monitors > Elo Touch Our books New and improved > Computer Touch Screen jeeves Subjects > Building Blocks > Computers > Gadgets > Home Theater > ShortStuff > Telecommunications > Video Games > Browse the Electronics Library Search now L searck Mugs and stickers Ask.com BEST AVAl .ABLE COPY http://electronics.howstuffworks.com/question716.htm 8/5/2005 APLNDC00025590 . Howstuffworks "How do touchscreen monitors know where you're touching?" Page 3 of 3 The HSld Market Research Program NEEDS Explore Stuff > Lidrock.com > Stuffo.com > Big List of Articles > Get the Newsletter > Shop for Top Products > Shop or Compare Prices > Search HSW and the Web GLOBALSPEC The Engineeri g Search Engin Home Store Newsletter Search Advertising Privacy Contact About Help © 1998 - 2005 HowStuffWorks, Inc. BEST AVAI .ABLE COPY http://electronics.howstuffworks.com/question716.htm 8/5/2005 APLNDC00025591 How Does a Touchscreen Work? Introduction Page 1 of 2 Product Catalog Sales Tech Support Our Con Now at: Home > Introduction > How Touchscreens Work How Does a Touchscreen Work? A basic touchscreen has three main components: a touch sensor, a controller, and a software driver. The touchscreen is an input device, so it needs to be combined with a display and a PC or other device to make a complete touch input system. ' i Touch Sensor A touch screen sensor is a clear glass panel with a touch responsive surface. The touch sensor/panel is placed over a display screen so that the responsive area of the panel covers the viewable area of the video screen. There are several different touch sensor technologies on the market today, each using a different method to detect touch input. The sensor generally has an electrical current or signal going through it and touching the screen causes a voltage or signal change. This voltage change is used to determine the location of the touch to the --n. 2. Controller The controller is a small PC card that connects between the touch sensor and the PC. It takes information from the touch sensor and translates it into information that PC can understand. The controller is usually installed inside the monitor for integrated monitors or it is housed in a plastic case for external touch add-onsloverlays. The controller determines what type of interface/connection you will need on the PC. Integrated touch monitors will have an extra cable connection on the back for the touchscreen. Controllers are available that can connect to a Serial/COM port (PC) or to a USB port (PC or Macintosh). Specialized controllers are also available that work with DVD players and other devices. 3. Software Driver The driver is a software update for the PC system that allows the touchscreen and computer to work together. It tells the computer's operating system how to interpret the touch event information that is sent from the controller. Most touch screen drivers today are a mouse-emulation type driver. This makes touching the screen the same as clicking your mouse at the same location on the screen. This allows the touchscreen to work with existing software and allows new applications to be developed without the need for touchscreen specific programming. Some equipment such as thin client terminals, DVD players, and specialized computer systems either do not use software drivers or they have their own built-in touch screen driver. Touchscreens Add-ons and Integrated Touchscreen Monitors We offer two main types of touchscreen products, touchscreen add-ons and integrated touchscreen monitors. Touchscreen add-ons are touchscreen panels that hang over an existing computer monitor. Integrated touchscreen monitors are computer displays that have the touchscreen built-in. Both product types work in the same way, basically as an input device like a mouse or trackpad. Touchscreens As Input Device BEST AVAI.ABLE COPY http://www.touchscreens.com/intro-anatomy.html 8/5/2005 APLNDC00025592 How Does a Touchscreen Work? Page 2 of 2 All of the touchscreens that we offer basically work like a mouse. Once the software driver for the touchscreen is installed, the toúchscreen emulates mouse functions. Touching the screen is basically the same as clicking your mouse at the same point at the screen. When you touch the touchscreen, the mouse cursor will move to that point and make a mouse click. You can tap the screen twice to perform a double-click, and you can also drag your finger across the touchscreen to perform drag-and-drops. The touchscreens will normally emulate left mouse clicks. Through software, you can also switch the touchscreen to perform right mouse clicks instead. TouchScreens.com is owned and operated by Mass Multimedia, Inc $ Call: 1-800-348-8610 E-mail: info@touchscreen: BEST AVAI .ABLE COPY http://www.touchscreens.com/intro-anatomy.html 8/5/2005 APLNDC00025593 4-Wire Resistive Touchscreens Introduction BEST AVAILABLE COPY Product Catalog Sales Page 1 of 2 Tech Support Our Con Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies > 4-Wire Resistive 4-Wire Resistive Touchscreens Touch pressure causes electrical contact between the conductive and resistive layers. f¯¯- Scratch, resistant coating - Conductive layer - Separators - Resistive layer 4-Wire Resistive touch technology consists of a glass or acrylic panel that is coated with electrically condictive and resistive layers. The thin layers are separated by invisible separator dots. When operating, an electrical current moves through the screen. When pressure is applied to the screen the layers are pressed together, causing a change in the electrical current and a touch event to be registered. -- - Glass panel 4-Wire Resistive type touch screens are generally the most affordable. Although clarity is less than - CRT with other touch screen types, resistive screens are very durable and can be used in a variety of environments. This type of screen is recommended for individual, home, school, or office use, or less demanding point-of-sale systems, restaurant systems, etc. Advantages Disadvantages • High touch resolution • 75% clarity • Pressure sensitive, works with any stylus • Resistive layers can be damaged by a . Not affected by dirt, dust, water, or light sharp object • Affordable touchscreen technology • Less durable then 5-Wire Resistive technology Touchscreen Specifications Touch Type: 4-Wire Resistive Screen Sizes: 12"-20" Diagonal Cable Interface: PC Serial/COM Port or USB Port Touch Resolution: 1024 x 1024 Response Time: 10 ms. maximum Activation Force: Positional Accuracy: 50-120 grams per square centimer 3mm maximum error Light Transmission: 80% nominal Light Transmission: 80% nominal Scratch Resistance: 3H pencil hardness Life Expectancy: 3 million touches at one point Temperature: Operating: -10°C to 70°C Storage: -30°C to 85°C Humidity: Pass 40 degrees C, 95% RH for 96 hours. Chemical Resistance: Alcohol, acetone, grease, and general household detergent Software Drivers: Windows XP / 2000 / NT / ME I98 / 95, Linux, Macintosh OS http://www.touchscreens.com/intro-touchtypes-4resistive.html 8/5/2005 APLNDC00025594 4-Wire Resistive Touchscreens -TouchScreens com is owned and operated tiy Mass Multimedia, Inc- Page 2 of 2 È Call: 1-800-348-8610 E-mail: info@touchscreen: BEST AVAILABLE COPY http://www.touchscreens.com/intro-touchtypes-4resistive.html 8/5/2005 APLNDC00025595 5-Wire Resistive Touchscreens Introduction BEST AVAILABLE COPY Product Catalog Sales Page 1 of 2 Tech Support Our Con Now at: Home > Introduction > Comparing Technologies > Comparing Touch Technologies > 5-Wire Resistive 5-Wire Resistive Touchscreens Touch pressure causes electrical contact between the conductive and resistive layers. Soratchresistant coating Conductive layer Separators layer 5-Wire Resistive touch technology consists of a glass or acrylic panel that is coated with electrically condictive and resistive layers. The thin layers are separated by invisible separator dots. When operating, an electrical current moves through the screen. When pressure is applied to the screen the layers are pressed together, causing a change in the electrical current and a touch event to be registered. Glass panel 5-Wire Resistive type touch screens are generally more durable than the similiar 4-Wire Resistive type. Although clarity is less than with other touch screen types, resistive screens are very durable and can be used in a variety of environments. This type of screen is recommended for demanding point-of-sale systems, restaurant systems, industrial controls, and other workplace applications. Advantages Disadvantages • High touch resolution • 75 % clarity • Pressure sensitive, works with any stylus e Resistive layers can be damaged by a e Not affected by dirt, dust, water, or light sharp object • More durable then 4-Wire Resistive technology CRT Touchscreen Specifications Touch Type: Cable Interface: Elo AccuTouch 5-Wire Resistive PC Serial/COM Port or USB Port Touch Resolution: 4096 x 4096 Response Time: 21 ms. at 9600 baud Light Transmission: 80% +/-5% at 550 nm wavelength (visible light spectrum) Expected Life: 35 million touches at one point Temperature: Operating: -10°C to 50°C Storage: -40°C to 71°C Humidity: Operating: 90% RH at max 35°C Storage: 90% RH at max 35°C for 240 Chemical Resistance: Acetone, Methylene chloride, Methyl ethyl ketone, Isopropyi alcohol, Hexane, Turpentine, Mineral spirits, Unleaded Gasoline, Diesel Fuel, Motor Oil, Transmission Fluid, Antifreeze, Ammonia based glass cleaner, Laundry Detergents, Cleaners (Formula 409, etc.), Vinegar, Coffee, Tea, Grease, Cooking Oil, Salt Regulations: UL, CE, TUV, FCC-8 Software Drivers: Windows XP, 2000, NT, ME, 98, 95, 3.1, DOS, Macintosh OS, Linux, Unix (3rd Party) http://www.touchscreens.com/intro-touchtypes-resistive.html 8/5/2005 APLNDC00025596 5-Wire Resistive Touchscreens TouchScreens.com is owned and operated by Mass Multimedia, Inc http://www.touchscreens.com/intro-touchtypes-resistive.html Page 2 of 2 Call: 1-800-348-8610 E-mail: info@touchscreen: 8/5/2005 APLNDC00025597 OV. 17. 2005 3-17PM 16509618301 NO. 810 P. 1 RECEIVED CENTRAL FAX CENTER B-Wav & Tao*6, 3 NW17 2W5 INTEL- -- - ·AL PROPERTY LAW 590 W. El Camino Real, Mountain View, CA 94040 Telephone: (650) 961-8300 Facsimile: (650) 961-8301 www.beverlaw.com FACSuvute CO v na SonT November 17, 2005 Receiver: USHO Art Unit 2673 TEL #: FAX #: 571-273-8300 Sender: Quin C. Hoellwarth, Reg. No. 34,239 Re. Petition to Revive an Application Abandoned for Failure to Notify the Office of a Foreign or International Filing Application No. 10/840,862 Attorney Docket No. APLIP305/P3266 Pages Including Cover Sheet(s): 3 NIESSAGE: goNFIDENTIALrrY NO E d and confidential information The infonnation contained in this facsimile ¯gxX) mes geeis er of message is not the intended intended only for the use of the receiver or firm name distribution or copy of this FAX is strictly prohibited. If receiver, you are hereby nedfied that any dissern y notify the sender at the telephone number provided above you have received this FAX m error, please athe address above via the United States Postal service. Thank you. andytura the origud m = - - - --- PAGE113'RCVDAT11111/20056:15:48PM[EastemStandardTime]*SVR:USPT0EFXRF6/24*DNIS:21383ÔO'CSID:165096183O1'DURATl0N(mmss):01·22 . . APLNDC00025598 mov. 17. 2005 >:1RM 16509618301 NO. 810 RECEIVED NOV.1 7 200Š IN THE UNITED STATES PA TENTAND TRADEMARK OFFICE I In re application of: Hotelling et al, Attomey Docket No.: AFL1P305/P3266 Application No.: 10/840,862 Examinar: Unassigned ' Filect May 6, 2004. Group: 2673 ' Title: MUL u.-wINT TOUCHSCREEN Confirmation No. 8470 CERTIFICATE OFTACSTMILE TRANEMISSION I hereby certify that.this dance mîtied by facsirnils to fax number 571.273.8300 d Tr k Omce on November 17, 2005. Signed: Agnes gence I r PE - - - -ON TO REv ava. AN APPLICATION ABA-- ma y FOR FAILURE TO NOTTW THE OFFICE OF A FOREIGN OR INTERNATIONAL FILING 37 C.F.R. 1.137(f) Mail Stop Petition Cornmissioner for Patents P.O. Box 1450 Alexandria, VA 22313-1450 L A non-puþIication request was included with the above-identified application on filing ' pursuant to 35 U.S.C. 1.22(b)(2)(B)(iii). However, subsequent to the filing of the above- I identified application, an application was filed in another country, or under a multinational i I : intemational treaty that requires publication of applications eighteen months after filing. The I filing date of the subsequently-filed foreign or international application was April 26, 2005. : I To the extent required and not already provided, notice of the fDing ofthe foreign or international application pursuant to 35 U.S.C. 122(b)(2)(B)(iii) and 37 C£.R. 1.213(c) is hereby provided. Nevertheless, because a non-publication request was included with the above-identified application on filing pursuant to 35 U.S.C. 122(b)(2)(B)(i), the above.identified applicatica may . have become abandoned pursuant to 35 I.°.S.C. 122(b)(2)(B)(iii) for failure to timely notify the I 11/18/2005 HDEMESS1 00000024 500388 01 FC:1453 10840862 1 1500.00 DA PAGE 2/3'RCVDAT 11/11/2005 6:15:48 PM [Eastern Standard Time]' SVR:USPTO-EFXRF4/24'ONIS:213830O * CSID:165096183Oi'DURATION (m·ss):O1-22 APLNDC00025599 10V. 17. 2005 9:17PM 16509618301 NO. 810 P. 3 office of the filing of an application in a foreign country or under a multinational international ty that requires pubEcation of applications eighteen months after filing. The date of such abandonment would be the day after the expiration date of the forty-five (45) day period set in 35 U.S.C. 122(b)(2)(B)(iii). The entire delay in filing the required reply from the due date for the reply until the filing of a grantable petition pmsuant to 37 CFR 1.137(b) was unintentional. In view ofthe ‡·oregoing, and pursuant to 37 C.F.R. 137(f), Applicant hereby petitions for revival of this application under 37 C.F.R. 137(b). The Commissioner is hereby authorized to charge the required fees ($1,500.00) to cover the petition fee set forth in 37 C.F.R. 1.17(m) or any additional fees to our Deposit Account No. 500388 (Order No. APL1P305) Respectfully subraitted, BEYER wenVER & THOMAS,LLP Quin C. Hoellwarth Reg. No. 45,738 P.O. Box 70250 Oakland, CA 94612-0250 (650) 961-8300 I i i I I I 2 PAGE 3I3* RCVDAT 11/17/2005 6:15:48 Pil[Eastem Standard Time]* SVR:USPTv·crw 6/24 *0Nls:2138300 * CSID:16509618301*DURATION (mm ss):01-22 APLNDC00025600 PTOISBl96 (11-05) Approved for use through 07/31/2006. OMB 0651-0031 U.S. Patent and Trademark Office; U.S. DEPARTMENT OF COMM.ERCE e Paperwork Reduction Act of 1995, no persons are re¶uired to respond to a collection of information unless it displays a valid OMB control number. STATEMENT UNDER 37 CFR23]b) Applicant/Patent Owner: Steye Ngggi og Application No./Patent No.: 10/840,8§2 Filed/Issue Date: Mav 8. 2004 Entitled: MULTIPOINT TOUCHSCREEN (Name of Assignee) ' (Type of Assignee, e.g., corporation, partnership, university, govemment agency, etc.) states that it is: 1. the assignee of the entire right, title, and interest; or 2. an assignee of less than the entire right, title and interest (The extent (by percentage) of its ownership interest \« %) in the patent application/patent identified above by virtue of either: A An assignment from the inventor(s) of the patent application/patent identified above. The assignment was recorded in the United States Patent and Trademark Office at Reel 015311 , Frame 07en or for which a copy thereof is attached. OR B.0 A chain of title from the inventor(s), of the patent application/patent identified above, to the current assignee as follows: 1. From: To: The document was recorded in the United States Patent and Trademark Office at Reel Frame , or for which a copy thereof is attached. 2. From: To: The document was recorded in the United States Patent and Trademark Office at Reel Frame or for which a copy thereof is attached. 3. From: To: The document was recorded in the United States Patent and Trademark Office at Reel Frame or for which a copy thereof is attached. O Additional documents in the chain of title are listed on a supplemental sheet. O As required by 37 CFR 3.73(b)(1)(i), the documentary evidence of the chain of title from the original owner to the assignee was, or concurrently is being, submitted for recordation pursuant to 37 CFR 3.11. [NOTE: A separate copy (i.e., a true copy of the original assignment document(s)) must be submitted to Assignment Division in accordance with 37 CFR Part 3, to record the assignment in the records of the USPTO. ge: MPEP 302.08] The undersig d is d below rized to act on behalf of the assignee. Signature Rillv Date AIInn ill Printed or Typed Name 4 O Telephone Number Attornev of Record Title This collection of information is required by 37 GFR 3.73(b). The information is required to obtain or retain a benefit by the public which is to file (and by the USPTO to process) an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.11 and 1.14. This collection is estimated to take 12 minutes to complete, including gathering, preparing, and submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to complete this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, P.O. Box 1450, Alexandria. VA 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 1450, Alexandria, VA 22313-1450. If you need assistance in completing the form, call 1-800-PTO-9199 and select option 2. APLNDC00025601 \ PE PTolSB/80 (Modified 10/06/05) POWER OF ATTORNEY TO PROSECUTE APPLICATIONS BEFORE THE USPTO I hereby appoint: Practitioners associated with the Customer Number: 29855 a i AND Practitioners associated with the Customer Number: 34599 OR O Practitioner(s) named below (if more than ten patent practitioners are to be named, then a customer number must be used): Name Registration " Number Name Registration Number as attorney(s) or agent(s) to represent the undersigned be ore the United States Patent and Trademark Office (USPTO) in connection with any and all patent applications assignedstily to the undersigned according to the USPTOassignment records or assignment documents attached to this form in accordance with 37 CFR 3.73(b). The correspondence address for the application identified in the attached statement under 37 CFR 3.73(b) is: The address associated with Customer Number: OR 29855 | O Firm or Individual Name Address City State Zip Country Telephone Email Assignee Name and Address: Apple Computer, Inc. 1 Infinite Loop Cupertino, CA 95014 A copyof this form, together with a statement under 37 CFR 3.73(b) (Form PTO/SBÍ96 or equivalent) is required to be filed in each application in which this form is used. The statement under 37 CFR 3.73(b) may be completed by one of the practitioners appointed in this form if the appointed practitioner is authorized to acton behalf of the assignee, and must identify the appilcation in which this Power of Attorney is to be filed. i SIGNATURE of Assignee of Record whose signature and title is supplied below is authorized to act on behalfofthe assignee. Signature Name Title Date | Ric J. Lutton, Jr Asjsta t Secretary and Chief Patent Counsel Telephone (408) 974-9453 APLNDC00025602 U-· --- STATes B TENT AND NEMAmt OFFIGE UNITED STATIG DEPAHTMENT OF COMMERCE United States Patent and Trademark Office Addren: COMMISSIONER FOR PATENTS P.O. Box 1450 Alexandria, Virginia 22313-1450 APPLICATION NUMBER FILING OR 371 (c) DATE FIRST NAMED APPLICANT ATTY. DOCKET NOJTITLE 10/840,862 05/06/2004 Steve Hotelling APLlP305/P3266 CONFIRMATION NO. 8470 29855 WONG, CASELLO, LUTSCH, RUTHERFORD & BRUCCULERI, P.C. 20333 SH 249 SUITE 600 HOUSTON, TX 77070 IlllllllUlllllllllllllllllllllllllllllIHillllllllllllllll *OCOOOOOOO17874736* Date Mailed: 01/19/2006 NOTICE OF ACCEPTANCE OF POWER OF ATTORNEY This is in response to the Power of Attorney filed 01/10/2006. The Power of Attorney in this application is accepted. Correspondence in this application will be mailed to the above address as provided by 37 CFR 1.33. LYNN LAM PTOSS (703) 308-9150 OFFICE COPY APLNDC00025603 UNITED STATES PATENT AND M s- OFFIGE UNITED STATimi DEPA.......-- - U¥ COMMERCE United States Patent and Trademark Office Address: COMMISSIONER FOR PATENTS PO. Box 1450 Alexen Virginia 22313-1450 APPLICATION NUMBER FILING OR 371 (c) DATE FIRST NAMED APPLICANT ATTY. DOCKET NOITITLE 10/840,862 05/06/2004 Steve Hotelling APLl P305/P3266 CONFIRMATION NO. 8470 022434 BEYER WEAVER & THOMAS LLP *OCOOOOOOO17874718* P.O. BOX 70250 OAKLAND, CA 94612-0250 Date Mailed: 01/19/2006 NOTICE REGARDING CHANGE OF POWER OF ATTORNEY This is in response to the Power of Attorney filed 01/10/2006. • The Power of Attorney to you in this application has been revoked by the assignee who has intervened as provided by 37 CFR 3.71. Future correspondence will be mailed to the new address of record(37 CFR 1.33). LYNN LAM PTOSS (703) 308-9150 OFFICE COPY APLNDC00025604 United States Patent and Trademark Office Address: COMMISSIONER FOR PATENTS PO. Box 1450 Alexandria,Virginia 22313-1450 wwwxspto.gov APPLICATION NUMBER 10/840,862 , FILING/RECElPT DATE FIRST NAMED APPLICANT ATTY. DOCKET NO. / 05/06/2004 Steve Hotelling APL1P305/P3266 CONFIRMATION NO. 8470 29855 WONG, CABELLO, LUTSCH, RUTHERFORD & BRUCCULERI, P.C. 20333 SH 249 SUITE 600 HOUSTON, TX 77070 Date Mailed: 01/27/2006 Communication Regarding Rescission Of Nonpublication Request and/or Notice ofForeign Filing Applicant's rescission of the previously-filed nonpublication request and/or notice of foreign filing is acknowledged. The paper has been reflected in the Patent and Trademark Office's (USPTO's) computer records so that the earliest possible projected publication date can be assigned. The projected publication date is 05/11/2006. If applicant rescinded the nonpublication request before or on the date of "foreign filing,"' then no notice of foreign filing is required. If applicant foreign filed the application after filing the above application and before filing the rescission, and the rescission did not also include a notice of foreign filing, then a notice of foreign filing (not merely a rescission) is required to be filed within 45 days of the date of foreign filing. See 35 U.S.C. § 122(b)(2)(B)(iii), and Clarification of the United States Patent and Trademark Office's Interpretation of the Proyisions of 35 U S.C. § 122(b)(2)(B)(ii)-(ly), 1272 Off. Gaz. Pat. Office 22 (July 1, 2003). If a notice of foreign filing is required and is not filed within 45 days of the date of foreign filing, then the application becomes abandoned pursuant to 35 U.S.C. § 122(b)(2)(B)(iii). In this situation, applicant should either file a petition to revive or notify the Office that the application is abandoned. See 37 CFR l.137(f). Any such petition to revive will be forwarded to the Office of Petitions for a decision. Note that the filing of the petition will not operate to stay any period of reply that may be running against the application. Questions regarding petitions to revive should be directed to the Office of Petitions at (571) 272-3282. Questions regarding publications of patent applications should be directed to the patent application publication hotline at (703) 605-4283 or by e-mail pgpub@uspto.gov. ' Note, for purpose of this notice, that "foreign filing" means "filing an application directed to the same invention in another country, or under a multilateral international agreement, that requires publication of applications 18 months after filing". APLNDC00025605 UNITED STATES PATENT AND TRADEMARK OFFICE Commissioner for Patents United States Patent and Trademark Office P. o. Box 1450 Alexandria, VA 22313-1450 www.uspto.gov WONG CABELLO LUTSCH R·· --RFORD & BRUCCULERI, PC 20333 SH 249 COPY MAILED SUITE 600 HOUSTON, TX 77070 FEB 0 2 2006 0 PCE OF PETUONS In re Application of Steve Hotelling et al Application No. 10/840,862 Filed: May 6, 2004 Attorney Docket No. APL1P305/P3266 : DECISION GRANTING PETITION : UNDER 37 CFR 1.137(b) This is a decision on the petition, filed November 17, 2005, which is being treated as a petition under 37 CFR 1.137(b) to revive the instant nonprovisional application for failure to timely notify the U.S. Patent and Trademark (USPTO) of the filing of an application in a foreign country, or under a multinational treaty that requires publication of applications.eighteen months after filing. See 37 CFR 1.137(f). The petition is GRANTED. Petitioner states that the instant nonprovisional application is the subject of an application filed in an eighteen month publication country on April 26, 2005. However, the USPTO was unintentionally not notified of this filing within 45 days subsequent to the filing of the subject application in an eighteen month publication country. In view of the above, this application became abandoned pursuant to 35 U.S.C. § 122(b)(2)(B)(iii) and 37 CFR 1.213(c) for failure to timely notify the Office of the filing of an application in a foreign country or under a multilateral international agreement that requires publication of applications 18 months after filing. A petition to revive an application abandoned pursuant to 35 U.S.C. 122 (b)(2)(B)(iii) for failure to notify the USPTO of a foreign filing must be accompanied by: (1) the required reply which is met by the notification of such filing in a foreign country or under a multinational treaty; (2) the petition fee as set forth in 37 CFR 1.17(m); APLNDC00025606 Application No. 10/840,862 Page 2 and (3) a statement that the entire delay in filing the required reply from the due date of the reply until the filing of a grantable petition was unintentional. The instant petition has been found to be in compliance with 37 CFR 1.137(b). Accordingly, the failure to timely notify the USPTO of a foreign or international filing within 45 days after the date of filing of such foreign or international application as provided by 35 U.S.C. § 122(b)(2)(B)(iii) and 37 CFR 1.213(C) is accepted as having been unintentionally delayed. The previous Request and certification under 35 U.S.C. § 122 (b)(.2)(B)(i) has been rescinded. A Notice Regarding Rescission of Nonpublication Request which sets forth the projected publication date of May 11, 2006 was mailed under separate cover on January 27, 2006. The address on the petition differs from the address of record. Therefore, if appropriate, a change of address and/or appropriate power of attorney documentation should be submitted. A courtesy copy of this decision (as well as a copy of the Notice mailed January 27, 2006) is being mailed to the address on the petition. However, all future correspondence will continue to be mailed to the above address of record, unless otherwise appropriately notified. Any inquiries concerning this decision may be directed to the undersigned at (571) 272-3218. This application is being forwarded to Technology Center Art Unit 2674 for examination in due course. Petitions Examiner Office of Petitions ATTACHMENT TO CC: Copy of Notice mailed 1/27/06 cc: Beyer Weaver & Thomas LLP PO Box 70250 Oakland, CA 94612-0250 APLNDC00025607 . 02/06/2006 . BEST AVAl .ABLE COPY 16:19 8324462424 WONG CABELLO PAGE 01 Nbt IvED CENTRAL FAX CENTER FEB Og 2008 WONGCO 36 O 2°N in'Ÿe'xi?7 0 Wong, Cabello, Lutsch, Rutherford & Brucculeri, LLP Fax: 832-446-2452 wcpatent©counselip.com Main: 832-446-2400 FACSIMILE TRANSMISSION COVER SHEET Date: Monday, February 06, 2006 To USPTO - Examiner: Edouard Patrick Nestor Art Unit: 2673 Fax: 571/273-8300 From: Billy C. Allen III Atty. Docket #: 1 19-0093US Re: Customer No: 29855 Serial No.: 10/840,862 Please see the attached Pages (including cover page): 2 Received in the United States Patent and Trademark Office 1. Change of Correspondence Address (1 page). If there is a problem with transrnission, please call (832) 446-2400 CONFIDENTIALITY NOTICE This communication is only for the person named above. Unless otherwise indicated, it contains information that is confidential, privileged or exempt from disclosure under applicable law. If you are not the person named above, or responsible for delivering it to that person, be aware that disclosure, copying, distribution or use of this communication is strictly prohibited. If you have received it in error, or are uncertain as to its proper handling, please immediately notify us by collect telephone and mail the original PAGE 1/2 RCVD AT 2/6/2006 5:13:43 Pi¶Eastem Standard Timej'8VR:USPTC-EFXRF·$I24*DNIS:21383Ô0* CSID:8324462424* DURATION (mmas):01·10 APLNDC00025608

Disclaimer: Justia Dockets & Filings provides public litigation records from the federal appellate and district courts. These filings and docket sheets should not be considered findings of fact or liability, nor do they necessarily reflect the view of Justia.


Why Is My Information Online?