Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 462

Declaration of DEOK KEUN Matthew Ahn IN SUPPORT OF #461 APPLES OPENING CLAIM CONSTRUCTION BRIEF PURSUANT TO PATENT L.R. 4-5 filed by Apple Inc.(a California corporation). (Attachments: #1 Exhibit A, #2 Exhibit B Part 1, #3 Exhibit B Part 2, #4 Exhibit C Part 1, #5 Exhibit C Part 2, #6 Exhibit D Part 1, #7 Exhibit D Part 2, #8 Exhibit D Part 3, #9 Exhibit D Part 4, #10 Exhibit E Part 1, #11 Exhibit E Part 2, #12 Exhibit F, #13 Exhibit G, #14 Exhibit H, #15 Exhibit I, #16 Exhibit J, #17 Exhibit K, #18 Exhibit L, #19 Exhibit M Part 1, #20 Exhibit M Part 2, #21 Exhibit N, #22 Exhibit O, #23 Exhibit P, #24 Exhibit Q)(Jacobs, Michael) (Filed on 12/8/2011) Modified on 12/9/2011 linking entry to document #461 (dhm, COURT STAFF).

Exhibit C

TO ALL TO WIIOR TII ENE I>It EN ENTS SHALII CO3I E

UNITED STATES DEPAR w NT OF COMws ·<CE
United States Patent and Trademark Office
June 22, 2011
· mm IS TO CER = w THAT ^=EXED HERETO IS A TRUE COPY FROM
THE RECORDS OF I nla OFFICE OF:

U.S. PATENT: 7,663,607
ISSUE DATE: February 16, 2010

By Authority of the
Under Secretary of Commerce for In llectual Property
and Director of the United State ate and Trademark orace

P. SWA
Certifying Officer

APLNDC00022435

lillllllllllllllllllllllllllllllllllllllllllllllllllllllllllli
(12) United States Patent

(10) Patent No.:

Hotelling et al.

(45) Date of Patent:

US 7,663,607 B2
Feb. 16, 2010

(54) MULTIPOINT TOUCH- - - N

4,734,685 A
4,746,770 A

3/1988 Watanabe ................... 340/7 0
5/1988 McAvinney .................. 178| 8

(75)

4,771,276 A
4,788,384 A
4,806,846 A

9/1988 Bruere-Dawson et al. ..... 178/ 8
11/1988 Parks ......................... 340/7 2
2/1989 Kerber .................. 324/60 CD

4,898,555 A
4,914,624 A
4,968,877 A

2/1990 Dunthorn ..................... 445/22
4/1990 Sampson et al.
11/ 990 McAvinney et al. ........ 250/221

5,003,519 A
5,017,030 A
5,189,403 A

3/
5/
1/
2/

5,194,862 A
5,224,861 A

3/ 993 Edwardsal. ................... 434/35
7/ 993 Glass et ...................... 341/20

5,241,308 A

8/ 993 Young ......................... 341/34

Inventors: Steve Hotelling, San Jose, CA (US);
Joshua A. Strickon, San Jose, CA (US);
Brian Q. Huppi, San F
'
CA
(US)

(73) Assignee: Apple Inc., Cupertino, CA (US)

( * ) Notice:

Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.C. 154(b) by 754 days.

5,178,477 A

(21) Appl. No.: 10/840,862
(22) Filed:
(65)

FOREIGN P

Prior Publication Data
US 2006/0097991 Al
May 11, 2006

CA

- · DOCUMENTS

1243096

10/1988

................. 340/180

(Continued)
OTHER PUBLICATIONS

(2006.01)

(52) U.S. Cl. ..................... 345/173; 345/174; 178/18.01
(58) Field of Classification Search ......... 345/173-179;
178/18.01-18.04
See application file for complete search history.
(56)

Noirjean ...................... 368/73
Crews ........................ 400/485
Garnbaro
Franz et al..................... 400/489
................. 340/711

(Continued)

May 6, 2004

(51) Int. Cl.
GOdF 3/041

991
991
993
993

References Cited

U.S. Appl. No. 10/654,108, filed Sep. 2, 2003.

(Continued)
Primary Examiner-Richard Hjerpe
Assistant Examiner-Kimnhung Nguyen

(74) Attorney, Agent, or Firm-Morrison & Foerster LLP

U.S. PATENT DOCUMENTS

(57)

ABS· -= ·

3,333,160 A
3,541,541 A
3,662,105 A

7/1967 Gorski
11/1970 Englebart
5/1972 Hurst et al. ................... 178/18

A touch panel having a transparent capacitive sensing

3,798,370 A
4,246,452 A

3/ 974 Hurst .......................... 17W18
1/ 981 Chandler ....................... 200/5

medium configuredto detectmultiple touches ornear touches
that occur at the same time and at distinct locations in the

6/ 987 Beckes ...................... 340/365 P
6/1987 Lucas et al. ............... 364/518

resentative of the location of the touches on the plane of the
touch panel for each of the multiple touches is disclosed.

4,550,221 A

10/ 985 Mabusth ...................... 178/18

4,692,809 A
4,695,827 A

9/1987 Beining et al. .............. 358/247
9/1987 Beining et al. ........... 34W365 P

4,733,222 A

plane of the touch panel and to produce distinct signals rep-

3/1988 Evans ..................... 340/365 C

4,672,364 A
4,672,558 A

11 Claims, 14 Drawing Sheets

100
102

108

110104

110

116

110
110

110

104
112
106

Conv provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022436

US 7,663,607 B2
Page 2
U.S. P
5,252,951 A

5,281,966 A

10/ 993 Tannenbaum et al. ....... 345/156

-· •- -

-

•~

6,002,389 A
6,002,808 A
6,020,881 A

1/ 994 Walsh ......................... 341/22

6,031,524 A

5,305,017
5,345,543
5,376,948
5,398,310
5,442,742
5,463,388

A
A
A
A
A
A

4/
9/
12/
3/
8/
10/

994
994
994
995
995
995

Gerpheide .................. 345/174
Capps et al. ................ 395/ 37
Roberts ...................... 345/ 73
Tchao et al. ................ 395/ 44
Greyson et al. ............. 395/ 46
Boie et al. .................... 341/33

5,463,696
5,483,261
5,488,204
5,495,077
5,513,309
5,523,775

A
A
A
A
A
A

10/
1/
1/
2/
4/
6/

995
996
996
996
996
996

Beernink et al. ............ 382/186
Yasutake .................... 345/173
Mead et al. ................... 178/18
Miller et al. .................. 178/18
Meieretal. ................. 395/155
Capps ........................ 345/179

5,530,455 A
5,543,590 A

6/996 Gillicketal.al................345/163
8/ 996 Gillespie et .............. 178/18

5,543,591
5,563,632
5,563,996
5,565,658
5,579,036
5,581,681
5,583,946
5,589,856
5,590,219

A
A
A
A
A
A
A
A
A

8/
_0/
0/
0/
1/
12/
12/
12/
12/

5,592,566
5,594,810
5,596,694
5,612,719
5,631,805
5,633,955
5,634,102
5,636,101

A
A
A
A
A
A
A
A

1/ 997
1/ 997
1/1997
3/ 997
5/ 997
5/ 997
5/ 997
6/ 997

5,642,108 A

996
996
996
996
996
996
996
996
996

6,037,882
6,050,825
6,052,339
6,061,177
6,072,494
6,084,576

A
A
A
A *
A
A

6,107,997
6,128,003
6,131,299
6,135,958
6,144,380
6,188,391

A
A
A
A
A
B

6,198,515 B
6,208,329 B

12/1999 Kasser ....................... 345/173
12/1999 Freeman ..................... 382/288
2/2000 Naughton et al. ........... 345/327

2/2000 Kunert ....................... 345/173

3/2000
4/2000
4/2000
5/2000
6/2000
7/2000
8/2000
10/2000
10/2000
10/2000
11/2000
2/200

Levy
Nicho
1
Frenkel et al
Fujimoto ......
Nguyen ......................
Leu et al. ....................

341/20
434/227
368/230
359/443
345/358
345/ 68

Ure ............................ 345/ 73
Smith et al. ................. 345/ .57
Raab et al. .................... 33/503
Mikula-Curtis et al. ..... 600/443
Shwartsetal. .............. 345/350
Seely et al.

3/200 Cole ..........................348/836
3/200 Ballare ....................... 345/173

Gillespie et al. .............. 178/18
Roberts ...................... 345/173
Tchao ........................ 395/144
Gerpheide et al. ............ 178/19
Yates, IV .................... 345/173
Tchao et al. ................ 395/804
Gourdol ..................... 382/187
Stein et al
Gourdol ....
382/202

6,222,465
6,239,790
6,243,071
6,246,862
6,249,606
6,288,707
6,289,326
6,292,178
6,323,846

B
B
B
B
B
B
B
B
B

4/200
5/200
6/200
6/200
6/200
9/200
9/200
9/200
11/2001

Kumar et al. ................. 341/20
Martinelli et al. ........... 345/174
Shwarts et al. .............. 345/146
Grivas et al. .................. 455/90
Kiraly et al. ................ 382/195
Philipp ....................... 345/168
LaFleur ...................... 705/702
Bernstein et al. ............ 345/173
Westerman et al.

Pagallo et al. ...............
Gourdol .....................
Capps ........................
Beernink et al. ............
Bonsall ......................
Bozinovic et al. ...........
Capps ........................
Bonsall et al. ..............

6,337,678
6,347,290
6,377,009
6,380,931
6,411,287
6,414,671
6,421,234
6,452,514

B
B
B
B
B1
B1
B1
Bl

1/2002
2/2002
4/2002
4/2002
6/2002
7/2002
7/2002
9/2002

Fish
Bartlett ....................... 702/150
Philipp ....................... 318/468
Gillespie et al. ............ 345/173
Scharfetal. ............... 345/177
Gillespie et al. ............ 345/157
Ricks et al. ................. 361/683
Philipp ........................ 341/33

382/ 87
382/ 87
395/ 52
345/ 73
361/681
381/187
395/334
361/681

6/ 997 Gopher et al. ................ 341/22

6,457,355 B1

5,644,657
5,666,113
5,666,502
5,666,552
5,675,361
5,677,710

A
A
A
A
A
A

7/ 997
9/ 997
9/ 997
9/1997
10/ 997
10/ 997

Capps et al. ................ 382/229
Logan ......................... 341/34
Capps ........................ 345/352
Grayson et al. ............. 395/802
Santilli ....................... 345/168
Thompson-Rohrlich .... 345/173

6,466,036
6,515,669
6,525,749
6,535,200
6,543,684
6,543,947

5,689,253
5,710,844
5,729,250
5,730,165
5,736,976
5,741,990
5,745,116
5,745,716
5,746,818
5,748,269
5,764,222
5,767,457
5,767,842
5,790,104
5,790,107
5,802,516
5,808,567
5,809,267
,821,690
,821,930
,823,782
,825,351
5,825,352
5,854,625
5,880,411
5,898,434
5,920,309
-,923,319
,933,134
,942,733
,943,044

A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A

11/ 997
1/ 998
3/1998
3/ 998
4/ 998
4/ 998
4/ 998
4/ 998
5/1998
5/,998
6/'998
6/ 998
6/ 998
8/ 998
8/ 998
9/ 998
9/1998
9/ 998
0/ 998
0/ 998
0/ 998
0/ 998
0/ 998
2/ 998
3/ 999
4/ 999
7/ 999
7/ 999
8/ 999
8/ 999
8/ 999

Hargreaves et al. ........... 341/22
Capps et al. ................ 382/317
Bishop et al. ............... 345/175
Philipp .......................... 137/1
Cheung ...................... 345/168
Davies ..................... 84/423 R
Pisutha-Arnond ........... 345/358
Tchao et al. ................ 395/350
Yatake .................... 106/31.86
Harris et al. .................. 349/58
Shieh ......................... 345/173
Gerpheide et al. ............ 178/18
Korth ......................... 345/168
Shieh ......................... 345/173
Kasser et al. ............... 345/174
Shwarts et al. ................. 707/6
McCloud ..................... 341/20
Moran et al. ................ 395/358
Martens et al. ............. 313/506
Hansen ....................... 345/340
Marcus et al. .............. 434/156
Tam
Bisset et al. ................ 34 /173
Fnsch et al. ................ 345/173
Gillespie et al. ......... 178/ 8.01
Small et al. ................. 345/348
Bisset et al. ................ 345/173
Bishop et al. ............... 345/175
Shieh .......
....... 345/173
Allen et al.
Martinelli et al. ........... 345/174

6,570,557
6,593,916
6,610,936
6,624,833
6,639,577
6,650,319
6,658,994
6,670,894
6,677,932
6,677,934
6,723,929
6,724,366
6,757,002
6,803,906
6,842,672
6,856,259
6,888,536
6,900,795
6,927,76
6,942,57
6,965,37
6,972,40
6,977,666
6,985,801
6,992,659
7,030,860
7,031,228
2002/0015024
2002/0118848
2003/0006974
2003/0076301

10/2002 Philipp ........................ 73/304

B1
Bl
Bl
B2
B1
B2

10/2002
2/2003
2/2003
3/2003
4/2003
4/2003

Philipp .......................
Mohri ........................
Moran et al. ................
Philipp
White et
Lee ............ ...... ......

BI
BI
B2
B1
B2
Bl
B1
B2
Bl
BI
B2
B2
B
B
B
B *
B2 *
Bl
B2
Bl
B1
B2
B1
B1
B2
B1 *
B2
A *
A
A
A

5/2003
7/2003
8/2003
9/2003
0/2003
1/2003
2/2003
2/2003
1/2004
1/2004
4/2004
4/2004
6/2004
10/2004
1/2005
2/2005
5/2005
5/2005
8/200
9/200
11/200
12/200
12/2005
1/2006
1/2006
4/2006
4/2006
2/2002
8/2002
1/2003
4/2003

Westerman et al.
Aroyan
Gillespie et al. ......... 178/18.01
Kumar et al. ............... 345/863
Eberhard .................... 345/102
Hurst et al.
McMillan .................... 99/468
Mehring
341/22
Westerman
Blanchard ................... 345/173
Kent
Crawford .................... 345/157
Oross et al. ................. 345/864
Morrison et al. ............ 345/173
Straub et al. ................... 701/3
Sharp
341/5
Westenna et
......... 45/173
Knight, IH et al. .......... 345/173
Badaye et al. .............. 345/173
McAllister et al
463/20
Gettemy et al. ...
345/173
Akitt et al. .................. 250/221
Hedrick ...................... 345/690
Straub et al. ................... 701/3
Gettemy ..................... 345/173
Hsu et al. ................... 345/173
Bom et al. .................... 368/69
Westerman et al. ......... 345/173
Karpenstein ................ 381/119
Clough et al. ............... 345/179
Tsuk et al. .................. 345/159

Copy provided by uur .s, from the PIRS Image Database on 06/20/2011

324/678
345/474
345/863
345/168
234/379
400/489

APLNDC00022437

US 7,663,607 B2
Page 3

2003/0076303 A
2003/0076306
2003/0095095
2003/0095096
2003/0098858

4/2003 Huppi ........................ 345/ 63

A
A
A
A

4/2003
5/2003
5/2003
5/2003

2003/0206202 A

Zadesky et al. .............
Pihlaja .......................
Robbin et al. ...............
Perski et al. ................

345/
345/
345/
345/

73
56
56
73

1/2003 Moriya ....................... 345/846

2003/0234768 A

2/2003 Rekimoto et al. ........... 345/ 69

2003/0234770 A * 2/2003 MacKey ..................... 345/ 73
2004/0227736 A *
2004/0263484 A _
2005/0007349 A _ *

2005/0012723 A _
2005/0052425
2005/0083307
2005/0104867
2005/0110768
2005/0146511
2006/0022955
2006/0022956
2006/0026521
2006/0026535
2006/0026536
2006/0032680
2006/0033724
2006/0053387
2006/0066582
2006/0085757
2006/0097991
2006/0197753

A
A *
A.
A.
A_*
A.
A.
A.
Ai
Al
A
A
A
A
A
A
A.

1/2004 Kamrath et al. ............. 345/ 73
2/2004 Mantysalo et al. .......... 345/ 73
1/2005 Vakil et al. .................. 345/ 73

1/2005 Pallakoff .................... 345/ 73

3/2005
4/2005
5/2005
5/2005
7/2005
2/2006
2/2006
2/2006
2/2006
2/2006
2/2006
2/2006
3/2006
3/2006
4/2006
5/2006
9/2006

FOREIGN P
DE
EP
EP
EP
EP
EP
EP
JP
JP
JP
JP
JP
JP
WO
WO
WO
WO
WO
WO
WO
WO
WO
WO

102 51 296
0 156 593
0 250 931
0 288 692
0 664 504
0 464 908
1 014 295
59-2,4941
60-2 1529
08-0 6307
2000-1 2642
2002-342033
2003-029899
97/18547
97/23738
98/14863
WO-01/27868
03/088176
WO-2004/0 3833
WO-2004/0 3833
WO-2005/1 4369
WO-2005/l 4369
2006/023569

«=

Zadesky et al. ............. 345/ 73
Aufderheide et al. ....... 345/ 73
Westerman et al. ......... 3451 73
Marriott et al. ............. 345/ 73
Hilletal..................... 345/,73
Kennedy .................... 345/173
Lengeling et al. ........... 345/173
Hotelling et al. ............ 715/702
Hotelling et al. ............ 715/863
Hotelling et al. ............ 715/863
Elias et al. ............... 178/ 8.06
Chaudhri et al. ............ 34 /173
Ording ....................... 71 J773
Lyon et al. .................. 345/173
Andre et al. ................ 715/771
Hotelling et al. ............ 345/173
Hotelling .................... 345/173

==

Al
A2
A3
A2
A3

st

S

5/2004
10/1985
1/1988
7/1993
1/1995
9/1996
1/2002
12/1984
10/1985
1/1996
4/2000
11/2002
1/2003
5/1997
7/1997
4/1998
4/2001
10/2003
2/2004
2/2004
12/2005
12/2005
3/2006

- PUBLICATIONS

U.S. Appl. No. 0/789,676, filed Feb. 27, 2004.
U.S. Apç . No. 0/903,964, filed Jul. 30, 2004.
U.S. Apç . No. 1/015,978, filed Dec. 17, 2004.
U.S. Apç . No. 1/038,590, filed Jan. 18, 2005.
U.S. Apç . No. 1/048,264, filed Jan. 31, 2005.
"Touch Technologies Overview," 2001, 3M Touch Systems, Massachusetts.
"Touchscreen Technology Choices," http://www.elotouch.com/
products/detech2.asp, downloaded Aug. 5, 2005.
Jun Rekimoto, "SmartSkin: An Infastructure for Freehand Manipulation on Interactive Surfaces," CHI 2002, Apr. 20-25, 2002, Minneapolis, Minnesota.
"Wacom
Components-Technology,"
http://www.
wacomcomponents.com/english/tech.asp., downloaded Oct. 10,
2004.

"Comparing Touch Technologies," http://www.touchscreens.com/
intro-touchtypes.html, downloaded Oct. 10, 2004.
"GlidePoint!®,"http://www.cirque.com/technology/technology_gp.
htm, downloaded Aug. 5, 2005.
"Captive Position Sensing," http://www.synaptics.com/technology/
cps.cfm, downloadedAug. 5, 2005.
"How do touchscreen monitors know where you're touching?,"
http:#electronics.howstuffworks.com/question716.htm,
downloaded Aug. 5, 2005.
"How Does a Touchscreen Work?," http:Hwww.touchscreens.com/
intro-anatomy.html, downloaded Aug. 5, 2005.
"4-Wire Resistive Touchscreens," http://www.touchscreens.com/
intro-touchtypes-4resistive.html, downloaded Aug. 5, 2005.
"S-Wire Resistive Touchscreens," http://www.touchscreens.com/
intro-touchtypes-resistive.html, downloaded Aug. 5, 2005.
"Capacitive Touchscreens," http://www.touchsereens.com/introtouchtypes-capacitive.html, downloaded Aug. 5, 2005.
"PenTouch Capacitive Touchscreens," http://www.touchscreens.
com/intro-touchtypes-pentouch.html, downloaded Aug. 5, 2005.
"Surface Acoustic Wave Touchscreens," http://www.touchscreens.
comlintro-touchtypes-saw.html, downloaded Aug. 5, 2005.
"Near Field Imaging Touchscreens," http://www.touchscreens.com/
intro-touchtypes-nfi.html, downloaded Aug. 5, 2005.
"Infrared Touchscreens," http://www.touchscreens.com/introtouchtypes-infrared.html, downloaded Aug. 5, 2005.
"WatershedAlgorithm,"http:Hrsb.info.nih.govlijlplugins/watershed.
html, downloadedAug. 5, 2005.
U.S. Appl. No. 10/654, 108, filed Sep. 2, 2003 entitled "Ambidextrous
Mouse".
U.S. Appl. No. 10/789,676, filed Feb. 27, 2004 entitled "Shape
Detecting Input Device".
"4-Wire Resistive Touchscreens" obtained from http://www.
touchscreens.com/intro-touchtypes-4resistive.html generated Aug.
5, 2005.
"S-Wire Resistive Touchscreens" obtained from http://www.
touchscreens.com/intro-touchtypes-resistive.html generated Aug. 5,

2005.
"A Brief Overview of Gesture Recognition" obtained from http://
www.dai.ed.ac.uk/Cvonline/LOCA_COPIES/COHEN/
gesture_overview.html, generated Apr. 20, 2004.
"Capacitive Touchscreens" obtained fromhttp://www.touchscreens.
com/intro-touchtypes-capacitive.html generated Aug. 5, 2005.
"Capacitive Position Sensing" obtained fromhttp://www.synaptics.
com/technology/cps.cfm generated Aug. 5, 2005.
"Comparing Touch Technologies" obtained from http://www.
touchscreens.com/intro-touchtypes.html generated Oct. 10, 2004.
"Gesture
Recognition"
http://www.fingerworks.com/
gesture_recognition.html.
"GlidePoinar®" obtained from http://www.cirque.com/technology/
technology_gp.html generated Aug. 5, 2005.
"How do touchscreen monitors know where you're touching?"
obtained from http://www.electronics.howstuffworks.com/question716.html generated Aug. 5, 2005.
"How does a touchscreen work?" obtained from http://www.
touchscreens.comlintro-anatomy.html generated Aug. 5, 2005.
"iGesture Products for Everyone (learn in minutes) Product Overview" FingerWorks.com.
"Infrared Touchscreens" obtained from http://www.touchscreens.
com/intro-touchtypes-infrared.htmlgenerated Aug. 5, 2005.
"Mouse Emulation" FingerWorks obtained from http://www.
fingerworks.com/gesture_guide_mouse.html generated Aug. 30,

2005.
"Mouse Gestures in Opera" obtained from http://www.opera.com/
products/desktop/mouselindex.dml generated Aug. 30, 2005.
"Mouse Gestures," Optim oz, May 21, 2004.
"MultiTouch Overview" FingerWorks obtained from http://vvvvw.
fmgerworks.com/multoverview.html generated Aug. 30, 2005.
"Near Field Imaging Touchscreens" obtained from http://www
touchscreens.com/intro-touchtypes-nfi.htm1generatedAug. 5, 2005.
"PenTouch Capacitive Touchsereens" obtained from http://www.
touchscreens.com/intro-touchtypes-pentouch.html generated Aug.

5, 2005.

Conv nrovided bv USPTO from the PERS Imaae Database on 06/20/2011

APLNDC00022438

US 7,663,607 B2
Page 4
"Surface Acoustic Wave Touchscreens" obtained from http://www.
touchscreens.com/intro-touchtypes-saw.html generated Aug. 5,
2005.
"Symbol Commander" obtained from http://www.-- com/
symbolcomanderl, generated Aug. 30, 2005.
"Tips for Typing" FingerWorks http://www.fingerworks.com/
mini_typing.html generated Aug. 30, 2005.
"Touch Technologies Overview" 2001, 3M Touch Systems, Massachusetts.
"Wacom Components-Technology" obtained from http://www.
wacom-components.com/english/tech.asp generated on Oct. 10,
2004.
"WatershedAlgorithm"http://rsb.info.nih.govlij/plugins/watershed.
html generated Aug. 5, 2005.
"FingerWorks-Gesture Guide-Application Switching," obtained
from http://www.fingerworks.com/gesture_guide_ apps.html, generated on Aug. 27, 2004, 1-pg.
"FingerWorks-Gesture Guide-Editing," obtained from http://
www.fmgerworks.com/gesure_guide_editing.html, generated on
Aug. 27, 2004, 1-pg.
"FingerWorks-Gesture Guide-File Operations," obtained from
http://www.fingerworks.com/gesture_guide_files.html, generated
on Aug. 27, 2004, 1-pg.
"FingerWorks-Gesture Guide-Text Manipulation," obtained from
http://www.fingerworks.com/gesture_guide_text_manip.html,
generated on Aug. 27, 2004, 2-pg.
"FingerWorks-Gesture Guide-Tips and Tricks," obtained from
http://www.fmgerworks.com/gesture_guide_tips.html, generated
Aug. 27, 2004, 2-pgs.
"FingerWorks-Gesture Guide-Web," obtained from http://www.
fmgerworks.com/gesture_guide_web.html, generated on Aug. 27,
2004, 1-pg.
"FingerWorks-Guide to Hand Gestures for USB Touchpads,"
obtained from http://www.fmgerworks.comligesture_userguide.
html, generated Aug. 27, 2004, 1-pg.
"FingerWorks-iGesture-Technical Details," obtained from http://
www.fmgerworks.comligesture_tech.html, generated Aug. 27,
2004, 1-pg.
"FingerWorks-The Only Touchpads with Ergonomic Full-Hand
Resting and Relaxation!" obtained from http://www.fingerworks.
com/resting.html, Copyright 2001, 1-pg.
"FingerWorks-Tips for Typing on the Mini," obtained from http:#
www.fmgerworks.com/mini_typing.html, generated on Aug. 27,
2004, 2-pgs.
"iGesture Pad-the MultiFinger USB TouchPad with Whole-Hand
Gestures," obtained from http://www.fingerworks.comligesture.
html, generated Aug. 27, 2004, 2-pgs.
Bier, et al., "Toolglass and Magic Lenses: The see-through interface"
In James Kijiya, editor, Computer Graphics (SIGGRAPH '93 Proceedings), vol. 27, pp. 73-80, Aug. 1993.
Douglas et al., The Ergonomics of Computer Pointing Devices
(1997).
European Search Report received in EP 1 621 989 (@ Beyer Weaver
& Thomas, LLP) dated Mar. 27, 2006.
EVB Elektronik "TSOP6238 IR Receiver Modules for Infrared
Remote Control Systems" dated Jan. 2004 1-pg.
Fisher et al., "Repetitive Motion Disorders: The Design of Optimal
Rate- Rest Profiles," Human Factors, 35(2):283-304 (Jun. 1993).
Fukumoto, et al., "ActiveClick: Tactile Feedback for Touch Panels,"
In CHI 2001 Summary, pp. 121-122, 2001.
Fukumoto and Yoshinobu Tonomura, "Body Coupled Fingering:
Wireless Wearable Keyboard," CHI97, pp. 147-154 (Mar. 1997).
Hardy, "Fingerworks" Mar. 7, 2002; BBC World On Line.
Hillier and Gerald J. Lieberman, Introduction to Operations
Research (1986).
International Search Report dated Mar. 3, 2006 (PCT/US 05/03325;
119-0052WO).
Jacob et al., "Integrality and Separability of Input Devices," ACM
Transactions on Computer-Human Interaction, 1:3-26 (Mar. 1994).
Kinkley et al., "Touch-Sensing Input Devices,"in CHI '99 Proceedings, pp. 223-230, 1999.
Kionx "KXP84 Series Summary Data Sheet" copyright 2005,dated
Oct. 21, 2005, 4-pgs.

Lee et al., "A Multi-Touch Three Dimensional Touch-Sensitive Tablet," in CHI '85 Proceedings, pp. 121-128, 2000.
Lee, "A Fast Multiple-Touch-Sensitive Input Device," Master's Thesis, University of Toronto (1984).
Matsushita et al., "HoloWall: Designing a Finger, Hand, Body and
Object Sensitive Wall," In Proceedings of UIST '97, Oct. 1997.
Quantum Research Group "QTS10 / QWheelm Touch Slider IC"
copyright 2004-2005, 14-pgs.
Quek, "Unencumbered Gestural Interaction," IEEE Multimedia,
3:36-47 (Winter 1996).
Radwin, "Activation Force and Travel Effects on Overexertion in
Repetitive Key Tapping," Human Factors, 39(1):130-140 (Mar.
1997).
Rekimoto "SmartSkin: An Infrastructure for Freehand Manipulation
on Interactive Surfaces" CHI 2002, Apr. 20-25, 2002.
Rekimoto et al., "Toolstone: Effective Use of the Physical Manipulation Vocabularies of Input Devices," In Proc. Of UIST 2000, 2000.
Rubine et al., "Programmable Finger-Tracking Instrument Controllers," Computer Music Journal, vol. 14, No. 1 (Spring 1990).
Rutledge et al., "Force-To-Motion Functions for Pointing," HumanComputer Interaction-· ~ · - - · (1990).
Subatai Ahmad, "A Usable Real-Time 3D Hand Tracker," Proceedings of the 28a' Asilomar Conference on Signals, Systems and
Computers-Part 2 (of2), vol. 2 (Oct. 1994).
Texas Instnunents "TSC2003 / I2C Touch Screen Controller" Data
Sheet SBAS 162, dated Oct. 2001, 20-pgs.
Wellner, "The Digital Desk Calculators: Tangible Manipulation on a
Desk Top Display" in ACM UIST '91 Proceedings, pp. 27-34, Nov.
1991.
Williams, "Applications for a Switched-Capacitor Instrumentation
Building Block" Linear Technology Application Note 3, Jul. 1985,
pp. 1-16.
Yamada et al., "A Switched-Capacitor Interface for Capacitive Pressure Sensors" IEEE Transactions on Instrumentation and Measurement, vol. 41, No. 1, Feb. 1992, pp. 81-86.
Yeh et al., "Switched Capacitor Interface Circuit for Capacitive

Transducers" 1985 IEEE.
Zhai et al., "Dual Stream Input for Pointing and Scrolling," Proceedings ofCHI'97ExtendedAbstracts (1997).
Zimmerman et al., "Applying Electric Field Sensing to HumanComputer Interfaces," In CHI '85 Proceedings, pp. 280-287, 1995.
U.S. Appl. No. 10/774,053, filed Feb. 5, 2004.
U.S. Appl. No. 11/140,529, filed May 27, 2005 which is a Reissue of
6,570,557 listed above.
U.S. Appl. No. 11/381,313, filed May 2, 2006 entitled "Multipoint
Touch Surface Controller".
U.S. Appl. No. 11/332,861, filed Jan. 13, 2006 which is a Reissue of
6,677,932 listed above.
U.S. Appl. No. 11/380,109, filed Apr. 25, 2006 entitled "Keystroke
Tactility Arrangement on Smooth Touch Surface."
U.S. Appl. No. 11/428,501, filed Jul. 3, 2006 entitled "Capacitive
Sensing Arrangement," which is a Continuation ofUS 2005/0104867
listed above.
U.S. Appl. No. 11/428,503, filed Jul. 3, 2006 entitled "Touch Surface" which is a Continuation of US 2005/0104867 listed above.
U.S. Appl. No. 11/428,506, filed Jul. 3, 2006 entitled "User Interface
Gestures" which is a Continuation ofUS 2005/0104867 listed above.
U.S. Appl. No. 11/428,515, filed Jul. 3, 2006 entitled "User Interface
Gestures" which is a Continuation ofUS 2005/0104867 listed above.
U.S. Appl. No, 11/428,522, filed Jul. 3, 2006 entitled "Identifying
Contacts on a Touch Surface" which is a Continuation of US 2005/
0104867 listed above.
U.S. Appl. No. 11/428,521, filed Jul. 3, 2006 entitled "Identifying
Contacts on a Touch Surface" which is a Continuation of US 2005/
0104867 listed above.
U.S. Appl. No. 11/426,078, filed Jun. 23, 2006 entitled "Electronic
Device Having Display and Surrounding Touch Sensitive Bezel for
User Interface and Control" which is a Continuation-In-Partof 2006/
0197753 listed above.

Copy provided by USPTO from the PIRS Imaae Database on 06/20/2011

APLNDC00022439

US 7,663,607 B2
Page 5
U.S. Appl. No. 11/278,080, filed Mar. 30, 2006 entitled "Force Imaging Input Device and System".
U.S. Appl. No. 11/382,402, filed May 9, 2006 entitled "Force and
Location Sensitive Display" which is.a Continuation of U.S. Appl.
No. 11/278,080 listed above.
International Search Report received in corresponding PCT application No. PCT/US2006/008349 Oct 6, 2006.

International search report for International Application No. ITT/
US2005 014364 mailed Jan. 12, 2005.
U.S. Appl. No. 12 267.522. filed Nov. 7. 2008, by Ilotelling et al.
U.S. Appl. No. 12 267.532. filed Nov. 7, 2008. by IIotelling et al.
U.S. Appl. No. 12 267.540, filed Nov. 7, 2008. by llotelling et al.

* cited by

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022440

- I
U.S. Patent

Feb. 16, 2010

Sheet 1 of 14

US 7,663,607 B2

FIG. 1A

FIG. 1B
Row projection

signal

I

I

Column projection

signal

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022441

U.S. Patent

Feb. 16, 2010

Sheet 2 of 14

US 7,663,607 B2

30
S

38

36
34

42

FIG. 2

Copy provided by USPTO from the PIRS Image Database on 06/20/20t1

APLNDC00022442

U.S. Patent

Feb. 16, 2010

Sheet 3 of 14

US 7,663,607 B2

38

44

44

44

42A
44

42A

42

FIG. 3

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022443

U.S. Patent

Feb. 16, 2010

Sheet 4 of 14

US 7,663,607 B2

45
46

RECEIVE MULTIPLE
TOUCHES ON
SURFACE OF TOUCH
SCREEN
47

RECOGNIZE EACH OF
THE MULTIPLE
TOUCHES
-

48

REPORT TOUCH DATA
BASED ON MULTIPLE
TOUCHES

FIG. 4
50
72

70

60

74'

---

/

62

64

68

58

F G. 5

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022444

U.S. Patent

Feb. 16, 2010

Sheet 5 of 14

US 7,663,607 B2
100

102

108

1101

-------

110

116

116 (

110
.

110

110

104
112

ice

FIG. 6A

110

102

SERIAL DATA
BUS

FIG. 6B
106

130

'

F G. 8A

142
140

8B

Copy provided by USPTO from the PIRS Imaae Database on 06/20/20ti

APLNDC00022445

i Ii

U.S. Patent

Ii

II iI

Feb. 16, 2010

I I ii

--..
----

Sheet 6 of 14

I I

i

I

iI

1 I

i

I

II

I I
i I

i
I

I
I

11
li

i
I

I
I

I
i

11
11

i

US 7,663,607 B2

-...-

I

LL.
I

I

i

I

Illi

I i
I i

i
I

iI
il

iII
III

i I

I

II

111

II

i I i .........

I I

(O

--..--

9-

CO

Copy provided by USPTO from the PIRS Imaae Database on 06/20/2011

APLNDC00022446

192

U.S. Patent

.

Feb. 16, 2010

,

,

'

176

Sheet 7 of 14

174

US 7,663,607 B2

150

156

158B

152B

152A

154
158A

FIG. 9

190

18

170

192
180
182

177

178

172

FIG. 10

Gopy provided by USP TO from the PIRS Image Database on 06/20/2011

APLNDC00022447

204

U.S. Patent

F G. 11 B

Feb. 16, 2010

2ee

Sheet 8 of 14

US 7,663,607 B2
200

©©©©©©©
206

15253E51

ESISISS5SSSESESESS

204

44'swnnnnnnnwnnunnnnnwnannnunnnsnw

206

204

20s

FIG. 11A

fasanas awaariAaA kar iluDTl% freeswa ika DIDO hwany.a filmiaL

204

202

ARI

ftfotadd

APLNDC00022448