Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 991

Administrative Motion to File Under Seal Documents Re Apples Opposition To Samsungs Motion To Exclude Opinions Of Certain Of Apple Experts filed by Apple Inc.. (Attachments: #1 Declaration Of Cyndi Wheeler In Support Of Apples Administrative Motion To File Under Seal Documents Re Apples Opposition to Exclude Apple Experts Opinions, #2 [Proposed] Order Granting Apples Administrative Motion To File Under Seal, #3 Apples Opposition To Samsungs Motion To Exclude Opinions Of Certain Of Apples Experts, #4 Declaration Of Mia Mazza In Support Of Apples Opposition To Samsungs Motion To Exclude Opinions Of Certain Of Apples Experts, #5 Exhibit Mazza Decl. Ex. D, #6 Exhibit Mazza Decl. Ex. F, #7 Exhibit Mazza Decl. Ex. G, #8 Exhibit Mazza Decl. Ex. J, #9 Exhibit Mazza Decl. Ex. K, #10 Exhibit Mazza Decl. Ex. L, #11 Exhibit Mazza Decl. Ex. R, #12 Exhibit Mazza Decl. Ex. S, #13 Exhibit Mazza Decl. Ex. T, #14 Exhibit Mazza Decl. Ex. U, #15 Exhibit Mazza Decl. Ex. V, #16 Exhibit Hauser Decl. Ex. B, #17 Exhibit Hauser Decl. Ex. C, #18 Exhibit Hauser Decl. Ex. D, #19 Exhibit Hauser Decl. Ex. E, #20 Exhibit Musika Decl. Ex. S, #21 Exhibit Musika Decl. Ex. T, #22 Exhibit Musika Decl. Ex. U, #23 [Proposed] Order Denying Samsungs Motion To Exclude Opinions Of Apples Experts)(Jacobs, Michael) (Filed on 5/31/2012) Modified on 6/3/2012 attachment #1 Sealed pursuant to General Order No. 62 (dhm, COURT STAFF).

Exhibit T

TO ALL TO WIIOR TII ENE I>It EN ENTS SHALII CO3I E

UNITED STATES DEPAR w NT OF COMws ·<CE
United States Patent and Trademark Office
June 22, 2011
· mm IS TO CER = w THAT ^=EXED HERETO IS A TRUE COPY FROM
THE RECORDS OF I nla OFFICE OF:

U.S. PATENT: 7,663,607
ISSUE DATE: February 16, 2010

By Authority of the
Under Secretary of Commerce for In llectual Property
and Director of the United State ate and Trademark orace

P. SWA
Certifying Officer

APLNDC00022435

lillllllllllllllllllllllllllllllllllllllllllllllllllllllllllli
(12) United States Patent

(10) Patent No.:

Hotelling et al.

(45) Date of Patent:

US 7,663,607 B2
Feb. 16, 2010

(54) MULTIPOINT TOUCH- - - N

4,734,685 A
4,746,770 A

3/1988 Watanabe ................... 340/7 0
5/1988 McAvinney .................. 178| 8

(75)

4,771,276 A
4,788,384 A
4,806,846 A

9/1988 Bruere-Dawson et al. ..... 178/ 8
11/1988 Parks ......................... 340/7 2
2/1989 Kerber .................. 324/60 CD

4,898,555 A
4,914,624 A
4,968,877 A

2/1990 Dunthorn ..................... 445/22
4/1990 Sampson et al.
11/ 990 McAvinney et al. ........ 250/221

5,003,519 A
5,017,030 A
5,189,403 A

3/
5/
1/
2/

5,194,862 A
5,224,861 A

3/ 993 Edwardsal. ................... 434/35
7/ 993 Glass et ...................... 341/20

5,241,308 A

8/ 993 Young ......................... 341/34

Inventors: Steve Hotelling, San Jose, CA (US);
Joshua A. Strickon, San Jose, CA (US);
Brian Q. Huppi, San F
'
CA
(US)

(73) Assignee: Apple Inc., Cupertino, CA (US)

( * ) Notice:

Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.C. 154(b) by 754 days.

5,178,477 A

(21) Appl. No.: 10/840,862
(22) Filed:
(65)

FOREIGN P

Prior Publication Data
US 2006/0097991 Al
May 11, 2006

CA

- · DOCUMENTS

1243096

10/1988

................. 340/180

(Continued)
OTHER PUBLICATIONS

(2006.01)

(52) U.S. Cl. ..................... 345/173; 345/174; 178/18.01
(58) Field of Classification Search ......... 345/173-179;
178/18.01-18.04
See application file for complete search history.
(56)

Noirjean ...................... 368/73
Crews ........................ 400/485
Garnbaro
Franz et al..................... 400/489
................. 340/711

(Continued)

May 6, 2004

(51) Int. Cl.
GOdF 3/041

991
991
993
993

References Cited

U.S. Appl. No. 10/654,108, filed Sep. 2, 2003.

(Continued)
Primary Examiner-Richard Hjerpe
Assistant Examiner-Kimnhung Nguyen

(74) Attorney, Agent, or Firm-Morrison & Foerster LLP

U.S. PATENT DOCUMENTS

(57)

ABS· -= ·

3,333,160 A
3,541,541 A
3,662,105 A

7/1967 Gorski
11/1970 Englebart
5/1972 Hurst et al. ................... 178/18

A touch panel having a transparent capacitive sensing

3,798,370 A
4,246,452 A

3/ 974 Hurst .......................... 17W18
1/ 981 Chandler ....................... 200/5

medium configuredto detectmultiple touches ornear touches
that occur at the same time and at distinct locations in the

6/ 987 Beckes ...................... 340/365 P
6/1987 Lucas et al. ............... 364/518

resentative of the location of the touches on the plane of the
touch panel for each of the multiple touches is disclosed.

4,550,221 A

10/ 985 Mabusth ...................... 178/18

4,692,809 A
4,695,827 A

9/1987 Beining et al. .............. 358/247
9/1987 Beining et al. ........... 34W365 P

4,733,222 A

plane of the touch panel and to produce distinct signals rep-

3/1988 Evans ..................... 340/365 C

4,672,364 A
4,672,558 A

11 Claims, 14 Drawing Sheets

100
102

108

110104

110

116

110
110

110

104
112
106

Conv provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022436

Pages Intentionally Omitted

US 7,663,607 B2
1

2

MULTIPOINT TOUCHSC--

of all simultaneously -- ng touch points are determined
and a single point which falls somewhere between the touch
points is reported. In surface wave and infrared tecimologies,
it is impossible to discern the exact positionofmultiple touch

BACKGROUND OF THE um v tus 11ON

5 points that fall on the same horizontal or vertical lines due to
1. Field of the Invention
masking. In either case, faulty results are generated.
The present invention relates generally to an electronic
device having a touch ---. More particularly, the present
These problems are particularly problematic in tablet PCs
inventionrelates to a touch screen capable ofsensing multiple
where one hand is used to hold the tablet and the other is used
points at the same time.
to generate touch events. For example, as shown in FIGS. 1A
2. Description of the Related Art
10 and 1B, holding a tablet 2 causes the thumb 3 to overlap the
There exist today many styles ofinput devices forperformedge ofthe touch sensitive surface 4 ofthe touch screen 5. As
ing operations in a computer system. The operations genershown in FIG. 1A, ifthe touch technology uses averaging, the
ally correspond to moving a cursor and/or making selections
teclmique used by resistive and capacitive panels, then a
on a display screen. By way of example, the input devices
single point that falls somewhere between the thumb 3 of the

may include buttons or keys, mice, trackballs, touch pads, joy 15 left hand and the index fmger 6 of the right hand would be
sticks, touch -- and the like. Touch ---, in particular,
reported. As shown in FIG. 1B, if the technology uses proare becoming increasingly popular because of their ease and
jection scanning, the technique used by infra red and SAW
versatility of operation as well as to their declining price.
panels, it is hard to discern the exact vertical position of the
Touch screens allow a user to make selections and move a
index finger 6 due to the large vertical component of the
cursor by simply touching the display screen via a finger or 20 thumb 3. The tablet 2 can only resolve the patches shown in
stylus. In general, the touch screen recognizes the touch and
gray. In essence, the thumb 3 masks out the vertical position
position of the touch on the display screen and the computer
of the index fmger 6.
system interprets the touch and thereafterperforms an action

based on the touch event.
Touch screens typically include a touch panel, a controller

SI IMM^ Y OF THE no -o -ON
25

and a software driver. The touch panel is a clear panel with a
The invention relates, in one embodiment, to a touch panel
touch sensitive surface. The touch panel is positioned in front
having a transparent capacitive sensing medium configured to
of a display screen so that the touch sensitive surface covers
detect multiple touches or near touches that occur at the same
the viewable area of the display screen. The touch panel
time and at distinct locations in the plane of the touch panel
registers touch events and sends these signals to the control- 30 and to produce distinct signals representative of the location
ler. The controller processes these signals and sends the data
of the touches on the plane of the touch panel for each of the
to the computer system. The software driver translates the
multiple touches.
touch events into computer events.
The invention relates, in another embodiment, to a display
There are several types of touch screen technologies
including resistive, capacitive, infrared, surface acoustic 35 arrangement. The display arrangement includes a display
having a screen for displaying a graphical user interface. The
wave, electromagnetic, near field imaging, etc. Each ofthese
display arrangement further includes a transparent touch
devices has advantages and disadvantages that are taken into
panel allowing the screen to be viewed therethrough and
account when designing or configuring a touch screen. In
capable of recognizing multiple touch events that occur at
resistive technologies, the touch panel is coated with a thin
40 different locations on the touch sensitive surface ofthe touch

metallic electrically conductive andresistive layer. When the

panel is touched, the layers come into contact thereby closing

a switch that registers the position of the touch event. This

screen at the same time and to output this information to a host
device.

The invention relates, in another embodiment, to a cominformation is sent to the controller for further processing. In
puter implemented method. The method includes receiving
capacitive technologies, the touch panel is coated with a
material that stores electrical charge. When the panel is 45 multiple touches on the surface of a transparent touch screen
at the same time. The method also includes separately recogtouched, a small amount of charge is drawn to the point of
nizing each of the multiple touches. The method further
contact. Circuits located at each corner of the panel measure
includes reporting touch data based on the recognized multhe charge and send the information to the controller for
tiple touches.
processmg.
The invention relates, in another embodiment, to a comIn surface acoustic wave technologies, ultrasonic waves 50
are sent horizontally and vertically over the touch screen
puter system. The computer system includes a processor configured to execute instructions and to carry out operations
panel as for example by transducers. When the panel is
touched, the acoustic energy of the waves are absorbed. Senassociated with the computer system. The computer also
sors located across from the transducers detect this change
includes a display device that is operatively coupled to the
and send the information to the controller for processing. In 55 processor. The computer system further includes a touch

screen that is operatively coupled to the processor. The touch
infrared technologies, light beams are sent horizontally and
screen is a substantially transparentpanel that is positionedin
vertically over the touch panel as for example by light emitting diodes. When the panel is touched, some of the light
front of the display. The touch screen is configured to track
beams emanating from the light emitting diodes are intermultiple objects, which rest on, tap on or move across the
rupted. Light detectors located across from the light emitting 60 touch screen at the same time. The touch screen includes a
diodes detect this change and send this information to the
capacitive sensing device that is divided irto several indepencontroller for processing.
dent and spatially distinct sensing points that are positioned
throughout the plane of the touch screen. Each sensing point
One problem found in all ofthese technologies is that they
is capable of generating a signal at the same time. The touch
are only capable of reporting a single point even when multiple objects are placed on the sensing surface. That is, they 65 screen also includes a sensing circuit that acquires data from
the sensing device and that supplies the acquired data to the
lack the ability to track multiple points of contact simultapr^^^-r
neously. In resistive and capacitive technologies, an average

Copy provided by USPTO from the PIRS image Database on 06/20/2011

APLNDC00022455

Pages Intentionally Omitted

US 7,663,607 B2
17

18

lines as for example ITO to provide the best possible index

sensing points 262 (electrode, nodes, etc.), to process the data
and to output processed data to a host controller.

matching. As should be appreciated, the dummy features will
more than likely still produce some gaps, but these gaps are
much smaller than the gaps found between the lines (many

The sensing circuit 260 includes a multiplexer264 (MUX).
The multiplexer 264 is a switch configured to perform time
orders of magnitude smaller). These gaps, therefore have 5 Inultiplexing. As shown, the MUX 264 includes a plurality of
minimal impact on the visual appearance. While this may be
independent input channels 266 for receiving signals from
the case, index matching materials may be additionally
each of the sensing points 262 at the same time. The MUX
applied to the gaps between the dummy features to further

264 stores all of the incoming signals at the same time, but

sequentially releases them one at a time through an output
improve the visual appearance of the touch screen. The distribution, size, number, dimension, and shape of the dununy 10 channel 268.

features may be widely varied.
The sensing circuit 260 also includes an analog to digital
FIG. 12 is a simplified diagram of a mutual capacitance
converter 270 (ADC) operatively coupled to the MUX 264
circuit 220, in accordance with one embodiment of the
through the output channel 268. The ADC 270 is configured
present invention. The mutual capacitance circuit 220 15 to digitize the incoming analog signals sequentially one at a

includes a driving line 222 and a sensing line 224 that are
spatially separated thereby forming a capacitive coupling
node 226. The driving line 222 is electrically coupled to a

time. That is, the ADC 270 converts each of the incoming

voltage source 228, and the sensing line 224 is electrically

retically infinite number ofvalues. The voltage varies accord-

analog signals into outgoing digital signals. The input to the

ADC 270 generally corresponds to a voltage having a theo-

coupled to a capacitive sensing circuit 230. The driving line 20 ing to the amount ofcapacitive coupling at each ofthe sensing
222 is configured to carry a current to the capacitive coupling
points 262. The output to the ADC 270, on the other hand, has
node 226, and the sensing line 224 is configured to carry a
a defined number of states. The states generally have predictcurrent to the capacitive sensing circuit 230. When no object
able exact voltages or currents.
is present, the capacitive coupling at the node 226 stays fairly
The sensing circuit 260 also includes a digital signal proconstant. When an object 232 such as a finger is placed 25 cessor 272 (DSP) operatively coupled to the ADC 270
p, ,,,,«-te the node 226, the capacitive coupling changes
through another channel 274. The DSP 272 is a programthrough the node 226 changes. The object 232 effectively
mable computer processing unit that works to clarify or stanshunts some of the field away so that the charge projected
dardize the digital signals via high speed mathematical proacross the node 226 is less. The change in capacitive coupling
cessing. The DSP 274 is capable of differentiating between
changes the current that is carried by the sensing lines 224. 30 human made signals, which have order, and noise, which is
The capacitive sensing circuit 230 notes the current change
inherently chaotic. In most cases, the DSP performs filtering
and the position of the node 226 where the current change
and conversion algorithms using the raw data. By way of
occurred and reports this information in a raw or in some
example, the DSP may filter noise events from the raw data,
processed form to a host controller. The capacitive sensing
calculate the touch boundaries for each touch that occurs on
circuit does this for each node 226 at about the same time (as 35 the touch screen at the same time, and thereafter determine
viewed by a user) so as to provide multipoint sensing.
the coordinates for each touch event. The coordinates of the
touch events may then be reported to a host controller where
The sensing line 224 may contain a filter 236 for eliminating parasitic capacitance 237, which may for example be
they can be compared to previous coordinates of the touch
created by the large surface area of the row and column lines
events to determinewhat action to perform in the host device.
relative to the other lines and the system enclosure at ground
FIG. 15 is a flow diagram 280, in accordance with one
potential. Generally speaking, the filter rejects stray capaciembodiment of the present invention. The method generally
tance effects so that a clean representation of the charge
begins at block 282 where a plurality of sensing points are
transferred across the node 226 is outputted (and not anything
driven. For example, a voltage is applied to the electrodes in
in addition to that). That is, the filter 236 produces an output
self capacitance touch screens or through driving lines in
that is not dependent on the parasitic capacitance, but rather 45 mutual capacitance touch --. In the later, each driving
on the capacitance at the node 226. As a result, a more acculine is driven separately. That is, the driving lines are driven
rate output is produced.
one at a time therebybuildingup charge on all the intersecting
FIG. 13 is a diagram of an inverting amplifier 240, in
sensing lines. Following block 282, the process flow proceeds
accordance with one embodiment of the present invention.
to block 284 where the outputs (voltage) fiom all the sensing
The inverting amplifier 240 may generally correspond to the so points are read. This block may include multiplexing and
filter 236 shown in FIG. 12. As shown, the inverting amplifier
digitizing the outputs. For example, in mutual capacitance
includes a non inverting input that is held at a constant voltage
touch screens, all the sensing points on one row are multi(in this case ground), an inverting input that is coupled to the
plexedand digitizedandthis is repeated until all the rows have

node and an output that is coupled to the capacitive sensing
been sampled. Following block 284, the process flow procircuit 230. The output is coupled back to the inverting input ss ceeds to block 286 where an image or other form of data
through a capacitor. During operation, the input from the
node may be disturbed by stray capacitance effects, i.e., para-

sitic capacitance. If so, the inverting amplifier is configured to
drive the input back to the same voltage that it had been

(signal or signals) ofthe touch screen plane at one moment in
time can be produced and thereafter analyzed to determine
where the objects are touching the touch screen. By way of
example, the boundaries for each unique touch can be calcu-

previously before the stimulus. As such, the value of the so lated, and thereafter the coordinates thereof can be found.
parasitic capacitance doesn't matter.
FIG. 14 is a block diagram of a capacitive sensing circuit
260, in accordance with one embodiment of the present

Following block 286, the process flow proceeds to block 288
where the current image or signalis compared to a past image
or signal in order to determine a change in pressure, location,

invention. The capacitive sensing circuit 260 may for

direction, speed and acceleration for each object on the plane

example correspond to the capacitive sensing circuits 65 of the touch screen. This information can be subsequently
used to perform an action as for example moving a pointer or
described in the previous figures. The capacitive sensing circursor or making a selection as indicated in block 290.
cuit 260 is configured to receive input data from a plurality of

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022463

Pages Intentionally Omitted

UNITED STATES P^r a I ^Ni l I u ni »Niv!^œK OFFICE

CERTIFICATE OF CORRECTION
PATENT NO.
APPLICATION NO.
DATED
INVENTOR(S)

:
:
:
:

7,663,607 B2
10/840862
February 16, 2010
Hotelling et al.

Page 1 of 1

It is certified that error appears in the above-identified patent and that said Letters Patent is hereby corrected as shown below:

On the Title Page:

The first or sole Notice should read --

Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b)
by 1423 days.

Signed and Sealed this
Twenty-eighth Day of December, 2010

David J. Kappos
Director ofthe United States Patent and TrademarkDjice

Copy provided by USPTO from the PIRS Image Database on 06/20/2011

APLNDC00022466