Apple Inc. v. Samsung Electronics Co. Ltd. et al
Filing
561
Declaration in Support of #559 Declaration in Support, filed byApple Inc.. (Attachments: #1 Exhibit 3.02, #2 Exhibit 3.03, #3 Exhibit 3.04, #4 Exhibit 3.05, #5 Exhibit 3.06, #6 Exhibit 3.07, #7 Exhibit 3.08, #8 Exhibit 3.09, #9 Exhibit 3.10, #10 Exhibit 3.11, #11 Exhibit 3.12, #12 Exhibit 3.13, #13 Exhibit 3.14, #14 Exhibit 3.15, #15 Exhibit 3.16, #16 Exhibit 3,17, #17 Exhibit 3.18, #18 Exhibit 3.19, #19 Exhibit 3.20, #20 Exhibit 3.21, #21 Exhibit 3.22, #22 Exhibit 3.23, #23 Exhibit 3.24)(Related document(s) #559 ) (Jacobs, Michael) (Filed on 12/29/2011)
EXHIBIT 3.11
WO 03/088176
PCTILISO3/11015
SYN-113PCT
5
What is claimed is:
1.
An object position detector, comprising:
a touch sensor formed as a substantially closed loop and having a physical constraint
formed on an upper surface of said touch sensor and coextensive with said closed loop, said
touch sensor configured to sense motion of an object proximate to said closed loop; and
10
a processor coupled to said touch sensor, said processor programmed to generate a
signal in response to said motion on said touch sensor.
2.
The object position detector of Claim 1, wherein said touch sensor is a capacitive
touch sensor.
3.
15
The object position detector of Claim 1, wherein said touch sensor is a resistive touch
sensor.
4.
The object position detector of Claim 1, wherein said touch sensor is an inductive
sensor.
5.
The object position detector of Claim 1, further comprising:
a processing unit;
20
instructions for directing said processing unit to:
receive information from said electrodes, and
generate an output responsive to receiving said information; and
a media readable by said processing unit that stores said instructions.
6.
25
The object position detector of Claim 5, wherein said instructions further include
instructions for directing said processing unit to detect an operating mode selected from
activating an input device, tapping an activation zone, positioning an object in said
activation zone, positioning an object in a navigation zone, activating a key on a keyboard
and moving at least one object on said touch sensor responsive to receiving said information.
7.
30
The object position detector of Claim 5, wherein said instructions for generating said
output further comprise instructions for directing said processing unit to perform an action
selected from controlling a cursor, scrolling through data, navigating a menu, adjusting a
value setting control, selecting data, interfacing with a computer program, interfacing with a
drawing program, changing a direction of motion, changing an axis of motion, changing a
direction of value adjustment, and interfacing with a game program.
35
8.
The object position detector of Claim 1, wherein said physical constraint is defmed
by at least one of the group consisting of a depression and a protrusion.
9.
The object position detector of Claim 1, further comprising at least one activation
32
APLNDC00026090
WO 03/088176
PCTIUS03/11015
SYN-113PCT
5
¯¯ ¯ ¯¯
zone disposed proximate to said touch sensor and coupled to said processor.
10.
The object position detector of Claim 7, wherein said at least one activation zone is
demarked by a guide.
11.
The object position detector of Claim 10, wherein said guide is said physical
constraint.
10
12.
The object position detector of Claim 1, further comprising a pointing input device
disposed proximate to said touch sensor and coupled to said processor.
13.
The object position detector of Claim 12, wherein said pointing input device is
responsive to one of a position, a velocity, and a force of said object
14.
15
The object position detector of Claim 1, further comprising an activation key
disposed proximate to said touch sensor, wherein said activation key is configured to initiate
an action in response to a user input.
15.
The object position detector of Claim 1, wherein said closed loop is configured
substantially into a shape selected from the group consisting of a circle, an oval, a triangle, a
rectangle, a square, a figure-eight, a polygon, a convex polygon, a concave polygon, an
20
ellipse, and a path that crosses itself.
16.
The object position detector of Claim 1, wherein said processor generates a signal to
a first action responsive to an object moving in a clockwise direction proximate to said
closed loop.
17.
25
The object position detector of Claim 16, wherein said processor generates a signal
to cause a second action responsive to said object moving in a counter-clockwise direction
proximate to said closed loop.
18.
The object position detector of Claim 1, further comprising a starting position along
said closed loop.
19.
30
The object position detector of Claim 1, wherein the object position detector is
disposed on a device selected from the group consisting of a computing device, a peripheral
input device, a detachable input device, and a rotary control.
20.
The object position detector of Claim 1, further comprising a switching method
coupled to said object position detector that can be activated to select at least one mode.
21.
35
The object position detector of Claim 20, wherein said switching method is selected
from the group consisting of activating an input device, inputting in a zone, activating a key
on a keyboard and moving at least one of said object on said closed loop.
22.
The object position detector of Claim 20, wherein said mode is selected from the
33
APLNDC00026091
WO 03/088176
PCT/USO3/11015
SYN-113PCT
5
group consisting of controlling a cursor, scrolling through data, navigating a menu, adjusting
a value setting control, selecting data, interfacing with a computer program, interfacing with
a drawing program, changing a direction of motion, changing an axis of motion, changing a
direction of value adjustment, and interfacing with a game program.
10
23.
The object position detector of Claim 1, further comprising at least one other touch
sensor having a closed loop.
24.
The object position detector of Claim 1, wherein an arrangement of electrodes of said
touch sensor is interleaving.
25.
The object position detector of Claim 1, wherein an arrangement of electrodes of said
touch sensor is self-interpolating.
15
26.
The object position detector of Claim 1, further comprising an electrode design that
inherently outputs positional information in only one variable from said touch sensor.
27.
The object position detector of Claim 1, further comprising an algorithm to calculate
position on said touch sensor, said algorithm selected from the group consisting of a
quadratic fitting algorithm, a centroid interpolation algorithm, a trigonometric weighting
20
algorithm, and a quasi-trigonometric weighting algorithm.
28.
The object position detector of Claim 1, further comprising at least two electrodes of
said touch sensor electrically coupled to a single sensor input.
29.
The object position detector of Claim 1, wherein said touch sensor is one-
dimensional.
25
30.
A solid-state object position detector, comprising:
a touch sensor having a plurality of electrodes disposed in a closed loop; and
a processor coupled to said touch sensor, said processor configured to output
positional information in only one variable.
30
31.
The solid-state object position detector of Claim 30, wherein said touch sensor is a
capacitive touch sensor.
32.
The solid-state object position detector of Claim 30, wherein said touch sensor is a
resistive touch sensor.
33.
The solid-state object position detector of Claim 30, wherein at least two of said
electrodes are electrically coupled to a single sensor input.
35
34.
The solid-state object position detector of Claim 30, further comprising:
a pointing input device disposed proximate to said touch sensor and coupled to said
processor.
34
APLNDC00026092
WO 03/088176
PCT/US03/11015
SYN-113PCT
5
35.
¯ ¯
The solid-state object position detector of Claim 34, wherein said pointing input
device is responsive to one of a position, a velocity, and a force of an input object.
36.
The solid-state object position detector of Claim 30, wherein said processor is
configured to operate in one of a first mode and a second mode, wherein said first mode
reports relative motion and said second mode reports absolute position.
10
37.
The solid-state object position detector of Claim 30, wher'ein at least two of said
electrodes are interleaved.
38.
The solid-state object position detector of Claim 37, wherein each of said at least two
electrodes are in a shape of a lightning-bolt.
39.
15
The solid-state object position detector of Claim 30, further comprising:
a guide disposed proximate to said electrodes.
40.
The solid-state object position detector of Claim 39, wherein said guide is tactile.
41.
The solid-state object position detector of Claim 30, wherein said processor is
configured to receive positional information from said touch sensor in only one variable.
42.
20
The solid-state object position detector of Claim 30, wherein said touch sensor is
configured to output positional information from said closed loop in only one variable.
43.
The solid-state object position detector of Claim 30, wherein said touch sensor is
configured to output only positional information.
44.
25
A touch sensor having a plurality of interleaving electrodes disposed in a closed
loop, each of said electrodes is interdigitated with an adjacent neighboring one of said
electrodes.
45.
The touch sensor of Claim 44, wherein said electrodes are self-interpolating.
46.
The touch sensor of Claim 44, wherein said touch sensor is a capacitive touch sensor.
47.
The touch sensoi of Claim 44, wherein at least two of said electrodes are electrically
coupled to a single sensor input.
30
48.
The touch sensor of Claim 44, wherein a layout of said electrodes is selected from
the group consisting of a lighting-bolt design, a flower petal design, and a triangle design.
49.
The touch sensor of Claim 44, wherein said electrodes are of about equal size.
50.
The touch sensor of Claim 44, wherein more than one interdigitation occurs between
each said neighboring said electrodes.
35
51.
A touch sensor, compnsmg:
a plurality of sensor electrodes disposed in a closed loop; and
an indicator electrode disposed proximate to said
electrodes.
35
APLNDC00026093
WO 03/088176
PCT/l]SO3/11015
SYN-113PCT
5
52.
The touch sensor of Claim 51, wherein said touch sensor is a capacitive touch sensor.
53.
The touch sensor of Claim 51, wherein said touch sensor is a resistive touch sensor.
54.
The touch sensor of Claim 51, wherein at least two of said sensor electrodes are
ohmically coupled together.
10
55.
The touch sensor of Claim 51, wherein at least two of said sensor electrodes are
interleaved.
56.
The touch sensor of Claim 55, wherein each of said at least two sensor electrodes are
in a shape of a lighting-bolt.
57.
The touch sensor of Claim 51, further comprising:
a guide disposed proximate to said saa electrodes.
15
58.
The touch
a
of r, - 57, wherein said guide is tactile.
59.
A solid-state object position detector, comprising:
a processor having M sensor inputs, where M is a positive integer, said M sensor
inputs having a primary function; and
20
a touch sensor having N sensor electrodes disposed in a closed loop, where N is a
positive integer such that N 5 M, each of said N sensor electrodes is coupled to a different
one of said M sensor inputs;
wherein said processor is configured to output first data related to said primary
function and to output second data related to operation of said touch sensor.
60.
25
The solid-state object position detector of Claim 59, wherein said touch sensor is a
capacitive touch sensor.
61.
The soHd-state object position detector of Claim 59, further comprising:
a pointing input device having Q sensing electrodes, where Q is a positive integer
such that Q 5 M, each of said Q sensing electrodes electrically coupled to a different one of
said M sensor inputs; and
30
wherein said primary function is related to operation of said object position detector.
62.
The solid-state object position detector of Claim 59, wherein said processor is
configured to operate in one of a first mode and a second mode, wherein said first mode
reports relative motion and said second mode reports absolute position.
63.
35
The solid-state object position detector of Claim 59, wherein at least two of said
sensor electrodes are ohmically coupled together.
64.
The solid-state object position detector of Claim 59, wherein at least two of said
sensor electrodes are interleaved.
36
APLNDC00026094
WOD3/088176
SYN-113PCT
5
65.
° ~ ~
PCT/USO3/11015
¯
The solid-state object position detector of Claim 59, further comprising:
a guide disposed proximate to said sensor electrodes.
66.
67.
10
The solid-state object position detector of Claim 65, wherein said guide is tactile.
A solid-state object position detector, comprising:
a processor having M sensor inputs, where M is a positive integer, said M sensor
inputs having a primary function; and
a touch sensor having N sensor electrodes disposed in a closed loop, where N is a
positive integer;
wherein said N sensor electrodes are coupled to ones of said M sensor inputs such
15
that at least two of said N sensor electrodes are coupled to a same one of said M sensor
inputs;
wherein said processor is configured to output first data related to said primary
function and to output second data related to operation of said touch sensor.
68.
The solid state position detector of claim 67, further comprising:
a pointing input device having Q sensing electrodes, where Q is a positive integer
20
such that Q 5 M, each of said Q sensing electrodes electrically coupled to a different one of
said M sensor inputs; and
wherein said primary function is related to operation of said pointing input device.
69.
A solid-state object position detector, comprising:
a processor having M sensor inputs, where M is a positive integer, said M sensor
25
inputs having a primary function; and
P touch sensors, where P is a positive integer, each of said P touch sensors having N
sensor electrodes disposed in a closed loop, where N is a positive integer such that NE (M /
P), each of said N sensor electrodes of each of said P touch sensors is coupled to a different
one of said M sensor inputs;
30
wherein said processor is configured to output first data related to said primary
function and to output second data related to operation of each of said P touch sensors.
70.
The solid state position detector of claim 69, further comprising:
a pointing input device having Q sensing electrodes, where Q is a positive integer
such that Q i M, each of said Q sensing electrodes electrically coupled to a different one of
35
said M sensor inputs; and
wherein said primary function is related to operation of said pointing input device.
71.
The solid-state object position detector of Claim 69, wherein at least one of said
37
APLNDC00026095
WO 03/088176
PCT/USO3/11015
SYN-113PCT
5
touch sensors is a capacitive touch sensor.
72.
The solid-state object position detector of Claim 69, wherein at least two of said
sensor electrodes are ohmically coupled together.
73.
A solid-state object position detector, comprising:
a processor having M sensor inputs, where M is a positive integer, said M sensor
10
inputs having a primary function; and
P touch sensors, where P is a positive integer such that P 5 M, each of said P touch
a rs having N sensor electrodes disposed in a closed loop, where N is a positive integer;
wherein said N sensor electrodes of each of said P touch sensors are coupled to said
M sensor inputs such that at least two of said N sensor electrodes of each of said P touch
15
sensors are coupled to a same one of said M sensor inputs;
wherein said processor is configured to output first data related to said primary
function and to output second data related to operation of each of said P touch sensors.
74.
The solid-state object position detector of claim 73, further comprising:
a pointing input device having Q sensing electrodes, where Q is a positive integer
20
such that Q 5 M, each of said Q sensing electrodes electrically coupled to a different one of
said M sensor inputs; and
wherein said primary function is related to operation of said pointing input device.
75.
A combination comprising:
a processor having M sensor inputs, where M is a positive integer; and
25
an object position detector comprising:
a touch sensor having N
electrodes disposed in a closed loop, where N
is a positive integer such that N 5 M; and
an indicator electrode disposed proximate to said N sensor electrodes, each of
said N sensor electrodes electrically coupled to a different one of M input electrodes;
30
wherein said indicator electrode is electrically coupled to at least one of said
M sensor inputs that is not coupled to one of said N sensor electrodes; and
wherein said processor is configured to-output data related to operation of
said object position detector.
76.
35
The combination of Claim 75, wherein said touch - -,r is a capacitive touch sensor.
77.
The combination of Claim 75, wherein said touch
78.
The combination of Claim 75, further comprising:
is a resistive touch sensor.
a pointing input device disposed proximate to said touch sensor and in electrical
38
APLNDC00026096
WO 03/088176
PCT/USO3/11015
SYN-113PCT
5
communication with said processor.
79.
The combination of Claim 75, wherein at least two of said sensor electrodes are
ohmically coupled together.
80.
The combination of Claim 75, wherein at least two of said sensor electrodes are
interleaved.
10
81.
The combination of Claim 80, wherein each of said at least two sensor electrodes are
in a shape of a lighting-bolt.
82.
A combination comprising:
a processor having M sensor inputs, where M is a positive integer; and
an object position detector comprising:
15
a touch sensor having N sensor electrodes disposed in a closed loop, where N
is a positive integer; and
an indicator electrode disposed proximate to said N sensor electrodes, said
indicator electrode electrically coupled to at least one of said M sensor inputs that is
not coupled to one of said N ,- electrodes;
20
wherein said N sensor electrodes are electrically coupled to ones of said M
sensor inputs such that at least two of said N sensor electrodes are coupled to a same
one of said M sensor inputs;
wherein said processor is configured to output data related to operation of
said object position detector.
25
83.
A combination comprising:
a processor having M sensor inputs, where M is a positive integer, said M sensor
inputs having a primary function; and
an object position detector comprising:
a touch sensor having N sensor electrodes disposed in a closed loop, where N
30
is a positive integer such that N < M; and
an indicator electrode disposed proximate to said N sensor electrodes, each of
said N sensor electrodes electrically coupled to a different one of said M sensor
inputs;
wherein said indicator electrode is electrically coupled to at least one of said
35
M sensor inputs that is not coupled to one of said N sensor electrodes;
wherein said processor is configured to output first data related to said
primary function and to output second data related to operation of said object
39
APLNDC00026097
WO 03/088176
PCT/USU3/11015
SYN-113PCT
5
position detector.
84.
The combination of claim 83, further comprising:
a pointing input device having Q sensing electrodes, where Q is a positive integer
such that Q < M, each of said Q sensing electrodes electrically coupled to a different one of
said M sensor inputs; and
10
wherein said primary function is related to operation of said pointing input device.
85.
A combination comprising:
a processor having M sensor inputs, where M is a positive integer, said M sensor
inputs having a primary function; and
an object position detector comprising:
15
a touch sensor having N sensor electrodes disposed in a closed loop, where N
is a positive integer; and
an indicator electrode disposed proximate to said N sensor electrodes;
wherein said indicator electrode is electrically coupled to at least one of said
M sensor inputs that is not coupled to one of said N sensor electrodes;
20
wherein said N sensor electrodes are electrically coupled to ones of said M
sensor inputs such that at least two of said N -- electrodes are coupled to a same
one of said M sensor inputs;
wherein said processor is configured to output first data related to said
primary function and to output second data related to operation of said object
25
position detector.
86.
The combination of claim 85 further comprising:
a pointing input device having Q sensing electrodes, where Q is a positive integer
such that Q 5 M, each of said Q sensing electrodes is electrically coupled to a different one
of said M sensor inputs; and
30
wherein said primary function is related to operation of said pointing input device.
87.
A method for processing signals from a plurality of electrodes in a closed loop sensor
device comprising:
receiving a signal from each of said plurality of electrodes in said closed loop sensor;
determining a capacitance of each of said plurality of electrodes from said signals
35
responsive to a receipt of said signal from each of said plurality of electrodes; and
determining position information of an input object proximate to said closed loop
sensor responsive to a determination of said capacitance of each of said plurality of
40
APLNDC00026098
WOU3/088176
PCT/USO3/11015
SYN-113PCT
5
electrodes.
88.
The method of claim 87 wherein said step of dete- ---:--:--g said position information
comprises:
determining a highest capacitance electrode from said plurality of electrodes
responsive to a dets samtion of said capacitance of each of said plurality of electrodes;
10
determining an equation of an inverted parabola from said capacitance of said
highest capacitance electrode, said capacitance of a first one of said plurality of electrodes
on a first side of said highest capacitance electrode, and said capacitance of a second one of
said plurality of electrodes on a second side of said highest capacitance electrode;
determining a center point of said inverted parabola from said equation responsive to
15
a determination of said equation; and
determining said position information from said center point responsive to a
determination of said center point .
89.
The method of claim 88 wherein said step of determining said position information
further comprises:
20
determining a modified center point by subtracting a modulus of a number of said
plurality of electrodes from said center point of said inverted parabola responsive to a
determination of said center point.
90.
The method of claim 89 wherein said step of determining said position information
further comprises:
25
applying a non-linear function to said modified center point to determine said
position information responsive to a determination of said modified center point.
91.
The method of claim 88 wherein said step of determining said position information
further comprises:
applying a non-linear function to said center point to determine said position
30
information responsive to a det- ----:--ation of said center point.
92.
The method of claim 87 wherein said step of detems:ui g said position information
comprises:
determining a highest capacitance electrode of said plurality of electrodes responsive
to a determination of capacitance of each of said plurality of electrodes;
35
setting an orientation of said plurality of electrodes to have said highest capacitance
electrode as a center of said plurality of electrodes;
determining a position of said input object by calculating a centroid responsive to
41
APLNDC00026099
WO 03/088176
PCT/USo3/11015
SYN-113PCT
5
said orientation of said plurality of electrodes being set; and
applying said reverse rotation function to said position to generate said position
information.
93.
The method of claim 92 wherein an application of said reverse rotation function sets
said orientation of said plurality of electrodes to an original orientation.
10
94.
The method of claim 87 wherein said step of determining said position information
compnses:
applying a first periodic weighting function to capacitances of said plurality of said
electrodes to determine a numerator,
applying a second periodic weighting function to said capacitances of said plurality
15
of electrodes to determine a denominator , and
applying a third function to said numerator and said denominator to generate said
position information responsive to a determination of said numerator and a determination of
said denominator.
95.
20
The method of claim94 wherein said third function is a four quadrant arctangent.
96.
The method of claim 94 wherein said step of applying said first periodic weighting
function comprises:
applying a first periodic weighting function to said capacitance of each of said
plurality of electrodes to determine a weighted capacitance component for each of said
plurality of electrodes, and
25
dete- ---:--:--g a numerator from said weighted capacitance components of said
plurality of electrodes responsive to a determination of said weighted capacitance
component of each of said plurality of electrode.
97.
The method of claim 96 wherein said first periodic weighting function is based on
sme.
30
98.
The method of claim 94 wherein said step of applying said second periodic
weighting function to determine said denominator comprises:
applying said second periodic weighting function to said capacitance of each of said
plurality of electrodes to determine a weighted capacitance component for each of said
plurality of electrodes, and
35
determining a denominator from said weighted capacitance component of each of
said plurality of electrodes responsive to a determination of said weighted capacitance
component of each of said plurality of electrodes.
42
APLNDC00026100
WO 03/088176
PCT/US03/11015
10
Sensor
12
i
/
14
Closed
Loop Path
\ Decoder /
i
Message \
\ Generator
16
/
Host
Device
Fig. 1
20
22
-
24
26
Fig. 2
28
26
Fig. 3
APLNDC00026101
WOU3/088176
PCT/US03/11015
30
34
Fig. 4
Fig. 5
40
35
39
38
37
36
Fig. 7
41
Fig. 6
42
Fig. 9
Fig. 8
Y
43
Fig. 10
APLNDC00026102
WO03/088176
Fig. 11
PCTIUSU3/11015
Fig. 12 Fig. 13 Fig. 14 Fig. 15
co
8
Fig. 16
Fig. 17
44
45
Fig. 18
46
Fig. 19
Fig. 20
48
Fig. 21
2
- -- - - t-
4
File Edit View(
Fig. 22
66
50
54
52
File Edit View (
Fig. 23
se
! I
IP V
50
APLNDC00026103
WO 03/088176
PCT/USO3/11015
62
IFile iEdit View
60
---
66
IFile |Edit View
64
66
64
Fig. 24
62
68
74
60
I i
I
Fig. 25
62
72
I
/
I I I
60
66
76
Fig. 26
82
File Edit View
66
84
86
Ill/Allii
IP/W
80
Fig.27
APLNDC00026104
WO 03/088176
PCT/USO3/11015
90
92
94
93
91
94
Fig. 28
95
A
98
96
Fig. 29
APLNDC00026105
WO 03/088176
PCT/US03/11015
o
ao
APLNDC00026106
WOG3/088176
PCT/USO3/11015
0
102
92<
90
94
100
Fig. 31
APLNDC00026107
WO 03/088176
PCTIUSO3/11015
101
I
I
- /
i
103
\
\
\
/
X
/
'×
12345678
X or Y Axis Sensor Inputs
Fig. 32
APLNDC00026108
WOU3/088176
PCTIUSU3/11015
34
110
115
114
112
116
34
Fig. 33
115
116 114 112 114
116
110
115
Fig. 34
120
124
124
122
124
124
Fig. 35
APLNDC00026109
WOU3/088176
PCT/USO3/11015
132
134
(
130-
-
O
+L
Volume
-
R
Balance
+Treble
+
Bass
Fig. 36
142
144
148
140
--
++ -
We
146
+
o
e
Fig. 37
APLNDC00026110
WO03/088176
PCT/US03/11015
150
I
158
-
L
- -
* *
Bass
Treble
R
156
Balance
154
Volume
152
Fig. 38
X
C(0)
.
--- J
&
C(1)
C(2)
C(3)
C(4)
i -1
i
C(5)
i+1
Fig. 40
APLNDC00026111
WO 03/088176
PCTIUSO3/11015
Start
Determine which electrode has
the largest capacitance
measurement
t
Fit capacitance measurements of
electrode with largest capacitance
and its neighboring electrodes to an
inverted parabola
t
Calculate the center point
of the parabola
Reduce the calculated mula
point by Modulo N, if necessary
†
Pass calculated center point value
through a non-linear function to
compensate for non-linearities
Fig. 39
APLNDC00026112
WO 03/088176
PCTIUSO3/11015
Locate peak electrode i
Rotate coordinate system by renumbering
each electrodejto Q-i+N/2) ModuloN,
thus centering i
Calculate mathematical centroid X
/
Reverse rotate X'=(X+i-N/2)ModuloN,
X' is final input object location
Fig. 41
APLNDC00026113
WO 03/088176
PCT/USO3/11015
Start
Compute numerator N as
N= Sum(sin(i*2 pi/N) * C(i))
Compute denominator D as
D= Sum(cos(i*2 pi/N) * C(x))
Compute atan2(N,D) to
obtain angular position
Fig. 42
APLNDC00026114
WO 03/088176
PCT/USO3/11015
w
Compute numerator Nas
N=f,
W
Compute der aminator D as
D=fc
ComputefA(N,D)to obtain
angular position
Fig. 43
APLNDC00026115
WO 03/088176
PCTIUSO3/11015
Calculate NewPos
Was an
object previously present
on the sensor?
No
Copy NewPos
into OldPos
Yes
Determine relative motion between
two samples (Motion + NewPos - OldPos)
a
Motion is
Greater than 180°or
more ?
No
Yes
Motion à
Less than
-180°
?
No
Yes
Subtract 360°
from Motion
Add 360 °
from Motion
Fig.44
APLNDC00026116
WO 03/088176
PCT/USO3/11015
Start
Determine a first point and a
second point on the closed
loopsensor
Calculate the distance between the first and second points
Calculate the angles corresponding
to the first and second points
Subtract the angle ofthe second point
from the angle of the first point to
get a result
Use the sign ofthe result to
indicate direction of motion
Fig. 45
APLNDC00026117
INTERNATIONAL SEARCH REPORT
International application No.
PCT/USos/11015
A.
CIASSIFICATION OF SUBJECT MATTER
IPC(7)
US CL
:GosC 21/00; GO9G s/oe
: 178/18.01,18.05,18.06,18.07,81,39; 345/173
According to International Patent Classification (IPC) or to both national classification and IPC
B.
FIELDS SEARCHED
Minimum documentation searched (classification system followed by classification symbols)
U.S. :
178/18.ol,18.05,18.os,18.07,81,se; 8+5/178
Documentation searched other than minimum documentation to the extent that such documents are included in the fields
seggggd
Electronic data base consulted during the international search (name of data base and, where practicable, search terms useÃ)
none
C.
DOCUMENTS CONSIDERED TO BE RELEVANT
Category*
Citation of document, with indication, where appropriate, of the relevant passages
Relevant to claim No.
X
US 5,159,159 A (ASHER) 27 OCTOBER 1992, (figs.1-5,7-9); col.
3, 55- col. 4, lines 52.
1-58
Y
US 5,518,078 A (TSUJIOKA et al) 21 MAY 1996, All
1-58
X
--
US 5,907,472 A (FARAHMANDI et al) 25 May
Abstract and fig. 9A)
1999 (see,
1-58
44-50
O
Further documents are listed in the continuation of Box C.
See pm 4
*
"A"
Special categories of cited deemnenk
document defining the general state of the art which is not considered
to be of particular relevance
"S"
later document published after the international filing dato or priority
hte and not in conflict with the application but cited to understand
the principle or theory nadatlying the invention
"E"
earlier doomnent published on or after the international filing dato
"X"
'L"
document which may thror doubts on priority claim(s) or which is
cited to establish the ynblication date of another citation or other
special reason (as specified)
doenment of particular relevance; the claimed invention cannot be
considoted novel or cannot be considered to involve an inventivo stop
when the doomnent is taken alone
"T"
document of partienlar televance; the claimed invention cannot be
*0"
ðoenment referring to an oral disclosure, aso, exhibition or other
"&"
a o
a
obvious to a person skilled in the art
document member of Ebe same palani family
y
(ho international Cling date but later
Date of the actual completion of the international search
Date of mailing of the interna ional search report
31AUG 03
01 AUGUST eoos
Name and mailing address of the ISA/US
Commissioner of Patents and Trademarks
Box Per
Washington, D.C. 20231
Authori ed officer
Facsimile No.
Telep
(708) 305-8980
A
i
MENGIST
No.
(7os)
.sago
'
Form PCT/ISAlelo (second sheet) (July 1998)*
APLNDC00026118
This Page is Inserted by I¥w Indexing and Scanning
Operations and is not part of the Official Record
BEST AVAILABLE TMAGES
Defective images within this document are accurate representations of the original
documents submitted by the applicant.
Defects in the images include but are not limited to the items checked:
ACK BORDERS
O IMAGE CUT OFF AT TOP, BOTTOM OR SIDES
O FADED TEXT OR DRAWING
O BLURRED OR ILLEGIBLE TEXT OR DRAWING
O SKEWED/SLANTED IMAGES
O COLOR OR BLACK AND WHITE PHOTOGRAPHS
O GRAY SCALE DOCUMENTS
NES OR MARKS ON ORIGINAL DOCUMENT
O REFERENCE(S) OR EXHIBIT(S) SUBMITTED A E POOR QUALITY
O O--R:
IMAGES ANY BEST AVAILABLE COPY.
As rescanning these documents will not correct the image
problems checked, please do not report these problems to
the 1¥ w Image Problem Mailbox.
APLNDC00026119
PCT
WORLD IPLi ECTUAL PROPERTY ORGANIZATION
Intemational Buæau
INTERNATIONAL APPLICATION PUBLISHED UNDER THE PA mm COOPERATION TREATY (PCT)
(51) International Patent Classification 6 :
GO6F 3/14, 15/02
(11) International Publication Numher: -
A2
(43) International Publication Date:
WO 98/14863
9 April 1998 (09.04.98)
(21) International Application Number:
(22) International Filing Date:
(30) Priority Data:
9620464.9
PCT/IB97/01139 (81) Designated States: JP, European patent (AT, BE, CH, DE, DK,
ES, FI, FR, OB, GR, IE, IT, LU, MC, NL, PT, SE).
22 September 1997 (22.09.97)
1 October 1996 (01.10.96)
GB
Published
Without international search report and to be republished
upon receipt of that report,
(71) Applicant: PHILIPS - - --ONICS N.V. [NUNLl; Groenewoudseweg 1, NL-5621 BA Eindhoven (NL).
(71) Applicant (for SE only): PHILIPS NORDEN AB [SE/SE];
Kottbygatan 7, Kista, S-164 85 Stockholm (SE).
(72) Inventor: STOVE, Andrew, Gerald, Stove; Pof. Holstlaan 6,
NL-5656 AA Eindhoven (NL),
(74) Agent: ERTL, Nicholas, J.; Intemationaal Octrooibumau B.V.,
P.O. Box 220, NL-5600 AE Eindhoven (NL).
(54) Title: HAND-HELD IMAGE DISPLAY DEVICE
(57) Abstract
A hand-held image display device (10)
has a display (12) and at least one sensor (14,
16) responsive to an angle of tik of the device
(10). Stie tilt of the device is used to effect
a scrolling function of the display (12).
12
r
26
24
A
20
APLNDC00026120
FOR THE PURPOSES OF INFORMATION ONLY
Codes used to identify States party to the PCT on the front pages of parnphlets publishing intemational applications under the PCT.
AL
AM
Albania
Annenia
ES
FI
AT
Austria
FR
France
AU
AZ
Australia
Azerbaijan
GA
GB
Gabon
United Kingdom
BA
BB
BE
BF
BG
BJ
BR
Bosnia and Herzegovina
Barbados
Belgium
Burkina Faso
Bulgaria
Benin
Brazil
GE
GH
GN
GR
HU
IE
IL
Georgia
Ghana
Guinea
Greece
Hungary
Ireland
Israel
MD
MG
MK
BY
CA
CF
CG
Belanis
Canada
Central African Republic
Congo
IS
IT
JP
KE
CH
CI
CM
CN
CU
CZ
DE
DK
EE
Switzerland
Côte d'Ivoire
Cameroon
China
Cuba
Czech Republic
Germany
Denmark
Estonia
KG
KP
KR
KZ
LC
Li
LK
LR
Spain
Finland
LS
LT
Izsotho
Lithuania
Si
SK
Slovenia
Slovakia
LU
Luxembourg
SN
Senegal
LV
MC
Latvia
Monaco
SE
TD
Swaziland
Chad
ML
MN
MR
Republic of Moldova
Madagascar
The former Yugoslav
Republic of Macedonia
Mali
Mongolia
Mauritania
TG
TJ
TM
TR
TT
UA
UG
Togo
Tajikistan
Turkmenistan
Turkey
Trinidad and Tobago
Ukraine
Uganda
Iceland
Italy
Japan
Kenya
MW
MX
NE
NL
Malawi
Mexico
Niger
Netherlands
US
UZ
VN
YU
United States of America
Uzbekistan
Viet Nam
Yugoslavia
Kyrgyzstan
Democratic People's
Republic of Kosta
Rcpublic of Korea
Kazakstan
Saint Lucia
Liechtenstein
Sri Lanka
Liberia
NO
NZ
PL
FI'
RO
RU
SD
SE
SG
Norway
New Zealand
Poland
Portugal
Romania
Russian Federation
Sudan
Sweden
Singapore
ZW
Zimbabwe
APLNDC00026121
WO98/14863
PCT/IB97/01139
HAND HELD IMAGE DISPLAY DEVICE
s
This invention relates to a hand held image display device, such as a
hand held computer or electronic diary.
It is known for conventional image display devices to include a scrolling
function which enables the display device to show only a portion of an image
to be viewed. This enables a magnification to be selected of the displayed
to
portion for comfortable viewing, and the scroll function enables easy viewing
of the entire image to be displayed. Conventionally, the scroll function may be
implemented as horizontal and/or vertical scroll bars which may be activated
using an electronic pointing device such as a mouse. Alternatively, a keyboard
may be used to scroll up and down a document, or indeed from side to side.
15
2o
25
In the case of a hand held device, additional keys may be required to
enable this function to be implemented using a keyboard input, and the use of
a mouse may not be possible.
According to the invention there is provided a hand held image display
device having an image display means and at least one sensor which is
responsive to an angle of inclination of the device, wherein the display means
displays a portion of an image to be displayed, and the selection of the portion
to be displayed is controlled in dependence upon the sensor signal, such that
the portion to be displayed is controllable by varying the angle of inclination of
the device.
In the device according to the invention, a portion of an image to be
displayed is selected by tilting the device itself.
ao
This provides a natural
operation for scrolling around text documents or images.
Preferably the angle of inclination comprises the angle to the horizontal
of a first axis extending from the top to the bottom of the display means. In
other words, it is possible to scroll up and down a document by pivoting the
device about a horizontal axis extending laterally across the screen.
APLNDC00026122
WO 98/14863
PCT/IB97/01139
2
Similarly, the angle of inclination may comprise the angle to the
horizontal of a second axis extending from one side to the other side of the
display means. In this case, it is possible to scroll from side to side of a
5
io
document by tilting the device left or right about an axis extending from the top
to the bottom of the screen.
By using either or both of these possibilities, the impression is generated
that the document displayed by the device can be rolled about within the
screen until the desired portion of the image is displayed.
The sensor or sensors may comprise tilt switches so that a
predetermined deviation from the horizontal gives rise to the scrolling effect.
However, it is preferred that the sensor or sensors comprise force transducers
which provide a variable signal depending upon the level of inclination of the
device. In this way, it is possible to put into effect a control of the speed of
scrolling as well as the direction.
is
Preferably, the device further comprises calibration means for defining
a reference inclination of the device, such that at the reference inclination of the
device, the portion to be displayed is constant. In this way, it is possible to
ensure that the user can select a preferred operating position of the device for
which the image to be displayed remains constant. Deviation from this
20
preferred orientation of the device gives rise to the required scrolling.
The image display device may comprise a hand held data processing
device, such as a telephone, personal digital organiser or game module.
25
The present invention will now be described by way of example, with
reference to and as shown in the accompanying drawings in which:
Figure 1 shows in simplified form a device according to the invention for
showing the operating principle; and
Figure 2 shows a data processing device employing a display of the
present invention.
30
Figure 1 part A shows a hand held image display device 10 according
to the invention and including a display screen 12 for displaying at least a
APLNDC00026123
WO98/14863
PCT/IB97/01139
3
portion of an image to be displayed. The device 10 includes at least one tilt
sensor, and two such sensors 14, 16 are shown in Figure 1, arranged
orthogonally. The sensors 14, 16 each enable an angle of inclination of the
s
to
device 10 to be determined which is subsequently used to control a display
command which effects scrolling of the image display.
When a programme produces a quantity of data for display which is
greater than can be displayed at any one time on a display device, it is
conventional for a scrolling function to be provided. For example, in the case
of word processing software package, horizontal and vertical scrolls may be
provided enabling a user to move between portions of a document whilst
maintaining sufficient clarity or size in the portion of the document displayed.
The scrolling function either requires the use of a mouse, to operate on scroll
bars, or requires the use of direction indicators on a keyboard.
is
20
The invention provides a more intuitive approach for image scrolling on
the screen of a hand held device, wherein the whole device is tipped. For
example, if the device is tipped towards the bottom of the screen the image or
text displayed by the screen will "fall" down the screen. If the device is tipped
towards the top of the screen, the image or text displayed will "fall" up.
As shown in Figure 1, two sensors 14, 16 may be provided, each of
which is responsive to tilting of the device about a horizontal axis.
Taking the sensor 14, an axis of the sensor extends along a top-tobottom direction of the display 12, and is therefore responsive to tilting of the
device 10 about a horizontal axis 20 which extends across the display 12.
Thus, the sensor 14 is responsive to rotation as represented by arrow 22 in
25
Figure 1 part A. The sensor 14 provides the most intuitive feel for scrolling up
and down a document. As shown in Figure 1 part B, when the base of the
screen 12 is pivoted downwardly about the axis 20 the image displayed by the
screen 12 effectively falls down as shown. In the case of a text document, the
display scrolls towards the beginning of the document.
ao
Figure 1 also represents a second sensor 16 which has an axis
extending from side to side of the display 12 and is therefore responsive to
rotation of the device 10 about a horizontal axis 24 extending from the top to
APLNDC00026124
WO 98/14863
PCT/IB97/01139
4
the bottom of the display 12. Thus, the sensor 16 is responsive to pivoting
about the axis 24 as represented by arrow 26. This enables scrolling from side
s
to side of an image displayed on the screen 12, for example where the width
of an image to be displayed is greater than the width which can be displayed
on the display screen at any one time.
lo
In order to implement the invention, the controller which determines the
information to be displayed must receive signals form the sensors 14, 16. The
sensors may comprise conventional tilt switches which are binary devices
detecting when the angle of tilt from a horizontal plane (in two directions) is
greater than a predetermined level. The use of such sensors may provide
limited control capability for the scroll function, since it is not possible to
determine the speed at which the user wishes to scroll around the image. Of
course, the use of different tilt switches each with differing sensitivity may
provide a number of levels of controt for the display, but the use of analogue
is
tilt sensors is preferred. Such analogue sensors will enable proportional control
to be possible, and may comprise arrangements of pressure sensors which
detect the pull of gravity.
One example of such a sensor is made by the company "Analogue
Devices" under the code ADXLO5. This is a monolithic silicon device known as
20
8 "Single chip accelerometer" having an etched substrate which deflects under
the influence of gravity. This deflection alters a capacitance which is
measured, and enables a steady state resolution of 0.005g.
The use of proportional tilt sensors may also enable a reference
orientation of the device 10 to be established for which the displayed
26
ao
information is stationary, and this reference orientation need not necessarily be
horizontal. It is possible, through appropriate software, to put into effect a dead
zone compnsing a range of orientations in which the displayed information
remains constant. These orientations will then cover the normal operating
position of the device by a user. Of course, if may be preferred that each user
can reset the dead zone according to the situation in which the device is being
used. For example, the device may be rested on a horizontal work surface in
which case the dead zone will operate when the device is in a substantially
APLNDC00026125
WO 98/14863
PCTIIB97/01139
5
horizontal plane. Altematively, if a user is standing while operating the device,
the hand held device may be held in a nearly upright position, for example in
the case of a mobile phone when the user may be scrolling between stored
telephone numbers. It will be apparent to those skilled in the art that each of
a
to
is
these commands may easily be implemented with appropriate software.
It would, of course, also be desirable to include an override function so
that any unwanted scrolling may be prevented, for example, for situations
when the device will not be stationary during use.
Those skilled in the art will appreciate that various software tools may
be employed to improve the interface between the device 10 and the user. For
example, a portion of a complete image can be displayed with the desired
scale, and information may be.provided around the edge of the display screen
12 which indicates to what extent the entire image extends, for example by
showing a compressed version of the remainder of the image. Equally, scroll
bars may be employed as position indicators , as are conventionally used in
word processing packages.
The technique described with reference to Figure 1 may be applied to
many different types of hand held device where th'ere is a large amount of
information to be displayed. For example, the device may comprise a personal
20
organiser, such as represented in Figure 2, a communications device such as
a pager or mobile phone or any number of other such products.
In Figure 2, the device 10 comprises a personal organiser and the
display screen 12 includes scroll bars 30 representing the position of the
2r,
so
portion displayed within the entire list of information. The specific hardware
and software required to implement the invention will be appreciated by those
skilled in the art. Generally speaking, the tilt sensors 14, 16 will provide input
signals to a microprocessor which controls a display controller.
The
information to be displayed will then be modified in dependence upon the
sensor signals by appropriate software implementation. The software will then
enable the calibration stage referred to earlier (for providing a dead zone) to be
put into effect as well as any override function which may be provided.
Implementation of the invention may be carried out using conventional
APLNDC00026126
WO98/14863
PCTIIB97/01139
6
apparatus, which will therefore not be described in detail in the present
application.
From reading the present disclosure, other modifications will be apparent
a
to persons skilled in the art. Such modifications may involve other features
which are already known in the design and use of electrical or electronic
circuits and component parts thereof and which may be used instead of or in
addition to features already described herein. Although claims have been
formulated in this application to particular combinations of features, it should
lo
is
be understood that the scope of the disclosure of the present application also
includes any novel feature or any novel combination of features disclosed
herein either explicitly or implicitly or any generalisation of one or more of those
features which would be obvious to persons skilled in the art, whether or not
it relates to the same invention as presently claimed in any claim and whether
or not it mitigates any or all of the same technical problems as does the
present invention. The applicants hereby give notice that new claims may be
formulated to such features and/or combinations of such features during the
prosecution of the present application or of any further application derived
therefrom.
APLNDC00026127
WO98/14863
PCTIIB97/01139
7
CLAIMS
s
io
1.
A hand-held image display device having an image display means
and at least one sensor which is responsive to an angle of inclination of the
device, wherein the display means displays a portion of an image to be
displayed, and the selection of the portion to be displayed is controlled in
dependence upon the sensor signal, such that the portion to be displayed is
controllable by varying the angle of inclination of the device.
2.
A hand-held image display device as claimed in claim 1, wherein
the angle of inclination comprises the angle to the horizontal of a first axis
extending from the top to the bottom of the display means.
is
3.
A hand-held image display device as claimed in claim 1, wherein
the angle of inclination comprises the angle to the horizontal of a second axis
extending from one side to the other side of the display means.
4.
A hand-held image display device as claimed in claim 1,
comprising two sensors, one of which is responsive to the angle to the
2o
horizontal of a first axis extending from the top to the bottom of the display
means, and the other of which is responsive to the angle to the horizontal of
a second axis extending from one side to the other side of the display means.
5.
25
A hand-held image display device as claimed in any preceding
claim, wherein the sensor or sensors comprise tilt switches.
6.
A hand-held image display device as claimed in any one of claims
1 to 4, wherein the sensor or sensors comprise force transducers which provide
a variable signal depending upon the level of inclination of the device.
30
7.
A hand-held image display device as claimed in claim 6, wherein
the device further comprises calibration means for defining a reference
APLNDC00026128
WO98/14863
PCT/IB97/01139
8
inclination of the device, such that at the reference inclination of the device, the
portion to be displayed is constant.
8.
s
A hand-held image display device as claimed in any preceding
claim, comprising a hand-held data processing device.
APLNDC00026129
WO98/14863
PCTIIB97/01139
12
16
26
22
20
14
FlG. 1A
16
20
1. 10:30am
30
Meeting at London
hotel to discuss
Lunch with Mr. Jo
2. 12.45pm
I
'6
\
3°
FIG.2
APLNDC00026130
(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
(19) World IntellectudalndroCy Organization
(43) International Publication Date
(10) International Publication Number
2 March 2006 (02.03.2006)
WO 2006/023569 A1
(51) International Patent Classification:
(81) Designated States (unless otherwise indicated, for every
kind of national protection available): AE, AG, AL, AM,
GO6F 3/044 (2006.01)
AT, AU, AZ, BA, BB, BG, BR, BW, BY, BZ, CA, CH, CN,
CO, CR, CU, CZ, DE, DK, DM, DZ, EC, EE, EG, ES, FI,
GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE,
KG, KM, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA,
MD, MG, MK, MN, MW, MX, MZ, NA, NG, NI, NO, NZ,
OM, PG, PH, PL, FT, RO, RU, SC, SD, SE, SG, SK, SL,
SM, SY, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC,
VN, YU, ZA, ZM, ZW.
(21) International Application Number•
PCTIUS2005/029270
(22) International Filing Date: 15 August 2005 (15.08.2005)
(25) Filing Language:
English
(26) Publication Language:
English
(30) Priority Data:
(84) Designated States (unless otherwise indicated, for every
60/522,107
16 August 2004 (16.08.2004)
US
kind of regional pwrection available): ARIPO (BW, GH,
GM, KE, LS, MW, MZ, NA, SD, SL, SZ, TZ, UG, ZM,
(71) Applicant(foralldesignatedStatesexcept US): FINGER¯
ZW), Eurasian (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM),
WORKS, INC. [US/US); P.O. Box 430, Townsend, DE
19734 (US)
(72) Inventors; and
M (75) Inventors/Applicants (for US only): - - ---,
Wayne, Carl [US/US]; 260 King Street, Apt. 1507, San
Francisco, CA 94107 (US). ORR, James, Edmund, IV
[US/US); 5642 Sevens Creek Boulevard, Apt. 504, Copertino, CA95014 (US).ELIAS, John, Greer [US/US]; 798
Taylors Bridge Road, Townsend, DE 19734 (US)-
Eumpean (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI,
FR, GB, GR, HU, IE, IS, IT LT, LU, LV, MC, NL, PL, PT,
RO, SE, SI, SK, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA,
GN, GQ, GW, ML, MR, NE, SN, TD, TG).
Published:
- with international search report
- before the expiration of the time limir for amending the
claims and to be republished in the event of rece¡pt of
amendments
(74) Agent: ALLEN, Billy, C., IH; Wong, Cabello, Lutsch,
Rutherfoul & Brucculeri, L.L.P., Suite 600, 20333 Tomball
Parkway, Houston, TX 77070 (US).
Fortwo-letter codes and other abbreviations, refer to the "Guidance Notes on Codes and Abbreviarions" appearing at the beginning of each regular issue ofthe PCT Gazette.
(54) Title: A METHOD OF INCREASING THE SPATIAL RESOLUTION OF TOUCH SENSITIVE DEVICES
1
6
2
10
3
A
Hiiii
A
sensor
Number
g
A
B
4A102189
Sensor
Number
A
5
a
2
20
6
a
r "P
18
6
A
Electrode
6
2
Number
17
7
A
Group
19
4
15
a
14
7
8
B
10 11 12 13
1
A
B
A
B
A
7
(57) Abstract: Disclosed herein is a capacitive touch sensitive device. One aspect of the touch sensitive device described herein is a
reduction in the number of sensor circuits needed for circular or linear capacitive touch sensitive devices while maintaining the same
resolution and absolute position determination for a single object. A related aspect of the touch sensitive device described herein a
coding pattern that allows each sensor circuit of a capacitive touch sensitive device to share multiple electrodes at specially chosen
locations in a sensor array such that the ability to determine the absolute position of a single object over the array is not compromised.
APLNDC00026131
WO 2006/023569
PCT/US2005/029270
A METHOD OF INCREASING THE SPATIAL RESOLUTION OF
TOUCH SENSITIVE DEVICES
Cross-reference to Related Applications
[0001]
This application is related to and claims priority to Provisional
United States Patent Application Serial No. 60/522,107, filed August 16,
2004, having the same title and inventors as herein, which provisional
application is hereby incorporated by reference in its entirety.
Background
[0002]
The present invention relates generally to the field of touch
sensitive devices, and, in particular, to the field of optimizing capacitive
sensing electrode shape and arrangement to increase the effective spatial
resolution and/or the physical range of the sensing device using a limited
number of sensors.
[0003]
In a capacitive touch sensitive device, each sensor, of which
there may be many, comprises a conductive pad that forms one plate of a
capacitor and a way to measure the capacitance of the conductive pad in
conjunction with another movable conductive object. The movable
conductive object is typically a finger or stylus that is kept at a minimum
distance from the conductive pad by a non-conductive spacer. The two
conductive objects (conductive pad and movable conductive object), along
with the non-conductive dielectric between them, form a capacitor. As
known to those skilled in the art, the capacitance of this capacitor changes
as the distance and/or overlap between the objects changes. In a typical
deviœ the number of conductive pads (henceforth called electrodes), the
size of the electrodes, and the spacing between the electrodes determine
the physical range and spatial resolution of the touch sensitive device.
- 1-
APLNDC00026132
WO2006/023569
PCT/US2005/029270
[0004]
In typical implementations of capacitive touch sensitive
devices the position of a finger gliding over a dielectric-covered array of
sensor electrodes is determined by observing the change in capacitance as
the finger moves on the surface. Scanning and processing circuitry
measures the change in capacitance due to the varying overlap between
the finger and a given electrode. If a finger is large enough to partially
overlap multiple neighboring electrodes then interpolation allows the
finger position to be determined to a resolution much higher than the
electrode spacing. The interpolation calculation follows the classic
centroid formula: the sum of the signal values at each electrode is
multiplied by its coordinate and divided by the sum of all the signal values.
This technique works equally well with linear arrays of row and column
electrodes, radial arrays of electrodes ananged as spokes in a wheel, or
two-dimensional arrays of electrodes arranged to fill a planar space.
Special electrode shapes intended to boost interpolation accuracy or
resolution are the main distinction between the various related art
designs.
[0005]
For example, U.S. Patent 5,463,388 to Boie et al., which is
hereby incorporated by reference, teaches fingertip sized, interleaved
electrode spirals to minimize the number of electrodes needed for a multitouch sensor array. The interleaving ensures that a finger overlaps
multiple electrodes even when centered on a particular electrode and
electrodes are one fingertip width apart. Stable interpolation generally .
requires continual finger overlap with multiple electrodes.
[0006]
Seonkyoo Lee, "A Fast Multiple-Touch-Sensitive Input
Device," Master's Thesis, University of Toronto (1984) teaches virtual
grouping of square electrode cells to more quickly determine whether an
object is present within a neighborhood. U.S. Patent 5,767,457 to
Gerpheide teaches locating an object by finding the balance point of a
-2 -
APLNDC00026133
WO 2006/023569
PCT/US2005/029270
virtual grouping of electrodes on either side of the object. Both of these
references are hereby incorporated by reference.
[0007]
Finally, U.S. Patents 5,543,590; 5,543,591; 5,880,411; and
6,414,671; each assigned to Synaptics and hereby incorporated by
reference, teach dense interleaving of row and column spanning
electrodes in the same plane by shaping each row electrode as a
connected string of diamond shapes, and each column electrode as a
string of diamond shapes with centers offset from the row diamond
centers.
[0008]
However, additional improvement in resolution is still desired
for such devices. Although resolution may be increased by adding
additional sensor elements, dictates of scanning time, circuitry cost, and
power consumption simultaneously drive systems towards as few sensor
elements as possible. Therefore, there is a need in the art of sensor array
design for sensor arrangements that maximize resolution with a limited
number of sensors. Disclosed herein is a touch sensitive device that
addresses the needs of the prior art for increased resolution and
decreased sensor element count.
Summarv
[0009]
Disclosed herein is a capacitive touch sensitive device. One
aspect of the touch sensitive device described herein is a reduction in the
number of sensor circuits needed for circular or linear capacitive touch
sensitive devices while maintaining the same resolution and absolute
position determination for a single object. A related aspect of the touch
sensitive device described herein a coding pattem that allows each sensor
circuit of a capacitive touch sensitive device to share multiple electrodes at
specially chosen locations in a sensor array such that the ability to
-3-
APLNDC00026134
WO2006/023569
PCT/US2005/029270
determine the absolute position of a single object over the array is not
compromised.
Brief Descrintion of the Drawinas
[0010]
Figure 1 illustrates a touch sensitive device employing certain
teachings of the present invention.
Detailed Description
[0011]
A capacitive touch sensor is described herein. The following
embodiments of the invention are illustrative only and should not be
considered limiting in any respect.
[0012] . The touch sensitive device described herein allows each
sensor circuit to share two or more electrodes by dispersing the shared
electrodes in a particular pattern. The electrodes are shared in the sense
that they both electrically connect to the same capacitive measuring
sensor circuit through a common conductor without the need for
multiplexing switches. Preferably, the distance separating a pair of shared
electrodes, i.e., the dispersal distance, is one-third the number of
electrodes in the device. The touch sensitive device employed herein
further includes a particular coding pattern so that: 1) adjacent electrodes
never share the same sensor circuit; and 2) the electrodes sharing the
same --- -r circuit are always separated from one another by the
dispersal distance, i.e., roughly one third of the number of electrodes.
[0013]
A touch sensitive device incorporating the teachings herein is
illustrated in Fig. 1. The capacitive touch sensitive device 100 is a onedimensional circular array, although other arrangements, e.g., linear
arrays, etc., could also be used. The circular array includes 22 electrodes,
numbered 0-21. The circular array includes only 11 sensor circuits.
These - ^r circuits may take the form of various sensor circuits known
-4-
APLNDC00026135
WO2006/023569
PCT/US2005/029270
to those skilled in the art. One such circuit is disclosed in U.S. Patent
6,323,846, entitled "Method and Apparatus for Integrating Manual Input,"
which is hereby incorpor,ated by reference.
The sensor circuit
corresponding to each electrode is designated by a number located at the
outer portion of each sensor electrode.
[0014]
The touch sensitive device 100 thus shares two electrodes
per sensor. However, additional electrodes may be shared with each
sensor. Each electrode in Fig. 1 also includes a group designator, either
"A" or "B". Each group A electrode shares'a sensor with a group "B"
electrode. As noted above, the preferred dispersal distance (i.e., the
distance between two electrodes sharing a sensor) is a span of
approximately one-third the number of sensors, and thus approximately
one-third of a characteristic dimension of the device. Thus for the circular
device illustrated in Fig. 1, the preferred dispersal distance is
approximately one-third the circumference of the circle, thus
encompassing approximately one third of the sensors. Any two adjacent
electrodes and the two electrodes that share sensor circuits will thus be
evenly spaced, a third of the way around the circle. For example,
electrode 1 in group A shares sensor 1 with electrode 8 in group B.
Electrode 1 is located at approximately the eleven o'clock position, while
electrode 8 is located at approximately the seven o'clock position.
Similarly, electrode 0 in group A shares sensor 0 with electrode 15 in
group B. Electrode 0 is located at the twelve o'clock position, while
electrode 15 is located at approximately the four o'clock position.
[0015]
The sensor may alternatively be constructed as a onedimensional linear array. For such a sensor, the dispersal pattern is
basically the same as for a circular array: linear arrays can be treated as a
circular array that has been broken between two electrodes and uncurled.
Again, it is preferred that the dispersal difference between two electrodes
-5-
APLNDC00026136
WO2006/023569
PCT/US2005/029270
sharing a censor be about one-third the characteristic dimension of the
device, which for a linear sensor is the length of the device.
[0016]
Obviously, because multiple electrodes share a sensing
circuit, the absolute position of an object in contact (proximity) with a
single electrode cannot be determined. For absolute position interpolation
to work properly in a device constructed according to the principles herein,
each electrode must be sufficiently narrow enough that the object belncj
tracked, usually a finger or conductive stylus, overlaps multiple (e.g., two
or three) adjacent electrodes. Likewise, to eliminate any ambiguity, the
object being tracked must be smaller than the dispersal distance so that it
does not overlap both shared electrodes of any sensor circuit.
[0017]
While other electrode sharing patterns are possible, some of
these can not be used to unambiguously determine the position of a
finger. For example, an electrode arrangement with a dispersal distance
of half the array size would fall. For a circular array, this would
correspond to sharing of electrodes on opposite sides of the circle, 180
degrees from one another. No matter how decoding and interpolation
were done, the system could never tell whether the finger or stylus was
really at the opposite position halfway around the circle.
[0018]
Because each sensor circuit. is connected to multiple
electrodes, the sensor illustrated herein requires a decoding method that
finds the set of electrodes with the largest signals, then decides which of
two possible electrode groups would attribute these largest signals to
adjacent rather than scattered electrodes. Once this best decoding is
known, classic centroid interpolation can commence amongst the adjacent
electrodes. For purposes of centroid computation, each sensor's entire
signal is attributed to its electrode in the adjacent group, leaving its other
electrode from the dispersed group with zero signal and zero contribution
to the centroid. Assuming the signal to noise ratio of the sensor circuits is
adequate, the sensor described herein offers the same position resolution
-6-
APLNDC00026137
WO 2006/023569
PCT/US2005/029270
as a conventional position detector that has a separate sensor circuit for
each electrode.
[0019]
The example of computer instructions below demonstrates
the algorithm used in the present invention to find the position of a finger
or stylus that is touching somewhere on the circular array of electrodes.
Sensor and electrode mappings are held in look-up-tables (LUTs) to
minimize the computation needed for decoding the location of the
touching finger. The LUTs map electrode number to sensor number for
each group (Sensor_to A_type_electrode, Sensor_to_B_type_electrode),
map the sensor number corresponding to the adjacent electrode
(next X_electrode_sensor, previous_X_electrode_sensor, where X = A or
B), and electrode number to sensor number (Electrode_to_Sensor). The
use of these LUTs simplifies the calculation of the finger location using the
present invention but they are not n=·==ry.
[0020]
A brief description of the algorithm implemented by the code
is as follows:
1. The sensor array is scanned and the signal values corresponding to
each sensor are collected.
2. The sensor having maximum strength signal is located using code
segment findMaxSensor.
3. The electrode under which the finger is located is computed using
code segment findMaxElectrode.
4. The centroid is computed using code segment computecentroid.
5. Steps 1 - 4 are repeated.
-7-
APLNDC00026138
WO 2006/023569
PCT/US2005/029270
#define NUM_SENSORS 11
#define NUM_ELECTRODES 22
// Group A electrode and sensor mappings
Sensotto_A_type_electrode[NUM SENSORS] = {0,1,2,3,4,5,6,7,9,11,13};
next_A_electrode_sensor[NUM_SENSORS] = {1,2,3,4,5,6,7,1,3,5,7};
previous_A_electrode_sensor[NUM SENSORS] = {6,0,1,2,3,4,5,6,1,3,5};
// Group B electrode and sensor mappings
Sensotto_B..type electrode[NUM SENSORS] = {15,8,17,10,19,12,21,14,16,18,20};
next_B_electräde_sensor[NUM_SENSORS} = {8,8,9,9,10,10,0,0,2,4,6};
previous_A_electrode_sensor[NUM_SENSORS) = {7,7,8,8,9,9,10,10,0,2,4};
// Electrode to sensor mapping
Electrode_to_Sensor[NUM_ELECTRODES) = {
0, // 0
1,//1
2, // 2
3, // 3
4, // 4
5, // 5
6, // 6
7, // 7
1,//8
8, // 9
3, // 10
9, // 11
5, // 12
10, // 13
7, // 14
0, // 15
8, // 16
2, // 17
9, // 18
4, // 19
10, // 20
6 // 21
};
// This code finds the sensor that has the strongest signal
void findMaxSensor(void) {
unsigned char maxval, i;
max_sensor = 0;
maxval = 0;
for (i = 0; i < NUM_SENSORS; i++) {
if (SensorData[e] > maxval) {
maxval = SensorData[i];
max
.. . = i;
-8-
APLNDC00026139
WO 2006/023569
PCTIUS2005/029270
}
}
}
// This code finds the electrode that has the strongest signal
// It starts by examining the electrodes adjacent to those
electrodes that
// belong to the maximum sensor. The electrode being touched is
identified
// by comparing the signal strength of the two electrodes on either
side
// of the electrodes belonging to the maximum sensor. The group
with the
// largest signal is the one under the touching finger.
void findMaxElectrode(void) {
int Asum, Bsum;
Asum = SensorDatainext_A_efectrode_sensor[max_sensor]] +
SensorData[previous_A_electrode_sensor[max_sensor)];
Bsum = SensorData[next_A_electrode_sensor[max_sensor]] +
SensorData[previous B_electrode_sensor[max_sensor]];
if (Asum > Bsum) {
maxelectrode = Sensor_to A_type_electrode[max_sensor];
} else {
maxelectrode = Sensor_to_B_type_electrode[max_onsor];
}
// This code computes the centroid corresponding to the touching
finger
// using the location decoded using the algorithm of the invention.
#define CENTMULumm 8
void computeCentrold(void) {
int pos_sum, electrode;
char offset;
int sval;
pos sum = 0;
total_signal = 0;
//sum from maxelectrode in positive direction for two electrodes
for (offset = 1; offset < 3; offset++) {
.9-
APLNDC00026140
WO 2006/023569
PCT/US2005/029270
electrode = maxelectrode + offset;
if (electode >= NUM_ELECTRODES) {
electrode -= NUM_rt r· mODES;
}
sval = SensorData[Electrode to_Sensor[electrode]];
LLLaignal += sval;
pos_sum += CENTMULTTPLIER*sval*offset;
//sum from maxelectrode in negative direction for two electrodes
for (offset = 1; offset <3; offset++) {
electrode = maxelectrode - offset;
if (electrode < 0) {
electrode += NUM_- - -ODES;
sval = SensorData[Electrode to_Sensor[electrode)];
totaLsignal += sval;
pos_sum -= CENTMULTIPLIER*Sval*offset;
}
totaLsignal += sensorDatalmaxe];
sval = pos sum/totaLsignal;
sval += CENTMULTIPLIER*maxelectrode; //absolute offset by
maxelectrode
if(sval < 0) {
Centroid = 176 + sval;
}
else {
Centroid = sval;
}
}
[0021]
While the invention has been disclosed with respect to a
limited number of embodiments, numerous modifications and variations
will be appreciated by those skilled in the art. It is intended that all such
variations and modifications fall with in the scope of the following claims.
- 10 -
APLNDC00026141
WO 2006/023569
PCT/US2005/029270
What is claimed is:
1.
A touch sensitive device comprising:
a plurality of touch sensitive electrodes; and
a number of sense circuits, wherein the number of sense circuits
is less than the number of touch sensitive electrodes such
that at least one sense circuit is shared between more
than one of the touch sensitive electrodes;
wherein each of the touch sensitive electrodes that share a
sense circuit are spatially separated from each other by a
dispersal distance and wherein each touch sensitive
electrode is directly connected to a sense circuit.
2.
The touch sensitive device of claim 1 wherein the dispersal distance
is approximately one-third of a characteristic dimension of the
touch sensitive device.
3.
The touch sensitive device of claim 1 wherein each -- drcuit is
directly connected to two touch sensitive electrodes
4.
The touch sensitive device of claim 1 wherein the plurality of touch
sensitive electrodes are arranged in a circular array.
5.
The touch sensitive device of claim 4 wherein the dispersal distance
is approximately one-third the circumference of the circular array.
6.
The touch sensitive device of claim 4 wherein each sense circuit is
directly connected to two touch sensitive electrodes.
7.
The touch sensitive device of claim 1 wherein the touch sensitive
electrodes are arranged in a linear array.
- 11 -
APLNDC00026142
WO 2006/023569
8.
PCT/US2005/029270
The touch sensitive device of claim 7 wherein the dispersal distance
is approximately one-third the length of the linear array.
9.
A method of tracking an object used in conjunction a touch
sensitive device, wherein the touch sensitive device comprises a
plurality of electrodes and a plurality of sense circuits, wherein at
least one of the sense circuits is directly connected to more than
one electrode, the method comprising:
scanning the plurality of sense circuits to collect a signal value
corresponding to each of the plurality of sense circuits;
identifying a sense circuit having a maximum signal value;
identifying an electrode having a maximum signal value, the
electrode corresponding to the sense circuit having a
maximum signal value; and
computing a centroid of the object being tracked with reference
to the electrode having the maximum signal value and
adjacent electrodes.
10.
The method of claim 9 wherein sensor and electrode mappings
required for identifying a sense circuit having a maximum signal
value and identifying an electrode having a maximum signal value
are stored in look up tables.
11.
The method of claim 9 wherein identifying an electrode having a
maximum signal value comprises:
picking out each electrode associated with the sense circuit
having a maximum signal value;
finding each electrode adjacent the electrodes associated with
the sense circuit having a maximum signal value;
comparing signal values associated with the adjacent electrodes;
and
- 12 -
APLNDC00026143
WO2006/023569
PCT/US2005/029270
identifying the electrode having a maximum signal by selecting
the electrode having adjacent electrodes with the highest
signal value.
- 13 -
APLNDC00026144
WO2006/023569
PCT/US2005/029270
1/1
1
0
6
2
10
3
A
Number
A
4
Sensor
Number
B
A
A
a
5
2
1
0 21
B
20
ya
4
A
6
Electrode
Number
GrouP
17
15
B
14
7
10 11 12 13
A
,
er up
16
7
A
g
18
5
A
6
Sensor
A
B
8
0
A
1
B
A
B
7
8
10
3
g
5
Figure 1
APLNDC00026145
ill I
DIMA I IVIMAL DEAM4-f1 81mYUn i
interr
nal Application No
PCTi 32005/029270
A. CLASSIFICATION OF
GO6F
BJECT MATTER
44
According to Intemational Patent Classification (IPC) or to both national classification and IPC
B. FIELDS SEARCHED
Minimum documentation searched (classification system followed by classificatlon symbols)
006F
Documentation searched otherthan minimum documentation to the extent that such documents are included in the fields searched
Electronic data base consulted dudng the International search (name of data base and, where practicat search terms used)
EPO-Internal, WPI Data, IBM-TDB
C. DOCUMENTS CONSIDERED TO BE RELEVANT
Category *
X
Citation of document, with indication, where appropriate, of the relevant passages
Relevant to claim No.
US 4 733 222 A (EVANS ET AL)
22 March 1988 (1988-03-22)
1-3,7-11
figures 1,2
figures 10-16
column
column
column
column
column
column
column
column
X
4, line 45 - column 5, line 46
6, line 12 - column 7, line 15
8, line 4 - column 9, line 9
10, 1 ines 54-38
11, 1 ne 10 - column 13, line 29
16, 1 ne 4 - column 17, line 24
18, 1-ne 65 - column 19, line 15
20, 1-ne 34 - column 21, line 51
WO 03/088176 A (SYNAPTICS, INC)
23 October 2003 (2003-10-23)
figure 30
page 18, line 36 - page 19, line 24
Further documents are listed in the continuation of box C.
*Special categories of cited documents:
'A' document defining the general state of the att which is not
considered to be of particular relevance
*E' earlier document but pubished on or after the intomational
filing date
"L' document which may throw doubts on priority claim(s) or
which is citedto establish the pubication date of another
citation or other special reason (as specified)
*O' document retening to an oral disclosure, use, exhibition or
other means
"P' document published prior to the intemational tiling date but
tater than the priorily date claimed
Date of the actual completion of the intemational search
5 January 2006
Name and mailing address of the ISA
1-6
Patent family members are listed in annex.
'T' later document published aner the intemational tiling date
or priorily date and not in conflict with the application but
cited to understand the principle or theosy underlying the
invention
'X* document of particular relevance; the claimed Invention
cannot be considered novel or cannot be consklered to
involve an Inventive step when the document is taken alone
"Y' document of particular relevance; the claimed invention
cannot be considered to involve an inventive step when the
document is combined with one or more other such documents, such combination being obvious to a person skiDed
in the arL
'&' document member of the same patent family
Date of malling of the intemational search report
12/01/2006
Authorized officer
European Patent Office, P.B. 5818 Patentlaan 2
NL - 2260 HV Rijswijk
Tel (+31-70) 34Œ-2040,Tx.31 651 epa nl'
Fa3e (+31-70) 34(Ml016
ŸiPi Ou
*
Y.N
•
wn PcTasArzio (second sheet) (January 2004)
APLNDC00026146
int
nal Application No
PCT
52005/029270
C.(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT
Category *
A
Citation of document, with indication, where appropriate, of the relevant passages
US 4 788 384 A (BRUERE-DAWSON ET AL)
29 November 1988 (1988-11-29)
figure 1
column 2, 1 nes 21-68
column 3, 1 nes 8-12
column 3, 1 nes 60-63
column 5, 1 nes 18-59
Relevant to claim No.
1-6
Form PCTasAt2to (conunuation of omnd sheel) genuary 2004)
APLNDC00026147
um a
aun a avsyna or-nn
n ncr asn a
Patent document
Pubilcation
cited in search report
intem
Application No
PCT
mation on patent family members
32005/029270
Patent family
data
Publication
member(s)
date
US 4733222
A
22-03-1988
NONE
WO 03088176
A
23-10-2003
AU
EP
JP
US
US
2003226049
1500062
2005522797
2005156881
2004252109
Al
Al
T
Al
A1
27-10-2003
26-01-2005
28-07-2005
21-07-2005
16-12-2004
US 4788384
A
29-11-1988
BR
DE
EP
FR
8707066
3770438
0273824
2608753
A
DI
A2
Al
02-08-1988
04-07-1991
06-07-1988
24-06-1988
Form WRISMMO (patent famRy annex) (January 2004)
APLNDC00026148
Europäisches Patentamt
(19)
European Patent Office
Officeeuropéendesbrevets
(12)
(11)
EP 1 014 295 A3
EUROPEAN PATENT APPLICATION
(88) Date of publication A3:
09.01.2002 Bulletin 2002/02
(51) Int ci?: GO6K 11/06, GO6K 11/08,
GO6K 11/18, GO6F 3/033
(43) Date of publication A2:
28.06.2000 Bulletin 2000/26
(21) Application number 99125631.4
(22) Date of filing: 22.12.1999
(84) Designated Contracting States:
AT BE CH CY DE DK ES FI FR GB GR lE IT LI LU
MC NL PT SE
Designated Extension States:
AL LT LV MK RO SI
(30) Priority: 25.12.1998 JP 36999898
25.12.1998 JP 36999998
(71) Applicant: Kabushiki Kaisha Tokai Rika Denki
Seisakusho
Niwapun, Aichi-ken 480-0195 (JP)
(54)
(72) Inventors:
• Nishikawa, Masato,
K.K.Tokai-Rika-Denki,Seisakusho
Niwa-gun, Aichi-ken (JP)
• Nagasaka, Chikao,
K.K.Tokai-Rika-Denki-Seisakusho
Niwa-gun, Aichi-ken (JP)
• Kunimatsu,Yoshimasa, K. K. Tokai-Rika-DenkiNiwa-gun, Aichi-ken (JP)
(74) Representative: Klunker . Schmitt-Nilson . Hirsch
Winzererstrasse 106
80797 Milnchen (DE)
Touch-operating input device, display system, and touch-operating assisting method for
touch-operating input device
(57) A touch-operation guide shape is formed on an
input pad for inputting a touch operation by variably deforming the surface of the input pad, forming grooves or
the like to enable a user to recognize the operation position on the input pad through finger touch. In addition,
an image representing the touch-operation guide shape
is displayed on a menu frame of a display together with
selection items, whereby the corresponding position on
the input pad can be recognized on the screen of the
display.
F I G.2
14
18
20
PRESENT
LOCATION
24-
DESTI¯
NATION
HEND
DAIR CON
ITIONER
AUDIO
IMAGE
QUALITY
28
16
Printed by Jouve, 75001 PAMS (FR)
APLNDC00026149
EP1 014295A3
European Patent
onke
EUROPEAN SEARCH REPORT
EP 99 12 5631
DOCUMENTS CONSIDERED TO BE RELEVANT
citation of
X
cumentwith indication, where approptate,
oneleygg y
I
Relevant
_ to aalm
EP 0 884 691 A (TDKAI RIKA CO LTD)
16 December 1998 (1998-12-16)
CMSSIFCATIONOF THE
_ APPL AT©N gnt01.
1,2,
B-11,
15-20
CO6K1 706
GO6K1 /08
GO6K1 /18
GO6F3/033
* column 6,_line 10 - line 38 *
A
* column 8, line 49 - column 9, line 1;
figures 1-3,12 *
3-7
X
PATENT ABSTRACTS OF JAPAN
vol. 014, no. 561 (P-1142),
13 December 1990 (1990-12-13)
& JP 02 240715 A (MATSUSHITA ELECTRIC IND
CO LTD), 25 September 1990 (1990-09-25)
1,2,10,
11,20
PATENT ABSTRACTS OF JAPAN
vol. 2000, no. 09,
,
13 October 2000 (2000-10-13)
1-5,
7-11,19
* abstract *
E
& JP 2000 181629 A (NEC CORP),
30 June 2000 (2000-06-30)
* abstract *
X
A
---
--- mus
WO 97 18546 A (CIROUE CORP)
22 May 1997 (1997-05-22)
* page 6, line 26 - line 35 +
* page 14, line 30 - line 34; figures 2,4
1-5,
NWKWED
7-11,19 006K
GO6F
12-14
0443.0
*
A
WO 98 09446 A (HO SENG BENG)
5 March 1998 (1998-03-05)
* page 52, line 1 - line 22; figure 9 *
12-14
A
WO 98 08241 A (ERICSSON TELEFON AB L M)
26 February 1998 (1998-02-26)
12-14
* abstract; claims; figures +
The present search report has been drawn up for all claims
Placeaseeren
BERLIN
CATEGOmtOF CRED DOCUMEUS
\
unisaomsseslanavia••alm
===mar
13 November 2001
Durand, J
T : theory or preciple urghdying the twention
E : earner patent document, tiui pubished on, or
X : panicularly relerard if takanalans
Y: palticubrly relerard il comNaad with anoihar
documeni of the same calogory
eher the fång date
D : document cBed in Ihe appication
L : ];
196 Twin Peaks Blvd, San Francisco, California 94114
(US). ORDING, Bas [NUUS); 1119 Dolores Street, #4,
San Francisco, Califomia 94110 (US).
(74) Agent: HOELLWARTH, Quin, C.; BEYER WEAVER
& THOMAS, LLP, P. O. BOX 70250, Oakland, California
94612-0250 (US).
(81) Designated States (unless otherwise indicated, for every
kind of national protection available): AE, AG, AL, AM,
AT, AU, AZ, BA, BB, BG, BR, BW, BY, BZ, CA, CH, CN,
CO, CR, CU, CZ, DE, DK, DM, DZ, EC, EE, EG, ES, FI,
GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE,
KG, KM, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA,
MD, MG, MK, MN, MW, MX, MZ, NA, NG, NI, NO, NZ,
OM, PG, PH, PL, PT, RO, RU, SC, SD, SE, SG, SK, SL,
[Continued on next page]
iiii (54) Title: MODE-BASED GRAPHICAL USER INTERFACES FOR TOUCH SENSITIVE INPUT DEVICES
(57) Abstract: A user interface method is disclosed. The method includes
detecting a touch and then determining a user interface mode when a touch is
detected. The method further includes activating one or more GUI elements
based on the user interface mode and in response to the detected touch.
OSPLArG EBRMTBASEDON
USERafrERFAŒMODEANDRi
98 ATTENTE
802DCTECTIONr.rs--,.7
N
804 DÉE ONABON MODE onmFACE UUUSATEUR
806 310130 E
_ _ UTILISATEUR EN FONCTION DU
MODE UGHFACE UUUSATEUR ET EN ASSOCanON AVEC
ses activAnON RGmFACE URUSATEUR
812 DÊSACilVATION INTERFACE UilUSAIEUR ?
814 OÊSACTWATION INTERFACE UTIUSATEUR ET SON
EFFACEMENT DE L16CRAN
o
CD NON
APLNDC00026156
WO 2006/020304 A2 lilllllllillillllllilillililllililllllllllllllllliligligg
. SM, SY, TJ, TM, TN, TR, TT, 12, UA, UG, US, UZ, VC,
VN, YU, ZA, ZM, ZW·
RO, SE, SI, SK, TR), OAPI(BF, BJ, CF, CG, CI, CM, GA,
GN, GQ, GW, ML, MR, NE, SN, TD, TG).
(84) Designated States (unless otherwise indicated, for every
PubHshed:
-- without international search report and to be republished
upon receipt of that report
kind of regional protection available): ARIPO (BW, GH,
GM, KE, LS, MW, MZ, NA, SD, SL, SZ, TZ, UG, ZM,
ZW), Eurasian (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM),
European (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI,
FR, GB, GR, HU, IE, IS, IT LT, LU, LV, MC, NL, PL, PT,
For two-lettercodes and other abbreviations, refer to the "Guidance Notes on Codes andAbbreviations"appearing at the beginning ofeach regular issue ofthe PCT Gazette.
APLNDC00026157
PCT
WORLD INTELLECTUAL PROPERTY ORGANIZATION
Intemational Bureau
INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)
(51) International Patent Classification 6 :
GO9G 5/00
(11) International Publication Number:
WO 99/38149
A1
(43) International Publication Date:
29 July 1999 (29.07.99)
(21) International Application Number:
PCT/US99/01454 (81) Designated States: AL, AM, AT, AU, AZ, BA, BB, BG, BR,
BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GE,
(22) International Bling Date:
25 January 1999 (25.01.99)
GH, GM, HU, ID, IL, IS, JP, KE, KG, KP, KR, KZ, LC,
LK, LR, LS, LT, LU, LV, MD, MG, MK, MN, MW, MX,
NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM,
(30) Priority Data:
TR, TT, UA, UG, US, UZ, VN, YU, ZW, A WO patent
60/072,509
26 January 1998 (26.01.98)
US
(GH, GM, KE, LS, MW, SD, SZ, UG, ZW), Eurasian patent
09/236,513
25 January 1999 (25.01.99)
US
(AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European patent
(AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, IT,
LU, MC, NL, PT, SE), OAPI patent (BF, BJ, CF, CG, CI,
(71)(72) Applicants and Inventors:
WESTERMAN, Wayne
CM, GA, GN, GW, ML, MR, NE, SN, TD, TU).
(US/US); 715 Oak Street, P.O. Box 354, Wellington, MO
64097 (US). JAS, John, G. (US/USJ; Huguenot Farm,
798 Taylors Bridge Road, Townsend, DE 19734 (US).
Published
With international search report.
(14) Agent: OLSEN, James, M.; Connolly & Hutz, P.O. Box 2207,
Wilmington, DE 19899 (US).
(54) Title: --··-·OD AND APPARATUS FOR INTEGRATING MANUAL INPUT
(57) Abstract
4
Apparatus and methods are disclosed for simultaneously tracking multiple finger (202--204) and
palm (206, 207) contacts as hands approach, touch,
and slide across a proximity-sensing, compliant, and
flexible multi-touch surface (2). The surface con-
"
sists of compressible cushion (32), dielectric electrode (33), and circuitry layers. A simple proximity transduction circuit is placed under each electrode to maximize the signal-to-noise ratio and to
reduce wiring complexity. Scanning and signal off-
2
ELECTRODE
SCANNING
HARDWARE
6
CAUBRATION AND
PROxaßTY IMAGE
FORMATION
E
CONTACT
TRACIONG AND
IDENTIRCATION
10
set removal on electrode array produces low-noise
proximity images. Segmentation processing of each
proximity image constmets a group of electrodes corresponding to each distinguishable contacts and extracts shape, position and surface proximity features
for each group. Groups in successive images which
correspond to the same hand contact are linked by a
persistent path tracker (245) which also detects individual contact touchdown and liftoff. Classification
of intuitive hand configurations and motions enables
unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into
a versatile, ergonomic computer input device,
12
TYPING
REcoGNizER
RNM
DETECTOR
MOTION
COMPONENT
EXTRACTION
16
PENGRIP
DETECTOR
17
I CHORD MOTION
RECOGNi2ER
18
F24
| o-
CO
ER
SYSTEM
HOST
CAR
INTERFACE
20
APLNDC00026158
FOR THE PURPOSES OF INFORMATION ONLY
Codes used to identify States party to the PCT on the front pages of pamphlets publishing intemational applications under the PCT.
AL
Albania
ES
Spain
LS
*
SI
Slovenia
AM
AT
AU
AZ
Annenia
Austria
Australia
Azedmijan
FI
FR
GA
GB
Finland
France
Gaban
United Kingdoin
LT
LU
LV
ÍWC
Lidurania Luxembourg
Latvia
Monaco
SK
SN
Sz
TD
Slovalda
Senegal
Swaziland
Chad
MD
MG
MK
Republic of Moldova
Madagascar
T11e former Yugoslav
Republic of Macedonia
Mali
Mongolia
TG
TJ
TM
TR
n
UA
Togo
Tajikistan
Tmkmenistan
Turkey
gg g Tgo
Ukraine
BA
Bosnia and Herzegovina
GE
BB
BE
BF
BC
BJ
Badados
Belgiurn
Burkina Paso
Btdgaria
Benin
CH
GN
GR
HU
IE
Georgia
Ghana
Guinea
Greece
Hungary
Ireland
MI.
MN
BR
Brazil
IL
Israel
MR
Mauritania
UG
Uganda
BY
Belarus
CF
Central African Republic
IS
IT
JP
MM
Italy
Japan
W
MX
NE
Malawi
Mexico
Niger
US
UZ
VN
United States of America
Uzbekistan
Viet Nam
CH
Swinerland
KG
KE
Kenya
Kyrgyzstan
NO
Norway
Nedleriands
YU
CI
Cote d'Ivoire
Canteroon
China
KP
Democratic People's
Republic of Korea
Republic of Korea
Kazakaan
Saint Lucia
Liechtenstein
NZ
PL
PT
RO
RU
SD
New Zealand
Poland
Portugal
Romania
Russian Federation
Sudan
Sri Lanka
Ltberia
SE
Sweden
SG
Singapore
CZ
DE
Ngo
Czech Republic
Germany
KR
KZ
LC
LI
DK
M
LK
EE
Emania
LR
NL
ZW
Yugoslavia
Zimbabwe
APLNDC00026159
(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION 'I'
ATY (PCT)
(19) World Intellectual Pmpert Organization
(43) International Publication Date
(10) International Publication Number
23 February 2006 (23.02.2
WO 2006/020305 A2
(51) International Patent classuication:
Not classified
(21) International Application Number:
PCT/US mvv ou 7
(22) International Filing Date:
19 July 2005 (19.07.2005)
(25) Filing Language:
English
(26) Publication Language:
English
(30) Priority Data:
60/592,483
10/903,964
. 30 July 2004 (30.07.2004)
30 July 2004 (30.07.2004)
US
US
Califomia 94115 (US). CHRISTIE, Greg [US/US]; 1112
Kelly Drive. San Jose, Califomia 95129 (US). ORDING,
Bas [NUUSl; 1119 Dolores Street, #4, San Francisco, Califomia 94110 (US). KERR, Duncan, Robert [GB/US};
2600 18th Street, #15, San Francisco, Califomia 94110
(US). IVE, Jonathan, P. [GB/US]; 196 Twin Peaks Blvd,
San Francisco, Califomia 94114 (US).
(74) Agent: HOELLWARTH, Quin, C.; Beyer Weaver &
Thomas, LLP, P. O. BOX 70250, Oakland, California
. 94612-0250 (US).
(81) Designated States (unless otherwise indicated, for every
kind of nationalprotection available): AE, AG, AL, AM,
AT, AU, AZ, BA, BB, BG, BR, BW, BY, BZ, CA, CH, CN,
CO, CR, CU, CZ, DE, DK, DM, DZ, EC, EE, EG, ES, FI,
GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE,
KG, KM, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA,
MD, MG, MK, MN, MW, MX, MZ, NA, NG, NI, NO, NZ,
OM, PG, PH, PL, PT, RO, RU, SC, SD, SE, SG, SK, SL,
SM, SY, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC,
VN, YU, ZA, ZM, ZW.
(71) Applicant (for all designated States except US): APPLE
COMPUTER, INC. [US/US]; 1 Infinite Loop, Cupertino,
Califomia 95014 (US).
(72) Inventors; and
- (75) Inventors/Applicants (for US only): HOTELLING,
Steve [US/US); 1351 Hidden Mine Road, San Jose, California 95120 (US). STRICKON, Joshua, A. [USIUS];
333 Santana Row #212, San Jose, California 95128 (US).
HUPPI, Brian, Q. [US/US); 101#2 28th Street, San
F---^, California 94131 (US). CHAUDHRI, Imran
(US/US]; 2713 Sacramento Street, No. 3, San Francisco,
(84) Designated States (unless otherwise indicated, for every
kind of regional protection available): ARIPO (BW, GH,
GM, KE, LS, MW, MZ, NA, SD, SL, SZ, 12, UG, ZM,
ZW), Eurasian (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM),
[Continued on next page]
(54) Title: GESTURES FOR TOUCH SENSITIVE uvro a DEVICES
69
GUI
DISPLAY
a
58
68
GESTURE -->
,
r PROC SSOR '
'
MEMORY
GESTURAL
PROGRAM
88
80
I/O DEVICE
ouTPuT
(57) Abstract: Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading
data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the
multipoint sensing deviœ, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.
APLNDC00026160
WO 2006/020305 A2 lillllllllllllllllllllllllllllllllllllllllllllllllllllililillH
European (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI,
FR, GB, GR, HU, IE, IS, IT, LT, LU, LV, MC, NL, PL, PT,
RO, SE, SI, SK, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA,
GN, GQ, GW, ML, MR, NE, SN, TD, TG).
Published:
-
Fortwo-lettercodes and other abbreviations, referto the "Guidance Notes on Codes andAbbreviations"appearing at the beginning ofeach regular issue ofthe PCT Gazette
without intemational search report and to be republished
upon receipt of that report
APLNDC00026161
270
APLNDC00026162
© IFP, 1990
Force-to-Motion Functions for Pointing
Joseph D. Rutledge Ted Selker
IBM T.J.Watson Research Center, Yorktown N.Y. 10598
SELKER@ibm.com
A pointing device which can be operated from typing position avoids time loss and distraction. We
have built and investigated force-sensitive devices for this purpose. The critical link is the force-to.
motion mapping. We have found principles which enable a force joystick to match the function and
approach the performance of a mouse in pure pointing tasks, and to best it in mixed tasks, such as
editing. Examples take into account task, user strategy and perceptual-motor limitations.
I. INTRODUCFION
conventional rate joystick. The function relating
.
Various
kers over the past two decades have in·
force to velocity is critical to the performance of the
vestigated ar.d compared a variety of analogue dePointing Stick, and Icads to the principle results re
vices for use in computer interface pointing tasks
ported bere.
[1, 4]. The usual conclusion has been that the
The force joystick has a long history of investigation
mouse has the advantage over alternatives, and the
and use (2). It has been found that inting times
current commercial fashion seems to agree.
could be upccted to be perha¡is 20Ý•slowerthan for
We have been intrigued with the 1.5 (2]or so seconds
a mouse performing the same tasks. Another concem
required to stake an excursion from the kekard to .
is the "feel" - the subjective impression of exact conthe mŠÑaZittum;in applications which intelmix
trol of the cursor, and that its movementsire thà
pointing alit! ¼'ug, this can be significant. Also, the
atug esponse to actions,
mouse has other inherent disadvantages, especially in
Many people fuid pointing witËthe position of a
environments which provide restricted space or where
mouse natural. Can pointing with a rate joystick also
dangling wiresor loose bits of equipment are a hazfeci natural? The rate joystick appears to have an
ard.
immediate disadvantage here, since the most natural
ešisis that it is possible to point efficiendy
response to a hand motion (for manýýeople) is à
tiiÑ isoving the hands from the normal touch
... ..nf of proþõiiional magnitude'independent
typÑËme posÑÍnn. This requires locating the
of duration. An analogous discordance will be repointié device eitN ÏÑëe immediate vicinity of the
called by anyone who has takeit the controls of a lighi
J or F keys.ithe Íiidex fi
being rather clearly the
aircraft for the first time - the aircraft responds to a
finger of choice), or below the space bar, convenient
- control offset with a rate of change, not with a direct
to the annibs. We firsi investigated the use of the J
change. As la that case, we find that useršvery
or F keys themselves, to serve for both pointing and
quickly become accustomed to the rate modè of re.
t
. This rei¡nires that the user tell the éomputer
sponse, and find if naturaL .
wiilch usiis intended. A number of made switch
The less tangible aspect of "h:el" is the positive conpoidlilûtios are available, but after preliminary ci•
trol; here the force to motion funcdon à critical.
perimeiità gäiiicluded that the cognitive load of
Good "feel" seems to correlate, agi to a point, with
making the switch was serious, and shifted attention .
the more easily measured speed of pointing tasks, esto a miniatute joy-stick, located between the G and
- pecially with small targets.
H keys in "no-hands land" where it does not interfere
with normal
Ris paper reports the result of an investigation of a
subject of thetyping. This PODir!NG STICK is Me
studies reported here.
class of force-temotion ihnctions (transferfanetions)
and their effect on the speed of several experimental
T1ic constraints of Space in the keyboard eliminate
pointing tasks for our in-keyboard pointing device,
the kind of position-.to-position mapping used for the
the Pointing Stick.
mouse• bence an isometric or force joystick. We
could map force applied to the joystick to the velocity
1 TRANSFER FUNCTIONS
of the cursor, to its position, or perhaps to some
Our exploration of the space of transfer functions
combination. We report here on the first choice, the
began with three families of mathematically simple
APLNDC00026163
702
mappings of force to cursor velocity•1inear, para·
bolic, and a sigmoid parabolic, obtained by reflecting
the initial part of the parabola in the point 1/2,1/2
((v=f),(v=J2),and(v=2×ft,05|¾l/2;
v=2×(1/2-(1-fy,l/25fsi:v==1,f>l)).
Forcefand velocity v have scale factors (coefficients),
making each of these a 2-pararneter family of functions. From experience with these functions, we arrived at the foDowing conjectures'
l. A 'solid' feel, that a point can be heid, requires a
'dead band' near zero force, in which the cursor does
not move, even if the finger is not perfectly steady.
2. Pointing at small targets requires accurate control
of low speed motion - one pixel at a time must be
possible. This needs to be done without excess strain
in fine motor control, hence the slope of the function
at low speed should be low.
3. For long-distance cursor movements, high speed is
required. However, we found that when eye-tracking
became inaccurate, overall speed was reduced. A
high-speed dash off the screen, or to somewhere distant from the target, is counter-productive. In less
extreme form, one has the impression of playing golf - a long-distance, partially controlled 'drive', followed
by "now where is it•oh,there", then perhaps another, shorter shot, recovery, and finally a low-speed
'putt'. This suggests that a limitation of maximum
speed to the eye•trackinglimit Will be desira6te.
4. As a final touch, users like to feel that they can
make the cursor dash across the screen almost in-
stantly, and there may be occasions when one wants
'
to reach the opposite edge and start again from there.
To accommodate this, we add a steep rise near the
top of the force scale. This probably adds little if
anything to speed of performance, but it does no
damage, and seems to increase acceptance.
Of the simple functions, the sigmoid parabolic seems
the most promising, according to the conjectures.
This was borne out in informal experiments. However, its behavior near zero was less than 'solid'. The
addition of a 'dead slow' plateau suggmed itself,
following a true dead band. This gives no motion at
all for very low force, foÏlowed by a region of pre·
dictably slow motion somewhat independent of force,
then followed by a rapid but smooth acceleration.
Similarly, in the upper ran8e, We Would like to be
able to easily 'cruise' just below the eye-hand-track·
ing limit, without danger of exceeding it. An upper
plateau provides this, reached smoothly from the acceleration regime (Figure 1).
S
P
E
E
D
FORCE
Figure 1. Transfer Function 2Plateau
The ordinate of this graph is force, the abscissa is
cursor velocity, in percent of the corresponding scale
factors. The velocity scale factor (multiplier of v in
the above formulas) is 1500 pixels/second, or on our
screen, 66 cm/second. The force scale factor (multiplier off) was fixed for these experiments at a comfortable value of 225 grams; all sensitivity ,
adjustments were done with the velocity scale,
3. APPARATUS
The Pointing Stick, as used in these experiments, is a
steel rod of 2 mm diameter and 2 cm length, mounted
on an acrylic base. A section near the base has or.
thogonal flats to which miniature semiconductor
strain gages are bonded (Figure 2).
.'
J.
Figure 2. Pointing Stick
The base is glued on the sutskey surface of an IBM.
PS/2 keyboard, so that the stick protrudes approximately 4 mm above the surface of the keys in their
rest position, between the G and H keycaps, which
are relieved at their bases to allow space for it. The
top is rounded to provide a comfortable fingertip
grip. To provide mouse button signals, two micro- .
switches and operating buttons are mounted nearly
flush just below the space bar, convenient to the
thumbs.
The keyboard was placed about 6 cm from the edge
of the desk, allowing subjects to use it as a rest for the
heel of the hand. The keyboard retains its normal
function as the keyboard of a PS/2 Model 80 computer, whic.') presentee' and recorded the experiments.
AVAILABLE COPV
APLNDC00026164
Disclaimer: Justia Dockets & Filings provides public litigation records from the federal appellate and district courts. These filings and docket sheets should not be considered findings of fact or liability, nor do they necessarily reflect the view of Justia.
Why Is My Information Online?