Touchscreen Gestures LLC v. Samsung Electronics Co, Ltd; et al
Filing
1
COMPLAINT For Patent Infringement against All Defendants ( Filing fee $ 350 receipt number 0540-3537229.), filed by Touchscreen Gestures LLC. (Attachments: # 1 Civil Cover Sheet, # 2 Exhibit A, # 3 Exhibit B, # 4 Exhibit C, # 5 Exhibit D)(Huff, Winston)
EXHIBIT
C
111111
1111111111111111111111111111111111111111111111111111111111111
US007190356B2
United States Patent
(10)
Lin et al.
(12)
(45)
(54)
METHOD AND CONTROLLER FOR
IDENTIFYING DOUBLE TAP GESTURES
(75)
Inventors: Jao-Ching Lin, Hsin Chuang (TW);
Shyh-In Huang, Hsin Chuang (TW);
Lin-Abel Chu, Hsin Chuang (TW);
Chung-Yi Shen, Hsin Chuang (TW)
Patent No.:
US 7,190,356 B2
Date of Patent:
Mar. 13,2007
(56)
References Cited
U.S. PATENT DOCUMENTS
5,880,411
5,956,019
6,856,259
7,002,557
200210093491
2004/0178997
(73)
Assignee:
Sentelic Corporation,
Taipei (TW)
( *)
Notice:
Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.c. 154(b) by 554 days.
*
A
A
Bl
B2
Al
Al
*
*
*
*
*
*
Filed:
212006
7/2002
912004
Gillespie et al.
Bang et al.
Sharp
Iizuka et al.
Gillespie et al.
Gillespie et al.
178/18.01
345/173
34115
345/173
345/173
345/173
Primary Examiner-Ricardo
Osorio
ABSTRACT
Appl. No.: 101776,976
(22)
9/1999
212005
cited by examiner
(57)
(21)
3/1999
(65)
Prior Publication
US 2005/0179646 Al
(51)
(52)
(58)
A method of identifying double tap gesture, wherein the
double tap gesture is produced on a touch device and
characterize in that: when the summation of the first appearing time duration, the time span between the two appearing
time durations and the second appearing time duration is
smaller than the first reference time, then generate a first
signal that represents the first and second appearances. This
is to simulate the double tap signal output from the double
clicking of the mouse button and so as to achieve a short,
simple and reliable determination.
Feb. 12, 2004
Data
Aug. 18, 2005
Int. Cl.
G09G 5/00
(2006.01)
U.S. Cl.
345/173; 3451156
Field of Classification Search
3451156,
3451157,173-177;
178118.01-18.09
See application file for complete search history.
down
Input
Output
up
up
\.
T down 1 ~.Tupl
r
21 Claims, 4 Drawing Sheets
Mdown2
.1· T
down2
~\
~l
TU!l2
(t
down
52
u.s. Patent
Mar. 13, 2007
Sheet 1 of 4
FIG 1
US 7,190,356 B2
u.s.
Patent
Mar. 13,2007
Sheet 2 of 4
US 7,190,356 B2
Main unit
Transmitter interface
><
o
-
u..
u.s. Patent
Mar. 13,2007
r
down
Input
up
\.
T downl
~,rupl
US 7,190,356 B2
Sheet 3 of 4
Mdown2
.1. r
~
down2
.\
Tun2
51
Output
n
up
down
FIG 3
52
u.s. Patent
Mar. 13,2007
US 7,190,356 B2
Sheet 4 of 4
FIG 4
A
counted time has reached Tl
,---------
First appearance
/ 42
end has been rietccted
......or counted time nas'"
'
• reached T 1?
f'"
appeanmce ends
».
Second appearance /44
COUn,...ltC_d_l_im_e_h3S_rC_3_C_hC_d_T_I_start
has been derecte~
or counted time has
'reached Tl i
~cond
appearance starts
45
No
46
No
»:
/47
Mdown2GMl
counted time has reached T 1 or Second appearance
eno has been detected or
or Mdown2 ~ M 1
counted time has
reached Tl?
I
second appearance ends
48
No
49
No
43
Determine if it is
any
other gesture
___
....__ i_e_s
Y __
Generates drag signal
/
50
US 7,190,356 B2
1
2
METHOD AND CONTROLLER FOR
IDENTIFYING DOUBLE TAP GESTURES
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a method and controller
for identifying double tap gestures, especially referring to a
method and controller for identifying double tap gestures on
touch device. When the touch device identifies the double
tap gesture, simulate a double tap signal that represent a
series of consecutive double clicking of the mouse button
(usually the default is the left button).
2. Brief Description of Related Art
Graphical User Interface, GUI, accompanying by the
pointing device (such as a mouse) was the first program
operation interface released by the PARC research group.
The user can easily accomplish the executed action by just
using the visual type of pointer through the movement and
clicking of the mouse, this solves the inconvenience created
by the input of complex instruction during the text mode.
Therefore, GUI is commonly used by Apple computers and
Microsoft and it becomes a mainstream interface of all the
operating systems. In the electronic devices that utilize GUI,
such as desktop computer, portable computer, tablets, personal digital assistant and so on, pointing device has become
a basic accessory.
Currently, the pointing device includes external mouse,
track-ball and touch pad built-in on the portable computers,
the touch panel incorporated with the monitor and so on. The
mouse is the pointing device that is released the earliest.
Using the mouse as an example to illustrate the functionality
of the pointing device, the mouse is able to control the
pointer on the monitor screen, which means that the pointer
will follow to anywhere the mouse moves to and when
clicking of the control button is performed at the to be
executed target on the monitor, then the instruction will be
executed to the electronic device. However, the current trend
of the electronic equipment is heading towards small and
light, for example, the portable computers are gradually
replacing the export of the desktop computers and this
results the small-sized touch device (e.g. touch pad) to be
slowly become the mainstream of pointing device.
Presently, the touch device technology includes capacitor
type, resistive type, magnetic type, pressure type, inductance
type, surface sonar type, supersonic type, and optical type
and so on. When an object such as a finger moves on the
touch device, it can control the pointer to move in the
direction of the movement of the object. Moreover, the
pointing device besides controlling the pointer, it also has
the function to execute instruction. Using the mouse as an
example, when the pointer moves over the target (e.g.
program, document) to be started, double clicking the mouse
button (default to be left button in most system) will select
the target and opens it. However, for touch device such as
touch pad, currently two control buttons have been installed
below to replace the left and right buttons of the mouse or
by defining certain gesture on the touch device to generate
signal corresponding to the simulated double clicking.
Currently, the touch device opens the selected target by
tapping the touch device consecutively twice gesture
(known as double tap gesture in the following text), which
replaces the double clicking action of the mouse. Thus, a
conventional method of identifying double tap gesture is
described in u.s. Pat. No. 6,414,671. Referring to FIG. 1
(corresponding to FIG. 15F in u.s. Pat. No. 6,414,671
specification), first of all, compare the first appearing time
10
15
20
25
30
35
40
duration t19 of the object on the touch device (refers to the
time of stay of the object first appeared on the touch device)
with the first reference time, if the first appearing time
duration t19 is smaller than the first reference time value,
then produce a first signal 11; after that, if second appearance is not detected within the time of the second reference
time, terminates the first signal, in other words, the time span
between the two appearing time duration t20 has to be
smaller than the second reference time value; next, compare
the second appearing time duration t2l with the third reference time value, if the second appearing time duration t2l is
shorter than the third reference time value, then terminates
the first signal and produce a second signal 12, therefore it
can output two signals 11 and 12 to simulate the signal of
double clicking of the mouse button.
Even though the conventional method can achieve the
objective of identifying the double tap gesture, however in
the conventional method, it makes the determination to be
more complex by comparing the first appearing time duration t19, time span between two appearing time duration t20,
and the second appearing time duration t21 with the respective reference time values. Additionally, since the user
differs from one another, therefore, when each person perform the double tap gesture on the touch device will have
different length of time in each step of the action or even for
the same user to perform the every double tap gesture on the
touch device will vary in time for each action, thus resulting
in the situation where a misinterpretation has occurred. Also,
during the operation of the touch device, it can be easily
touched by mistake, or due to the noise of the touch device
itself, or interference by the noise from the surrounding
environment will all produce short spike of the first and
second appearance phenomenon. The conventional method
does not have minimum time restriction on the first and
second appearing time duration and the time span between
the two appearing time durations; therefore, the interference
signal produced due to noise will cause inappropriate determination and easily allow the situation of misinterpretation
to happen. Moreover, as the tap and drag gesture also taps on
the touch device twice where during the drag of the second
tap, the conventional method did not take into the consideration of the accumulated displacement of the second
appearing duration, it will easily cause the misinterpretation
of the double tap gesture with the tap and drag gesture.
45
SUMMARY OF INVENTION
50
55
60
65
A main objective according to the present invention is to
provide a method and controller for identifying double tap
gesture, utilizing the comparison of the total time duration
for each action with the first reference time value in order to
achieve a faster and more reliable determination.
Another objective of the present invention is to provide a
method and controller for identifying double tap gesture,
wherein the time duration of each respective action has to be
larger than the corresponding pair of reference values so as
to effectively avoid the situation where a misinterpretation
might occur due to noise signal.
A further objective of the present invention is to provide
a method and controller for identifying double tap gesture,
wherein the displacement detected during the second occurrence has to be smaller than the corresponding reference
value so to achieve an accurate determination.
The method of identifying double tap gesture according to
the present invention, wherein the double tap gesture is
performed on a touch pad and the method includes the
following steps:
US 7,190,356 B2
3
i. detecting the first occurrence of an object on the touch
pad;
ii. detecting the second occurrence of the particular object
on the touch pad; and
iii a first signal representing the first and second appearance being immediately generated in case of the summation of the first appearing time duration, the second
appearing time duration and the time span between the
end of first appearing time duration and the start of the
second appearing time duration is smaller than first
reference time value.
4
27 in the preferred embodiment of present invention are all
included in a controller such as a chip.
The gesture unit 26 receives the calculation results Dx and
Dy from the displacement unit 25 to determine if the object
has produced an action qualified as a double tap gesture on
the touch pad 21 and also during this determination whether
the action is a double tap gesture, correspondingly transmits
out the first signal of the simulated double clicking through
the transmitter interface to the host 3 in order to carry out the
control. The characteristic technique of the
10 corresponding
present invention is the method of identifying double tap
gesture in the gesture unit 26. The gesture unit 26 can
achieve the method of identifying double tap gesture
BRIEF DESCRIPTION OF THE DRAWINGS
through software, firmware or hardware. Moreover, even
The present invention can be more fully understood by 15 though the gesture unit 26 in the example of the present
invention is embedded in the controller of the touch device
reference to the following description and accompanying
2, it can be installed in the host 3 as a software or hardware
drawings, in which:
and not just limited to technique used in the preferred
FIG. 1 is a diagram illustrating time pulse of conventional
embodiment of the present invention.
double tap gesture;
20
Besides, even though a capacity type touch device 2 is
FIG. 2 is a block diagram illustrating touch device of a
used as an example in the preferred embodiment of the
preferred embodiment in a method associated with the
present invention, persons with knowledge of this convecpresent invention for identifying double tap gesture;
tional art should know that the present invention can be
FIG. 3 is diagram illustrating time impulse of an input and
applied onto other types of touch device, such as optical
an output signal shown in FIG. 2; and
25 type, resistive type, magnetic type, pressure type, inductance
FIG. 4 is a flow chart of the embodiment shown in FIG.
type, surface sonar type, supersonic type and so on. There2.
fore, it is not confined to just what is illustrated in the
preferred embodiment of the present invention.
DETAILED DESCRIPTION OF THE
Referring to FIG. 3 and FIG. 4, they illustrate the flow
PREFERRED EMBODIMENTS
30 chart of an example in the preferred embodiment of the
present invention. In the example, first assume that an object
First and foremost, the method and controller for identisuch as a finger 10 has simultaneously tapped on the touch
fying double tap gesture according to the present invention
pad 21 twice. To simplify the explanation, in the following
is to be applied on a touch device. To simplify the explaparagraphs, the object will be represented by the finger 10.
nation, a capacity type touch device will be selected for 35 Something worth noting is that even though a finger is used
illustrating the preferred embodiment of the present invento illustrate the preferred embodiment of the present invention.
tion, persons familiar with the conventional art should know
Referring to FIG. 2, a capacity type touch device 2
that the touch device 2 of the preferred embodiment is
includes at least one touch pad 21, one treat unit along X
suitable for detecting other types of conductive objects or
direction 22, one treat unit along Y direction 23, one 40 multiple conductive objects, which is not confined to what
operational unit 24, one displacement unit 25, one gesture
is revealed in the preferred embodiment of the present
unit 26 and a transmitter interface 27. The touch pad 21 has
invention.
multiple wires distributed in the X and Y direction respecFirst of all, in step 41, the touch device 2 detects the finger
tively, for example 16 wires in the X direction and 12 wires
10 on the touch pad 21 at the start of its first appearance.
in the Y direction. Therefore, when a conductive object such 45 When the touch device 2 detects the first appearing time
as a finger 10 touches and in close contact with the touch pad
duration, gesture unit 26 will start timer immediately.
21, it will cause a change in the capacitance on the touch pad
Subsequently, in step 42, it is to be determined which of
21. The X and Y direction treat units will immediately
the two conditions: the ending of the first appearing time
process the respective capacitance on the X and Y direction
duration or the timer after the first appearing time duration
and transmit the data to operational unit 24. The operational 50 has reached the first reference time T u has been achieved
unit 24 based on the received data will compute the X and
first. In the present example, assume that within the first
Y coordinates of the object contact location. After that, the
reference time T u the second tap of the double tap gesture
displacement unit 25 will receive the X and Y coordinates
should be able to be detected. The range of the first reference
computed by the operational unit 24 and based on this
time T 1 in the present example is between 100 ms and 1000
information calculate the relative displacement Dx and Dy 55 ms (100 ms T22),
a requirement that the time duration of each action must be
it implies that the second appearance has truly finished and
larger than the respective minimum time value, in order to 30 step 49 will be continued. However, if step 48 determines
effectively filter out inappropriate signals and thus enhance
that the time span after the second appearing time duration
the accuracy of the identification.
T up2 is not larger than the second minimum UP reference
time T22 (Tup1~T22)'
it implies that the UP during the time
In step 45, first determine if the time span T up1 between
span after the second appearing time is noise signal and thus
the first appearing time duration T 1 and the second appearing
time duration T2 is larger than the first minimum UP refer- 35 will be discarded and jump back to step 47 to resume waiting
for the real UP signal which indicates the finish of the second
ence time T21' The first minimum UP reference time T21 is
appearing time duration. In the present example, the second
the shortest effective time between the UP and DOWN of the
minimum UP reference time T22 can be set to be the same
finger 10. The first time span Tup1 is the time between the
as the first minimum UP reference time T21'
tapping of the finger 10 on the touch pad 21 followed by
leaving the touch pad 21 and until the second tapping of the 40
In step 49, determines if the second appearing time
finger 10 on the touch pad 21. In the present example, the
duration Tdown2 is larger than the second minimum tap
first minimum UP reference time T21ranges from 1 ms to 10
reference time T32' If step 49 determines the second appearms (1 ms~T 21~ 10 ms) and it can be adjusted according to
ing time duration T down2 is larger than the second minimum
the need of the designer or the operating preference of the
tap reference time T32 (T down2> T32)' thus it indicates the
user. If step 45 determines the first time span Tup1 to be 45 signal of the second appearance is a valid signal. Then, as the
larger than the first minimum UP reference time T21
summation of the first appearing time duration Tdown1' time
(Tup1> T21), it represents that the signal of the first time span
span between the two appearing time duration Tup1 and the
Tup1 is valid and thus it will continue to step 46. If step 45
second appearing time duration T down2 is smaller than the
determines that the first time span Tup1 is not larger than the
first reference time T1 [(Tdown1+Tdown2+Tup1)T31), it indicates
that the first appearance is a valid signal and step 47 will be 65 Referring to FIG. 3, the signal 51 and 52 in the present
continued. However, if step 46 determines the condition to
example will only be sent together after the detection of the
second appearance and the double tap gesture is confirmed.
be false (T down 1~ T31), which implies that the first appear-
US 7,190,356 B2
7
8
It differs from the convectional method of identifying where
the first signal is produced immediately after the first tap.
If in step 47, it is determined first that the accumulated
displacement of the second appearing time duration Mdown2
is not less than the reference
displacement
M,
(Mdown2~Ml)'
it implies that when the finger 10 taps on the
touch pad 21 for the second time has not move and thus it
could be a tap and drop gesture instead of double tap gesture
so it will jump back to step 43 to determine if it is any other
gestures. Thus, it will effectively reduce or avoid the chance
that the tap and drop gesture is determined as the double tap
gesture. The range of the reference displacement M, in the
present example can vary between 1 pixel and 10 pixel (1
pixel s M, ~ 10 pixel), such as 3 pixel or it can be adjusted
according to the need of the designer or the operating
preference of the user.
Similarly, if in step 47, it is determined first that the timer
since the first appearance has already reached the first
reference time T1, it implies that the summation of the first
appearing time duration Tdownl' time span between the two
appearing time duration Tup1 and the second appearing time
duration T down2 is not smaller than the first reference time T 1
[(Tdownl+Tdown2+Tupl)~Tll,
thus the two appearances are
not double tap gesture and will jump to step 43 instead to
determine if it is of any other gestures.
Summarising the previous claims, the requirement for the
double tap gesture in the preferred embodiment of the
present invention is defined by the following equations:
the tap and drop gesture as the double tap gesture, and
further achieve a more accurate determination.
While the invention has been described with reference to
the a preferred embodiment thereof, it is to be understood
that modifications or variations may be easily made without
departing from the spirit of this invention, which is defined
by the appended claims.
What is claimed is:
1. A method of identifying double tap gesture with which
the double tap gesture is performed on a touch device,
comprising follow steps:
i. Detecting a first appearance of an object on the touch
device;
ii. Detecting a second appearance of the object on the
touch device; and
iii. generating a first signal that represents the first and
second appearances in case of the summation of a first
appearing time duration, a second appearing time duration and a time span between the two appearing time
durations being smaller than a first reference time.
2. The method of identifying double tap gesture as defined
in claim 1, wherein the first signal is generated when the
accumulated displacement of the second appearing duration
is smaller than the reference displacement value.
3. The method of identifying double tap gesture as defined
in claim 1, wherein the first signal is generated when the first
appearing time duration is larger than the first minimum tap
reference time value.
4. The method of identifying double tap gesture as defined
in claim 1, wherein the first signal is generated if the second
appearing time duration is larger than the second minimum
tap reference time value.
5. The method of identifying double tap gesture as defined
in claim 1, wherein the first signal is generated when the
time span between the ending of the first appearing time
duration and the start of the second appearing time duration
is larger than the first minimum UP reference time value.
6. The method of identifying double tap gesture as defined
in claim 1, 2, 3, 4, or 5 wherein the first signal will be
generated when there is no detection of a new appearance
within the time after the ending of the second appearance
that is at least larger than the second minimum UP reference
time value.
7. The method of identifying double tap gesture as defined
in claim 1, wherein the first signal is transmitted to a host.
S. A controller of the touch device, with which it is used
to identify gesture of an object on the touch device, the
controller comprising:
an operational unit, being used to detect every appearance
of the object on the touch device and accordingly
producing a respective tap signal, the respective tap
signal being generated corresponding to the start of the
appearance on the touch device and being terminated
when that appearance finishes; and
a gesture unit, being connected to the operational unit so
as to receive the tap signal, calculating the time duration of the object appearing on the touch device based
on the tap signal and identifying movement of the
object;
wherein, the gesture unit receives from the operating unit
the generated first tap signal and the second tap signal
corresponding to the first and second appearance of the
object on the touch device respective; the gesture unit
also computes the summation of the first appearing
time duration, the second appearing time duration and
then time span between the two appearing time durations and compares this result with the first reference
Tdownl>T31
Eq.l
Tdown2>T32
Eq.4
(Tdownl+Tdown2+Tupl)T22
15
Eq. 2
Tup1>T21
10
Eq.6
30
35
40
It should be noted that even the previous mentioned steps
42, 44 and 47 can simultaneously determine multiple conditions. The person familiar with the convectional arts
should know that the previous mentioned steps 42, 44 and 47
can also determine the conditions sequentially, so it is not
just limited to what has been revealed in the preferred
embodiment of the present invention.
It is appreciated that the present invention is different
from the convectional method with which the time of each
respective step is determined by way of if it is smaller than
the respective reference time value and the method of
identifying double tap gesture according to the present
invention sums up the overall time duration of each action,
Tdownl' Tdown2 and Tup1 and determine if it is not smaller
than the first reference time T. (refer to Eq. 5) so as to
achieve a short, effective and reliable determination. Moreover, the present invention further requires that the time
duration of each action has to be larger than their respective
reference values T31 (refer to Eq. 1), T 21 (refer to Eq. 2) and
T 22 (refer to Eq. 4) so as to effectively filter out the
inappropriate signals generated due to disturbance and thus
achieve a more accurate determination. In addition, the
present invention also requires that the accumulated displacement of the second appearing time duration Mdown2 has
to be smaller than reference displacement M, (refer to Eq.
6), this will differentiate the double tap gesture from the tap
and drop gesture and effectively avoid the misjudgement of
45
50
55
60
65
US 7,190,356 B2
9
10
time; and if the sum is smaller than the first reference
time value, then produce the first signal that presents
the first and second appearance.
9. The controller of identifying double tap gesture as
defined in claim 8, wherein the tap signal generated by the
operational unit includes the amount of displacement on the
touch device.
10. The controller of identifying double tap gesture as
defined in claim 9, wherein the first signal will be generated
by the gesture unit when the accumulated displacement of
the second appearing time duration computed by the gesture
unit is smaller than the reference displacement value.
11. The controller of identifying double tap gesture as
defined in claim 8, wherein the first signal will be generated
by the gesture unit only when the first appearing time
duration is larger than the first minimum tap reference time
value.
12. The controller of identifying double tap gesture as
defined in claim 8, wherein the first signal will be generated
by the gesture unit when the second appearing time duration
is larger than the second minimum tap reference time value.
13. The controller of identifying double tap gesture as
defined in claim 8, wherein the first signal will be generated
by the gesture unit when the time span between finish of the
first appearing time duration and the start of the second time
duration is larger than the first minimum UP reference time
value.
14. The controller of identifying double tap gesture as
defined in claim 8, 10, 11, 12 or 13 wherein the first signal
will be generated by the gesture unit when there is no
detection of a new appearance within the time after the
ending of the second appearance that is at least larger than
the second minimum UP reference time value.
15. The controller of identifying double tap gesture as
defined in claim 8, wherein the controller further includes a
transmitter interface that is connected to the gesture unit and
transmit the first signal to a host.
16. A gesture unit of the touch device, which is used to
identify movement of an object on the touch device, wherein
the gesture unit receives from the operating unit the generated first tap signal and the second tap signal corresponding
to the first and second appearance of the object on the touch
device respective, the gesture unit also computes the summation of the first appearing time duration, the second
appearing time duration and then time span between the two
appearing time durations and compares this result with the
first reference time; and if the sum is smaller than the first
reference time value, the first signal that presents the first
and second appearance is produced.
17. The gesture unit as defined in claim 16, wherein the
first signal is generated when the accumulated displacement
of the second appearing time duration is smaller than the
reference displacement value.
18. The gesture unit as defined in claim 16, wherein the
first signal is generated when the first appearing time duration is larger than the first minimum tap reference time
value.
19. The gesture unit as defined in claim 16, wherein the
first signal is generated when the second appearing time
duration is larger than the second minimum tap reference
time value.
20. The gesture unit as defined in claim 16, wherein the
first signal is generated when the time span between the
finish of the first appearing time duration and the start of the
second appearing time duration is larger than the first
minimum UP reference time value.
21. The gesture unit as defined in claim 16, 17, 18, 19 or
20 wherein the first signal is generated when there is no
detection of a new appearance within the time after the
ending of the second appearance that is at least larger than
the second minimum UP reference time value.
10
15
20
25
30
35
* * * * *
Disclaimer: Justia Dockets & Filings provides public litigation records from the federal appellate and district courts. These filings and docket sheets should not be considered findings of fact or liability, nor do they necessarily reflect the view of Justia.
Why Is My Information Online?