SmartPhone Technologies LLC v. Amazon.Com, Inc., et al

Filing 1

COMPLAINT against Amazon Digital Services, Inc., Amazon.Com, Inc., ( Filing fee $ 350 receipt number 0540-3263866.), filed by SmartPhone Technologies LLC. (Attachments: # 1 Exhibit A - US 6,950,645 BI, # 2 Exhibit B - US 7,506,064 Bl, # 3 Exhibit C - US RE40,459 E, # 4 Exhibit D - US 6,956,562 BI, # 5 Exhibit E - US 6,466,236 BI, # 6 Civil Cover Sheet)(Ward, Thomas)

Exhibit “D”

111111

1111111111111111111111111111111111111111111111111111111111111
US006956562Bl

United States Patent

(10)

O'Hara et ai.

(12)

(45)

(54)

METHOD FOR CONTROLLING A
HANDHELD COMPUTER BY ENTERING
COMMANDS ONTO A DISPLAYED
FEATURE OF THE HANDHELD COMPUTER

(75)

Inventors: Sean O'Hara, Foster City, CA (US);
Gary Responte, Fremont, CA (US);
Lauren Vtigard, Pleasanton, CA (US);
Joe Tate, San Jose, CA (US)

(73)

Assignee: Palm Source, Inc., Sunnyvale, CA (US)

( *)

Notice:

5,805,474
5,815,165
5,838,337
6,011,546
6,097,374
6,226,739
6,337,681
6,388,877
6,459,442
6,462,760
6,476,834
6,496,284

Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.c. 154(b) by 0 days.

(21)

Appl. No.: 09/574,720

(22)

Filed:

(60)

Provisional application No. 60/204,876, filed on May 16,
2000.

(51)
(52)
(58)

Int. CI? .............................. G09G 5/00; G06F 3/00
U.S. CI. ........................ 345/173; 345/173; 715/864
Field of Search ................................. 345/173, 506,
345/526, 502, 178, 156, 157, 158, 863,
179, 519, 507, 524, 864; 365/230.05; 364/708.1;
3611683, 686; 312/223.2; 715/864

May 18, 2000
Related U.S. Application Data

References Cited

(56)

U.S. PATENT DOCUMENTS
5,528,743 A

Patent No.:
US 6,956,562 BI
Date of Patent:
Oct. 18, 2005

A
A
A
A
A
B1
B1
B1
B1
B1
B1
B1

9/1998
9/1998
11/1998
1/2000
8/2000
5/2001
1/2002
5/2002
10/2002
10/2002
11/2002
12/2002

Danielson et al. .......... 361/683
Blixt .......................... 345/506
Kimura et al. .............. 345/505
Bertram ...................... 345/700
Howard ...................... 345/168
Eagle ............................ 713/1
Martin .................... 178/18.03
Canova et al. ........... 312/223.2
Edwards et al. ............ 345/863
Cox et al. ................... 345/835
Doval et al. ................ 345/863
Dow et al. .................. 358/473

* cited by examiner
Primary Examiner-Alexander Eisen
ABSTRACT

(57)

A method for software control using a user-interactive
display screen feature is disclosed that reduces stylus or
other manipulations necessary to invoke software functionality from the display screen. According to the method, a
graphical feature having a surface area is displayed on a
touch-sensitive screen. The touch-sensitive screen is
coupled to at least one processor and the graphical feature is
generated by an operating system and uniquely associated
with a particular software program by the operating system.
To control software executing on the processor, a usersupplied writing on the surface area is received and the
software is controlled responsive to the writing. In alternate
embodiments, the method further controls data stored in a
memory device responsive to the writing or further controls
transmission of data from a radiation emitter, which may be
coupled to voice and data networks.

* 6/1996 Tou et al. ................... 715/541

66 Claims, 4 Drawing Sheets

420

410

A)

*
*
*
*
*
*
*
*
*
*
*
*

0

Application
420

B)
430

420

C)
430

420

0)
430

u.s. Patent

Oct. 18, 2005

US 6,956,562 BI

Sheet 1 of 4

135

130

Palm V
Oct 19: 19

[

-4 I s IM"wi T I F I s I ~

•........Q4... ~~J.~.~.~g~.r~~.Q~.~........... _
~~gg ~r.~.~~~~.~.~!.~9......................... _

..

[~ ~~gg:::::g9.D.f.~i.~:6:~~:~~H~~N~~:YQf.~
...................... _-_ ...... -........................................... _-

[ ~~gg. . 9H.~.~tpr.~~~.~.~t~9.D. ................ _ .
[ ~~gg::::$.t~f(fu~:~~(6.g:::::::::::::::::::::::::::::~
..... -_ ................................................................. _...

~

(New] ( Details] ( Goto]

~
~

(I)
110

e.

.G

~©o

o

Pig. 1

120

-

[ ~~gg . . PtDD.~f..@..Aq~.~.y~!..~~~~~... -_
..........................................................................

I----t"""

u.s. Patent

Oct. 18, 2005

US 6,956,562 BI

Sheet 2 of 4

Palm Ille
~

4:45pm

®

Address
220-~-

225----r--

~

®
Calc

fJ

Graffitti

~
~

Memo Pad

Note Pad

Security

To Do List

o

(.)
210

.~._ _.&--_~

Pig. 2

All

u.s. Patent

US 6,956,562 BI

Sheet 3 of 4

Oct. 18, 2005

~310

~

r---------~---------,

320~
I
I
I

320

:
I
I
I

370

BOOT DIS
DISPLAY

SCREEN

ICON

I

I

~---------

----------

INPUT
345

30

370

360

SCREEN

399

Pig. 3

U.S. Patent

US 6,956,562 BI

Sheet 4 of 4

Oct. 18, 2005

420

410

A)

o

Application
420

B)
430

420

C)

420

D)
430

Pig. 4

US 6,956,562 Bl
1

2

METHOD FOR CONTROLLING A
HANDHELD COMPUTER BY ENTERING
COMMANDS ONTO A DISPLAYED
FEATURE OF THE HANDHELD COMPUTER

mencement and cessation, logical decisions, and graphical
presentation are non-limiting examples of control that may
be accomplished by the method.
5

CROSS-REFERENCE TO RELATED
APPLICATION
This application claims priority to U.S. provisional application Ser. No. 60/204,876 filed May 16, 2000 entitled
"METHOD FOR SOFTWARE CONTROL USING A
USER-INTERACTIVE COMPUTER ICON" which is fully
incorporated herein by reference.
FIELD OF THE INVENTION

10

DESCRIPTION OF RELATED ART
20

25

30

35

40

45

SUMMARY OF THE INVENTION
This invention is a method for software control using a
user-interactive display screen feature. According to the
method, a graphical feature having a surface area is displayed on a touch-sensitive screen. The touch-sensitive
screen is coupled to at least one processor and the graphical
feature is generated by an operating system and uniquely
associated with a particular software program by the operating system. To control software executing on the
processor, a user-supplied writing on the surface area is
received and the software is controlled responsive to the
writing. In alternate embodiments, the method further controls data stored in a memory device responsive to the
writing or further controls transmission of data from a
radiation emitter, which may be coupled to voice and data
networks.
In one embodiment, the writing is a sequence of impulses
applied to the touch-sensitive screen. In other embodiments,
the writing comprises at least one character of an alphabet or
simple shapes such as circles or polygons. Software com-

FIG. 1 illustrates a hand-held computer.
FIG. 2 illustrates one embodiment of a display.
FIG. 3 shows a flow chart of one embodiment of the
method.
FIGS. 4A-4D illustrate an embodiment of a userinteractive feature and exemplary writings.
DETAILED DESCRIPTION

15

This invention relates to handheld computers in general
and to iconography for hand-held computers in particular.

Engineering hand-held computers poses special problems
in comparison to desk-top or lap-top computer design. One
problem relates to combining device functionality and convenience with an inherently small display size. In contrast to
desk top or lap top computers having displays comparable in
size with a standard sheet of paper, a hand-held computer
inherently has a display about the size of the palm of a
human hand. Since the display space is limited to be
considerably smaller than that of other computers, the
amount of surface area allocated to graphical features providing functional control is a design consideration.
Typically, a hand-held computer user selects a menu icon
on a display screen with a stylus and opens a menu of control
options that occupies an area of the display screen. Then, the
user must drag the stylus to a subsequent selection within the
menu display or otherwise proceed through an array of
displayed choices by manipulating the stylus or keys or
buttons on the computer's face. Often, the user must pass
through several levels of choices and perform attendant
manipulations to arrive at the desired functionality. This is
needlessly complicated and frustrating to the user. Related
methods using a dedicated writing, or "graffiti," area of a
touch sensitive screen are an improvement. However, by
having a dedicated area for general writing input, an association of the writing input to particular aspects of software
is not immediate.

BRIEF DESCRIPTION OF THE DRAWINGS

50

55

60

65

FIG. 1 illustrates a hand-held computer 100 for use with
an embodiment of this invention. In FIG. 1, housing 110,
touch-sensitive screen 120, radiation emitter 130 and network 135 are shown. At least one processor and storage
memory device are within the housing and not shown.
Examples of handheld computers include PALM IIITM,
PALM VTM and PALM VIITM organizers, manufactured by
PALM, Inc. Other examples include devices operating a
Windows CETM or pocket windows™ operating system.
Still further, handheld computers may include cell-phones
and other network-enabled devices.
The characteristics of suitable touch-sensitive screens,
radiation emitters, processors and storage memory devices
are well known in the art. In different embodiments, the
radiation emitter may be an optical radiation emitter, or a
radio frequency radiation emitter, or a microwave radiation
emitter. In a preferred embodiment, the storage memory
device is a non-volatile memory device. A volatile memory
device may also be provided.
Network 135 may be digital or analog, or a voice network
such as a cellular phone network or a data network such as
the Internet. Alternate networks include local area and wide
area networks. From FIG. 1, a user may interact with
hand-held computer 100 through touch-sensitive screen 120.
Radiation emitter 130 couples the computer to network 135.
Embodiments of the computer may also include a radiation
receiver (not shown) for two-way communication with the
network. Suitable radiation receivers are also well known.
FIG. 2 illustrates one embodiment of a display for handheld computer 100. In FIG. 2, touch-sensitive screen 120,
writing area 210, user-interactive feature 220 and feature
surface area 225 are shown. For the embodiment in FIG. 2,
the location of the writing area is fixed on the screen and is
a general input area, not associated with particular software
by the computer operating system. The writing area may be
a Graffitti™ input feature, such as used by handheld computers using a PALM operating system.
In an embodiment, the user-interactive feature 220 is
programmatically controlled to appear at any particular
location of the screen by an operating system. The userinteractive feature may also be associated with a particular
software program by the operating system. An example of a
user-interactive feature is an icon. Other examples are
menus and check fields. The user-interactive feature may be
state-selecting, so as to select, for example, between unactuated and actuated states.
FIG. 3 shows a flow chart of one embodiment of the
invention. In FIG. 3, user-inputs 345 control software
including software application program 350. The software
application may be in two-way communication with hardware units such as touch-sensitive screen 370, memory 385
and radiation transmitter 390. The transmitter is in commu-

US 6,956,562 Bl

3

4

nication with network 395. As is obvious to one skilled in the
single stylus tap commences or launches the software application associated with the user-interactive feature and a
art, a computer system may consist of other hardware and
software in addition to, or instead of, that shown in FIG. 3
double tap presents other options for the application on
without departing from the invention.
display 370 (see FIG. 3). In FIG. 4B, writing an "x" over the
In FIG. 3, a system starts at block 310 by displaying a 5 user-interactive feature deletes the application from memory
380 (see FIG. 3). In FIG. 4C, writing a "b" over the
user-interface. The user-interface includes a graphical useruser-interactive feature transmits, or beams, the application
interactive feature such as an icon on screen 370 (see block
from radiation emitter 390. In FIG. 4D, writing an "0" over
330). According to the invention, the graphical userthe user-interactive feature presents other options for the
interactive feature is generated by the operating system and
uniquely associated with a particular software application 10 application on display 370.
program 350 by the operating system.
The foregoing description of various embodiments of the
invention has been presented for purposes of illustration and
User input 345 from the interactive feature may open or
description. It is not intended to limit the invention to the
reconfigure the software application associated with the
precise forms disclosed. Many modifications and equivalent
user-interactive feature at block 340. User input may also
control logical decisions within the software application at 15 arrangements will be apparent.
What is claimed is:
block 360 or cause cessation of the software application at
1. A method for software control, comprising:
block 399.
displaying a graphic representing a set of one or more
Interaction between the user and the graphical feature or
computer functions on a portion of a touch-sensitive
icon displayed on the touch-sensitive screen includes writing
screen, wherein the touch-sensitive screen is coupled to
on a surface area of the feature. Writing includes a sequence 20
at least one processor to detect and interpret contact
of impulses, or taps, applied to an area that is less than or
with the screen;
equal to the surface area of the graphical feature. According
to the invention, writing also includes characters of an
detecting an object making a first sequence of one or more
alphabet or numbers or simple shapes such as circles or
contacts that form a first drawing on the portion of the
polygons. Combinations of all of the foregoing types of 25
screen;
writing are also possible.
in response to detecting the object making the first
sequence of one or more contacts that form the first
In an embodiment, the writing is momentarily apparent on
the display, before the user input is acted on by handheld
drawing:
computer 100. Preferably, the writing on the icon causes an 30
matching the first sequence to a particular action in a set
action that is different than activating the icon. For example,
of actions, and performing the particular action;
the icon may be activated through a single-tap, applied to a
detecting an object making a second sequence of one or
region of screen 370 where the icon is being displayed. In
more contacts to form a second drawing on the portion
contrast, the writing is a gesture applied on the region of the
of the screen;
screen 370 that is not a single-tap.
in response to detecting the object making the second
35
Logical decisions determined at least in part by input from
sequence of one or more contacts to form the second
the graphical user-interactive feature may determine input/
drawing:
output communication with hardware devices such as touchmatching the second sequence to a second action in a
sensitive screen 370, memory 380 and radiation emitter 390.
set of actions related
In this embodiment, the input/output communication with 40
to said one or more computer functions, and
the screen, including the writing on the user-interactive
performing the second action;
feature may present additional graphics to the user, includwherein the visual appearance of the graphic is the same
ing graphics indicating additional user-selectable software
when the first sequence of contacts is commenced and
options. The input/output communication with the memory
when the second sequence of contacts is commenced.
controls data stored in the memory, which includes deleting 45
2. The method of claim 1, wherein the first sequence of
or altering data in memory. The input/output communication
contacts and the second sequence of contacts are applied
with the radiation emitter controls transmission of informawithin an area that is smaller than an area of the graphic.
tion to network 395. Alternate embodiments may include a
3. A computer-readable medium carrying one or more
radiation detector for two-way communication with the
sequences of instructions which, when executed by one or
network.
50 more processors, causes the one or more processors to
Writing on the user-interactive feature may alter data
perform the method recited in claim 2.
stored in memory. A preferred memory 380 is non-volatile,
4. The method of claim 1, wherein the first drawing is an
but may also be volatile. Alternate embodiments include
alphabet character.
interaction between a processor and a random access
5. A computer-readable medium carrying one or more
memory (RAM) and read only memory (ROM). A preferred 55 sequences of instructions which, when executed by one or
type of memory is operated by control of electric fields
more processors, causes the one or more processors to
within a semiconductor. However, alternate embodiments
perform the method recited in claim 4.
include magnetic or optical memory devices. Radiation
6. The method of claim 1, wherein the first drawing is in
emitter 390 may be an optical radiation emitter or a radio
a circular form.
frequency radiation emitter or a microwave frequency radia- 60
7. A computer-readable medium carrying one or more
tion emitter. Network 395 may be a digital or analog
sequences of instructions which, when executed by one or
network for voice or data and may be a local area or a wide
more processors, causes the one or more processors to
area network.
perform the method recited in claim 6.
FIGS. 4A-4D further illustrate an embodiment of a user8. The method of claim 1, wherein the first drawing is in
interactive feature and exemplary writings. In FIGS. 65 a polygonal form.
4A-4D, user-interactive feature surface area 410, stylus tap
9. A computer-readable medium carrying one or more
sequences of instructions which, when executed by one or
marks 420 and other writings 430 are shown. In FIG. 4A, a

US 6,956,562 Bl
5

6

more processors, causes the one or more processors to
30. The method of claim 28, wherein performing an
perform the method recited in claim 8.
operating system function includes deleting one or more
software applications from a memory of a computer.
10. The method of claim 1, wherein:
31. A computer-readable medium carrying one or more
performing the particular action includes presenting a set
5 sequences of instructions which, when executed by one or
of graphics to the user on the screen; and
more processors, causes the one or more processors to
the graphics provide a plurality of user-selectable softperform the method recited in claim 30.
ware options.
32. The method of claim 30, wherein deleting one or more
11. A computer-readable medium carrying one or more
software applications from a memory includes deleting the
sequences of instructions which, when executed by one or
software applications from a non-volatile storage memory.
more processors, causes the one or more processors to 10
33. A computer-readable medium carrying one or more
perform the method recited in claim 10.
sequences of instructions which, when executed by one or
12. The method of claim 1, wherein the particular action
more processors, causes the one or more processors to
corresponds to transmitting data by generating a signal
perform the method recited in claim 32.
emanating from a radiation emitter.
34. The method of claim 30, wherein deleting one or more
13. A computer-readable medium carrying one or more 15 software applications from a memory includes deleting the
sequences of instructions which, when executed by one or
software applications from a random access memory.
more processors, causes the one or more processors to
35. A computer-readable medium carrying one or more
perform the method recited in claim 12.
sequences of instructions which, when executed by one or
14. The method of claim 12, wherein the radiation emitter
more processors, causes the one or more processors to
is an optical radiation emitter.
20 perform the method recited in claim 34.
36. The method of claim 30, wherein deleting one or more
15. A computer-readable medium carrying one or more
software applications from a memory includes deleting the
sequences of instructions which, when executed by one or
software applications from a memory that is readable by a
more processors, causes the one or more processors to
magnetic memory reader.
perform the method recited in claim 14.
37. A computer-readable medium carrying one or more
16. The method of claim 12, wherein the radiation emitter 25
sequences of instructions which, when executed by one or
is a radio frequency radiation emitter.
more processors, causes the one or more processors to
17. A computer-readable medium carrying one or more
perform the method recited in claim 36.
sequences of instructions which, when executed by one or
38. The method of claim 30, wherein deleting one or more
more processors, causes the one or more processors to
30 software applications from a memory includes deleting the
perform the method recited in claim 16.
software applications from a memory that is readable by an
18. The method of claim 16, wherein the radiation emitter
optical memory reader.
is coupled to a computer network.
39. A computer-readable medium carrying one or more
19. A computer-readable medium carrying one or more
sequences of instructions which, when executed by one or
sequences of instructions which, when executed by one or
more processors, causes the one or more processors to 35 more processors, causes the one or more processors to
perform the method recited in claim 38.
perform the method recited in claim 18.
40. The method of claim 1, wherein displaying a graphic
20. The method of claim 16, wherein the radiation emitter
includes displaying a computer-generated icon on the
is coupled to a telephone network.
screen.
21. A computer-readable medium carrying one or more
41. A computer-readable medium carrying one or more
sequences of instructions which, when executed by one or 40
sequences of instructions which, when executed by one or
more processors, causes the one or more processors to
more processors, causes the one or more processors to
perform the method recited in claim 20.
perform the method recited in claim 40.
22. The method of claim 12, wherein the radiation emitter
42. The method of claim 1, wherein displaying a graphic
is an microwave radiation emitter.
23. A computer-readable medium carrying one or more 45 includes permanently displaying the graphic on the screen.
43. A computer-readable medium carrying one or more
sequences of instructions which, when executed by one or
sequences of instructions which, when executed by one or
more processors, causes the one or more processors to
more processors, causes the one or more processors to
perform the method recited in claim 22.
perform the method recited in claim 42.
24. The method of claim 22, wherein the radiation emitter
44. The method of claim 1, wherein performing the
is coupled to a computer network.
50
particular action includes interpreting the first sequence as a
25. A computer-readable medium carrying one or more
selection to launch one of a plurality of applications on the
sequences of instructions which, when executed by one or
handheld computer.
more processors, causes the one or more processors to
45. A computer-readable medium carrying one or more
perform the method recited in claim 24.
26. The method of claim 22, wherein the radiation emitter 55 sequences of instructions which, when executed by one or
more processors, causes the one or more processors to
is coupled to a telephone network.
perform the method recited in claim 44.
27. A computer-readable medium carrying one or more
46. A computer-readable medium carrying one or more
sequences of instructions which, when executed by one or
sequences of instructions which, when executed by one or
more processors, causes the one or more processors to
60 more processors, causes the one or more processors to
perform the method recited in claim 26.
perform the method recited in claim 1.
28. The method of claim 1, wherein performing the
47. A handheld computer comprising:
particular action includes performing an operating system
displaying a graphic representing a set of one or more
function.
29. A computer-readable medium carrying one or more
computer functions on a portion of a touch-sensitive
sequences of instructions which, when executed by one or 65
screen, wherein the touch-sensitive screen is coupled to
more processors, causes the one or more processors to
at least one processor to detect and interpret contact
perform the method recited in claim 28.
with the screen;

US 6,956,562 Bl
7

8

detecting an object making a first sequence of one or more
contacts that form a first drawing on the portion of the
screen;
in response to detecting the object making the first
sequence of one or more contacts that form the first
drawing:
matching the first sequence to a particular action in a set
of actions, and performing the particular action;
detecting an object making a second sequence of one or
more contacts to form a second drawing on the portion
of the screen;
in response to detecting the object making the second
sequence of one or more contacts to form the second
drawing:
matching the second sequence to a second action in a
set of actions related to said one or more computer
functions, and
performing the second action;
wherein the visual appearance of the graphic is the same
when the first sequence of contacts is commenced and
when the second sequence of contacts is commenced.
48. The handheld computer of claim 47, wherein the first
sequence of contacts is applied within an area that is smaller
than an area of the graphic.
49. The handheld computer of claim 47, wherein the first
drawing is an alphabet character.
50. The handheld computer of claim 47, wherein the first
drawing is in a circular form.
51. The handheld computer of claims 47, wherein the first
drawing is in a polygonal form.
52. The handheld computer of claim 47, wherein:
performing the particular action includes presenting a set
of graphics to the user on the screen; and
the graphics provide a plurality of user-selectable software options.
53. The handheld computer of claim 47, wherein the
particular action corresponds to transmitting data by generating a signal emanating from a radiation emitter.

54. The handheld computer of claim 53, wherein the
radiation emitter is an optical radiation emitter.
55. The handheld computer of claim 53, wherein the
radiation emitter is a radio frequency radiation emitter.
56. The handheld computer of claim 53, wherein the
radiation emitter is an microwave radiation emitter.
57. The handheld computer of claim 56, wherein the
radiation emitter is coupled to a telephone network.
58. The handheld computer of claim 56, wherein the
radiation emitter is coupled to a computer network.
59. The handheld computer of claim 53, wherein the
radiation emitter is coupled to a computer network.
60. The handheld computer of claim 53, wherein the
radiation emitter is coupled to a telephone network.
61. The handheld computer of claim 47, wherein performing the particular action includes performing an operating
system function.
62. The handheld computer of claim 61, wherein performing an operating system function includes deleting one or
more software applications from a memory of the handheld
computer.
63. The handheld computer of claim 62, wherein deleting
one or more software applications from a memory includes
deleting the software applications from a non-volatile storage memory.
64. The handheld computer of claim 62, wherein deleting
one or more software applications from a memory includes
deleting the software applications from a random access
memory.
65. The handheld computer of claim 62, wherein deleting
one or more software applications from a memory includes
deleting the software applications from a memory that is
readable by a magnetic memory reader.
66. The handheld computer of claim 62, wherein deleting
one or more software applications from a memory includes
deleting the software applications from a memory that is
readable by an optical memory reader.

5

10

15

20

25

30

35

* * * * *

UNITED STATES PATENT AND TRADEMARK OFFICE

CERTIFICATE OF CORRECTION
PATENT NO.
APPLICATION NO.
DATED
INVENTOR(S)

: 6,956,562 B2
: 09/574720
: October 18,2005
: O'Hara et al.

Page 1 of 1

It is certified that error appears in the above-identified patent and that said Letters Patent is
hereby corrected as shown below:

In the Claims:
Claim 47, column 6, line 63, "A handheld computer comprising:" should read -- A
handheld computer configured for: --.

Signed and Sealed this
Third Day of October, 2006

JON W, DUDAS
Director of the United States Patent and Trademark Office