SmartPhone Technologies LLC v. Apple, Inc. et al

Filing 1

COMPLAINT against AT&T Mobility LLC, AT&T, Inc., Apple, Inc. ( Filing fee $ 350 receipt number 0540-3314474.), filed by SmartPhone Technologies LLC. (Attachments: # 1 Exhibit A, # 2 Exhibit B, # 3 Exhibit C, # 4 Exhibit D, # 5 Exhibit E, # 6 Exhibit F, # 7 Civil Cover Sheet)(Ward, Thomas)

EXHIBIT A

111111111111111111111111111111111111111111111111111111111111111111111111111
US006976217Bl

United States Patent

(10)

Vertaschitsch et al.

(12)

(45)

Patent No.:
US 6,976,217 BI
Date of Patent:
Dec. 13, 2005

(54)

METHOD AND APPARATUS FOR
INTEGRATING PHONE AND PDA USER
INTERFACE ON A SINGLE PROCESSOR

(75)

Inventors: Ed Vertuschitsch, Bellevue, WA (US);
Sean Mercer, Issaquah, WA (US);
Gordon Onorati, Kent, WA (US)

5,522,089
5,673,268
5,797,089
6,2(;6,539
6,389,124
6,647,101
6,754,3.13

(73)

Assignee: PahnSource, Inc., Sunnyvale, CA (US)

* cited by examiner

( .)

Notice:

Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.e. 154(b) by 538 days.

A • 5/1996 Kikinis et al. .......... 345/864 X
A • 9{1997 Sharma et al. .......... 455/557 X
A • 8/1998 Nguyen .................. 455/557 X
B l ' 712001 Pardo .................. 379/93.05 X
B1 · 512002 Schnarel et al. ..... 379/93.23 X
132 • 1112003 Rahamim et al. ........ 379/93.05
01· 612004 Quinton et al. .......... 379/90.01

Primary Examiner-Raymond J. Bayer!
(74) Attorney, Agent, or Firm-Berry & Associates P.e.
ABSTRACT

(21)

App!. No.: 09/687,987

(57)

(22)

Filed:

(51)
(52)

Int. CI.7 ..................... ...... G06F 3/00; H04M 11100
U.S. CI. ....................... 715/717; 715/864; 715/771;
379/90.01; 379/93.19; 379/93.23; 379/ll0.01;
455/556; 455/575
Field of Search .............................. .. . 345/864, 771,
345/776,716-718,863,963,727,978,
839; 379/90.01, 93.09, 93.05, 93.17, 93.19,
93.23, 110.01, 419, 441, 442, 456; 455/74,
556, 557, 566, 565

Separate processors, a PDA processor, and a baseband
processor are maintained in a PDA having an integrated
telephone device. The PDA processor runs PDA related
programs and a user interface for the telephone device. A
link between the PDA processor and baseband processor
transfers data and commands from the user interface to a
phone control program executing on the baseband processor.
The base band processor is connected to the telephone
device, and the phone control program controls operation of
the telephnne device. The separation of processors reduces
vulnerability of the telephone device to hacker rogue applications that invade or program crashes that occur on the
PDA processor.

(58)

Oct. 13, 2000

(56)

References Cited
U.S. PATENT DOCUMENTS
5,097,528 A

•

21 Claims, 8 Drawing Sheets

3/1992 Gursahaney et al .. 379/93.23 X

POA
DEVICE

~

RADIO'

DISPlAY SCREEN

300

DEVICE

255
PHONE JII
APPUCAnON

USER 312
INTERFACE

Al'P1.ICATI~S

322
DATA 324 ---l._-T'T-n

COtiTR<X. J18
APPUCATION

MEMORY
DEVICE
HARDWARE INTERFACE

235

'--- -- -- - J ' - -t----'

BASEBAND
UNK

USER 314
INTERFACE
WORD 313
PROCESSOR

u.s.

Patent

Dec. 13, 2005

r
8:2

'OO

am

•
8:00
10:00

12-00
,
1 :00

2'00
,

.. S

~W9d

MTVvTf:S ... . QCt.10~

~~~kt'aSllNith Mo

en, Meet'Ing
rn
Inte ..~renCG Call
'Ylew
Staff MeeUng

--+-t---11 0

CQ~

-----

t::l t Take
t:J 1 e
kids to ach

o

US 6,976,217 HI

Sheet 1 of 8

uy birthd

.. I::"-------.::J

. 001
t Plan SUn. ay card for Mo
... rner trip
rn

~-++- 120

FIG. 1

u.s. Patent

Dec. 13, 2005

US 6,976,217 B1

Sheet 2 of 8

HANDHELD
COMPl1TER~

200

\

'0

RADIO
DEVICE

DISPLAY SCREEN

255

230

1J

r

240

SYSTEM BUS

1

1
PROCESSING

UNIT

[V---y

210
.I-

r HARDWARE INTERFACE

~

~EMORY

DEVICE

~

220

225
235

FIG. 2

MEMORY

BUS

u.s. Patent

Dec. 13, 2005

PDA
DEVICE

~

RADIO'
DEVICE

DISPLAY SCREEN

300

US 6,976,217 Bl

Sheet 3 of 8

255

340
PHONE 311'
APPUCATION
USER 312
INTERFACE

APPliCATIONS

322
DATA 324 --1.-----t-t-n

315

~BASEBAND

320
MEMORY
DEVICE

PROCESSOR

~~--------~~~

HARDWARE INTERFACE

235

~O

BASEBAND
LINK

USER 314
INTERFACE
WORD 313

PROCESSOR

FIG. 3

CONTROL 318
APPUCAnON

u.s. Patent

Palm

Dec. 13,2005

osnt Boot

Sheet 4 of 8

400

Boot user selected
application(s); Perform
user operation(s)

410
430
Boot phone control
OS & phone
controlapp

Yes

440

Perform phone
operation

US 6,976,217 Bl

phone operation
(sublaunch.
answer. dial, etc.)

460

FIG. 4

Init PDA & phone
control processor
communication

non phone
(pwrdown.
init other app.
switch apps.
time out pwr down,
etc.)

u.s.

Patent

Dec. 13, 2005

Sheet 5 of 8

US 6,976,217 B1

)

Start
A

Phone operation

/505

1---500

•

Sub launch program on
PDA processor

r

/525

Collect digits from
phone app UI

Receive incoming call
indication from phone
control processor

/530

/510
Perform operations,
update saved
parameters according
to sub program

Configure device to
make call

/550
Configure device to
receive call

/535
A

Communicate digits
and call signal to
phone cnU processor

/555
Incoming call
notification
to user

L
A

FIG. 5

545

560

Perform user action or
preferences inaction

A

u.s. Patent

Dec. 13, 2005

(

Start

US 6,976,217 Bl

Sheet 6 of 8

)

A.----I

f--600

Phone control
processor operation

£650
Receive

Receive
configuration
signal

r
Configure
phone
hardware
for call

Receive
hang-up
signal

answer or

make call
signal

610

r

call

Receive
incoming

call indication
from network

r6JO~640

620

...---........"-....,
Connect

Collect digits
from phone
application UI

Disconnect
call

Program
phone
radio to
make call

Configure
device
to receive
call

645\
A

A

655

L

660

L

A
Administer

Send
incoming call

call

notification

to phone
application UI

A

FIG. 6

670

~

~S~~call
NO~ped

Yes
A

u.s. Patent

Dec. 13, 2005

US 6,976,217 Bl

Sheet 7 of 8

,
710

~ processor
word
Elle

705

-

Edit

~

I

Ylew F£nnat Iools

-

-1-

Once upon a time, there were young
people with computers. Each day was
filled with games and programs, but
they all stayed home glued to their
monitors. Until one day, one of the
young people received a Palm as a
birthday gift. The Palm had
applications, Internet, and integrated
cell phone technologies ... I

760

I-

0
0

0 0

...

720

73o

7.'J5

5/22100

doc name: story.txt v1

7.'SO

Help

--

g

0

0

0 0

FIG. 7

J40

u.s. Patent

Dec. 13, 2005

800

Mobile dlil l
.....
. Swisscom
.. _. --_.
_ __

__
.
_

815

US 6,976,217 B1

Sheet 8 of 8

840

Y

_._-_ _- £(0

....

Dialer
845

....

:::7

0G)Gi)
GJG)G)
(JJG)CJ:)

Talk
Note

830

End

0
0

825

Mute

000

820

835

0
0

00

00

FIG. 8

US 6,976,217 B1

1
METHOD AND APPARATUS FOR
INTEGRATING PHONE AND PDA USER
INTERFACE ON A SINGLE PROCESSOR
COPYRIGHT NOTICE

2
burdens a&~ociated with managing contacts and tracking
phone numbers.
However, despite the great capabilities and conveniences
of the modern PDA, and the cell phone, many innovations
5 are needed for expanding the capabilities and for increasing
the convenience of using PDAs and cell phones.

A portion of the disclosure of this patent document
SUMMARY OF THE INVENTION
contains material which is subject to copyright protection.
The present inventors have realized that the integration of
The copyright owner has no objection to the facsimile
reproduction by anyone of tbe patent document or the patent 10 mobile telephone technology into a PDA is one area where
innovations are greatly needed to improve the performance,
disclosure, as it appears in the Patent and Trademark Office
convenience, and usability of PDA and/or other devices
patent file or records, but otherwise reserves all copyright
having mobile telephone capabilities. The present inventors
rights whatsocver.
have also realized that the integration of cell phones into a
BACKGROUND OF THE INVENTION
15 PDA have some drawbacks that make operation of the
combined devices less ellicienl. For example, a PDA having
1. field of Invention
an integrated cell phone has more processing capability than
This invention rclates generally to user interfaces. The
needed, if the cell phone is simply added to tbe PDA. APDA
invention is more particularly related to user interfaces for
having integrated cell phone capability which uses a single
phone and Personal Digital Assistants (PDAs). And, the
20 processor to run both the cell phone and PDA is subject to
invention is yet more particularly related to combining
invalid, spurious, rogue, or hacker initiated sigoals if the
phone and PDA user interfaces on a single processing
PDA processor runs user programs and controls the radio
device.
functions of the cell phone.
2. Discussion of Background
The present invention is a PDA or other electronic device
Personal computer systems and their applications have 25 having integrated cell phone technology. The user interfaces
become common tools in modern society. To organize their
for the cell phone and the PDA are run on a single main
lives, many personal computer users use personal informaprocessor (PDA proce&~or, for example) . A second, phone
tion management applications such as an address book and
control processor controls the radio functions of tbe cell
a daily organizer on their personal computers. Although such 30 phone. A proprietary link is established [or communications
applications have proven useful for personal information
between the PDA processor and phone control processor.
management, their utility is limited by the fact that the
The proprietary link isolates the phone control processor and
person must be sitting at their personal computer system to
radio equipment of the cell phone from spurious commaods
access the information.
instituted because of backer's programs, program crashes,
To remedy this limitation, palmtop computers, electronic 35 etc., that occur on the PDA processor.
organizers and other handheld devices, commonly known as
The invention may be embodied as a handheld computer
personal digital assistants (PDA's), have been introduced.
or electronic device comprising, a display screen, a first
The PDA is a computer that is small ellough to he handheld
processor configured to nm user applications and send
or placed in a pocket, and allows a user and run various
outputs of the user apJllications to the display screen, the
applications including personal information management 40 user applications including a telephone user interface conapplications such as address books, daily organizers, etc.
figured to capture user inputs [or telephone related operaThese applications make people's lives easier.
lions and display current telephone operations in [ormation
The most pOJlular brand of PDA is the Palm™. However,
on tbe display screen, a telephone device, a baseband
the Palm™ is much more than a simple PDA. A hasic
processor connected to the telephone device and configured
configuration of the Palm"M 100 is shown in FIG. 1. This 45 to control operations of the telepbone device, and a comsmall, slim, device, about tht: size of your wallet, can hold
munications link between the first processor and the base6000 addresses, 5 years of appointments, 1500 to-do items,
band processor for communicating user inputs and selec1500 memos, 200 e-mail messages, and can run many
tions from the telephone user interface to tbe baseband
different software applications.
processor.
The front of the Palm™ 100 is a large LCD screen 110 50
The invention includes an electronic device comprising
which is touch-sensitive and allows a user to enter and
display means, a first processing means for running user
manipulate data. A stylus (not shown) is provided with the
applications and sending outputs of the user applications to
Palm™ to help in making touch screen inputs. By using the
said display screen, said user applications including a user
stylus (or another handheld pointer) to interact with a
interface means for at least capturing user inputs for teletouch-sensitive screen, a palmtop user can easily navigate 55 phone related operations and displaying current telephone
through a host of huilt-in programs, software, and other
operations information on said display means, a telephone
applications.
communication means, a baseband processing means for
controlling operations of said telephone communication
Today, the Palm™, PDA and other handheld computing
devices offer Internet connectivity capabilities, as well as a
means, and a link means for communicating data between
vast array of hardware and software choices. Palmtops have 60 said first processing means and said baseband processing
evolved from simple organizers into a new kind of handheld
meaos, said data including user inputs and selections from
said user interface means to said baseband processing
that people use to instantly mall age all kinds of information,
.f
from email, to medical data, to stock reports.
means .
Mobile telephones (cell phones, PCS, satellite phones,
The present invention includes a method of operating an
etc) are also common tools in today's world. Many cell 65 electronic device having an inlt:grated telephone device,
phones include rudimentary functionality for maintaining
comprising the steps of, running a telephone user interface
call lists, or phone book information, to help alleviate the
program on a first processing device, running a telephone

US 6,976,217 B1

3

4

device control program on a second processing device,
A mobile radio device 240 provides connectivity to a
cellular telephone network (not shown). A system bus 255
communicating user data and actions from the telephone
carries data and commands to/from the processing unit 210
user interface program to the telephone device control
from/to other devices within the computer 200. For example,
program via a communications link between the first processor and the second processor, and controlling operation 5 user applications running on the computer 200 send application screens and other data outputs to display screen 230
of the integrated telephone device via the telephone device
for display via the system bus 255. User inputs (Graffiti™
control program according to the user data and actions
area drawing, or tap selection, for example) are detected by
communicated.
the screen 230 and sent to the processing unit 210 via the
Portions of the present invention may be conveniently
system bus 255.
implemented on a general purpose computer, such as a 10
In addition to the operating system and user selected
modern PDA, PalmTM, cell phone, satellite phone, or netapplications, another application, a phone device, executes
worked computers, and the results may be displayed on an
on the processing unit 210. Phone calls from the network
output device connected to any of the general purpose, PDA,
directed toward the mobile radio device 240 are detected by
PalmTM, networked computers, or transmitted to a remote 15 the mobile radio device and sent, in the form of an incoming
device for output or display.
call notification, to the phone device (executing on the
processing unit 210). The phone device processes the incomBRIEF DESCRIPTION OF THE DRAWINGS
ing call notification by notifying the user by an audio output
A more complete appreciation of the invention and many
such as ringing (not shown).
of the attendant advantages thereof will be readily obtained
The phone device also includes a method for the user to
as the same becomes better understood by reference to the 20 answer the incoming call. For example, tapping on a phone
following detailed description when considered in connecicon, or pressing a hard bu lion designated or preprotion with the accompanying drawings, wherein:
grammed for answering a call signals the phone device to
FIG. 1 is a Palm™ handheld computer;
send instructions (via system bus 255) to the mobile radio
FIG. 2 is a block diagram of selected components of a 25 device 240 to answer the call.
Outgoing calls are placed by a user by entering digits of
possible design integrating cell phone technology into a
the number to be dialed and pressing a call icon, for
PDAdevice;
example. The dialed digits are sent to the mobile radio
FIG. 3 is a block diagram of selected components of a
device 240 along with instructions needed to configure the
design according to an embodiment of the present invention
for integrating cell phone technology into a PDA device; 30 mobile radio device 240 for an outgoing call. Tbe instructions may include, for example, 1. Access a base station, 2.
FIG. 4 is a flow chart illustrating process flows of a main
Send digits, 3. Retrieve and forward ring indication (if any),
PDA processor executing PDA and cell phone user inter4. Connect call, 6. manage call, and 7. await further instrucfaces;
tions. Many other instructions may be utilized. For example,
FIG. 5 is a flow chart illustrating an embodiment of
in the AT command set more than 100 commands are
process flows of a cell phone user interface and communi- 35
available. Similar instructions may be sent for handling an
cations of the cell phone user interface to a phone control
incoming call by the phone device after receiving and
processor according to the present invention;
processing an incoming call indication from the mobile
FIG. 6 is a flow chart illustrating an embodiment of a
radio device 240.
phone control program according to the present invention; 40
The mobile radio device 24() is a device configured send
BG . 7 is an electronic device running a PDA application
signals on exact frequency requirements (FCC certified, for
according to an embodiment of the present invention; and
example). Base stations that communicate with the mobile
FIG. 8 is an electronic device running a phone application
radio device 240 are also precision devices sending and
according to an embodiment of the present invention .
receiving on specified radio frequency channels. One diffi45 culty arising with the design as shown in FIG. 2 is that
DESCRIPTION Or- THE PREFERRED
application program crashes on processor 210 can cause
EMBODIMENTS
unwanted or inconsistent signals to be generated on system
Referring again to the drawings, wherein like reference
bus 255 and potentially causing problems with the mobile
numerals designate identical or corresponding parts, and
radio device 240, such as spurious radio emissions. In
more particularly to FIG. 2 thereof, there is illustrated a 50 addition the design of FIG. 2 also is susceptible to hacker or
rogue programs that may be executing on processing unit
block diagram of selected components of a handheld com210, also potential1y causing spurious radio emissions from
puter 200 that includes cell phone technology. The handheld
computer 200 includes a processing device 210, for executmobile radio device 240. The potential spurious emissions,
ing applications and an operating system of the computer
might, for example, cause radio broadcasts in an unintended
200, a memory device 220 for storing the operating system, 55 or unapproved frequency range, potentially cause problems
data, and the applications. A memory bus 255 is utilized to
at one or more base stations (unintentionally causing a base
station re-boot, for example), or cause interfere with other
transfer programs and data from memory to the processing
mobile radio devices.
unit 210.
FIG. 3 is a block diagram of selected components of a
A display screen 230 is provided (preferably a touch
sensitive screen) for display of Operating System prompts, 60 design according to an embodiment of the present invention
buttons, icons, application screens, and other data, and for
for integrating cell phone technology into a PDA device 300.
providing user inputs via tapping or touching (or drawing in
The PDA device 300 is a handheld computer such as a
Palm™, Palm III™, or Palm VTM, or Palm VIITM organizers,
the Gralliti™ area 120) via a stylus or other touch mechamanufactured by Palm, Inc. Other embodiments of the
nism. Hardware interface 235 connects to physical hard
buttons and switches located on a body of the computer 200 65 invention can include Windows CETM and Visor™ handheld
computers, or otber haodheld computers and personal digital
and provides signals to applications running on the processassistants (PDAs).
ing unit 210.

US 6,976,217 Bl
5

6

and/or utilizes other protocol stacks. In other embodiments,
Preferably, the PDA 300 has interactive hardware and
software that perform functions such as maintaining
the PDAibaseband link 330 is a parallel interface. In the
calendars, phone lists, and at least one voice or audio related
embodiments using a proprietary link (proprietary protocol
functions integrated or attach ably integrated (via a connector
andlor proprietary protocol stack), the format of the propridevice, for example, not shown) so as to be configured for 5 etary link is not particularly important over and above
use with cellular telephone capabilities of the PDA. Several
normal protocol considerations (byte economy, ease of use,
examples of a configuration and details of connector devices
etc), but keeping the link proprietary assures that rogue
for connecting or integrating voice function devices to a
applications affecting operation of other PDA devices are
PDA are described in Maes et aI., application Ser. No.
unlikely to have any effect on a device according to the
09/675,872, entitled, "INTEGRATING VOICE FUNCpresent invention. The PDAibaseband link 330 includes a
TION INTO A PDA," filed Sep. 29, 2000, the contents of 10
protocol that is updateable by downloading an updated
which are incorporated herein by reference in their entirety.
protocol from a vendor web site and installing the updated
The software, including a phone user interface, operating
protocol on each of the processing unit 310 and phone
system, and other applications (word processors,
control (baseband) processor 315.
spreadsheets, databases, etc.) 322 are stored in memory
The type of interface used over the PDAibaseband link
device 320, along with program data, graphics, and other 15
330 may be selected based on criteria of the phone control
data 324, and executed on a processing device 310. A touch
(baseband) processor 315 which may already have commusensitive display device 230 and hard button interface 235
nication ports configured for either parallel or serial comare also provided as similarly discussed above. A system bus
munications. The selected protocol is a choice between the
255 provides data, command, and possibly other types of
communication, as directed, by anyone of the devices, 20 available protocols for a particular baseband processor, or a
protocol tbat may be developed by the producer of the
including display screen 230, hardware interface 235, and
baseband processor and the producer of a device utilizing
processing unit 310, to the other devices.
the present invention. No advantage in the type of protocol
Processing unit 310 runs applications, including the operutilized is envisioned, except that an industry standard
ating system (aS, including a User Interface (UI) of the OS), 25
protocol (such as tbe AT command interface discussed
and other user applications (word processor 313 and word
above) may be more familiar to development engineers
processor user interface 314, for example) as directed by
implementing a product, and may reduce development time.
user inputs. The user applications display outputs on the
FIG. 4 is a flow chart illustrating process flows of a main
display screen 230 and receive inputs from taps, tap & hold,
and writing operations on the display screen and from 30 PDA processor executing PDA and cell phone user interfaces. At step 400, tbe system (handheld computers, Palm TM,
programmed hard buttons attached to hardware interface
etc.) is powered on and tbe Palm™ OS is booted. The Palm
235.
OS ™ is used as an example, other handheld or full service
FIG. 3 includes a mobile radio device 340, and a phone
operating systems (NT, Windows, Linux, etc.) may be
control processor 315. The mobile radio device 340 receives
instructions and other control data from the phone control 35 utilized. Steps 410 and 420 are combination steps.
At step 410 any user operation may be performed (power
processor 315 (also referred to as a baseband processor),
down, set preferences, arrange icons, etc.) or user selected
implementing those instructions and using the data so as to
application (word processor, Internet, etc.) may be invoked
operate the mobile radio device 340. The phone control
and used. Step 420 identifies that the user has selected a
(baseband) processor 315 sends instructions and data to the
mobile radio device based on programming of a phone 40 pbone application that is intended to control mobile phone
capabilities built into the system (mobile radio 340, for
control application 318.
example).
A phone application 311 and phone application user
When the phone application is started, it sends a signal
interface 312 are provided and execute on the processing
across the PDAibaseband link 330 that signals the phone
unit 310. The main function of the phone application 311 is
to service the phone application user interface 312 and 45 control OS to boot and start a phone control application that
runs on the phone control processor (step 430).
transfer required data to and from the phone control appliAlternatively, the phone control OS is booted upon power up
cation 318 running on the phone control (baseband) procesof the system and waits in a hibernation state until a signal
sor 315.
is received to start the phone control application. In the
A PDAibaseband link 330 is used to communicate data
between the phone application 311 (on processing unit 310) 50 former case, an on/off recognizer identifies whether a signal
on the PDAibaseband link 330 is an on/off command and
and the phone control application 318 (on phone control
boots or shuts down the phone control OS and processor
(baseband) processor 315). The PDAibaseband link 330 is
accordingly. In the latter case, the phone control as recogan AT Command interface over a serial link. The PDN
nizes start and shut down commands that are applied to the
baseband link 330 separates processing performed on processing unit 310 and processing performed on the phone 55 phone control application.
Once started, the PDA processor unit and phone control
control (baseband) processor 315, providing a separation
processor begin communicating from phone application to
that reduces chances that a hacker program, other rogue
phone control application over the PDAibaseband link 330
application, or a program crash on the processing unit 310
(step 440). User actions (step 450) controlling PDA funchas any improper influence on the phone control (baseband)
processor 315 or the phone control application 318, hence 60 tions or directly phone operations (step 460) are implemented.
providing a more stable environment for operation of the
mobile radio device 340 and assuring no adverse impact on
FIG. 5 is a flow chart illustrating some example phone
the operation of the cellular network (e.g., preventing
operations. The user initiates various phone operations (step
unwanted interference signals that could adversely affect
500) by tapping phone application icons, graphics, enters
other users).
65 control data into the Grafiiti™ area, or other input method
attached keyboard, hard buttons, etc.). Phone operations
In one embodiment, the AT Command over serial link
may include, for example, sub-launching a phone related
used on the PDNbaseband link 330 is proprietary to Palm™

US 6,976,217 B1

7

8

application (step 505) and performing the suh-application
processed (sub-launching an address book or note taking
function (step 505), and updating/creating an address book
entry or taking/updating a note (step 510), for example. One
example of a note taking application is described in Maes et
aI., u.s. Pal. No. 6,442,251, application Ser. No. 09/675,
363, entitled, "METHOD AND APPARATUS FOR TAKING A NOTE WHILE IN A CALL," liled Sep. 29,2000, the
contents of which are incorporated herein by reference in
their entirety.
Another example phone operation is making a call, illustrated in steps 525-535. First, the phone application collects
digits entered by the user via the phone application user
interface (running on PDA processing unit 310) (step 525) .
A step of sending a wake up or configuration signal (step
530) to the phone control application (running configuration
signal (step 530) to tbe phone control application (running
00 phone control processor 315) may be performed to
"wake" the pbone control application 318 (in the case where
tbe phone control application 318 is in a sleep mode from a
period of in-operation, for example) and signal the pbone
control application 318 to configure the mobile radio device
340 so as to be ready to make a call (power up, awake form
sleep, etc.). Step 530 may be performed as soon as the pbone
application knows that a call is being made, such as up on
phone application boot, or when a first digit of a pbone
number is received (as in step 525, for example). At step
535, the digits collected at step 525 are communicated from
the phone application to the phone control application,
signaling the phone control application to initiate a call to
that number.
Another example phone application is receiving an
incoming call as illustrated in steps 545-560. At step 545, an
incoming call indication is received by tbe phone application
from the phone control application (running on ph call
processor). At step 550, the phone application is configured
to receive the call (set up audio channels, "wake" phone
applications, etc.). At step 555, tbe pbone application presenl~ an incoming call notification to the user (ringing,
vibration, visual display, combination, etc.). Finally at step
560, a user acts to answer the call (presses a talk button or
icon, for example), wbich directs the phone application to
connect tbe call, or, a user acts to send the call to voicemail
(or ignore), by pressing an end button or icon, for example.
Alternatively, if a user does nothing, tbe call is left unattended (call directed to voicemail by network, for example),
or, if the user has preferences set, the preferences are used
to direct operations of tbe phone application. Examples of
user preferences for directing phone operations during periods of user inaction (and other conditions, sucb as how to
no tify a user of an incoming call) are described in M aes e t
al.; application Ser. No. 09/675,874, entitled, "METHOD
AND APPARATUS FOR SETTING AND USING USER
PREFERENCES," filed Sep. 29, 2000, the contenl~ ofwbich
are incorporated herein by reference in their entirety.
FIG. 6 is a flow chart illustrating an embodiment of a
pbone control program according to the present invention.
Several processes are shown, as sequential processes initiated by an event or control signal. One example operation,
configuring the mobile radio device 340 to make a call, is
initiated, for example, by a control signal received (step 605)
via the PDAibaseband link 330 from the pbone application.
The phone control processor 315 performs the configuration
(step 610). Another example includes signals received by thl;:
phone control processor directing it to answer a call (step
615), and the operations of the control processcr needed to
connect the call (step 620) are performed. Similarly, a signal

may be n:ceived to hang-up a current call (step 625), and tbe
phone control processor disconnects the current call accordingly (step 630).
Another example operation of the phone control processor
is shown in steps 635-645, for making a call. The phone
control processor receives a communication from tbe phone
application baving the digits of a user entered telephone
number (step 635), the phone control processor programs
the mobile radio device 340 to contact a base station and
initiate the call (step 640), and the phone control application
administers (performs any functions needed to maintain tbe
connection) the call (step 645).
A final example operation, answering an incoming call, is
illustrated in steps 650-670 . An incoming call indication is
received from the network (step 650). The phone control
processor conJlgures the mobilr;: radio device to answer the
call (step 655) and sends an incoming call notification to the
phone application (step 660) . If a user action prompted
action message (hang-up, send to voicemail, or answer, for
example) is returned from tbe phone application, a phone
control application process is then initiated (downstream
from connector A) to perform tbat process. If no user action
is occurs, the incoming call notification is resent (no branch
of step 670).
Alternatively, the phone application is pre-programmed to
continue any ringing (or other notification) until a lost call
signal is received from tbe phone control application indicating tbat there is no longer an incoming call (already
diverted to voice mail by the network, or caller hung-up, for
example). The above processes are examples, and other
features or processes may also be performed by the phone
control processor (periodic network checks, or sending
network ID information to the phone application, for
example).
FIG. 7 is an electronic device running an example PDA
application according to an embodiment of the present
invention. Tbe example PDA application is a word processor
705 tbat runs on processing unit 310. The word processor
includes an identification banner 710, a set of pull down
menus 720 for file management and other features of the
word processor 705. The document being processed 730 is
displayed, and uscr inputs are received via tapping the touch
sensitive screen, writing or other actions in tbe Graffiti™
area 740, tapping virtual buttons 750, or pressing one or
more hard buttons 760 (some of which may be connected via
Hardware in terface 235 and programmed for initiating a
specific function of the word processor, for example). The
document being processed is saved as storyLtxt (as shown
by document identifier 735) in memory device 320.
Concurrently hosted on the Palm™ (or electronic or
computer device) 300 is the phone application. An example
phone application 800 is shown in FIG. 8. Tbe phone
application 800 includes a dialer screen 815 tbat includes
keypad digits 1-9, " and #, and a set of operation keys. The
operation keys include Talk 820, Note 825, Mute 830, and
End 835. In one embodiment, user activation of tbe Talk key
820 initiates a pbone call of previously entered digits, or
answers an incoming call. User activation of the Mute key
830 mutes the caller at the other end of the line (other caller),
wbich keeps the other caller from hearing any conversation
initiated at tbe users side of the call. User activation of tbe
End key 835 terminates the call that the user is currently
participating, or immediately transfers an incoming call to
voicemail (or other options as specified in user preferences,
for example). Other functions may be assigned or programmed into the keys, and additional or alternative keys

10

15

20

25

30

35

40

45

50

55

60

65

US 6,976,217 B1

9

10

and functions may also be provided. The Palm OSTM (or
other operating system) decides which of the concurrent
applications is currently being executed on the processing
device 310, the remain application(s) in an inactive state.
While on a call, the Note key 825 activates an in-call note
taking service, allowing the user to take notes about the call
and return to the dialer screen for control of other telephone
options after completing the note. Details of a note options
are described in co-pending U.S. patent application No.
09/675,363, entitled "METHOD AND APPARATUS FOR
IN A PHONE CALL," filed Sep. 29, 2000, the contents of
which are incorporated by n:ference in their entirety.
A voicemail flag 845 (envelope icon, for example) indicates a voicemail or other message (short messaging service,
for example) received by the phone application or network
administering the telephone capabilities of the Palm™ 300.
Ringer preferences are shown as two icons 840 (a bell with
a line drawn through it, and a vibrator icon) illustrating the
current options for notifi cation of incoming calls. Either the
bell icon or vibrator icon may be tapped to change the status
of the option. For example tapping the bell with a line drawn
through it changes it to bell without a line. Tapping the
vibrator icon changes it to a no vibrate icon. In this manner,
user preferences, or options, may be changed. The phone
application 810 is one example of a phont: application that
may be utilizt:d in conjunction with the present invention.
However, it should be understood that variations and/or
other phone applications may be utilized.
FIGS. 7 and 8 illustrate concurrent applications, and their
respective user interfaces, executing on the processing unit
310. However, control of the mobile radio device 340 is
maintained by the phone control processor, and the phone
control application. In effect, separating user applications
and interfaces and the phone application user interface from
having any inl1uence over the operation of the phone control
application, thereby isolating the phone control application
for any ill effects of a rogue application or program crash on
the processing unit 310.
Although the present invention has been described using
the specific example of integrating phone and PDA user
interfaces on one processor and maintaining phone control
on a separate processor, the invention may be applied to
applications other than phone and PDA based systems. For
example, combining a wireless internet device (replacing
340) and another electronic device (e.g., PDA, electronic
inventory system, etc.), or any other wireless communication system and another electronic device, each having a
usn interface.
Portions of the present invention may be conveniently
implemented using a conventional general purpose or a
specialized digital computer or microprocessor programmed
according to the teachings of the present disclosure, as will
be apparent to those skilled in the computer art.
Appropriate software coding can readily be prepared by
skilled programmers based on the teachings of the present
disclosure, as will be apparent to those skilled in the
software art. The invention may also be implemented by the
preparation of application specific integrated circuits or by
interconnecting an appropriate network of conventional
component circuits, as will be readily apparent to those
skilled in the art.
The present invention includes a computer program product which is a storage medium (mt:dia) having instructions
stored thereon/in which can be used 10 control, or cau~, a
computer to perform any of the processes of the present
invention. The storage medium can include, but is not

limited to, any type of disk including lloppy disks, mini
disks (MD's), optical discs, DVD, CD-ROMS, micro-drive,
and magneto-optical disks, ROMs, RAMs, EPROMs,
EEPROMs, DRAMs, VRAMs, flash memory devices
(including flash cards), magnetic or optical cards, nanosysterns (including molecular memory ICs), RAID devices,
remote data storage/archive/warehousing, or any type of
media or device suitable for storing instructions and/or data.
Stored on anyone of the computer readable medium
(media), the present invention includes software for controlling hoth the hardware of the general purpose/specialized
computer or microprocessor, and [or enabling tht: computer
or microprocessor to interact with a human user or other
mechanism utilizing tbe results of the present invention.
Such software may include, but is not limited to, device
drivers, operating systems, and user applications.
Ultimately, such computer readable media further includes
software for performing the present invention, as described
above.
Included in the programming (software) of the general/
specialized computer or microprocessor are software modules for implementing the teachings of Ihe present invention,
including, but not limited to, placing and receiving telephone calls, transferring audio and voice data, serial, parallel
and proprietary communications between processors, user
interfaces, and the display, storage, or communication of
results according to the processes of the present invention.
Obviously, numerous modifications and variations of the
present invention are possible in light of the above teachings. It is therefore 10 be understood that witbin thc scope of
the appended claims, the invention may be practiced otherwise than as specifically described herein .
What is claimed and desired to be secured by Letters
Patent of the United States is:
1. An electronic device comprising:
a display screen;
a first processor configured to run user applica tions and
send outputs of the user applications to said display
screen, said user applications including a telephone
user interface configured to capture user inputs for
telephone related operations and display current telephone operations information on said display screen;
a telephone device;
a baseband processor conoected to said telephone device
and configured to control operations of said telepbone
device; and
a communications link between said first processor and
said baseband processor for communicating uSt:r inputs
and selections from said telephone user interface to said
baseband processor;
wherein said communications link is a proprietary protocol stack.
2. The electronic device according to claim 1, wherein
said communications link is an AT Cnmmand interface over
a serial link.
3 . The electronic device according to claim 1, wherein
said communications link is a parallel interface.
4. The electronic device according to claim 1, wherein:
said baseband processor comprises,
a baseband proccssing unit, and
a phone control program configured to execute on said
basehand processing unit;
said first processor includes a user interface program
configured to retrieve user inputs; and
said phone control program is configured to,

10

15

20

25

30

35

40

45

50

55

60

65

US 6,976,217 B1
11

12

receive data communicated acros.~ the communications
link, and
control operations of said telephone device.
5. The electronic device according to claim 4, wherein
said data communicated across the communications link
includes data identifying any of phone numbers, data setting
network user preferences, and call actions, including any of
answer call, make call, and hang-up call.
6. The electronic device according to claim 4, wherein:
said phone control program is further configured to send
data identifying current couditions of said telephone
device to the user interface program.
7. The electronic device according to claim 6, wherein
said current conditions include any of incoming calls,
incoming call caller id information, network status, and
indications of network voicemails received.
8. The electronic device according to claim 1, wherein:
said electronic device is a PDA; and
said telephone device is a cellular radio integrated within
said PDA.
9. An electronic device comprising:
a display screen;
a !irst processor configured to run user applications and
send outputs of the user applications to said display
screen, said user applications including a telephone
user interface configured to capture user inputs for
telephone related operations and display current telephone operations information on said display screen;
a telephone device;
a baseband proces.<;or connected to said telephone device
and configured to control operations of said telephone
device; and
a communications link between said first processor and
said baseband processor for communicating user inputs
and selections from said telephone user interface to said
baseband processor;
wherein said communications link includes a protocol that
is updateabh: by downloading an updated protocol from
a vendor web site and installing the updated protocol on
each of said first processor and said baseband processor.
10. The electronic device according to claim 9, wherein
the electronic device comprises a wireless Internet device.
11. The electronic device according to claim 9, wherein
the baseband processor comprises a phone control program
that boots up upon power-up of the electronic device and
waits in a hibernation state until a signal is received to start
the phone control program.
12. The electronic device according to claim 9, wherein
the baseband processor is configured to wake phone applications when an incoming call is received .
13. A method of operating an electronic device having an
integrated telephone device comprising the steps of:
running a telephone user interface program on a first
processing device;
running a telephone device control program on a second
processing device;
communicating user data and actions from the telephone
user interface program to the telephone device control
program via a communications link between the first
processor and the second proces.~or;
controlling operation of the integrated telephone device
via said telephone device control program according to
thc user data and actions communicated; and
updating the communications link by,

uownloading a protocol utilized by the communications
link, and
installing the downloaded protocol in each of the telephone user interface program and the telephone device
control program.
14. The method according to claim 13, further comprising
the steps of:
communicating conditions of the telephone device, via
said communications link, to the telephone user interface program; and
displaying the conditions of the telephone device on a
display of the electronic device.
15. An electronic device comprising:
display means;
a first processing means for running user applications and
sending outputs of the user applications to said display
screen, said user applications including a user interface
means for at least capturing user inputs for telephone
related operations and dispJaying current telephone
operations information on said display means;
a telephone communication means;
a baseband processing means for controlling operations of
said telephone communication means; and
a link means for communicating data between said first
processing means and said baseband processing means;
wherein:
said link means is a proprietary protocol stack; and
said data including user inputs and selections from said
user interface means to said baseband processing
means.
16. The electronic device according to claim 15, wherein
said link means is an AT Command interface over a serial
link.
17. The electronic device according to claim 15, wherein
said link means is a parallel interface.
18. The electronic device according to claim 15, wherein:
said baseband processing means includes a phone control
program;
said first processing means includes a user interface
program configured to retrieve user inputs and communicate data related to the user inputs to said phone
control program via said link means; and
said phone control program is configured to,
receive data communicated across said link means, and
control operations of said telephone device based on the
communicated data.
19. The electronic device according to claim 18, wherein
said data communicated across said link means includes data
identifying any of phone numbers, data setting network user
preferences, and call actions, including any of answer call,
make call, and hang-up call.
20. The electronic device according to claim 15, wherein:
said electronic device is a PDA; and
said telephone communication means is one of a cellular
radio, PCS, and satellite phone.
21. An electronic device comprising:
display means;
a first processing means for running user applications and
sending outputs of the user applications to said display
screen, said user applications including a user interface
means for at least capturing user inputs for telephone
related operations and displaying current telephone
operations information on said display means;

10

15

20

25

30

35

40

45

50

55

60

65

US 6,976,217 BI
14

13
u h:lcphunc t~lmrnunicaliun me~ns;
II b~clJalxl prt)(.\:ssing mf;ans flJroonl ful1ing operatiuns of
said telephone cormnunication means; and

a link means for (;ommunicatLng data between said firsl
processing means and said baseband processing means; 5
wherein:

said link means includes a ptotocollhat is updalcablc by
downloading an updated protocol from a vendor web

sile :t1IU installing lhe IIpdU100 p«lIIlCol un each of t;lIid
first proccssing means and said baseband processing
means; and

sa id d~la indu(ling user inputs ~nd selC(.1ions from sa id
user interrace means \0 said basc:band processing
menns.

,.

....