Klausner Technologies, Inc. v. Microsoft Corporation

Filing 1

COMPLAINT for Patent Infringement against Microsoft Corporation ( Filing fee $ 350 receipt number 0540-3412194.), filed by Klausner Technologies, Inc.. (Attachments: # 1 Exhibit A - 576 Patent, # 2 Exhibit B - 818 Patent, # 3 Civil Cover Sheet)(Capshaw, Sidney)

111111111111111111111111111111111111111111111111111111111111111111111111111
.

United States Patent

[11]

[19]

US005283818A

Patent Number:
Date of Patent:

Klausner et al.

[45]

[54] TELEPHONE ANSWERING DEVICE
LINKING DISPLAYED DATA WITH
RECORDED AUDIO MESSAGE

4,894,861

[75] Inventors:

Klausner Patent Technologies,
Sagaponack, N.Y.
Mar. 31, 1992

H04M l/M; H04M 11/00;
H04M 15/06
[52] U.S. Cl•..................................•..... 379/67; 379/88;
379/89; 379/96; 379/142; 379/199
379/67, 88, 89, 96,
[58] Field of Search
379/97, 70, 142, 74, 199, 77 .

[51} Int. Cl.s

References Cited

[56]

U.S. PATENT DOCUMENTS
O. 299,716
O. 316,024
O. 327,063
4,241,238
4,304,968

2/1989

4/1991
6/1992

12/1980
12/1981

4,477,807 10/1984
4,511,764 4/1985
4,517,410 5/1985
4,600,809 6/1986
4,612,416 9/1986
4,776,002 10/1988

4,782,510 1111988
4,790,003 12/1988

4,802,202
4,803,717
4,805,207
4,829,559

111989
2/1989
2/1989
5/1989

4,850,005

7/1989

4,853,952 8/1989
4,860,339

8/1989

111990 Fujioka.
Hashimoto.
Figa et al..
Miller.
Thompson et al. .
Baehr et al..
Chamberlin et al..
Shimanuki.
Karnowski.

Primary Examiner-James L. Dwyer
Assistant Examiner-Fan Tsang
Attorney, Agent, or Firm-Darby & Darby

[21] Appl. No.: 860,699
[22] Filed:

Weisz et al. .
Sharbaugh.
Panzer.
Strand.
Klausner
Nakajima et al. .
Nakayama et al. .
Williams et al. .
Tatsumi et al. .
Emerson et al. .
Kammerl.
Szlam.
Kepley et al. .
Takahashi et al. .
Marui.
McNutt et al. .
Izawa et al. .
Hashimoto
Jachmann et al.
D'Agosto, III et al.

379/142

379/88
379/88
379/67

ABSTRACT
[57]
A telephone answering device (TAD) which includes a
means of intelligently organizing voice messages, associated entered codes such as personal IDs and home
telephone numbers, and information stored in the memory of the TAD. These codes or numbers are decoded
by means of the caller entering DTMF signals into the
telephone which are recognized, recorded and processed by the TAD. When processed with codes and
personal information previously entered into the device's memory, the TAD displays the identity of the
callers for each message, thus providing a menu of
choices, i.e., a list of callers. This enables the user to
access messages in a selective manner based on the
identity of the caller. The need to listen to the actual
voice messages to determine the caller's identity and the
need to listen to the messages sequentially or chronologically is obviated, saving both time and effort. Additionally, because the voice message is also linked to
pre-stored additional data in the data base, when hearing a message, one also can view relevant associated
information, such as a fax number, etc., that might not
have been left in the audio message but might be important.
14 Claims, 7 Drawing Sheets
36
32

1. SID
2.
3.
4.
5.
6.

CEASER

• 497·6201

PAT DOBBS • 661·4199
ALICE POOB • 786·5035
REGIS LAMB • 431·9762
MARY PRESTO • 382·6579
WILLY SMITH·
887·7200

~25

34d
34c
A
B

0
H

34 a
30

Feb. 1, 1994

4,916,730 4/1990
4,924,496 5/1990
4,930,152 5/1990
4,935,954 6/1990
4,961,216 10/1990
5,003,575 3/1991
5,050,206 9/1991
5,163,082 11/1992

Judah Klausner, Sagaponack, N.Y.;
Robert Hotto, La Jolla, Calif.

[73} Assignee:

5,283,818

w
N

s
T

1

4
7

*

c
D

I
I

0
p

u
V

2

5
8
0

B

P
E
L

Q
R

W

x

3

SPACE

6

I

9

I

SEARCH

I

ERASE

EDIT

I

#
34b

30

I

1

FLASH

T

s

M
N

*

7

~ 4

B

A

REDIAL

~ 0

Fig. 1

I I

5

2

~ 8

J

I

g

6

3

I I

x

W

MUTE

#

~9

L

K

P

B

SID CEASER - 497-6201
P AT DOBBS - 661-4199
ALICE POOB - 786-5035
REGIS LAMB - 431-9762
MAR Y PRESTO - 382-6579
WILLY SMITH - 887-7200

340

1:
2.
3.
4.
5.
6.

I

EDIT

ERASE

SEARCH

SPACE

STORE

I

I
I

I
I

34b

34c

34d

~25

32

o

QO

••••

-.
QO

eN

QO

~

(,IJ

-.

~

loot)

Q

••••

-

=til
til

rJl

\0
\0
,J:o.

••••

i'"

~

••••

=

('1)

••••

~
s=

•

•
CI'l

3

4/

,1

'.:;

MICROCONTROLLER

20

CONTROLLER

DISPLAY

MEMORY

EPROM

RAM

2

26

25

VOICE

8

PLAYBACK

I
RECORDER

"Fig. 2

15

14

13

7

XMIT

I

DAA

Rev

10

RING

RJ11

TIP

11

~

=

QO

~

-QO

(.H

QO

-~

U1

-I

'""

~

o

=sf!)
f!)

00

~

\C
\C

••••

~

.:-

~

=

~
tD

~

•
rr.J.
•

u.s. Patent

Feb. 1, 1994

Sheet 3 of 7

101
CALL
.USER
MODE

OFF·HOOK
PLAY OGM
(AND BEEP)

ON HOOK

Fig. 3

5,283,818

u.s. Patent

Feb. 1, 1994

Sheet 4 of 7

300
ALLOCATE
MEMORY
310

Fig. 4

ACTIVATE
RECORD
320

y

y

350
STOP .
RECORD

360
STOP
RECORD

370
ON HOOK

390

380

5,283,818

u.s. Patent

5,283,818

Sheet 5 of 7

Feb. 1, 1994

DTMF
DECODE
ROUTINE

400

ALLOCATE
VOICE AND
DATA MEMORY

410
INPUT
SIGNAL
LEVEL

Fig. 5
420

y

440
y

460
ON • HOOK
y

STORE
DTMF
CODE

470

480

.

Fig.9

6. WILLY SMITH - 887-7200

5. MARY PRESTO - 382-6579

4. REGIS LAMB - 431-9762

3. ALICE POOB -786-5035

2. PAT DOBBS - 661-4199

I. SID CEASER - 497-6201

Fig. 6

6. REGIS LAMB - 431-9762(H)
211-0162(M),431-2400(0),
684-3199(F),34 E. 6 ST.

5. FRAN GRILLARD - 729-6555(H),
219-8663(0), 919-3342(F) 407
NEWTON LANE, PIANO TUNER

4. LUCY FROCK - 637 -4064(H), 12
E 9 ST. N.Y.C., 229-8019(F)

3. PAT DOBBS - 661-4199(0),
817-312(H)

2. SIDCAESER - 497-6201 (H)
331-2677 (P), ROCKWELL
DRIVE #34, PISTON LAKES,
BIRTHDAY 11/17/16

1. THORNTON ALUCKET 417-6832(H), 371-6268(0), 230
WEST RD., FAIRVIEW CITY.
VICE PRESIDENT RLB CORP.

MEMORY SECTION 1

431-9762 (5)

786-5035 (4)

661-4199 (3)

497 -6201 (2)

Fig. 7

MEMORY SECTION 2

Fig.10

REGIS LAMB
HOME # 431-9762
MOBILE # [phone]
OFFICE # 431-2400
FAX # [phone]
34 E. 6 ST.

Fig. 8

5. "THIS IS MR. LAMB. I'LL BE IN
MY CAR UNTOl ABOUT 4:00
P.M.

4. "YOUR FRIEND ALICE. SEE
YOU LATER TONIGHT."

3. "MS DOBBS HERE. I'LL BE IN
MY OFFICE TILL 5:30, THEN AT
HOME."

2. "HI, THIS IS·SID; PLEASE
BRING THE YEllOW
BALLOONS WHEN YOU COME
OVER TONIGHT."

1. "PLEASE DIAL IN YOUR
PHONENUMBER ON A TOUCH
TONE PHONE AND THEN LEAVE
A MESSAGE. THANK YOU."

. MEMORY SECTION 3

c::

•••
QO

QO

eN
..•

QO

(JJ
~

..•

-...I

...••

0\

o

l'l>
l'l>

=-

00

.f:o.

IC
"'"
IC

,!-l

~

f"'t-

=

('t)

~

a.

•

rJl

•

u.s. Patent

Feb. 1, 1994

Sheet 7 of 7

5,283,818

SOO

TAO CONNECTS TO
TELEPHONE LINE TO
RECEIVE INCOMING CALL

S10

OUTGOING MESSAGE
INSTRUCTS CALLER
TO .INPUT DTMF TONES AND
TO· LEAVE A VOICE MESSAGE

S20

. VOICE MESSAGE RECORDED
+
DTMF TONES DECODED INTO
IDENTIFYING INFORMATION

S30

,NAMES MATCHING
IDENTIFYING INFORMATION
DISPLAYED

Fig. 11

SSO

- TAD PLAYS BACK
VOICE MESSAGE
LINKED TO SELECTED NAME
BY IDENTIFYING INFORMATION

S60

PRE·STORED DATA
IS DISPLAYED
MATCHING VOICE MESSAGE
BEING PLAYED

S70

USER MAY SELECT
ANY OF DISPLAYED
CALLER'S NUMBERS TO BE
DIALED AUTOMATICALLY

S40

S80

USER SELECTS WHICH
VOICE MESSAGE TO HEAR
BASED ON DISPLAY

TAD DIALS AND CONNECTS
TO
SELECTED NUMBERS

5,283,818

1
TELEPHONE ANSWERING DEVICE LINKING
DISPLAYED DATA WITH RECORDED AUDIO
MESSAGE
FIELD OF THE INVENTION
The present invention relates to a device for recording and recalling messages received through telecommunication. More specifically, the invention relates to a
telephone answering device that displays information
about messages recorded within the device and provides selective access to those messages based on the
displayed information.
BACKGROUND OF THE INVENTION
Most everyone is well acquainted with the standard
telephone answering machine. Such a machine is
hooked up to a telephone and by means of a tape recorder device and magnetic tape, it records oral messages from the caller. While such a machine has the
advantage of allowing the user to receive messages
when he is not present and cannot answer the phone, it
has several disadvantages:
(1) The owner of the machine must play back many
minutes of taped voice messages just to know who
has called. (2) The owner can not intelligently
search for a specific caller's recorded message. (3)
To retain a list for later callback after listening to
messages, the owner must either keep tape unerased, or must copy down the list with a pen and
paper. (4) The caller must speak his name, phone
number, etc. into his phone in order for the message to be transmitted through the phone system
and recorded on the answering machine on the
other end of the line. Since many callers feel uncomfortable talking to machines, some callers don't
leave messages and merely hang up the phone. (5)
An additional inconvenience occurs when the user
wishes to retrieve stored messages by phone. He
must on occasion hang on the phone for many
minutes for all recorded voice messages to be
played in their entirety and must copy with pen and
paper in order to have a hard copy. This is not only
inconvenient, but may be quite costly, particularly
if the call to retrieve messages is a long distance
call and the user is interested in a particular message that is preceded by a number of lengthy, less
interesting, voice messages.
A partial solution to many of these disadvantages was
offered by the "Telephone Electronic Answering Device" (TEAD) by the present inventors, disclosed in
U.S. Pat. No. 4,304,968, which is incorporated herein
by reference. The TEAD is capable of receiving and
storing messages such as the callers' names and telephone numbers and times of receipt of such messages by
converting dual tone-touch tone frequencies (DTMF)
or rotary dial pulses, generated by the caller dialing his
own phone number, into proper digital data representing the caller's phone number and indicating the caller's
name if pre-stored in memory by the user. The entire
pre-stored message could then be retrieved and displayed on command on a display provided on the
TEAD or printed out to provide a permanent record.
The message stored by the TEAD, however, is limited. It only includes information pre-stored in its internal memory that is associated with a caller's phone
number, or, in some instances, only the caller's number
and the time of day. It is known that in many environ-

2

ments, caller's wish to leave more information in their
messages, such as the urgency of the call. In many cases,
a return call is not necessary if a simple descriptive
message is left. With the TEAD, the user would have to
5 call back the caller to get any such message in person,
wasting effort and telephone line charges. The TEAD
does provide some mechanism for leaving slightly more
information by selecting from a limited menu of messages, such as "Urgent," but playing that menu for the
10 caller takes time and the menu choices will only cover
a very few limited choices of the messages that callers
actually want to leave.
Also currently available are voice mail systems,
15 which organize voice messages according to the called
party. Each stored message is associated with one or
more persons that are service members of the voice mail
system. Each voice message to a called party is then
organized sequentially in a chronological order as in the
prior art sequential tape recording answering devices.
20 These voice mail systems lack the ability to access a
voice message selectively by name, since there is no
way a user can determine the identity of any of the
callers without listening to the messages.
25 It is also known that digital recording of voice messages can be used to replace the magnetic tape, but
again selective accessing of a particular individual's
messages in selective order is not possible.
30

SUMMARY OF THE INVENTION

Thus, it is an object of the invention to provide a
telephone answering device ("TAD") that allows visual
identification of callers, identities and selective access to
their linked recorded voice messages.
35 It is a further object that the TAD provide a link
between each recorded voice message and personal
information pre-stored in data base memory related to
that caller.
It is a further object of the invention to provide a
40 TAD that displays a list of all caller displays such list so
that the user may selectively access the voice message
associated with a given caller without having to listen
to all preceding voice messages.
In accordance with the objects of the invention, a
45 telephone answering device is provided which includes
a means of intelligently organizing voice messages,
associated entered codes such as personal IDs and home
telephone numbers, and information stored in the memory of the TAD. These codes or numbers are decoded
50 by means of the caller entering DTMF signals into the
telephone which are recognized, recorded and processed by the TAD. When processed with codes and
personal information previously entered into the device's memory, the TAD displays the identity of the
55
caller for each message, thus providing a menu of
choices in the form of a list of the callers names. This
enables the user to access individual messages in a selective manner based on the identity of the caller. The need
60 to listen to the actual voice messages to determine the
caller's identity and the need to listen to the messages
sequentially or chronologically is obviated, saving time
and effort. Additionally, the voice message is also
linked to pre-stored additional data in the data base.
65 Thus, when hearing a message, one also can view relevant associated information, such as a fax number, alternate phone number, etc., that might not have been left
in the audio message but might be important.

5,283,818

3
BRIEF DESCRIPTION

4
OF THE DRAWINGS

The above and other objects and advantages will
become apparent to those skilled in the art upon reviewing the detailed description of the preferred embodiments in conjunction with a review of the appended
drawings, in which:
FIG. 1 is a front perspective view of a telephone
answering device according to the present invention;
FIG. 2 is a block diagram illustrating the major functional circuit blocks and their connections of the TAD;
FIG. 3 is a flowchart illustrating the answer mode of
the present invention;
FIG. 4 is a flowchart illustrating the record mode of
the present invention;
FIG. 5 is a flowchart illustrating the DTMF decode
routine of the present invention;
FIG. 6 is a chart illustrating the contents of a first
memory section of the invention;
FIG. 7 is a chart illustrating the contents of a second
memory section;
FIG. 8 is a chart illustrating the contents of a third
memory section;
FIG. 9 is an illustration of the display of the invention, listing received calls;
FIG. 10 is an illustration of the display recalling information linked to one of the callers; and
FIG. 11 is a flowchart illustrating a typical operation
of the present invention.
DETAILED DESCRIPTION OF THE
PREFERRED EMBODIMENTS
FIG. 1 illustrates the front perspective view of a
telephone answering device (TAD) 25 according to the
invention. The TAD preferably includes a standard
telephone handset 30 having a microphone and speaker
for audio communication with a user. The remainder of
the TAD preferably includes a display/touch screen 32
and various keys 34 used to activate functions of the
TAD. Some ofthe keys 34a are arranged as a numeric
keypad, similar to standard touch-tone telephones. This
allows the TAD to be used as a standard telephone, as
well as providing access to alphanumeric input by the
user. Another set of keys 34b below the numeric keypad
includes other standard telephone functions, such as
flash, redial, mute and speaker, which allows audio
communication without the handset, as is known.
A third set of keys 34c are used for access to a stored
database within the TAD that contains information
about calIers, as described more fully below. Inputting
the information to the database is accomplished similarly to the disclosure of the inventor's above-mentioned U.S. Pat. No. 4,304,968. A fourth and fifth set of
keys 34d,34e are used for accessing identification data
about recorded messages and then accessing and retrieving those messages. A key 36 for recording the
outgoing message of the TAD is included, as is a standard "on-off" key 38. All of these keys 34a-e,36,38 and
their functions are described more fully below with
respect to the preferred embodiment.
The display/touch screen 32 is shown in a state when
several messages have been received and recorded by
the TAD. The display preferably indicates the identity
4{) and phone number 42 of the calIers who recorded the
messages, this information preferably being retrieved
from the database as described more fully below.
Through actuation of the touch screen 32 or keys
34d,34e, it is possible to playback any of the voice mes-

sages left by the displayed callers, in any sequence, and
to perform other functions, such as automatically dialing the particular caller's number to return the call, as
described more fully below.
By creating an internal link between the recorded
S
voice message and stored digital database data, an intelligent organized voice/data message (IOVDM) is
formed that can be displayed with alphanumeric information, played back as analog recorded voice, pro10 cessed in a database, etc.
FIG. 2 illustrates the block diagram of the circuit
elements comprising an embodiment of the present invention.
The microcontroller 1 is preferably a 68HCll, manu15 factured by Motorola Semiconductor. The microcontroller internally is comprised of memory 2 containing
.RAM memory and EPROM memory circuits that are
known to those skilled in the art. The RAM memory
functions as read/write memory used for string data and
20 temporary system status events of the microcontroller.
In the present invention, the RAM memory of the microcontroller 1 is also used for the storage of telephone
numbers, names, user identification codes and voice
messages. Similarly, the EPROM memory stores the
25 program instructions for the control and operation of
the microcontroller. These circuit elements are organized and connected in a data/address and control circuit bus structure 20, the general structure of which is
known in the art.
The display controller 3 is a known circuit that con30
verts data and control signals from the microcontroller
unit into video signals that produce character and
graphic information on the display unit 4. The display
controlier 3 is preferably a circuit comprising the Sig35 netics 2670, 2672 and 2673 CRT controller integrated
circuit set The display controller 3 drives the display
unit 4 to produce visual display output with character
and/or graphic indicia to be presented to the user.
The display unit 4 is overlaid with a touch screen 5,
40 such as that available from Microtouch, Wilmington,
Mass. The touch screen 5 is an input device that presents an X-Y positional coordinate pair to the microcontrolIer 1 indicating the position touched on the screen 5.
Through the use of software within the microcontroller
45 memory, the touch screen is positionally mapped onto
the underlying indicia, allowing the user to select or
indicate information and functions displayed on the
display unit 4.
The speech recorder/playback and DTMF trans50 ceiver circuit 6 is preferably comprised of the
DS2271DK speech recorder/playback board manufactured by DalIas Semiconductor, DalIas, Tex. Illustrated
in FIG. 2 is the microphone input 7 and the speaker
output 8 interfaced to the speech recorder/playback
55 circuit 6 which enables the user to record and playback
voice messages.
The function ofthe voice record/playback circuit 6 is
to record voice messages into and from the memory 2,
and to later play back these voice messages. Other func60 tions of the circuit 6 include DTMF decoding, line
status determination and DTMF generation. The messages are recorded either through the microphone unit
7, which is intended for the recording of the outgoing
message, or through the data access arrangement circuit
65 (DAA) 10 that interfaces tip and ring lines to a standard
RJ11 jack 11, which is preferably connected to a line on
the public telephone line. The voice playback function
provides an output voice signal either through the

5

5,283,818

6

speaker 8 or through the DAA 10 connected to the
10, the microcontroller then proceeds to block 120 in
telephone line. The DAA 10 is preferably the CH1840
which it reads the variable stored in memory indicating
manufactured by Cermetek Microelectronic Company,
the number of rings to wait before answering the incomSunnyvale, Calif.
ing call (INC). The microcontroller then preferably
The DAA 10 also provides a signal indicating the 5 multiplies this number by 6 (a standard ring is 2 seconds
incoming ring signal status to the microcontroller 1 via
with a 4 second silence gap) and counts down that numwire connection 25 as illustrated. After a preprober of seconds before answering.
grammed number of ring signals, which may be adjustAs illustrated, during this delay, the microcontroller
able, the TAD answers the call by providing a signal on
checks every 6 seconds to determine if the ringing has
"line 26. This line, which is connected to the DAA 10 10 stopped, If no ring is present, this indicates that the
causes the DAA 10 to put the telephone line in the
caller hung up. The microcontroller would then return
off-hook state, thereby causing the TAD to answer the
to block 100. If the timer successfully counts down, the
call.
system progresses into the outgoing message state
Voice signals are transmitted to and from the tele(block 150).
phone line through the RJ11 connector 11 and pass 15 The microcontroller causes the DAA to create an
through the DAA 10 to the voice recorder/playback
off-hook state and then causes the voice/recorder playcircuit on RCV and XMIT lines. This voice signal is in
back circuit 6 to transmit the pre-recorded outgoing
analog form when inputted to the voice recorder/message (OGM) through the DAA to the telephone
playback circuit 6. As illustrated, these connections
line. The OGM is preferably stored as message #1 in
ReV and XMIT are capacitivelycoupled between the 20 memory 2. As described below, the OGM would inDAA 10 and the voice recorder/playback circuit. The
elude instructions for the caller to enter a home phone
voice signal is preferably digitized and stored in the
number or other caller identifying information.
voice memory section of the memory 2 by means oftheWhen
the playing of the OGM is completed, the
recorder/playback circuit 6, "although other storage
microcontroller preferably waits 5 seconds (block 160).
means, such as analog memory circuits, are possible. 25 This 5 second grace period prevents malfunction of the
The microcontroller 1 controls the functioning of the
TAD due to silence by the natural pause or hesitation of
voice/playback circuit such as with PLAY, RECORD,
caller before or during enunciation of a message. At
ERASE, and STOP signals along with the signals corblock 170, the microcontroller determines if voice or
responding to message numbers.
DTMF signals are being transmitted. The microconThe PLAY, RECORD, ERASE, and STOP signals 30 troller can distinguish three states-voice
signals,
to the recorder/playback circuit 6 are received from the
DTMF signals, or silence=-by reading the level and
microcontroller via the output bus 13 as illustrated.
modulation of the signals on the telephone line. The
These control functions are activated by means of the
DS2271DK voice recorder/playback unit can distinmicrocontroller toggling pins connected to bus 13, and
guish between the tones ofDTMF signals and the signal
selecting the desired message number through an output 35 level ranges associated with human speech detected on
port on the microcontroller 1 via the bus connection 14
the telephone line. If voice signals are transmitted, the
as illustrated.
microcontroller executes the voice record routine. Ifno
The DTMF signals received from the telephone netvoice is present on the line, but DTMF signals are being
work are decoded as is known by the voice recorderz'transmitted, the micro controller executes the DTMF
playback circuit 6. Through the same circuit, the en- 40 decode routine.
ergy level on the telephone line can be detected, indiIf, however, there is silence on the telephone line for
eating to the microcontroller if there is voice signals on
5 seconds, themicrocontroller then causes the DAA to
the line (varying energy level), DTMF signals (steady,
go into the on-hook mode (block 240), thereby hanging
known energy levels), or a dial tone or silence on the
up from the call. The TAD now returns to its initial
line (steady high or low energy level). The determina- 45 state in the answer mode routine of looping and checktion of the status of the line, in conjunction with the user
ing for a user key touch and waiting for a ring signal.
setup mode provides input to the decision of the next
The process for determining line silence, voice enmachine operation, as will be illustrated.
ergy or DTMF signaling is illustrated in blocks 180, 190
and 200. If block 190 is true (voice energy present),
System Operation
50 program execution follows to block 220, the record
routine If, however, there is a DTMF tone present,
FIG. 3 is a flowchart illustrating the answer program
execution follows to block 230, the DTMF decode
mode of the present invention, in which the TAD loops
routine.
and checks for an incoming call on the telephone line or
Block 220, the record function, is illustrated in FIG.
for the user to activate a key.
As illustrated in FIG. 3, the TAD first determines if 55 4 and begins with the allocation of voice memory and
data memory at block 300. This function increments a
the user has pressed a key on the TAD (Decision block
memory variable stored in EPROM that points to the
1(0). This is done by means of the microcontroller readnext memory position allocated in the voice memory
ing its RS232 serial data port connected to the touch
and data memory stored in memory circuit 2. This proscreen 5 through connection 20 to determine if the
screen has been touched. The microcontroller 1 is also 60 cess is required in order to organize the data and voice
memory and link them together. Memory organization
connected an monitors the other keys 34a-e on the
ofthe TAD is described more fully below.
TAD. If an X-Y coordinate pair is read and the parameAt block 310, the voice message memory is accessed.
ters of the X-Ypair map onto the boundaries ofa known
The record function is then executed and voice recorkey, a true key has been depressed and the microcontroller 1 calls the user mode routine (block 101).
65 der/playback circuit begins digitizing the analog voice
and stores this data sequentially in the voice memory 2.
If no key has been pressed, the system next tests if a
The record function is now in process and operating as
ring signal is available (block 110). If a ring signal is
a parallel task to the task of determining the line status.
available, determined by reading the state of the DAA

a

7

5,283,818

At block 320, data is then analyzed at block 330 (is there
a dial tone). If this test is false, the block 340 (is there a
DTMF tone) is executed.
If both these blocks (330 and 340) generate a false,
then control is looped back to block 320, input signal
levels, and allows the voice record routine to continue.
This looping back will compensate for momentary silence or gaps in the voice message. If block 330 is true,
i.e., there is a dial tone, then the voice recording routine
is stopped at block 350 and the telephone line is put
on-hook at block 370. The TAD then returns to answer
mode (shown in FIG. 3) at block 390.
If block 340 is true, then there is a DTMF signal and
the record routine is stopped at block 36 and block 380
calls the DTMF decode routine shown in FIG. 5. This
routine decodes the DTMF signals keyed into the tele.phone by the caller and stores the code in memory of
the TAD and links it to the voice memory if a voice
message is recorded.
Operation is entered to the. DTMF decode routine
when a DTMF signal is sensed via the input function
and begins at block .wo (allocate voice and data memory). This process sets up data memory for receiving
the DTMF signaling and links the data memory to
voice message memory if a voice message has already
been recorded. If a voice message has not yet been
recorded it allocates an available message number in
case a voice message is left later. This allows the system
to be.flexible and will allow the user to key in a DTMF
LD. code anytime during the message sequence.
Control proceeds to block 410 to read the levels of
the telephone line. At block 420, the microcontroller
determines if there is still a DTMF signal on the line.
If block 420 is true, control is looped back to input
block 410. This input and test loop continues until the
DTMF signal stops indicating either the standard silent
interval between DTMF digits or perhaps that the
DTMF signaling has been completed and a voice message has been initiated. If decision block 420 generates a
false, it is determined at block 430 if a voice signal is
present. If a voice signal is present, block 440 passes
control back to the record function routine of FIG. 4.
If no voice signal is on the line, block 430 generates a
false, and control passes to block 450 in which it is
determined if silence or a dial tone is present on the line.
Silence indicates an inter-digit silence and control
passes to block 470, which stores the decoded DTMF
digit and passes control back to block 410 to read the
next DTMF digit.
If, however, there is dial tone on the line, indicating
that the caller has disconnected, block 450 instead
passes control to block 460, which puts the TAD in the
on-hook mode and proceeds to block 480. Block 480
passes control to the answer mode routine of FIG. 3.
Now, the TAD is ready for a new incoming call or for
the user to activate a key function by pressing the touch
screen.
Memory Organization
The memory circuit block 2 (FIG. 2) connected to
the microcontroller 1 as further illustrated in FIGS. 6,7
and 8 is the storage means where the user options, commands, data and voice messages are stored and interact
with the microcontroller unit 1 and the voice record/playback circuit 6 in order to accomplish the features as
taught in the present invention.
The data entered by the user for the functioning of
the present invention are textual names of the callers as

8

they would appear on the display 4. For example, "Sid
Ceaser" with the user's identification code, i.e.
497-6201 as well as additional related data. This data is
stored in the memory and organized by the database
5 portion of the programming in memory section illustrated in FIG. 6. The address or relative position ofthis
data in the memory section can change as new names
are entered or deleted as controlled and organized by
database functions in the microcontroller.
10 The recorded messages which are entered by the
caller can be composed either of 1 or 2 parts, a diaital
data part and a digitized analog part. The first part,
which is the digital data portion, is composed of the
data acquired by the DTMF decoding function as illus15 trated in the flowchart of FIG. 4 and is stored as binary
numbers in memory section 2 as illustrated in FIG. 7. As
explained, this digital data, which is composed of the
translated code as entered by the caller from DTMF
keypad, also contains an address link byte to the voice
20 message if the user had also recorded a voice message
along with this data message.
The voice message memory as required by the voice
record/playback circuit 6 is a separate section of the
memory, i.e. memory section 3 as illustrated in FIG .•.
25 The voice recorder/playback circuit 6 preferably
digitizes and compresses the voice message and presents
it to the microcontroller which stores it in a specific
format in a separate section (section 3) of memory. The
format is preferably composed of 128 byte speech re30 cords of which each voice message is composed of an
integral number of records. The first byte of each record contains a number specifying which message number it is part of. The valid message numbers are prefersbly 1 to 254 although more, of course, are possible.
3S Therefore, a preferred maximum of 253 messages exits
with 'message 1 being the OGM. This message number
in the record is used to link to the digital data message
which contains the same message number.
Therefore, as explained, there are three sections of
40 memory which can be linked together by the database
program function to form an intelligent organized voice/data message IOVDM) as taught in the present invention,
These memory sections are:
4S Memory Section 1) The database entry by the user of
the names with the associated data, such as telephone
number and address, and the caller's I D which could
be the caller's home or business telephone number or
any unique code. (FIG. 6)
50 Memory Section 2) The message memory containing
caller entered I.D. code data and linked message
numbers. (FIG. 7)
Memory Section 3) The message memory containing
voice message data recorded by the caller. (FIG. 8)
SS A message as recorded by the caller can be composed of
any of the following types:
1) A voice message alone.
2) A data message alone as described in U.S. Pat. No.
4,304,968 by the inventors of the present invention.
60 3) A voice message as described in (1) linked to a data
message as described in (2) that are linked together
into an intelligent organized voice data message
(IOVIDM) as taught by the present invention.
The linking together of these separate data memory
6S and voice memory elements in an IOVDM is performed
by the database function and displayed on the display.
To perform this linking, a reserved byte of memory
attached to the data message is stored which indicates

9

5,283,818

the voice message number it is linked to. The database
program code then searches the database entry section
. in which the user entered the data such as name, address
and phone number. If a match is found between these,
the information is presented to the user as an IOVDM.
Other ways of linking the voice messages and data
messages are possible. In one alternate configuration,
each data message precedes its corresponding
voice
message in contiguous memory bytes.

5

10

Example of Operation
For proper functioning of the TAD, it is preferred
that database information, such as names, phone numbers and address, personal and/or business reference
notes, etc. is entered by the user. Using keys 34c for
accessing the database, information,
such as "Regis
Lamb" and his associated phone number "431-9762"
plus other additional information may be entered. As
seen in FIG. 6, several telephone numbers can be stored
for an individual. Preferably, they would be coded, for
example, with an "0", "H", "M" or other letters, signifying "office", "home", "mobile", etc. The database can
have as many entries as the user desires and the specific
memory size will allow. The user preferably also records the OGM, which would preferably include instructions for the caller to enter his home phone number
or caller identifying number on a touch tone phone and
then to record a voice message.
It is to be understood that any incoming signals over
the telephone line with a voice message that is recognizable by the TAD and is generally unique to the caner
may be used instead of DTMF tones.
The unit is then left in the answer mode. Upon receiving a call (detecting rings), the TAD puts the telephone
line in an off-hook state (Block 500, FIG. 11) and plays
the outgoing message to the caller (Block 510).
If, for example, Regis Lamb were the fourth caller
since the messages were last cleared, he would enter his
home phone number, as requested by the OGM (Block
520). The microcontroller
records the decoded identifying information in memory section 2, along with the
available message number, in this case "5", as shown in
FIG. 7. The microcontroller
then searches all of the
phone numbers stored in the database and matches the
received phone number to the stored data record and
recalls Mr. Lamb's for display as message 4 (Block 530)
This is shown on the example display in FIG. 9. The
microcontroller
also records Mr. Lamb's voice message
as message number 5 (FIG. 8), linking that voice message with the recalled data record through the list in
memory section 2.
Later, the user would come home and press, for example, the "Display New Messages" key to see a list of
the messages as shown in FIG. 9. By pressing on Mr.
Lamb's name on the touch screen or the corresponding
keypad number, only the fourth message would be
played back from the proper location in memory, avoiding having to hear any other unwanted messages (block
540,550). Simultaneously, the entire data record matching Mr. Lamb could also be displayed on the display
while the voice message is being played back (Block
560), as shown in FIG. 10.
By merely pressing, "Return Call," the microprocessor would retrieve the phone number from the data
record and produce the DTMF tones on the telephone
line to dial Mr. Lamb. If more than one phone number
appears on Mr. Lamb's data display, the touch screen or

15

20

25

30

35

40

45

50

55

60

65

10

corresponding
keypad number could be used to select
and then dial any of the numbers (Block 570, 580).
While the embodiments shown and described are
fully capable of achieving the objects of the invention,
it is to be understood that these embodiments are shown
only for the purpose of illustration and not for the purpose of limitation.
What is claimed is;
1. A telephone answering device coupled to a telephone line for. automatically answering incoming telephone calls and storing and retrieving information from
the incoming telephone calls comprising;
means for storing a predetermined
list of names and
associated stored identifying information;
means for receiving first signals from said telephone
line, each of said first signals specifying a particular
one of a plurality of callers;
means for receiving a voice message from each of
said callers on said telephone line and storing said
voice message.
means for converting each of said received first signals into received identifying information;
means for linking each received identifying information with the corresponding
voice message;
means for comparing each received identifying information with said predetermined list;
means cooperating with said comparing means for
simultaneously
displaying a plurality of callers'
names whose respective received identifying information matches stored identifying information in
said list; and
means for allowing a user to select anyone of the
plurality of simultaneously displayed callers' names
from said display means, said selecting means also
automatically directly audibly retrieving the voice
message associated with the selected caller's name
without scrolling individually through either the
displayed names or voice messages.
2. The telephone answering device as in claim I,
wherein said means for displaying is also adapted to
simultaneously display the corresponding caller's name
and associated stored identifying information when the
voice message associated with the selected caller is
audibly retrieved.
3. The telephone answering device as in claim 1 further comprising input means with a plurality of alphanumeric and function keys for controlling the inputting
and retrieval of information from said device.
4. The telephone answering device as in claim 3 including means cooperating with said input means for
automatically dialling a caller's number in response to
being actuated by the user.
5. The telephone answering device as in claim 4
wherein said number is automatically
retrieved from
Said stored identifying information.
6. The telephone answering device as in claim 3 in
which said device is incorporated in a telephone instrument, said input means performing the combined functions of dialling telephone numbers and controlling said
device.
7. The telephone answering device as in claim 1 in
which said device contains a display means for visually
displaying stored identifying information and received
identifying information.
8. The telephone answering device as in claim 1 including means for printing out callers' names.
9. The telephone answering device as in claim 1 including means for storing the time of incoming calls.

11

5,283,818

10. The method of automatically answering incoming
telephone calls and storing and retrieving information
from the incoming telephone calls with a telephone
answering device having a memory which is coupled to
a telephone instrument comprising the steps of:
storing a predetermined list of names and associated
stored identifying information in said memory;
receiving signals specifying the caller of each incoming call;
receiving a voice message from the caller and storing
it in said memory;
converting said received signals into received identifying information;
comparing said received identifying information with
said predetermined list and displaying the caller's
name if the received identifying information
matches any stored identifying information identical in said predetermined list;
displaying simultaneously a plurality of callers' names
whose respective received identifying information
matches stored identifying information in said list;
linking each displayed caller's name with its corresponding voice message;
selectively directly retrieving the voice message corresponding to anyone of the displayed caller's
names by selecting that caller's name without
scrolling through either said displayed names or
voice messages.
11. A method as in claim 10, further comprising the
step of simultaneously displaying the corresponding
caller's name and stored identifying information when
the voice message associated with the selected caller's
name is audibly retrieved.
12. A telephone answering device coupled to a telephone line for automatically answering incoming telephone calls and storing and retrieving information from
the incoming telephone calls, comprising:
means for receiving a signal having an identifier from
said telephone line identifying the caller of an incoming call;
means for receiving a voice message from said caller
and storing said voice message;
means for linking said identifier with the corresponding voice message;
means for displaying the identifiers for a plurality of
incoming calls; and
means for selecting anyone of the identifiers from
said display and audibly directly retrieving the
voice message linked to the selected identifier
without scrolling through individual displayed
identifiers.
13. A telephone answering device coupled to a telephone line for automatically answering incoming tele-

12

phone calls and storing and retrieving information from
the incoming telephone calls comprising:
a microcomputer having a read only member (ROM)
for providing a program for said microcomputer, a
random access memory (RAM) with a plurality of
5
storage sections therein and peripheral interface
means for coupling peripheral means to said microcomputer;
a keyboard means having a plurality of alphanumeric
and function keys coupled to said microcomputer
10
by said peripheral interface means;
an alphanumeric display means mounted on said device and coupled to said microcomputer by said
peripheral interface means;
15
said RAM having a predetermined list of names and
associated identifying information stored therein in
a first memory section thereof;
an analogue telephone interface system coupled between said telephone line and said microcomputer
20
having a line seizing means for connecting said
device to said telephone line after a predetermined
number of rings;
a telephone signal converter means coupled between
said telephone line and said microcomputer for
converting a telephone number transmitted over
25
the telephone line into digital form understandable
by said microcomputer;
a voice recording means coupled between said telephone line and said microcomputer for receiving
and storing in digital form a voice message in a
30
second memory section of said RAM;
said microcomputer comparing converted incoming
telephone numbers with said list stored in said first
memory section of said RAM;
means for displaying a caller's name and said incom35
ing telephone numbers which the caller's transmitted telephone number corresponds to a telephone
number previously stored in said first memory
section, said means for displaying cooperating with
40
said microcomputer and simultaneously displaying
a plurality of caller's names;
means for linking each caller's name to its associated
voice message;
means for allowing a user to select anyone of the
45
simultaneously displayed caller's names and for
simultaneously audibly retrieving the voice message associated with the selected caller's name
from said second memory section without scrolling
through individual displayed names or stored voice
50
messages.
14. A telephone answering device as in claim 13
wherein said means for displaying is also adapted to
display a caller's name and stored identifying information when the linked voice message is audibly retrieved.
•
55

• •

60

65

• •