e-Watch Inc. et al v. Apple, Inc.

Filing 1

COMPLAINT against Apple, Inc. ( Filing fee $ 400 receipt number 0540-4435336.), filed by e-Watch Inc., e-WATCH CORPORATION. (Attachments: #1 Exhibit 1, #2 Exhibit 2, #3 Civil Cover Sheet, #4 Summons(es))(Goodpastor, Christopher)

EXHIBIT 2

111111

1111111111111111111111111111111111111111111111111111111111111
USOO7643168B2

(54)

(76)

United States Patent

(10)

Monroe

(12)

(45)

APPARATUS FOR CAPTURING,
CONVERTING AND TRANSMITTING A
VISUAL IMAGE SIGNAL VIA A DIGITAL
TRANSMISSION SYSTEM
Inventor:

4,891,650
4,910,692
5,027,104
5,027,114
5,042,061
5,091,780
5,111,291
5,136,628
5,164,979
5,166,746

David A. Monroe, 740 Lincoln Center,
7800 IH-lO West, San Antonio, TX (US)
78230

( *)

Notice:

(21)

Filed:

A
A
A
A
A
A
A
A
A
A

111990 Sheffer
3/1990
6/1991
6/1991
8/1991
2/1992
5/1992
8/1992

1111992
1111992

Appl. No.: 11/617,509

(22)

Patent No.:
US 7,643,168 B2
Date of Patent:
Jan. 5,2010

(65)

Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.c. 154(b) by 134 days.

(Continued)

Dec. 28, 2006

FOREIGN PATENT DOCUMENTS

Prior Publication Data
US 2007/0109594 Al

EP

(63)

(51)

Int. Cl.
H04N 1/00
(2006.01)
G06F 3/12
(2006.01)
U.S. Cl. ...................... 358/1.15; 358/402; 358/403;
358/407
Field of Classification Search ................ 358/1.15,
358/402,403,407,442,468,474
See application file for complete search history.
References Cited

(56)

U.S. PATENT DOCUMENTS
4,163,283
4,179,695
4,197,536
4,516,125
4,688,244
4,831,438
4,845,629
4,857,912

5/1987

(Continued)

Continuation of application No. 10/336,470, filed on
Jan. 3, 2003, now Pat. No. 7,365,871.

(58)

220752

May 17, 2007

Related U.S. Application Data

(52)

Outram
Reid
Kawashime et al.
Kaneko et al.
Pomerleau
Erickson
Araki et al.
Choi et al.
Sato et al.

A
711979 Darby
A
1211979 Levine et al.
A
411980 Levine
A
511985 Schwab et al.
A * 811987 Hannon et al. ................ 377/58
A
511989 Bellman, Jr. et al.
A
711989 Murge
A
811989 Everett, Jr. et al.

OTHER PUBLICATIONS
Apr. 1966, Apollo Unified S-Band System, NASA-Goddard Space
Flight Center, Greenbelt, Maryland.
(Continued)

Primary Examiner-Houshang Safaipour
(57)

ABSTRACT

An image capture, conversion, compression, storage and
transmission system provides a data signal representing the
image in a format and protocol capable of being transmitted
over any of a plurality of readily available transmission systems and received by readily available, standard equipment
receiving stations. In its most comprehensive form, the system is capable of sending and receiving audio, documentary
and visual image data to and from standard remote stations
readily available throughout the world.
31 Claims, 73 Drawing Sheets

US 7,643,168 B2
Page 2

u.s. PATENT DOCUMENTS
5,218,367
5,243,340
5,243,530
5,268,698
5,283,643
5,321,615
5,334,982
5,351,194
5,400,031
5,400,068
5,408,330
5,432,838
5,440,337
5,440,343
5,448,243
5,463,595
5,469,371
5,485,504
5,497,149
5,508,736
5,517,683
5,530,440
5,546,194
5,550,646
5,553,609
5,557,254
5,557,278
5,598,167
5,612,668
5,627,753
5,629,691
5,636,122
5,642,285
5,666,157
5,666,159
5,670,961
5,677,979
5,689,300
5,689,442
5,712,679
5,712,899
5,714,948
5,742,336
5,751,346
5,777,551
5,777,580
5,793,416
5,835,059
5,850,180
5,867,804
5,917,405
5,926,210
5,933,098
5,938,706
5,974,158
5,983,161
5,995,041
5,999,116
6,002,427
6,009,356
6,035,212
6,036,086
6,067,571
6,069,655
6,072,600
6,078,850
6,084,510
6,092,008
6,100,964
6,133,941
6,154,658

A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A

*
*
*

*
*

*

*
*
*

611993
911993
911993
1211993
211994
611994
811994
911994
311995
311995
411995
711995
811995
811995
911995
1011995
1111995
111996
311996
411996
511996
611996
811996
811996
911996
911996
911996
111997
311997
511997
511997
611997
611997
911997
911997
911997
1011997
1111997
1111997
111998
111998
211998
411998
511998
711998
711998
811998
1111998
1211998
211999
611999
711999
811999
811999
1011999
1111999
1111999
1211999
1211999
1211999
3/2000
3/2000
5/2000
5/2000
6/2000
6/2000
7/2000
7/2000
8/2000
10/2000
1112000

Sheffer et al.
Norman et al.
Stanifer et al.
Smith, Sr. et al.
Fujimoto
Frisbie et al.
Owen
Ross et al.
Fitts
Ishida et al.
Squicciarini et al.
Purchase
Henderson et al.
Parulski
Bethke et al.
Rochall et al.
Bess
Ohnsorge
Fast
Cooper
Collett et al. ............ 455/575.1
Danzer et al.
Ross .......................... 358/445
Hassan et al. ............... 358/442
Chen et al.
Johnson et al.
Piccirillo et al.
Zjderhand
Scott
Brankin et al.
Jain
Shah et al.
Woo
Avid
Parulski et al. ... ... ..... 348/211.2
Tomita et al.
Squicciarini
Shibata et al ............ 348/14.07
Swanson
Coles
Pace, II
Farmakis et al.
Lee
Dozier
Hess
Jankyet al.
Rostoker et al.
Nadel et al.
Hess
Pilleyet al.
Joso
Hackett et al.
Haxton
Feldman
Auty et al.
Lemelson et al.
Bradley et al.
342/357.1
Evers
Kipust
Monroe
Rostoker et al. . ........ 455/552.1
Sizer et al. .................. 235/375
Igarashi et al.
Seeley
Wertsberger ................ 358/479
Kane et al.
Lemelson et al.
Bateman
De Cremiers
Ono
Caci

6,157,317
6,181,373
6,195,609
6,226,031
6,243,056
6,246,320
6,259,475
6,275,231
6,278,965
6,282,488
6,292,098
6,356,625
6,385,772
6,424,370
6,462,697
6,476,858
6,504,479
6,522,532
6,525,761
6,549,130
6,556,241
6,570,610
6,628,835
6,646,676
6,662,649
6,675,386
6,698,021
6,720,990
7,113,971
7,310,072
7,372,447
2003/0071899
2005/0055727
2005/0130803

A
Bl
Bl
Bl
Bl *
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
B2
B2
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
B2
Bl
Al
Al
Al

12/2000
112001
2/2001
5/2001
6/2001
6/2001
7/2001
8/2001
8/2001
8/2001
9/2001
3/2002
5/2002
7/2002
10/2002
1112002
112003
2/2003
2/2003
4/2003
4/2003
5/2003
9/2003
1112003
12/2003
112004
2/2004
4/2004
9/2006
12/2007
5/2008
4/2003
3/2005
6/2005

Walker
Coles
Pilley et al.
Barraciough et al.
Jachimowicz et al. ......... 345/82
Monroe
Ramachandran et al.
Obradovich
Glass et al.
Castor et al.
Ebata
Casteiani
Courtney
Courtney
Klamer et al.
Ramirez Diaz et al.
Lemons
Liao et al.
Sato et al.
Joso
Yoshimura et al.
Kipust
Brill
DeGrace
Knight et al.
Hendricks et al.
Amini
Walker et al.
Ohi et al.
Ronzani
Jacobsen et al.
Joso
Creamer et al.
Rastegar

FOREIGN PATENT DOCUMENTS
EP
EP
EP
EP
EP
EP
EP
EP
JP
JP
JP
JP
JP
JP
JP
WO
WO
WO
WO
WO

232031
532110
209397
613109
613110
744630
785536
613111
03089691
6-301898
9-282600
HEI-I0-66058
A-1O-155040
9-251599
11-160424
W090/04242
W095/27910
W096112265
W097/37336
W098/52174

8/1987
3/1993
7/1993
8/1994
8/1994
1111996
7/1997
8/1998
4/1991
10/1994
10/1997
3/1998
6/1998
4/1999
6/1999
4/1990
10/1995
4/1996
10/1997
1111998

OTHER PUBLICATIONS
Nov. 24, 1976, TELEXIS ViaNet General Information Booklet Version 1.3.
2000, ViaNet 3000 Administrator's Manual Version 1.1- NetXpress
Video by TELEXIS, Kanata, Ontario, Canada.
1999 Vianet 3000 Operator Manual Version 1.0-NetXpress Video
by TELEXIS, Kanata, Ontario, Canada.
1999 ViaNet 3000 Administrator Manual Version 1.0-NetXpress
Video by TELEXIS, Kanata, Ontario, Canada.
1999 ViaNet 3000 Instruction Manual Operator's Revision
I-NetXpress Video by TELEXIS, Kanata, Ontario, Canada.
Office Action issued on Oct. 4,2007 in U.S. Appl. No. 111617,509
(present application).
Office Action issued on Dec. 12,2008 in U.S. Appl. No. 111617,509
(present application).

US 7,643,168 B2
Page 3
Office Action issued on Sep. 27, 2004 in U.S. App\. No. 10/336,470
(the parent of the present application).
Office Action issued on Aug. 9, 2005 in U.S. App\. No. 10/336,470
(the parent of the present application).
Office Action issued on Dec. 16,2005 in U.S. App\. No. 10/336,470
(the parent of the present application).

Office Action issued on Ju\. 27, 2006 in U.S. App\. No. 10/336,470
(the parent of the present application).
Office Action issued on Mar. 8, 2007 in U.S. App\. No. 10/366,470
(the parent of the present application).

* cited by examiner

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 1 of73

28

24
G-m
ENCODING &

G-m
CORRECT
TRANSMIT PROTOCAl

COMPRESSION

26

o
COMMUNICATION
CHANNa

36
G-1II
CORRECT

RECEIVE PROTOCOL

32~

40

42

G-m
DECODING "
DECOMPRESSION

'~----------------~--------________- J /

h"' 34

'TYPICAL GROUP 1II Ff« OEVICE

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 2 of73

48

AG.2
t----6---rCOMPRESSION

52

54

28

24
G-lI[
'----t

ENCODING &
COMPRESSION

G-lJI

TRANSMIT

PROTOCOL

36
G-1II
RECEIVE

PROTOCOl
'~

COMMUNICAlION
CHANNEl.

38

42

G-m

DECODING &
DECOMPRESSION

__________________

~

__________________- J /

hi::

34
lYPfCAl GROUP III FAX DEVICE

u.s. Patent

Jao.5,2010

Sheet 3 of73

US 7,643,168 B2

FIG. 3

48

54
52

COMMUNlCAlION
CHANNEL

28

G-:m:
TRANSMIT

PROTOCOL

36

G-1II
RECEIVE
PROTOCOl
'~

38

G-1II

OPTIONAL

DECODING &
DECOMPRESSION

________________________

-'~

VIEWER
________________________-J/

1"(034
TYPICAl GROUP JJI FAX DE.VICE

~

7Jl
•

FIG. 4

~
~

OPTIONAL ~ 48

VIEWER
,

~

~

COMMUNtCA110N

=

CHANNa

~

~
~

?
~Ul

N

o
o

....

rFJ

=-

('D
('D

.....

.j;o.

sa i~3

....

0

-....l

(.H

COMPRESSION h __ "tPROTOCOLt\.

fIJ./ ~~I
77

*-1

~::s I
'-79

I D,I~i
r81
....

Ib.

·r -: :PA

,

~

i

d

rJl
",-.....1
0'1
~

"'w
0'1
"""'"
QO

=
N

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 5 of73

I

(I 'los
CD FAX TO TELCO
® FAX TO MODEM
®

MODEM TO TnCO
U'I.,I,.II"U 1111111,11,.111

94

11 • • • • • I.fI:J.I" • • • • • • ' I . ' •• ,I11

87

IMAGE
CARD

81

141

~~
•

72

FIG. 5

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 6 of73

156

DESKTOP

m.co

10

158
PORTABLE

I I--'
BATTERY

162

160

FIG.6B

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 7 of73

72

FIG.6C
I------~--~ mEPHONE UNE
,......-~~-~

r--L.......Ii-..,

FAXIPHONE
CELLULAR

VIDEO IN
VIDEO OUT
DC POWER
DESKTOP

u.s. Patent

Jao.5,2010

Sheet 8 of73

US 7,643,168 B2

FIG.7A

196

98

FIG. 78

~~

; " 190

u.s. Patent

Jao.5,2010

Sheet 9 of73

US 7,643,168 B2

FIG.8A-l

>--il----< CRTB+

RJll

CRT DRIVER

CONNECTOR

VIEW FINDER

J21
VERT

1 FAX I-PHONE
2
OFFHOOK
-RI
~ AUDFROMDAA
5 AUDTODAA

VFGNDl

7

6

GND
GND

VFB+

8

+5V

VFGND2
VFVID

B88-ZR
JST
ZHR-4

B
FIG.8A-3

u.s. Patent

Jao.5,2010

INPlITl
5VCURR
CHRGEI

V

-EPWR

/.

BATEMP
PON

J23
r-1
2
3

FIG. BA-2

4

J~
1

+5V
HOT5V

2

GND
GND

/.

V

~

3
4

+18V
-5.5V
+5.5V
VIN+
SAT-

~

~

5
6
7
8

JST
J6
AGND
AGND
-5V
+18V

~
V
~
V

r--

1
2

3

4
-lOY
5
+5.5V
6
-SYNON
7
SYNCLK
8
BB8-ZR
JST
J17

-

r---

I

V

~

G FIG.8A-3

J14

t--

I

9

B98-ZR

E
FIG. BA-3

FIG. BA-3 F

US 7,643,168 B2

5
6
B68-ZR
JST

~
D
FIG. BA-3

Sheet 10 of 73

2
3
4
B48-ZR

2
POWER
BOARD

3

4
ra4S-ZR
JST

~3
I
2
3
4
BAlTCONN

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 11 of 73

FIG. BA-3
FIG.8A-l
FIG.8A-l@I---------------@
FIG.8A-4
B
FIG.8A-2 E
FIG.8A-2@
LANDSCAPE CAPT

CAPTlB
J8
1
2

,~) S1

t--

)

3
4

CAPTlA

5

6

CAPT2B

r-I1
1

"
"

FAX I-PHONE
OFFHOOK
-RI

~
~

AUDFROMDAA
AUDTODM
GND
GND

+5V

2
3

CAPT2A

J22

r--

4
5

PROCESSOR

1
2
3
4
5
6

6
7
8

ALAPHAI

9

I...-

A-DIAL

+5V
HOT5V
GND
GND
+18V
-5.5V
+5.5V
VIN+
BAT-

B98-ZR
JST

7

~8
1
2
3
4
r-s48-ZR
JST

1-

J12

r--

1
2

DIALER

/
/

/
"/

"/

~

"/
"/

"/

roo--

B88-ZR
JST
r--

/
"/
'/

1f68-ZR
JST

,4)S2

PORTRAIT CAPT

INPUTI
5VCURR
CHRGEI
-EPWR
BATEMP
PON

3
B38-ZR

JST~
FIG. BA-5

t

FIG.8A-4 H

/
"/
/

u.s. Patent

F FIG.8A-2

Jao.5,2010

Sheet 12 of 73

FlG SA-3
C

US 7,643,168 B2

FIG.8A-4

G FIG.8A-2

~

~

J5

VFGNDI
VFB+
VFGND2
VFVID

~2

.-1
2
3

1
2

3
4

~

ZHR-4

VIDEO
BOARD

~

®--

FIG.8A-3

'"
''"
"
~.

i'\.

AGND
AGND
-5V
+18V
+5.5V
-SYNON
SYNCLK

JST

1
2
3

4
5
6

7
8

B88-ZR~
JST

7
8

~8-ZR

J9
..-

-lOY

5
6

FIG. SA 6

t

VIDOUT+
VIDOUTVIDIN+
VIDINIRIS OUT
PWR
HS
VS

J~

VIDEO
CONNECTOR

B88-ZR
JST

u.s. Patent

Jao.5,2010

Sheet 13 of 73

US 7,643,168 B2

+

FIG. BA-3

-

FIG. BA-5
JI6
~

POWER
ON IOFF

J15
r--

1
2
3
4
5
6
L..rPOWER SWITCH
B68-ZR
868-ZR
JST
JST
JI9
J20
I--

LED IDOOR
STATUS

-

6
L..rSTATUS & DOOR
B68-ZR
868-ZR
JST
JST
J7
J7
I-r-LlNEON
1
GND
2
LlNEOUT
3
AUDIO
CELDAT
4
CONNECTOR
CELCLK
5
EXTRIG
6
NC
7
r-ZHR-7
ZHR-J
JST
JST
Xl
J27

-=

~

MICROPHONE

LSI

"'-roViSPEAKER

6 r7 r8 !--

9 r-10 1011 r12 I-r13 l I
14
2 PROCESSOR
15
3
16 i-4
I-

5

j"'"'.....,

-- f - J10
1~
2 r3 I-4 to5 r-

r-

1
2
~

ZHR-~

JST
J28

.--

1
2

'--

ZHR-2
JST

17

18 1019 r20 I-21 I-22 I-23 I-24 I25 I--

I--

CON N25
J34
-1 I--

2 I3 r-4 I-5 I6 I7 I8 I-9 I7HR-9
JST

FIG.
8A-6

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 14 of 73

FIG.8A- 6

Jll
r--

~

1

2
3
4
5

6
7
8
9

10
11

12
13
14
15
16
17
18
19

20
21
22
23
24
25
""-CONN25
J33
r--

1

2
3
4

5
6

7
8
9

--JST

ZHR-9

SERIAL
CONNECTOR

VIDEO

BOARD

A-4

u.s. Patent

Jao.5,2010

Sheet 15 of 73

US 7,643,168 B2

AG.8B-2

FIG. 88-1
DAAIN
C24

R40

R41

"il:&Q)>--~ R39\r-...___-----!~
I!AXlXO
~-------+----+-~C

R37

R46

FIG. 88-3
F
FIG. 88-3

FIG. 88-2

1...-_--1

T

C29

FIG. 88-3
G
FIG. 88-3

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 16 of 73

@~----------------------~
FIG. 88-4

1----=:;.;;;...;;.;:;..:..----'':-1 AUDIO

FIG. 88-1

I/O

FIG. 88-1
C

SPKR

R14
5VAUD

011
SDAT

C6

"J'

1

SPEAKER
2 CONNECTION

r
RI

AUCLKl

AUOLDl

5VAUD

-5VAUD

FIG. 88-2

u.s. Patent

Jao.5,2010

FIG. 88-3

~---------

FIG. BB-l FIG. BB-I

E

FIG. BB-I
G

F
AUOUT2
AUOUn
AUOUTO

US 7,643,168 B2

Sheet 17 of 73

9
10
11

-------,

I
I
I
I
I
I

I
I

lC34!

!

~--I-5VAUD

I

12 SERIAL RAM
..--+---If--_ _--:l~3 FOR AUDIO 1.:L.----4---...l

14
15
16
5VAUDIo--=i

I
I
I
I
I
I
I
I

iii

I
I

I
I
I

AUTO

~C19
CPBEEP .

I

lCI6

C4

-----L----J----J 8~
FIG. B8-4

)Q)
I FIG. BB-5

I
I FIG.

SUMMING I

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 18 of 73

FIG. 88-4

FIG. 88-3:..-_ _t-t

R42

CD(----.

5VAUD

.------------{s
AUOUT2
AUOUTl
AUOUTO

5
C

9
10
11

12
13
14
15
16

1
I

FIG.
88-5

AUDIO
SWITCH

I
I

R4
I
I
I
I
I
I
I
I
PREAMPUFIER
1
______ - - - - - -

FIG. 88-5

10

11
12
13
14
15
fiG. 88-6 K 5VAUD

16

u.s. Patent

Jao.5,2010

Sheet 19 of 73

US 7,643,168 B2

FIG. 88-5
FIG.88-4 S } - - - - - - - - - - - - - - - .
R30

®-"vVv--< AUDINH I
FIG. 88-4
FIG. 88-4

RIO

R13

~---1-5VAUD

C32

R29

CI8

~--II-I--~ FAXRXI>

C31

I FIG. 88-3

u.s. Patent

Jao.5,2010

Sheet 20 of 73

US 7,643,168 B2

FIG. 88-6
AUCLK3

!G. 88-4

R25
R26

AUDIN2
AUDINI

AUDINO R21
AUOUT2 R22
AUOun
AUOUTO R23
\_=~ R24

u.s. Patent

Jao.5,2010

Sheet 21 of 73

5

FIG. BC-I

VIDEO BUFFER
AMPLIFIER
7
8
6

4
3
2
1

US 7,643,168 B2

CHSHUT

C2

Cl

CAMV+

~

AG.8C-2

CAMERA MODULE

D
FIG.8C-3

FI~¥,G. 8C-3

u.s. Patent

Jao.5,2010

Sheet 22 of 73

FIGI8C-2
R9
A

FIG. BC-l

RlO

B
FIG. BC-I

D1

D2

G

FIG.8C-4

US 7,643,168 B2

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 23 of 73

FIG 8C-I

'®{

FIG.8C-I
I

~

H FIG.8C-4
I FIG.8C-4
J FIG.8C-4

\

16

1

-- l-l
C6

!

-

..... I

~

11
10
9

6
7
8

C7

A R5

"..

CHSClK I

....
...

8
9

7
6
5
10
11 CAMERA 4
CONTROL 3

CAMV+:

12 RESISTER
2
13

C
FIG.
8C-l

:CAMV+

15
2
3 CAMERA 14
13
4
CONTROL 12
5
o fA

1

14

CAMV+:

-

1

L
FIG.8C-4

·CHOUT+ ">
.CHOUT-

Rl

'V\/'v

<J

FIG.8C-l AR12
D
v
Ito.

>

<CHGNOI

-IRIS
r

-

Rll
v

FIG.8C-3

'-CAMAGC"">

u.s. Patent

Jao.5,2010

Sheet 24 of 73

US 7,643,168 B2

FIG.8C-4
CAMV+

RI3

R14
FIG.8C-2

CAMERA
CONTROll
D fA

REF25

AG.8C-3

I)-------e-----'\
FIG.8C-3
AG.80-3
R6

C3T

R8

J

FIG.8C-3

u.s. Patent

Jao.5,2010

M08
Mag
MalO
MOll

1
2
24
25

-CAS4 'I~
I 23
-HWEH 3
4
-RAS4

11
12
14
15
16
17
18
5

~I'''''
13
....

9
10
11
M08
M09
MalO
MOll

1
2
24

25

12
14
15
16
17

18
-CAS4" ,~
23
-HWEH 3
4
-RAS4

MAO
MAl
MA2
MA3
MA4
MAS
MA6
MA7
MA8
MA9

MAO
MAl
MA2
MA3
MA4
MA5
MA6
MA7
MA8
MAg

9
10

5

MAO
MAl
MA2
MAl
MM
MAS
MA6
MA7
MA8
MAg

ft-{I
~5

Sheet 25 of 73

9
10

12
14
15
16
17
18

5

5~
MAO
MAl
MA2
MA3
MA4
MA5
MA6
MA7
MAS
MA9

FIG.8D-1

11

'I~

DRAM

US 7,643,168 B2

1

MOB
M09

2
24
25

MOlD
Mall

i-I -CAS4
23
I'

3

-HWEH

4

-RAS4

1
2
24

M09

MOIO

25

Mall

9
10

11
12
14
15
16

MOB

17
18
5

IJ--H
5~

~I'
23 '-CAS4
3
4

-HWEH

-RAS4

u.s. Patent

Jao.5,2010

MAO
MAl
MA2
MA3
MA4
MA5
MA6
MA7
MAS
MAg

9
10
MOB
M09
MOlD
MOll

1
2
24

25

'It-#
23
3

-CAS4
-HWEH

-RAS4

4

11
12
14
15
16
17

18
5

MAO
MAl
MA2
MA3
MA4
MA5
MA6
MA7
MAS
MA9

~I'
13 ~r:

US 7,643,168 B2

Sheet 26 of 73

9
10
11
12
14
15
16
17
18
5

'I~

5~

FIG. 80-2
1
2
24
25

MaS
Mag
MalO
MOll

iii'-HWEH
23 -CAS4
3
4

-RAS4

1
2
24
25

MOB
M09
MOIO
MOll

DRAM

MOS
M09
MOIO
MOll

1
2
24
25

fit

I
-CAS4'1 23
-HWEH 3
-RAS4
4

MAO
MAl
MA2
MA3
MA4
MA5
MAG
MA7
MAS
MA9

9
10
11
12
14

15
16
17
18
5

~I'.e:
13

.

MAO
MAl
MA2
MA3
MA4
MA5
MAG
MA7
MAB
MA9

9

10
11
12

14
15
16
17
18
5

'I~

5.,.:.....Y

~.J'-CAS4
23
3
4

-HWEH
-RAS4

u.s. Patent

Jan. 5,2010

Sheet 27 of 73

US 7,643,168 B2

FIG. BD-3
1
2

1
2

3

3

4

4

..---1

'1

5
6

POWER OFF D
INPUTV
5VCURR

1

2

CHRGI

3
4

-EPWR
BATTVP
PON

5
6

1
~5
2 HOTGN011HOT5V
3
II

4

5

1.,

1

~l8

• 5.5

6

7
8

9

,~

VIN+-"5.5
I

BAT-

FIG. 80-7

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 28 of 73

FIG.8D-4

-

~I IRf
-1
2
3
4

5
6

7

8
9

10
11

12
13
14

15
16
17
18
19

20

21
22
23
24

25

-

VID5V

VSHllT~
_

XD7
XD6
XD5
XD4
XD3
XD2
XDI
XDO
-XIDRD
-XIDWR
XAO
XA1

XAO
-VSELO
-VSEI
-VSEL2
-DMAAKO
TC
IR06
IR07
AEN
VCLK
I
RESET
I

III

-

11

12
13
14
15

16
17
18
19

10 HI'XD7
9
XD6
8
XD5
7
XD4
6
5
4
3
2

X03

XD2
XDI
XDO
-VIDRD

.r 2O
5

1

11

10

HI'-XIORD

7
6

-XIOWR
XAO
XAI

12
13
14

15
16
17
18
19

-[20

5

~R20
V1DEN

-

~

XA2

~
3

-OMAKO
TO

2
1 ~I'

AEN

VSHUT

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 29 of 73

FIG.8D-5

r-' -

--- --- - - I.

I MAIN RESET I
I ______ J

RESET

RESET

5
6
WAT OG 7
8

R9

-

5

4

3

5

2
1
II

5

1
2

u.s. Patent

Jao.5,2010

Sheet 30 of 73

US 7,643,168 B2

FIG. 8D--6
P-----------~SDAT

..-------tAUCLKl

,..----1 AUCLK3
. - - - 1 AUDINH

R49
R19

'1

5
6
7
S

4
3

2
1

®

FIG. 80-10

5

5

u.s. Patent

Jan. 5,2010

Sheet 31 of 73

US 7,643,168 B2

FIG.8D-7

II

----D-3---~.
R22

o
FIG. 80-3

80-10

u.s. Patent

Jao.5,2010

Sheet 32 of 73

US 7,643,168 B2

FIG.8D-8

FIG. 8D-lO~FIG. 80-10 F

8
9

7

10

5
4
3
2
1

11

12
5

13
14

6

~IG. 8D-10
01

I·

5

KBCLK
A20G

'---< CELDAT
02

5
Rl8
---<CELCLK

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 33 of 73

FIG.8D-9

RI6{

Cl2 C14 Cl6
CII C13 Cl5 Cl7 CIS •
I,," • :.. ::. :1 1=- :- 1=

CF

-"N.)r

4~ i-

...

Po
WV\;

-OKIHI R43
PON

HINTRL

l-

I

,.-

1

2

~R47

~I'

9
10
11
12
13
14
15
16

FJG.8~

10

RI5

Blrl
-----~lPHAyIALI

A-N)r ~5
R42

~
7

6

5

4

3
2

1

INPUTV
5VCURR
CHRGI
BATEMP

AILEV
ADLEV
MICLEY

u.s. Patent

Jao.5,2010

Sheet 34 of 73

US 7,643,168 B2

u.s. Patent

US 7,643,168 B2

Sheet 35 of 73

Jao.5,2010

FIG. 80-11
5 5 5 5 5 5 S 5 S P P
D D D D D D D DY A A
o1 2 3 4 5 6 7S0 0
C K K
L R T
K 0 0
24 22 20 18 16 14 12 10 8 6 4

S

R
S

.§.

T

>

>R41
~'

2

5.5:

25 23 21 19 17 15 13 11 9 7 5 3.J;

.

.~ D

R21>

-=-

-

I -

R D R I
Q A 0 0
1 o 5W
K
R

1

-- -

S S S
I B DA A A
0 I K 0 1 2
R S S
D B E

L l

~

5
_ 6

CONNECTOR

,.....~

-DKIHI

I IVIN+

1
CI9

~

1.4

~

8

.
C20

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 36 of 73

FIG. 8D-12
R25

~y

VCLK

_

CROClK ...vvv
~!

8
9
VSHUT
SRST

10
11

RESET

,.. >

R26~
~

!
5

5:
ESHUT

12
13
14

7
6
SIGNAL
BUFFER

5
4

3
2
1

II·

I

A FIG. 80-17
II·
I

&AA

R23"

III
I

SYSClK

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 37 of 73

FIG.8D-13
5

r------,
REAL TIME I
CLOCK

osc.

Rl

I BAT-

I
I
I

L_,

YIC

I
Cl
C2
I ________ J ___-~
------41~
l
-KBINT

FIR03
8
-FIR03 9
FIRa! 10
-FIRal 11

~--I--I---rC

~--t----lB

FIR02

12
-FIRa2 13
5 14

FiG. 80-14
FIG. 80-14

C4

C3

RIO
PROCESSOR

lID
OSCILLATOR

":"

I
I
I
1
I
I
I
I
I
I
I
I
I
I

------------

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 38 of 73

FIG.8D-14

8~~i3
o

-~
-.....I

-ROM .....
-XMRO

t

186
187
188
189
190
191
192
193
194

FIG. 8D-15

-XMWR
-KBSET
-XI ORO
-XIOWR 195
-RC
196
A20G

197

-KBRST 198
KBCLK R17

~~v\"--J

FIG. SCO-13 -RESET
B

199
200

igi

FIG. SO-17 -

203

FIG. 80-13

204
- - - - I 205
PROCESSOR
'---..... 206
207
~=....J 208
209
- - I 210
5
211
--1212
--1213
--1214
--1215
--1216
123456789111111111122222222
012345678901234567

D

-D

R
Q

H
A

5-

o

K

o

I RPP PRCI I I I
OIRRRO

IRoaa1
4Q3216

5
T

o

u.s. Patent

Jao.5,2010

Sheet 39 of 73

US 7,643,168 B2

FIG.8D-15
R46
R45
R52

HHHHHHHHHHHH

ODDDODDODDDD

XXXXXXXX

DDOODDDD

119876543210
76543210
5
10

5

MOl3 163 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
M014 164 6 6 6 5 5 5 5 5 5 5 5 5 5 4 4 4 4 4 4 4 4 4 4 3 3 3 3 3 3 3
M0l5165210987654321098765432109876543
'1 166
SOO'I 167
SOl 168
S02 169
S03 170
S04 171
S05 172
S06 173
FIG. 80-16 ----~
S07 174
.............j175
PROCESSOR
5
176
S08'I 117
SOg 178
SOlO 179
FIG. 80-14
SOll 180
S012 181
S0l3 182
S014 183
~....j184
S0l5 185

1

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 40 of 73

FIG.8D-16

HHCC

CCRR

RR

E E S S

S S S S

S S

1 1

1 0 3 2 -,;F' 1 0

9 8

WWAA
H l 3 2. ~

TI

AAAA

AA

T

5S

AA
---

/1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 ~5SA17
3 3 3 2 2 2 2 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 0 106 SAl6
I 2 1 0 9 8 7 6 5 4 3 2 1 0 9 8 7 6 5 4 3 2 1 0 9 105
SA15
104 SA14
103

101

)

1

SA9
SA8

94
93

FIG. 80-17

(

SAlO

99
98
97
96
95

PROCESSOR

SA12
SAIl

100

....- FIG. 80-15

SAl3

102

)

_

__

92
91
90
89

SA7

SA6
SA5
SA4
SA3
SA2
SAl
SAO
III
I

u.s. Patent

Jao.5,2010

Sheet 41 of 73

US 7,643,168 B2

FIG. 80-17
MAIO
MA9
MA8
MA7
MA6

FIG. 80-16

,5 MA5

77
76
75
74
73

MA3
MA2
MAl

69
68
67
66
65

.......- - FIG. 80-14

MA4

XAI

MAO
72
71 I·
70 5 XAO

PROCESSOR

64
63
62

61

XA2
XA3
XA4
XA5
XA6
XA7
XA8
XA9
XA10
XAll
XAl2

60
59
58
57 II
56
2 2 333 3 3 3 3 333 444 4 4 4 4 444 5 5 5 5 5 55 5 XAl3
8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4t-='-..,;,,;,;;:-..

.
-

I I I I
RRRR

D

0

QQQQ

R A

4567

C

C

1

K
1

I I
o0
WR
R0

IA
OE
RN
D
Y

R-XXXX
SIAAAA
TOllll
D C 7 6 54
RH
VK

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 42 of 73

FIG. 80-18

x

-

X

S

A A

0 1

--...
•

E
L
5
5

11 10 9 8 7 6 5 4 3 2 1
12
44 -XIDRO
43 RCA3
13

MODA3
MODA4

14
15

16
17
18

lIO
DECODE

42 -ReE
41 -ReAUX
40 -RCSHE

39
38

19
20

37

21

35 -XIDWR

22

34

36

5~23 24 25 26 27 28 29 30 31 32 133
0 0 0 0 0 0 0 0 R
7 6 5 4 3 2 1 0 E
S
E
T

u.s. Patent

Jao.5,2010

A

R51

F R
S
H ~
U E

R7
555
R6: >~ R8
~
-FIROl
52
-FIR02
53
-FIR03
54
55
-XIORD 56
-XIOWR 57
-FXSET 58
59
60
XAO
61
XA1

US 7,643,168 B2

Sheet 43 of 73

CIO

FIG.8D-19

)-

R14 ?

I.

Y4

C5

4~D

~ A~4.. I
Glvvv-y

Iil~l~I:Ii/: hi :11 Ii : ;1~lili~ r¥4 4
1 0 987654 3

~
30
29
28

FAX MODEM

26
~3

~i
24

XA2

62

~
22

MODA3
MODA4

63
64

21
20

I

2 3 4 5 6 7

11\llH

I'

4
5

L~

1 I'vv~I'R3

t C25U C2:

R50

FAXAUD>
,~

8

II

L...fOAAOUT

L--< DAAIN :1

1
8
X x x x x x x 9110 1 23456789
x 1

DO o 0 o 0 o 0
o1 2 3 45 6 7

FAX/-PHONE'}
OFFHOOK
2
-RI
3

L..-.-.J FAXRXI
Ll

FAXTXD

5

>

u.s. Patent

Jao.5,2010

Sheet 44 of 73

US 7,643,168 B2

xxxxxxxx

XOD

AAAAAAAA
01234567

1 1 1 1
321098.765
~--l!1~4

4

XA12

3
2
1

XAl5
XAI6

32
31 5_XMWR
30 XAl7
222222222
123456789
~_-J -XXXXXXX
RAAAAAAA
OlR19811
MODI
34

FIG.8D-20

u.s. Patent

Jao.5,2010

Sheet 45 of 73

10-5

11t-M12

~r

13

rr.

8 OTRr-

14
7 CTS
15
6 TXD
16 BUFFER 5 RTS
17
4 RXO

18
19

XDO
XDI
XD2
XD3

US 7,643,168 B2

30SR

2 OeD

~
5

I

1

~

4 SERIAL
.I~ 5 DATA
6 CONN.
7
8
9

h5

.~

XD4
XD5
XD6
XD7

5
6
7

8
9

10

222
4321 876

25
24
23
22

SERIAL
CONTROLLER

RESET

21

11

XAD

20
19

XAl
XA2

1 1 1 1 1 1 1
-COMSL 2 3 4 5 6 7 8
- - I
X X R

I
0
W
R
r--I
I I
I
_OJ

I
1
I
I

I
0
R
D

--- 1 - - - f--...,
'0

SERIAL
CONTROLLER

osc.

I
I
I
>I
>1
~1

...&..'

I
":' I
L--- _________1

Q

4

FIG.8D-21

u.s. Patent

Jan. 5,2010

US 7,643,168 B2

Sheet 46 of 73

FIG. 80-22
XA9
XA8

13
14

XA7

15

XA6

16

XA5

17

XA4

18
19

XA3
-EISEL
-CKSEL
-COHSL

AEH

5:

20
21

22
23
24

ADDRESS
DECODER

12
11
10
9
8
7

I ••

I

XA9
-FXSEL
-RCSEl
-5EL55

6

5
4
3
2
1

..;.VIDEN

-VSElO
-VSELI
-VSEL2
VSHUT

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 47 of 73

FIG.8D-23

5
..,.

5

?

81
·1

'1
II
II
-I

·1
'1

II
II
·1

-I

5:

101
41
1

38

11

fR27
-DETl

III

-

R28

66

40
28

21
51
31
61

6
95
96
97

71
91

RAMCARD

81

69
56
53
57
86
54
52
49
47

CONTROLLER

111
16
46
60
76
106
120
30
32
35

44

100
98
93

50
48
45
43
42
99
94
92
V-

........

FIG. 80-24

l

-DETO

-BAT2
-BATI
CWP

-CWR

-CEH

-CEl

-CRD
-REQ

COl 5 --IA\
C014·"
y
C013"
FIG.
C012 '\ 80-25
COlO '\
COlO"
C09 "
C08 "
C07 "
C06 '\
C05 "
C04 '\
C03 '\
C02 'COl '\
COO '\
'\

u.s. Patent

Jao.5,2010

~~
FIG.8D-23

XOO
XDl
X02
XD3
XD4
X05
XD6
XD7
MOB
M09
MOlO
MOl1
MOl2
MD13
M014
MD15

4

5
7
8
9
10
12
13
14
15

17

-

18

19
20

RCIRO_

112

,~

113
LRCI

5

22
29

)(AO

5

-IOCHK
R36

RAMCARD
CONTROLLER

.....

82
79
77
74
72
70
68
65
63
73
75
67
64
78
58
55
59
62
80
83

CAZ5
CAZ4
CA23
CA22
CA21
CAZO
CA19
CA1S
CA17
CAl6
CA15
CA14
CAl3
CAl2
CAll
CAlO
CA9
CA8
CA7
CA6
CA5
CA4
CA3
CA2
CAl
CAD

84

85
87
88

23

89

90

"""

XAl
RCA3
-XIORD
-XIOWR
-RCSEL
-RCBHE
-RCCAUX
-RESET

)~ ~
5

25
26
36
37
34
27
115
33
39

IOROY

FIG.8D-24

"
"
"
"
"
"
"
"
"
"
"
"
"
"
"
"

"
"
"
"
"
"

"
"
"
"4

-OVER I FIG. 80-26

24

XA2

US 7,643,168 B2

Sheet 48 of 73

102
103
104
105
107
108
109
110
114
116
117
118
119

~.8~26

I
:5

D
FIG. 80-27

,I

I

FIG. 80-27®"'

~.80-27

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 49 of 73

FIG.8D-25
C03' III/ CD4
V CD5
1/ COG
V CD7
1/ -CEL

6
7
8

-CRD

V
V

"
"
V

C22 ;

"

-..:•

V
V
V
V

"
"
'/

V

V
V
/

2
3
4
5

CA10

FIG. 80-23

I

9

CA11
CA9
CAS

10
11
12

CAl3
CA14
-CWR

Cypp
CA16
CA15
CAl2
CA7

-

13
14
15

16
17

18

19
20
21
22
23
24

CA6

CA5
CA4
CA3
CA2
CAl
CAO
COO
V COl
V CO2

25

V CWP
'1
'1

-

26
27
28
29
30
31
32
33
34
35

~

FIG. 80-26

t

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 50 of 73

FIG.8D-26

FIG. 80-25

t
FIG. 80-25

,.----'~'---i\
I
V

V
V
V

-OETO
COll
C012
C013
C014
C015

1/ -CEH

-

CAl7 CAl8
CA19
CA20
CA21

"-

"-

\..
\..

C2:i

-

~

Cypp
CA22
CA23
CA24
CA25

~

I\.
I\.
~

B

-

FIG. 80-24

FIG.~

-

80-2'r\:

C

r
5

5
6
7
8

4
3
2

-

HII

1U

-REG -

-

-BATI
-BAT2
1/
1/

C08
C09
COlO

V -DEn

III-

i'-36
37
38
39
40
41
42
43
44
45
46
47
48

49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 51 of 73

FIG. 80-27
EPROM POWER

-BUSY
-CBATLO
SBALTO
-WPROT
DOOR

I'LED6+

C23~

5

LEDON

':"

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 52 of 73

FIG.8D--28
B
9

7

I-

6

10

RESEr

5
4

SA7
SAB

11
12

3

13
14

2
1

1

2
4
6
8
10

rFIGo8D-29

SA4
SA5

5

3
5
7

S07
S06
S05
S04
S03
S02
SOl
SOO

9
11

12

IR014
SAl
SAO
'1

-I

14
16
18
20
22
24
26
28
30
32

43

IOROY ·1
-lORD
-IOWR

13
15
17
19
21
23"
25
27
29
31
33
35
37
39
41

44

45
47
49

46

S09
SOlO
SOli
S012
S013
S014
S015

34

36
38
40

42
48

50
SOLDER PAD

FIG.SD-29¥

I- S08

SA2
MOTGNO
HOTSV

u.s. Patent

Jan. 5,2010

US 7,643,168 B2

Sheet 53 of 73

FIG.8D-29
FIG. 80-28

~

FIG " 80-28
A
J

- 15

14
13

....

12

11
- 10
-- 9

-I'
II
HI
H2
H3
H4
H5
H6
H7
H8

7

8

1
3
5
7
9
11
13

15

1
2
3
6
4

SA3

SAg
SA6

AEN
16 H5
5

2
4
6

8
10

12
14
16

H9

HIO

Hlt
H12

H13
H14

HI5
HI6

u.s. Patent

Jao.5,2010

Sheet 54 of 73

US 7,643,168 B2

FIG.8D-30

HINTRL

HI

H2
H3
H4
H5

HI2
H6

H7

1
2

31

3
4
5
6
7
8

33

9
10
11
12

32
34
35

H12

H16

13

H12
H8

H9

14
15
16
17

23

H12

47

18
19
20
21
22

24
25
26
27
28
29
30

36
37
38
39
40
41
42
43
44
45
46
48
49

HID

Hll

50
51
52
53
54
55

H13
H14

HI2
HI5

56
57

58
59
60

u.s. Patent

Jan. 5,2010

US 7,643,168 B2

Sheet 55 of 73

FIG.8E-l
cc
-PMODE
TXDA
RXDB
RXDBF

S
Y

LL
KK

.§.

1 3
8 5
4 8.

--

S
C

L
K

TXD
IROD

2 2 2 2 2 2 2 2 2 1 1
8 7 6 5 4 3 2 1 0 9 8

16XCLK 29

17

650lNT 30

16 IROB
15 IROA
14 15
13 -RESET

-lORD

31

.132
-CR7 II. 33

-CR4
-CR3

lROC

It

GLUE

34

Loele

35

-RTS

12

11 RXCB
10 I

136
5'·37
-IOWR

9

60TXD 38
CLKOUT 39

8
7

III

TXCB
-SRINT

MRXD

4 4 4 4 4 1 2 3 4 5 6
0 1 2 3 4

-..:-

0 0 D7 6 5

-S-

O D0
4 32

A

0 0
1 0

y

R53

XIN

u.s. Patent

Jan. 5,2010

Sheet 56 of 73

FIG.8E-2

8
9
10

11

5:

12
13
14

7
6
5
4
3
2
1

II'
I

RESET

T

SYSClK

US 7,643,168 B2

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 57 of 73

6 5 5 555 55 55 54 4 444 4444
8 7 6 5 43 2 1 o 9 8 7 6 5 43 2 1

FIG. BE-3

o9
BOMC
EDMC
DDMC
PIT
DO
Dl

02
03
04
05
06
07

61
62
63
64
65
66
67
68
69
70

GLUE

lOGIC
PAD

71

72

IKf
AO '1 74
Al
75
A2
76

'I~

~
~

...mL
12
-RESET 1 2 3 4 5 6 7 8 9 1 1 1 1 1 1 1 1 1 9 0
0 1 2 34 5 6 7 8

.

FIG.8E¥ 5

...
5

---

40
39
38
37
36
35
34
33
32
31
30
29
28
27
26
25
24
23
22
21

-SPRINT
-CD
-RLSO
OKYPIT
TEDET
-RI
-CTS
-DSR

u.s. Patent

Jan. 5,2010

US 7,643,168 B2

Sheet 58 of 73

FIG.8E-4

I" I

AO
AI
A2

I
3
5
7
9

11 MODEM BOARD
13
15 CONNECTORS
17
19
21
23
25

2
4
6

RESET

8

12
14

SVSCLK
D7
06
05

16
18

04
03

20

02

22

01

10

24

DO

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 59 of 73

FIG.8E-5

-RI
-RLSO

5

-I I

-B2SEL
6501NT
A2

Al
AO

-650SEL
RXDMA

7
8
9

10
11

12
13
14

0 0
WR
.~
R 0
4
6 543 2 1 4 4 440
4 3 2 1

SYNCHRONOUS /
ASYNCHRONOUS
SERIAL
CONTROLLER

39 -DSR
38 -CTS
37 -OTR
36 -RTS
35
34
33
32

650TXD
31 RXDB
30 16XCLK
29 RXCB

15
16
17
1 1 2 2 22 22 2 2 2
8 9 0 1 23 4 5 6 7 8
-..,!:-....

0 0 0 0
7 6 5 4

0 0 o 0 T- 5 X

3 2 10 X
0
M
A

I
N

-

S
Y
S
R

S

T

t
-

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 60 of 73

FIG. BE-6

CRYPTO CUTOVER MODEM

5
R78

R80

TXDA

':'

':'
10

9
8
7
6
5 MRXD
4

3

C13

2

C44

1
R79

Cl

-CD
5

~------------------------------------------~B

FIG.8E-7

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 61 of 73

,-------------,
,
"
I
I

,
,

,
I
I

KY MODE
EDMe

R2

KYMIC

r-t------+----4~O

I
I
I
I
I
I
I
5 I
I
, 01
I

EOMC

FIG. BE-7

SIGNAL MULTIPLEX I
RELAY
I

FIG.8E-8

RXCLK

IRXOATA
I
I
I
_________IL __ _
Q2

I

XMIT

I
":" ,FIG. 8E-6
3
I B
5
r--------I
I
I TRANSMIT 1m
1
RELAY
I
I
I
I
I
I
I
PIT
I
I
__

I

I-----------.:..r---J ---~~~_I I·
-.
I
I
I
I
J

5t--'--~A.

DIGITAL

MODE
I
I DOMe
DISPLAY
I
L
I
-I _ _ _ _ _ ..:_ _ _ _ _ _ _ _ _ _ I

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 62 of 73

TXGAIN

C
FIG. 8E-7
5D
3

)SL 2 J

5-

D
FIG. 8E-7

KYMICD
IPMICD

:4

82
1

:
1]
.....

~1r

4
9
I

1OuF /6.3V IP-PTT

1&11

~

V'V'

10 ~-sv

lU-

.~

.-

:6

.4

:
I
4

1
I

lU

3

8~

E-

1

FIG. 8E-7

Il U
3

cu::
M

1'02E"__5V

33K

KY PTT
IPAOUT
KYAOUT
1/701 HZ TONE
C17 1\
IPADMC
10uF76.3V

J

.

~2
j.. 4
:
9
I..
.. 7 RXDATA

-PTTIN

C33
1 T2100pF R3

1I:fI
~f
TONE-

KYADMC
KYDDMC
IPDDMC

600

TONE+

AT&T WV16301T

IP-DDO

...

I cu::

~-sv

KY-DDO
KYADIN

JS.L

IPADIN

!

IPDDCO

2
..
." 4 t:\...
9 17
M4
7 RXCLK

~
R2

F
FIG. 8E-7

2
4
9
7

IPMICC

1

cu::

H

D7:;ii ~

1N4148 L.BDMC

...-

T02E-5V

~=::h ROHM

06
DTD143EK

2
_

KYDDCO
BYPASS RELAYS
G
FIG. 8E-9

FIG. SE-8

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 63 of 73

( PFIG. 8E-1O

~PFlG.8E-8

FIG. BE-9

RING ,/
RXCLK /
RXD5
R
X
C5

5

~

R84

8765432
9
20

~

>
~

""""22

5

-PTTIN
-KYPIT

~

1111~111

5

-Rr

5

23
24

LINE
RECEIVERS

~

11
RXDATIV
10
TXCB
9 5
B
TXClK ,/
rt-II
6 I' -CTS
5 5

222 1 234
678

5,

5

CTS/

-OSR
DSR/
-RLSO

RLSO./

u.s. Patent

Jao.5,2010

Sheet 64 of 73

FIG.8E-10

US 7,643,168 B2

FIG.8E-11

•
.....

FIG.8E-9

u.s. Patent

Jao.5,2010

Sheet 65 of 73

US 7,643,168 B2

RADIO / SERIAL
DATA CONNECTOR

FIG. 8E-l1
~

f'~
~

"

""f'-.
f'-

~
~
~

"
"""~
~

~

"
"
""
~

"

""-

IPMICC
IPMICO
IPAOUT
IPADMC
KYMICD
KY-PTT
KYAOUT
KYADMC
RTSOUT
DTROUT

TXCLK
DSR
CTS

RING
IPDDMC

IP-PTT
'POOCO
IPADIN
IP-DDO
KY-DDO
KYDDMC
KYADIN
KYDDCO
RXCLK
RXDATA
-CLKOUT
-TXDOUT

r--'"

1
2
3
4

5
6

7
8

9
10

11
12
13
14

15
16
17
18

19
20

21
22
23
24
25
26
27
28

'1

29

-I

30
31

II

,

-TXDOUT /

I FIG.8E-10

'---

CABID

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 66 of 73

5

FIG. 8E-12
RI9
R43

RXDBF

5,~'\I'Vv--------'

R7
.I~
C25

R8

5

8 76 5

8 76 5
R6

1 2 34

1 2 34

R43

-

RXDB
II

u.s. Patent

Jao.5,2010

BUSY
~~ 01

~

J1
r--

Sheet 67 of 73

US 7,643,168 B2

CARD BAT BATTERY WRITE
LOW
LOW
PROTECT
~ t03
~
'(

~ tD2

~

~t 04

~

-BUSY

1 -CBATLO

~

-SYSBATLOW

4
LED6+
5 GNO
6
DOOR

PCMCIA DOOR
/OPEN SWITCH

7
.....
878-ZR

)S1

J5T

FIG.8F

POWER ON

S1

Jl
1

2
3

EMERGENCY
POWER OFF

4
5
6

53

868-ZR
J5T
STBY /
POWER OFF

S2

FIG.8G

STATUS
LED'S

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 68 of 73

PUSH BunON SWITCHES

1212121212121212

.
-.. '- --

-

-

--

-...

-- -.... ..-

1212121212121212

-- -- - - -- --- . - --.
-. _. -- _ . ---FIG.8L-l

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 69 of 73

FIG.8L-2
B
FIG. 8L-l

----~=t

SDO
SOl
S02

SD3
SD4
SD5
R21

KEYBOARD IDISPLAY

SD6

5

MICRO CONTROLLER

SDl

SAO .,
~~=---~~SAl=-

__~

./
./

CLK16 5
R2 R3

5
R23

~====:;~J

TXD
5

RXD

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 70 of 73

FIG. BL-3
C14 R8 C13 R9 C12 RIO Cll Rll CIO R12 C9 RI3 C8 R14 C7 R15

1f1f-~f~f~f1f1f1
JfI tI
-.
-

-

-- - -

.~

-

...

-

<'
1

C
FIG.

... AA
vv

,.

R6

1~~C5

8L-2

.. R7

NVi

...

"

>

~R16

'\
5
E

~

~R17

FIG.

8L-2
i-

....

Io-

k r; •
3

3

3
-~ •

I 2

I 2

1 2

~

k• k• k•
3

3

3

k~3

1 2

1 2

1 2

1 2

®FIG.SL

- - - - -. - - - -..,:---- - - - - I(!)FIG. SL
- . . .. .. .
- J FIG. BL-4

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 71 of 73

FIG.8L-4

SAl

·1

Cl
I FIG. BL-3

D
FIG. BL-2

5
SAO

RIg

4
3
2

R4

1

C4.x.
':'
':'

FIG. BL-2
F

u.s. Patent

Jao.5,2010

US 7,643,168 B2

Sheet 72 of 73

FIG. BL-5

~"F
I.f-t
SAO

5
7

SAl

9

SA2

11

-SELO 13
-SEU 15
-lOR
17
-lOW 19
IR05 21
-OACKl 23
DR01 25

11ft

2 RESET
TXD
4

RXO
6
8 COO6

110
12

rI4

16

18
20
22

24

S07
80G
S05
S04
S03
SD2
SOl
SOO

5

2 RESET

4

TXO

S07
SOG
S05
S04
S03
S02
SOl
SOO

RXO
6
8 ClK16

SAO
SAl

9

SA2

11

10
12
14

-lOR
-lOW
IR05

17

16
18

21

20
22
24

7

-SELO 13
-Sill 15
19

-OACKl 23
DROI 25

KEYBOARD IOISPLAY
INTERFACE CONNECTORS

u.s. Patent

Jao.5,2010

Sheet 73 of 73

US 7,643,168 B2

+
SAMPlES

$..

$M

sa ~ se sd se sf

~h 5 i

Sg

I

5

J Sk

51

Sm Sn So Sp Sq sr $5

I
I

,...lRIGGER AT START:

I
*
I

•

210

,...

TRIGGER AT MIDDLE:
212

,...TRIGGER AT END:
214

*
I
!

51 52 $3 s4 $5 56 ~7
I

BEFORE
TRIGGER

•

I
I
I

I
I
I

FIG. 9

US 7,643,168 B2
1

2

APPARATUS FOR CAPTURING,
CONVERTING AND TRANSMITTING A
VISUAL IMAGE SIGNAL VIA A DIGITAL
TRANSMISSION SYSTEM

digitized formats. For instance, the Canon PV-540 is a floppy
disk drive that uses conventional still video disks, digitizing
and a still video image using a conventional format, and
communicates with the computer through a standard communications I/O port.
U.S. Pat. No. 5,193,012 discloses a still-video to facsimile
conversion system for converting the still-video image frame
into a half-tone facsimile reproduction without having to
store an entire intermediated gray scale image frame by
repeatedly transmitting the still-video image frame from a
still-video source to an input circuit with a virtual facsimile
page synchronization module. This system permits image to
facsimile conversion by utilizing a half tone conversion technique.
While the various prior art systems and techniques provide
limited solutions to the problem of transmitting visual images
via a facsimile transmission system, all fall short of providing
a reliable and convenient method and apparatus for readily
capturing, storing, transmitting and printing visual images in
a practical manner.

This application is a divisional application of and claims
priority from a non-provisional United States Application
entitled Apparatus For Capturing, Converting And Transmitting A Visual Image Signal Via A Digital Transmission System, Ser. No. 09/006,073, having a filing date of Jan. 12,
1998; the specification and drawings of which are hereby
incorporated by reference.

10

BACKGROUND OF THE INVENTION
15

1. Field of the Invention
The invention is generally related to image capture and
transmission systems and is specifically directed to an image
capture, compression and transmission system for use in connection with land line and wireless telephone systems.
2. Discussion of the Prior Art
Industry has developed and continues to develop and
enhance techniques for scanning, compressing, transmitting,
receiving, decompressing, viewing and printing documents.
This technology, encompassing the full body of facsimile
transmission and reception, is currently in widespread use.
The current standards, CCITT Group III and Group 1\1, define
methods to scan and transmit high quality, bi-level images
with a high degree of success and has become commercially
acceptable throughout the world. However, gray scale documents are not easily transmitted because the scanners and
algorithms are not tailored to the function. Three dimensional
objects will not fit into the flat document scanners and cannot
be transmitted.
Examples of systems that have addressed some of these
issues are shown in U.S. Pat. No. 5,193,012 which shows a
video to facsimile signal converter, and U.S. Pat. No. 3,251,
937 which discloses a system for transmitting still television
pictures over a telephone line.
Wire photography, and its extension, radio photography,
have long been used by the news media. The most common
form involves an input device that converts photographs into
encoded signals for communication over telecommunications facilities or radio. At the receiving end, reproducing
equipment reconverts the encoded image signals by exposing
photographic film or other sensitized paper. The term facsimile is often used with these products.
Still video equipment has recently become available from
vendors such as Kodak, Canon and Sony, and is again primarily used by television and print media, although applications
are expanding rapidly in such areas as insurance investigations and real estate transactions. A still video camera captures a full color still video image that can be reproduced
using a special video printer that converts the still video image
data into hard copy form. For applications requiring communication of the still video image, transmit/receive units are
available wherein the image begins and ends as a video
image.
The Photophone from Image Data Corporation is an
example of a specialty product that combines a video camera,
display and storage facility in a terminal package. One terminal can send a real time or stored still video image to another
for display or storage, or printing on special video printers.
Again, the signal begins and ends as a video image.
Another example of a specialty product is peripheral
equipment available for personal computers that enables the
input/output, storage and processing of still video images in

20

SUMMARY OF THE INVENTION

25

30

35

40

45

50

55

60

65

The subject invention is an image capture, compression
and transmission system that is specifically designed to permit reliable visual image transmission over land line or wireless communications using commercially available facsimile
transmission techniques. The invention incorporates a camera and signal converter into an integrated unit wherein the
converted signal may be transmitted on a real time basis or
may be stored in memory for later recall and transmission.
The design of the invention permits maximum flexibility,
with the camera/converter/telephone or other transmission
device being designed in a modular configuration wherein
any or all of the devices may exist as integrated or independent nnits.
The preferred embodiment permits capture of a video
image using a digital camera, an analog camera, or a video
camera such as a camcorder. The captured video image is then
converted into still frame digitized format for transmission
over any of a variety of transmission systems ranging from
Group-III facsimile to computer, or to a like device at a
remote location, in any protocol desired. The invention recognizes that once the signal is digitized, the transmission
protocols are virtually endless.
For example, the present invention, permits a still frame
visual image to be captured at a remote location and sent
immediately, over wireless communication systems, to a
remote location such as, by way of example, a computer
system wherein the image could be merged directly into
newsprint. The image may also be sent to and printed as a hard
copy using any Group-III facsimile machine, anywhere in the
world. Where desired, the images may be stored in memory
for later recall, and may be archived on a portable medium
such as a memory card or the like.
The system of the subject invention is particularly useful
for applications where immediate transmission of visual
images of scenes, people and objects is desirable and sophisticated equipment is not always available for receiving the
information. The system also provides a nnique and reliable
means for transmitting visual data to and from remote locations, such as, by way of example, law enforcement and
emergency vehicles and the like.
In the preferred embodiment of the invention, the system
includes a video camera and an integral cellular telephone,
wherein the telephone using the standard audio mode or
future digital modes, can be used to transmit and receive

US 7,643,168 B2

3

4

visual image signals. A desk model is also disclosed and
permits connection to a standard land line telephonic system.
A mobile console model is disclosed for use in law enforcement vehicles, and the like. Other communication systems are
also supported by the subject invention, including hardwired
networks, radio and satellite transmission and the like.
A local facsimile machine may be incorporated with the
unit and can serve as a printer for providing hard copy of the
captured image at the point of capture, as well as being
adapted for receiving facsimile transmissions in the standard
fashion.
The circuitry is disclosed for supporting any of the preferred configurations from a basic real time transmission
system via Group-III fax to a comprehensive system supporting both land line and wireless transmission of image, audio
and documentary data at both a local and remote station.
The subject invention also permits digitized collection of
audio signals through the use of an internal microphone, and
external input device, a cellular telephone, land line telephone, wireless radio or other communication system, and
digitized audio playback, as well. The playback can be via an
internal speaker, out an external outjack to a remote device or
via a cellular telephone, land line telephone, wireless radio or
other communication system.
The digitized image and audio capture features permit
association of audio with an image, as well as data with the
image. Useful data associated with the image includes GPS
from either internal or external GPS devices, range information from ranging devices, date and time, and text which may
be input from an integrated keyboard or from a remote device.
It is an important feature of the invention that the system
supports storage of images in an interim storage format
including raw video, compressed video, interim gray scale
format and/or halftone format. The image can also be stored
in the selected output mode, such as by way of example, a
Group III facsimile mode. The versatile capability of the
system permits transmission of captured data to a standard
bi-level facsimile machine such as Group III, to gray scale
facsimile systems or full color facsimile systems, as well as to
other remote receiving devices such as, by way of example,
personal computers and network servers. The data may be
transferred in any of a variety offormats and protocols including JPEG, FAX, wavelets, emerging imagery formats, FAX
and computer data protocols. The invention is adapted to
operate in multiple modes, with a unitary capture and send
mode or separate capture and store, and send modes.
In the preferred embodiment, the system is adapted for
tagging a collected image, video, audio, and other data such
as a GPS information, with geospatial information and real
time clock and added text. This permits the complete historical data to be transmitted simultaneously with the image
signal.
It is contemplated that the system of the invention would be
self-contained with an integral power unit such as a disposable battery, rechargeable battery source or the like. Therefore, the system is adapted to power up when in use and power
down or "sleep" when not activated, preserving power during
idle time. The power systems for the video camera, the video
input circuits and converters, the modem or other transmission devices and other high drain components may be isolated
and only powered when needed. This also permits use of
ancillary functions, such as use as a cellular telephone, to
proceed without draining the power source by powering idle
components. The processor clock rate may also be slowed
down during idle mode to further conserve power.
Where desired, the system also includes camera operation
control capability through the use of digital/analog circuits

for converting digital commands to analog signals for controlling the gain, pedestal, setup, white clip, lens focus, white
balance, lens iris, lens zoom and other functions of the camera
from a local input device, a remote device or as automatic or
programmed functions. The central processor may also be
used to control camera shutter rate. Other camera features and
parameters which may be controlled in this manner are compressor resolution ( such as high, medium, low user settings)
corresponding to compression rate parameters, field/frame
mode, color or monochrome, image spatial resolution (640x
420 pixels, 320x240 pixels, for example), lens and camera
adjustments, input selection where multiple cameras or video
sources are used and the like.
When an integrated communications device is used, such
as by way of example, a cellular telephone, the telephone can
be isolated from the rest of the system to permit independent
use, and independent power up and power off and other cellular phone functions.
In operation, the system permits not only the manual capture, dial (select) and send of images, but may also be fully
automated to capture, dial and send, for example, on a timed
sequence or in response to a sensor such as a motion sensor,
video motion detection, or from a remote trigger device. The
remote trigger also may be activated by an incoming telephone signal, for example.
The remote device may also be used for remote loading and
downloading of firmware, and for setting of the programmable parameters such as to provide remote configuration of
sampling modes during capture, compression rates, triggering methods and the like.
The triggering function permits a multitude of sampling
schemes for a simple triggered activation for capturing an
image upon initiation to a trigger signal to more complicated
schemes for capturing and transmitting images prior to and
after receipt of the trigger signal. The trigger function can be
set to operate, for example, on a time per sample and number
of sample basis, or time per sample and total sample time
basis, or number of samples and total time basis. Depending
on application, the trigger can sample in a prior to and after
signal mode, using in combination the time per sample and
number of samples prior and after signal basis, a total time
basis, a percent prior versus percent after trigger basis, time
per sample basis, time prior to and time after trigger basis, and
other combination. For example, if the image capture device
is positioned to monitor traffic accidents at a specific location,
and an audio signal sensor identifying a crash were used as the
trigger, it would be desirable to collect image sample both
prior to and after the trigger signal. The number of samples,
total sample time, and percentage of samples prior to and after
trigger would be controlled by the specific application.
Circular sampling techniques are supported by the data
capture system of the present invention. This is particularly
useful when triggering events are used to initiate transmission
of collected image data over the communications system. For
example, if a triggering event is motion detected at a motion
sensor, it may be useful to look at the images captured for a
period of time both prior to and after the actual event. The
circuitry of the subject invention permits any circular sampling technique to be utilized depending upon application,
such as prior to an after trigger, only after trigger or only
before trigger or prior to and after the trigger point. Again, as
an example, it may be desirable to look primarily at images
captured before a triggering event if the event is a catastrophic
event such as an explosion or the like. Other circular sampling
techniques may be employed, as well, incorporating multiple
cameras, for example, wherein different fields are sampled
depending upon the time frame in a sequence of events.

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2

5

6

It is, therefore, an object and feature of the invention to
provide an apparatus for capturing, converting and transmitting a visual image via standard facsimile transmissions systems.
It is another object and feature of the invention to provide
an apparatus for compressing the visual image data in order to
minimize the capacity requirements of the data capture and
storage system.
It is an additional object and feature of the invention to
provide an apparatus for capturing and storing a visual image
for later recall and review and/or transmission.
It is yet another object and feature of the invention to
provide an apparatus for storing a captured video image in
digital format on a portable storage medium.
It is an additional object and feature of the invention to
provide an apparatus capable of sending and receiving telephonic audio messages, facsimile documents and captured
visual images to and from standard, readily available remote
stations.
It is a further object and feature of the invention to provide
the means and method for capturing images prior to, prior to
and after, or after a triggering event.
It is also an object and feature of the invention to provide
for multiple triggering events and/or optional viewing or
review of the captured images prior to printing or transmisslon.
It is another object and feature of the invention to provide
an apparatus which may be activated from a remote location
for initiating the capture of images by the device.
Other objects and features will be readily apparent from the
drawings and detailed description.

analog image or a digital image data signal and transmitting
the captured signal via any of a plurality of transmission
schemes to a remote receiving station where the image is
downloaded in a suitable format for viewing and printing on
hard paper copy, a CRT screen image, or other medium. The
system is particularly well suited for sending and/or receiving
images via a standard Group III facsimile transmission system and permits capture of the image at a remote location
using an analog or digital camera. Two generic configurations
are shown and described, the first, where each image is transmitted as it is captured, and the second, which permits capture, storage, and selective recall of captured images for transmission. The invention also contemplates a portable storage
medium, wherein the captured stored medium may be
removed from the capture device and archived for later use.
While a system for black and white (gray tones) for Group-III
facsimile transmission is described in detail herein, the invention could be readily adapted to transmission of color images
utilizing the teachings of the present invention using industry
standard color video standards and circuits. Both portable, or
hand held, and stationary, or desktop, units are described. The
circuitry utilized for both configurations is identical, but stationary configurations do not need a battery.
FIGS. 1-5 are circuit configuration diagrams for the various capture, storage and transmission schemes. The physical
embodiments utilized to employ the teachings of the schemes
taught in FIGS. 1-5 are not limited. FIGS. 6-10 are exemplary
physical embodiments of the subject invention.
Turning now to FIG. 1, the simplest embodiment of the
invention incorporates a standard analog or digital camera
device 10 for capturing a visual image in the typical fashion.
The camera 10 may be operator activated as indicated at 12, or
may be progranJilled to be activated at selected intervals or in
response to certain conditions. For example, a motion detector may be utilized to activate the camera 10 in a surveillance
installation. Once activated, the camera 10 captures a visual
image in typical fashion through a lens (see lens 192, for
example, in FIG. 7A). In the illustrated embodiment, the
captured image is then transmitted to a gray scale bit map
memory device 16, from which it is output to a half-tone
conversion scheme 18 to be input into a binary bit map 20 for
formatting the captured image in a configuration suitable for
transmission via a Group-III facsimile system. The signal
generated at 22 by the binary bit map 20 is input into a
Group-III encoding and compression network 24 for generating an input signal at 26 which is introduced into a Group III
protocol transmission device 28. The output at 30 of the
transmission device 28 is then transmitted into any standard
transmission interface such as, by way of example, hard line
telephonic transmission, cellular transmission, radio signal,
satellite transmission or other transmission system 32 via a
modern or similar device, as needed, to be received via a
compatible interface by a remote Group-III receiving system
34. The Group III receiving system 34 is a typical Group-III
facsimile system comprising a Group-III receiver 36, decoder
and decompressor 38 and binary bit map 40, from which a
facsimile hard copy such as plain paper copy 42 may be
generated.
This configuration is particularly well suited where real
near time transmission is desired, for example when the system is operator controlled and a "real time" image is desired
at a remote location. An example of such a system may be a
photo identification confirmation of an apprehended suspect
in law enforcement use, or transmission of images of damaged assets for insurance purposes, or transmission of images
of construction job site conditions. This configuration is also
well suited for use in those applications where a sensor acti-

10

15

20

25

30

BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1. is a block diagram of a basic facsimile camera
configuration for capturing an image via a camera and transmitting it via Group III facsimile transmission to a standard
hard copy medium.
FIG. 2 is similar to FIG. 1, but incorporates a memory
storage capability, permitting storage and optional review or
viewing of the image prior to transmission.
FIG. 3 is similar to FIGS. 1 and 2, but incorporates a data
compression scheme for increasing the capacity of the
memory and for increasing efficiency of transmission.
FIG. 4 includes the capture and transmission configuration
of FIG. 2, with multiple transmission format capability
including Group-III facsimile, personal computer, modem,
parallel and serial transmission schemes.
FIG. 5 is an exemplary schematic diagram supporting the
configurations shown in each of FIGS. 1-4.
FIGS. 6A, 6B, and 6C, are block diagrams of the physical
components of desktop, portable and comprehensive console
embodiments of the invention, respectively.
FIGS. 7A and 7B are perspective drawings of a hand held
device for capturing, storing and transmitting an image in
accordance with the invention (new drawings to replace
Frassinito design.
FIGS. 8A-8L (Formerly FIG. 12) comprises a schematic
diagram for an exemplary embodiment of the circuit for supporting the subject invention.
FIG. 9 is a diagram of the various triggering sequence
options.

35

40

45

50

55

60

DETAILED DESCRIPTION OF THE PREFERRED
EMBODIMENTS
65

The image capture and transmission system of the subject
invention is suited for capturing one or more single frame

US 7,643,168 B2

7

8

vates the system and real time transmission of the sensed
condition is desired. An example of such a system would be a
motion activated camera in a surveillance location, where the
image is immediately transmitted to a remote monitoring
station. Of course, it will be readily understood by those who
are skilled in the art that tagging a transmitted image with
information such as, by way of example, date, time and location, can be incorporated in the transmitted signal so that a
receiving station could monitor a plurality of remote image
data capture systems. This is also useful for reviewing a body
of previously stored or printed images to determine the time
and location of such image.
The embodiment of FIG. 2 is similar to FIG. 1, but incorporates a memory and optional operator viewer system. The
image is captured by the camera 10 and conditioned by the
gray scale bit map 16, as in FIG. 1. In this embodiment, the
output 44 of the bit map 16 is input into a standard digital
memory device 46 for later recall. This configuration is particularly well suited for applications where near real time
transmission of the image either is not required or is not
desirable. It will be noted that with the exception of the
insertion of the memory device 46 and the optional viewer
device 48, the capture and transmission system of FIG. 2 is
identical to that shown and described in FIG. 1. Once the
image is captured by the camera 10 and is presented at 44 to
the memory device 46, it is stored for later recall and transmission. The specific type of memory device is optional and
may include, for example, an SRAM device, a DRAM, Flash
RAM, hard drive, floppy disk, PCMCIA format removable
memory (see, for example, the PCMCIA card 72 in FIG. 7A),
writeable optical media or other storage device. The memory
may selectively capture images, as indicated by the operator
interface/capture interface 52, or may be programmed to
selectively capture periodic images or all images. In the
embodiment in FIG. 2, an optional viewer device 48 is provided. This permits the operator to recall and view all or
selective images before transmission, as indicated by the
operator interface/recall interface 54. This permits the operator to review all images retained in the memory 46 and transmit selective images, as desired, to the Group-III transmission
system. The remainder of the system of FIG. 2 operates in the
same manner as the configuration shown and described in
FIG. 1.
The configuration of FIG. 3 incorporates all of the features
of FIGS. 1 and 2, and additionally, includes an interim data
compression and decompression scheme to permit increased
utilization of the memory or storage medium 46. As shown in
FIG. 3, an interim format compressor 56 is inserted between
the gray scale bit map 16 and the memory device 46. This
permits compression and reduction of the data required to
store the image, effectively increasing the capacity of the
storage device. It is an objective of the storage device to
preserve the gray scale quality of the image for viewing at the
location of capture. An interim format decompression device
58 is inserted between the output of the memory device 46
and the rest of the system, whether the optional viewer 48 is
utilized, or the output is entered directly into the half-tone
convertor 18. The interim compression/decompression
scheme is particularly useful when all of the image data is to
be permanently archived, or when limited capacity portable
media are used, such as, by way of example, floppy disks or a
portable PCMCIA card. It will be noted that the remainder of
the system shown in FIG. 3 is identical to the system shown
and described in FIG. 2.
FIG. 4 illustrates the use of the image capture and/or retention configured in any of the optional embodiments of FIGS.
1-3 and adapted for use in combination with any of a variety

of transmitting and receiving schemes such as, by way of
example, the Group-III system shown in FIGS. 1-3, a modem,
direct connection to a personal computer, serial or parallel
transmission, or any selected transmitting/receiving protocol.
This illustration demonstrates the versatility of the system
once the image has been captured, converted and conditioned
by the image capture device of the subject invention. Specifically, once the image is captured by the camera 10 and conditioned by the gray scale bit map 16, it may be stored and
transmitted, or transmitted "real time" via any transmitting
and receiving scheme. As shown in FIG. 4 the image capture
device includes the memory device 46 and the optional
viewer 48 for incorporating maximum capability. However,
any of the schemes of FIGS. 1-3 would be suitable for producing a transmittable signal. In the embodiment shown, a
format select interface switch 60 is positioned to receive the
fully conditioned signal on line 59. This would permit either
automated or manual selection of the transmitting protocol,
including the Group-III facsimile system previously
described in connection with FIGS. 1-3, as indicated by
selecting format select switch 60 position A; or PC modem
protocol as illustrated by the JPEG compressor 62 and protocol generator 64, as indicated by selecting format select
switch position B; or the wavelet compressor and PC modem
protocol, as illustrated by the wavelet compressor 66 and PC
modem protocol generator 68 by selecting switch position C;
or any selected conversion network 65, (if needed) with a
compatible compressor 67 (if needed) and compatible protocol generator 75 (if needed), as indicated by switch position
D; or a serial protocol scheme 77, with serial drivers 79
directly to a hardwired personal computer 181 by selecting
switch position E. Of course, it will be readily understood by
those skilled in the art that one or a plurality of transmitting
protocols may be simultaneously selected. Depending on the
protocol selected, the signal output is generated at the
selected output module and introduced to a communications
interface module 183 via a modem or other device, as needed,
for transmission via a transmission system to a compatible
receiving station such as the Group-III facsimile device 34,
the personal computer 85, the video telephone 89, and/or
other server or receiving device 91 for distribution.
An exemplary circuit supporting the configurations of
FIGS. 1-4 is shown in FIG. 5. With specific reference to FIG.
5, an analog camera is indicated by the "video in" signal at 70.
Typically, the video signal is a composite video/sync signal.
The diagram shows all of the signal processing necessary to
sync up to an NTSC signal 70 coming out of the analog
camera and processed for introduction into an integral RAM
memory 71 and/or a portable RAM memory via interface 73.
An analog to digital (AID) converter 74 converts the video
portion of the analog signal from the camera and produces the
digital signal for output at line 76. The digital output data on
path 76 is introduced into a data multiplexer circuit 81 and
into the RAM memory unites) 71, 72. In the exemplary
embodiment, the portable RAM memory 72 is an image card
such as, by way of example, a PCMCIA SRAM card or a
PCMCIA Flash RAM card. However, it will be readily understood that any suitable RAM memory configuration can be
used within the teachings of the invention. It is desirable to
store compressed rather than raw data in card 72 because of
space and transmission speed factors.
As the signal at 70 is introduced into the circuit, the sync
detector 78 strips the sync signal portion off of the video
signal. The sync signal drives the video address generator 80
for providing a signal used to generate an address signal at the
address multiplexer circuit 82 for synchronizing the scanned
in video signal with the locations in RAM to define each

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2
9

10

frame to be captured. The read/write control 84 controls the
coordination of the sync signal 93 with the video signal to
define a full frame. Basically, when the camera is activated
either by the operator or by automation, the system processor
86 detects the initiation of the camera and capture sequence
and sends a signal via line 88 to the read/write control 84. The
read/write control then monitors the incoming video signal 83
to find the horizontal and vertical sync pulse to identify the
beginning of a frame. The read/write control then initiates
writing to memory at the RAM devices to initiate capture of
the frame. The read/write control continues to "write" to
memory until the appropriate sync signal is received, indicating the end of the frame. At this point a single frame is
captured in RAM 71 and/or on the portable medium RAM 72.
This frame may now be output from the system via any of
the available transmitting schemes. In the exemplary embodiment, the processor 86 may be any processor or such as a
microprocessor or DSP, with sufficient capability to perfonn
the described functions. The processor bus is indicated at 87.
The circuitry supporting the processor comprises the processor chip 86 and the control store memory (ROM, Flash RAM,
PROM, EPROM or the like) 92 for storing the software program executed by the processor. It will be understood that
other memory devices could be utilized without departing
from the spirit of the invention. For example, a Flash RAM
would permit flexibility and replacement of the program for
upgrades and enhancements. The user interface commands
are generated and interpreted by the software that is being
executed by the processor 86.
The display unit 94 is connected through a typical interface
96, and provides visual user interface at the camera body to
give the operator a visual read-out of the status of the collection and transmission of a selected frame. In the exemplary
embodiment, the display unit is a two line, multi -character
LCD display, but other sizes or technology displays could be
readily incorporated, depending, for example, on the amount
of graphics desired in the display module. The bank of operator buttons and/or switches 98 are connected to the system
through the button interface 100.
The general purpose control register 102 serves as a latch
and pennits control bits to be introduced from the processor
86 to the transmitting systems or to transfer status bits from
the transmitting systems back to the processor in the well
known manner. The modem 104 may be any of a variety of
widely available modems or modem chip sets currently in
commercial use. The modem should support CCITT Group
III fax fonnat for transmission to Group III fax machines.
Once the signal is introduced into the modem 104, it is
handled in typical fashion to provide input/output transmissions: (1) from the subject device to a hardwired telephonic
line as indicated at 114, (2) from the subject device to the
external facsimile machine as indicated at 116, or (3) from the
subject device to an external wireless device telephone as
indicated at 130. The specific selection is controlled by the
user at button module 98 in conjunction with the processor 86.
An isolation transformer 110 is provided to isolate the
circuitry connected to external communications circuit from
the circuitry of the subject device. The relays at 108 and 112
permit patching directly into the hardwired telephonic line
and to the telephone company system as indicated at 114, to
an external handset or fax machine at 116, or to the modem
104, whereby facsimile data can be sent and received via the
modem. These relays could be mechanical or solid state. The
relay 118 is connected to a tone source 120 for providing an
audible tone signaling to the user that the system is being used
for transmitting or receiving a captured image.

With specific reference to the circuitry associated with
relay 112, it will be noted that when the handset is switched
away from the phone line to the tone source, the modem
transfonner 110 is switched to the telephone line 114. This
blocks nonnal audio telephone service and pennits the transmission of an image signal from the RAM devices 71 or 72,
through the modem 104, and to the telephone line 114.
In the exemplary embodiment, a stand alone facsimile
machine can be connected through the external handset jack
at 116. With relay 112 set to activate telephone service and the
tone generator 120 disconnected, the relay 108 can be set in
either of two positions. The first position, as drawn, connects
the facsimile machine at jack 116 to the telephone line, permitting standard facsimile transmission. The second or alternative position pennits the modem 104 to transmit the image
data signal directly to the facsimile machine at jack 116, for
providing an archive copy or the like. In this configuration,
the facsimile machine will operate as a local printer for printing the captured images. Signal source 120 may be used as a
ringing voltage generator for signaling such facsimile
machine prior to connection.
The system of the present invention also contemplates
wireless transmission over a cellular telephone, radio frequency, satellite transmission or the like. In the exemplary
embodiment, the specific configuration for a cellular telephone interface is shown in detail. The amplifiers 122, 124
amplify the input of the modem 104 and are controlled by the
FETs 126, 128, respectively. The FETs are controlled by the
control register 102 and allow selection of the audio either
coming in from the cellular interface 130 or from the telephone line 104 to the modem. This pennits the cellular phone
to be used for three distinct functions: (1) as an audio telephone, (2) as a transmitting system for transmitting the captured image and related signals via a cellular system, and (3)
for receiving incoming transmissions to the processor. such as
remote control, remote configuration, or images.
In the exemplary embodiment, the image card 72 is a
DRAM card or non volatile storage card such as a Flash RAM
or the like and provides a removable medium for storing the
image data as either raw or compressed data. The card can
also be used to store compressed data sent into the system via
external facsimile transmission. As illustrated, the system is
capable of both sending and receiving image data via GroupIII fax or other protocol. By incorporating the digital to analog (D/A) converter into the system and pulling the signal
from the RAM 71 (or portable RAM 72), the signal can be
displayed right at the camera viewfinder 134 or other display
device connected at port 138. A sync generator 136 is incorporated to provide synchronization of incoming data in the
same manner. The sync detector 78 is utilized to define a
frame-by-frame correlation of the data generated by the camera at the video input 70 for storage to memory 71 or 72.
Any standard power source may be utilized, including
replaceable or rechargeable batteries 141, or an AC adapter
142. TheAC adapter is particularly suitable for desktop applications.
The exemplary embodiment includes a speaker or other
audio transducer 144 for emitting a detectable signal whenever the user interface merits its use, such as user induced
errors, system errors, user attention getting and the like.
In order to send a facsimile transmission over a typical
Group-III Facsimile system, the multiplexer 82 is switched to
the processor 86 such that the RAM address is generated by
the processor 86 instead of the video address generator signal.
In the facsimile transmitting mode, the processor 86
addresses the RAM and manipulates the data representing
each frame image. For example, the processor 86 will per-

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2
11

12

form the gray scale to halftone conversion described in connection with FIGS. 1-4 to prepare the signal for facsimile
transmission. The processor 86 can also perform image compression and output the image as a gray scale. In the facsimile
transmission mode, once the half tone conversion is completed, the processor 86 executes a code for performing a
bi-level compression of the data and the signal representing
the frame data is output over line 90, through the multiplexer
81 and over the processor bus 87 to the processor 86, then to
modem 104 for transmission. Other memory and processor
configurations could be used without departing from the
scope and spirit of the invention, as will be recognized by
those skilled in the art.
Various physical configurations of the invention are shown
in FIGS. 7A & 7B. FIGS. 6A, 6B and 6C are block diagrams
for desktop and portable units. FIGS. 7A and 7B illustrate the
subject invention as incorporated in a standard 35 millimeter
type camera housing.
A basic desktop system is shown in FIG. 6A, and includes
a console unit having a telephone jack 152, an external telephone connection 154 and a video input/camera power jack
156 for connecting the analog camera 10. A facsimile
machine may be also connected at jack 154 to provide local
printer capability. The configuration shown in FIG. 6B is a
basic portable system, with a battery powered portable module 160 having a self-contained power source 162. The system may include an integral RAM and/or the removable
memory module as indicated by the image card 72. The
camera 10 may be an integral feature of the portable module
160, or may be a detached unit, as desired. In this embodiment, a cellular telephone 164 is provided with a data jack 166
for connecting to the output jack 168 of the module, whereby
the image data signal may be transmitted via the cellular
telephone to a remote facsimile machine over standard cellular and telephone company facilities. When incorporating the
circuitry of FIG. 5, the cellular phone may be used as both an
input and an output device, and incoming data or stored
images may be viewed through the viewfinder 170.
FIG. 6C shows a comprehensive desk or stationary configuration incorporating all of the features supported by the
circuitry of FIG. 5. As there shown, the control module 172 is
adapted for receiving the image card 72 and is powered by an
AC power adapter as indicated at 142. The camera 10 is
connected to the module via a hardwired connection at jack
174. A monitor 176 is provided for viewing data images. A
video cassette recorder 178 is provided and may be used as an
auxiliary input device for the images transmitted from the
system. The facsimile machine 180 can be used as a local
printer, or can be used to send facsimiles transmissions in the
well-known manner. Direct connections to the telephone line
system are provided at jack 182. The FAX/phone jack 186 can
be connected to a facsimile machine 180 and/or a standard
telephone 184, where the public telephone system can be
accessed. A data jack 188 is used to connect to a cellular
telephone or the cellular modem, or other wireless device for
transmission or reception of image data.
Turning now to FIGS. 7A and 7B, the camera body 190 is
similar to a standard 35 millimeter camera housing and is
adapted to receive a standard lens 192 with a viewfinder 194.
The electronics are housed in the casing in the area normally
occupied by the film and film advancing implements. The
operator interface button keys 98 are housed within the housing and may be positioned on the back plate 196 of the body.
FIG. 8. The LCD unit may be positioned to be visible through
the viewfinder 194 or may be in a separate back window 198.
The memory card 72 is positioned in a slot 200 provided in a
sidewall of the camera body. This camera has the appearance

of a standard SLR 35 millimeter camera. In addition, where
desired, an integral cellular phone can be incorporated in the
camera housing and transmission can be sent directly from
the camera housing to a remote receiving station. The keypad
for the telephone is indicated at 202.
FIG. 8 is an illustration of an exemplary schematic diagram
for the circuit of a system according to the teaching of the
invention as specifically taught in the diagram of FIG. 5. Pin
numbers, wiring harnesses and components are as shown on
the drawing. FIG. 8, part A, is the system interconnect and
shows the central processor board 300, the video board 302,
the power board 304 and the CRT electronic interconnect
board 306. The telephone interface is provided at 307. Board
308 is the audio connector board. Board 310 is the serial
connector board and board 312 is the video connector board.
FIG. 8, part B contains the audio logic, with audio I/O at 314.
The audio amplifiers are designated 316 and 318. A microphone connector is provided at 320, with preamplifier circuit
322. Audio switches are provided at 324 and 326. Summing
circuit 328 provides audio summing. The serial RAM for
audio is designated 330. FIG. 8, part C includes the camera
module 332 and the camera control digital to analog convertor 334. Amplifier 336 is the video buffer. Module 338 is the
camera shutter control resistor.
FIG. 8, part D contains the central processor unit 340.
Voltage in is at 342, with the power switch at FET 344. Power
shutdown is provided at the video shutdown bit 346. The
video connector is designated at 348. Pin I is switched five
volts out to video logic. Pins 2-9 are connected to the video
data bus and pins 10-22 are video control signals. Buffers 350
and 352 are the video board I/O isolation buffers. As shown,
pin 19 of buffer 352 is the output enable and is connected to
the video shutdown bit 346. Line 354 is bus enable. PinAO of
buffer 350 is the direction control signal and pins Al A 7 are
connected to the processor data bus. Pins 10-17 of buffer 352
are also connected to the processor bus.
The system DRAM memory is designated 356. The processor I/O module is designated 358 and the I/O decoder is
provided at 360. A non-volatile RAM 362 provides system
parameters. The processor oscillator is shown at 364 and a
real time clock at 366. Controller 368 is the RAM card controller. The PCMCIA socket for the RAM card is shown at
370a and 370b. The modem is designated 372. The serial
controller is shown at 374 with serial controller oscillator
376. Module 378 is a memory module. A signal buffer is
provided at 380, and an address decoder at 382. Connectors
are designated at 384, 386 and 388.
FIG. 8, part E shows the modem board connector at 390,
the glue logic PLD at 392 and the glue logic module at 394.
Module 396 is the synchronous/asynchronous serial controller. Circuit 398 is the signal multiplex relay and circuit 400 is
the transmit/PTT relay. Bypass relays are shown at 402. Relay
404 is the digital mode relay. Transformer 406 is the audio
isolation transformer. Circuit 408 provides a low speed data
filter. The line drivers are designated 410 and the line rectifiers are designated 412, respectively. Connector 414 provides
radio/serial data connection.
FIG. 8, part F shows the status LED's 416 and the PCMCIA door open switch 418. FIG. 8, part G shows the power
switches 420. FIG. 8, part H is the battery pack 422.
FIG. 8, part I is the power supply. The rechargeable battery
connection is shown at 424, with DC power input at 426. An
internal battery/external DC input transfer relay is provided at
430. The signal for the power switch on the removable disk
drive access door is on pins 3,4 of connector 428. The voltage
IN regulator is designated at 432, with the processor voltage
regulator designated 434. The processor power control bit is

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2
13

14

at 436. The system power control bit is at 438, with the system
voltage regulator at 440. The video power control bits are at
442 and 444, with the video voltage regulators at 446 and 448,
respectively. Battery 450 is the real time clock battery. Connector 452 is the battery charger connector. Connector 454
connects processor power, system power, regulated battery
power and real time clock power, as shown. Connector 456
connects video power. The power sequencer circuit is at 458.
FIG. 8, part J shows the direct access arrangement to a land
line telephone at 460 and the video viewfinder circuitry (CRT
electronics) at 462.
FIG. 8, part K is the video control circuitry. The video input
amplifier is designated at 464. The composite video sync
stripper is designated at 466. The video H/V timing pulse
generator is at 468 and the video phase lock loop at 470. The
register 472 is the video control register. Circuit 474 provide
programmable video filters---edge enhancers, with the FET
switch designated at 476. The video filter circuit is at 478 and
the video filter is at 480. The video reference digital to analog
circuit-is shown at 482, with the video analog to digital circuit
at 484 and the video analog to digital data out buffer at 486.
The voltage reference circuit is designated at 488.
FIG. 8, part L, shows the push button control switches as
490 and 492. The keyboard display is designated 494, and the
microcontroller 496 is the keyboard and keyboard display
microcontroller. The backlight circuitry is designated at 498,
with the back light control at 500. Module 502 is the LCD
module.
The circuitry supports any of the preferred configurations
from a basic real time transmission system via Group-III fax
to a comprehensive system supporting both land line and
wireless transmission of image, audio and documentary data
at both a local and remote station.
The subject invention also permits digitized collection of
audio signals through the use of an internal microphone, and
external input device, a cellular telephone, land line telephone, wireless radio or other communication system, and
digitized audio playback, as well. The playback can be via an
internal speaker, out an external out jack to a remote device or
via a cellular telephone, land line telephone, wireless radio or
other communication system.
The digitized image and audio capture features permit
association of audio with an image, as well as data with the
image. Useful data associated with the image includes GPS
from either internal or external GPS devices, date and time,
and text which may be input from an integrated keyboard or
from a remote location.
It is an important feature of the invention that the system
supports storage of images in an interim storage format
including raw video, interim gray scale format and/or half
tone format. The image can also be stored in the selected
output mode, such as by way of example, a Group III facsimile mode. The versatile capability of the system permits
transmission of captured data to a standard bi-level facsimile
machine such as Group III, to gray scale facsimile systems or
full color facsimile systems, as well as to other remote receiving devices such as, by way of example, personal computers
and network servers. The data may be transferred in any of a
variety of formats and protocols including JPEG, FAX,
emerging imagery formats, wavelets and data protocols. The
invention is adapted to operate in multiple modes, with a
unitary capture and send mode or separate capture and store,
and send modes. In the preferred embodiment, the system is
adapted for tagging a collected image, video, audio, and other
data such as a GPS signal, with a real time clock and added
text. This permits the complete historical data to be transmitted simultaneously with the image signal.

It is contemplated that the system of the invention would be
self-contained with an integral power unit such as a rechargeable battery source or the like. Therefore, the system is
adapted to power up when in use and power down when not
activated, preserving power during idle time. The power systems for the video camera, the video input circuits and converters, the modem or other transmission devices and other
high drain components may be isolated and only powered
when needed. This also permits use of ancillary functions,
such as use as a cellular telephone, to proceed without draining the power source by powering idle components. The
processor clock rate may also be slowed down during idle
mode to further conserve power.
Where desired, the system also includes camera operation
control capability through the use of a digital/analog network
for converting digital commands to analog signals for controlling the gain, pedestal, setup, white clip, lens focus, and
other functions of the camera from a local input device, a
remote device or as programmed functions. The central processor may also be used to control camera shutter rate. Other
camera features and parameters which may be controlled in
this marmer are compressor resolution (high, medium, low),
field/frame mode, color or monochrome, image spatial resolution (640x430, 320x240, for example), lens and camera
adjustments, input selection where multiple cameras are used
and the like.
When an integrated communications device is used, such
as by way of example, a cellular telephone, the telephone can
be isolated from the rest of the system to permit independent
use, and independent power up and power off and other cellular phone functions.
In operation, the system permits not only the manual capture, dial (select) and send of images, but may also be fully
automated to capture, dial and send, for example, on a timed
sequence or in response to a sensor such as a motion sensor or
from a remote trigger device. The remote trigger may be
activated by an incoming telephone signal, for example. The
remote device may also be use for remote loading and downloading of firmware, and of the progranlillable devices, as
well as to provide remote configuration of sampling modes
during both the capture and the send functions.
Circular sampling techniques are supported by the data
capture system of the present invention. FIG. 9 is a diagram
illustrating exemplary sampling techniques in accordance
with the teachings of the invention. As shown in FIG. 9, the
time sequence is indicated by the Time Line: tl, t2 ... tn, with
a sample at each time interval, as indicated by SI ... Sn. For
purposes of illustration, the triggering event occurs at time
interval tlo. Based on the predetermined progranlilling of the
system, images will start to be collected upon triggering
event, as shown at 210, for a predetermined period prior to
and after trigger, as shown at 212, or immediately preceding
the trigger, as shown at 214. This permits "circular image
storage" without requiring that all images be collected and
stored in order to look at events surrounding a triggering
event. The technique is also very useful when multiple overlapping zones are monitored by multiple devices and it is
desirable to sequence from device to device without losing
any critical images.
This is particularly useful when triggering events are used
to initiate transmission of collected image data over the communications system. For example, if a triggering event is
motion detected at a motion sensor, it may be useful to look at
the images captured for a period of time both prior to and after
the actual event. The circuitry of the subject invention permits
any circular sampling technique to be utilized depending
upon application, such as prior to an after trigger, only after

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2
15

16

trigger or only before trigger. Again, as an example, it may
desirable to look primarily at images captured before a triggering event if the event is a catastrophic event such as an
explosion or the like. Other circular sampling techniques may
be employed, as well, incorporating multiple cameras, for
example, wherein different fields are sampled depending
upon the time frame in a sequence of events.
Other configurations are contemplated and are within the
teachings of the invention. While specific embodiments have
been shown and described herein, it will be understood that
the invention includes all modifications and enhancements
within the scope and spirit of the claims.

6. The apparatus according to claim 1 and further comprising:
the mobile phone being selectively operable to receive
from a remote sender an incoming wireless transmission
the incoming wireless transmission conveying at least
one of:
incoming compressed digital image data,
an incoming voice transmission, and
both incoming compressed digital image data and an
incoming voice transmission.
7. The apparatus according to claim 1 and further comprising:
camera supported by the portable housing, the camera
including the image collection device.
S. The apparatus according to claim 1 and further comprising:
the image collection device being suitable to provide the
visual image data in digital fonnat.
9. The apparatus according to claim 1 and further comprising:
the image collection device being suitable to provide the
visual image data in analog fonnat:
an analog to digital converter supported by the portable
housing, the analog to digital converter being suitable to
receive the visual image data in analog fonnat, the being
suitable to provide the visual image data in digital format;
the display including an LCD, the LCD being operable to
display for viewing by a user a perceptible visual image,
the perceptible visual image being generated from the
visual image data.
10. The apparatus according to claim 1 and further comprising:
the display including a viewfinder, the viewfinder being
suitable to receive the visual image data, the viewfinder
being operable to display for viewing by a user a perceptible visual image, the perceptible visual image
being generated from the visual image data.
11. The apparatus according to claim 10 and further comprising:
the viewfinder being suitable to receive the visual image
data in digital formal.
12. The apparatus according to claim 10 and further comprising:
the viewfinder being suitable to receive the visual image
data in analog format.
13. The apparatus according to claim 1 and further comprising:
the display including a display screen, the display screen
being defined apart from a viewfinder, the display screen
being operable to display for viewing by a user a perceptible visual image, the perceptible visual image
being generated from the visual image data.
14. The apparatus according to claim 13 and further comprising:
the display including an LCD, the LCD being operable to
display for viewing by a user a perceptible visual image,
the perceptible visual image being generated from the
visual image data.
15. The apparatus according to claim 14 and further comprising:
the LCD being suitable to receive the visual image data in
digital fonnat.
16. The apparatus according to claim 1 and further comprising;
at least one transmission protocol algorithm embodied in
suitable media;

What is claimed is:
1. Apparatus comprising:
a portable housing, the portable housing being wireless;
an image collection device supported by the portable housing, the image collection device being operable to provide visual image data of a field of view;
a display supported by the portable housing, the display
being operable to display for viewing by a user a perceptible visual image, the perceptible visual image
being generated from the visual image data;
memory supported by the portable housing, the memory
being suitable to receive visual image data in digital
format, the memory being suitable to retain the visual
image data in digital format,
an input device supported by the portable housing, the
input device being operable by the user;
operation of the input device by the user enabling the
memory to retain the visual image data in digital format,
the memory being suitable to provide retained visual
image data in digital format;
media supported by the portable housing, the media being
suitable to embody at least one compression algorithm;
at least one processing platfonn supported by the portable
housing, the at least one processing platfonn being operable to execute the at least one compression algorithm,
the at least one processing platform being provided the
retained visual image data in digital format, execution of
the at least one compression algorithm providing compressed visual image data; and
a mobile phone supported by the portable housing, the
mobile phone being operable to send to a remote recipient a wireless transmission, the wireless transmission
conveying the compressed digital image data; and
movement by the user of the portable housing commonly
moving the image collection device,
movement by the user of the portable housing commonly
moving the display.
2. The apparatus according to claim 1 and further comprising:
the processing platform including at least one processor.
3. The apparatus according to claim 1 and further comprising:
the portable housing including a handset.
4. The apparatus according to claim 1 and further comprising:
a microphone supported by the portable housing, the
microphone being associated with the mobile phone;
a speaker supported by the portable housing, the speaker
being associated with the mobile phone.
5. The apparatus according to claim 1 and further comprising:
the mobile phone being selectively operable to send to a
remote recipient a wireless transmission, the wireless
transmission conveying a voice transmission.

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2
17

18

a processing platfonn associated with the at least one transmission protocol algorithm, the associated processing
platform being operable to execute the at least one transmission protocol algorithm, the associated processing
platform being provided the compressed visual image
data, execution of the at least one transmission protocol
algorithm providing the compressed visual image data
in a transmission format, the visual image data in a
transmission fonnat being compatible with the mobile
phone for wireless transmission by the mobile phone.
17. The apparatus according to claim 16 and further comprising:
the mobile phone being operable according to a specified
wireless transmission protocol, the at least one transmission protocol algorithm providing the visual image data
in a compatible data transmission fonnat, the compatible data transmission fonnat being compatible with the
specified wireless transmission protocol.
18. The apparatus according to claim 17 and further com-

10

~~:

w

an image collection device supported by the portable housing, the image collection device being operable to provide visual image data of a field of view;
memory supported by the portable housing, the memory
being suitable to receive visual image data in digital
fonnat, the memory being suitable to retain the visual
image data in digital fonnat,
an input device supported by the portable housing, the
input device being operable by the user;
operation of the input device by the user enabling the
memory to retain the visual image data in digital format,
the memory being suitable to provide retained visual
image data in digital fonnat;
media supported by the portable housing, the media being
suitable to embody at least one compression algorithm;
at least one processing platfonn supported by the portable
housing, the at least one processing platfonn being operable to execute the at least one compression algorithm,
the at least one processing platform being provided the
retained visual image data in digital format, execution of
the at least one compression algorithm providing compressed visual image data;
a display supported by tile portable housing, the display
being operable to display for viewing by a user a perceptible visual image of the field of view, the perceptible
visual image being generated from the visual image data
in digital format;
a mobile phone supported by the portable housing, the
mobile phone being operable to send to a remote recipient a wireless transmission, the wireless transmission
conveying the compressed digital image data; and
movement by the user of the portable housing commonly
moving the image collection device,
movement by the user of the portable housing commonly
moving the display.
23. The apparatus according to claim 22 and further comprising:
the display including at least one of:
a viewfinder, and
a display screen apart from the viewfinder.
24. Apparatus comprising:
a portable housing, the portable housing being wireless:
an image collection device supported by the portable
housing, the image collection device being operable
to provide visual image data of a field of view;
memory supported by the portable housing, the memory
being suitable to receive visual image data in digital
format, the memory being suitable to retain the visual
image data in digital format,
an input device supported by the portable housing, the
input device being operable by the user;
operation of the input device by the user enabling the
memory to retain the visual image data in digital
format, the memory being suitable to provide retained
visual image data in digital format;
media supported by/the portable housing, the media
being suitable to embody at least one compression
algorithm;
at least one processing platfonn supported by the portable housing, the at least one processing platfonn
being operable to execute the at least one compression
algorithm, the at least one processing platform being
provided the retained visual image data in digital format, execution of the at least one compression algorithm providing compressed visual image data;
a display supported by the portable housing, the display
being operable to display the viewing by a user a

at least one transmission protocol algorithm embodied in
suitable media;
a processing platfonn associated with the at least one transmission protocol algorithm, the associated processing
platform being operable to execute the at least one transmission protocol algorithm, execution of the at least one
transmission protocol algorithm providing compressed
visual image data in a compatible fonnat, the compatible
format being compatible with at least one transmission
protocol, the compressed visual image data in a compatible format being suitable for transmission by the mobile
phone according to at least one wireless transmission
protocol.
19. The apparatus according to claim 1 and further comprising:
the portable housing including a first housing section, the
image collection device being supported by the rust
housing section,
the portable housing including a second housing section,
the display being supported by the second housing section,
the first housing section being adjoined to the second housing section,
the second housing section being movable in common with
the first housing section when the first housing section is
moved by the user,
the first housing section being movable in common with
the second housing section when the second housing
section is moved by the user,
the first housing section being supported for movement
relative to the second housing section,
the image collection device being movable in common
with the first housing section relative to the display when
the first housing section is moved relative to the second
housing section.
20. The apparatus according to claim 19 and further comprising:
the first housing section being supported for pivotal movement relative to the second housing section about a pivot
aXIs.
21. The apparatus according to claim 1 and further comprising:
the image collection device being supported by the portable housing in fixed relation to the display.
22. Apparatus comprising:
a portable housing, the portable housing being wireless:

15

25

30

35

40

45

50

55

60

65

US 7,643,168 B2
19

20

perceptible visual image of the field of view, the perceptible visual image being generated from the
retained visual image data in digital format;
a mobile phone supported by the portable housing, the
mobile phone being operable to send to a remote
recipient a wireless transmission, the wireless transmission conveying the compressed digital image data;
and
movement by the user of the portable housing commonly moving the image collection device,
movement by the user of the portable housing commonly moving the display.
25. The apparatus according to claim 24 and further comprising:
the display including at least one of:
a viewfinder, and
a display screen apart from the viewfinder.
26. A mobile handset comprising:
a portable housing, the portable housing being wireless;
an image collection device supported by the portable housing, the image collection device being operable to provide visual image data of a field of view;
a display supported by the portable housing, the display
being operable to
display for viewing by a user a perceptible visual image,
the perceptible visual
image being generated from the visual image data;
memory supported by the portable housing, the memory
being suitable to receive visual image data in digital
format, the memory being suitable to retain the visual
image data in digital format,
an input device supported by the portable housing, the
input device being operable by the user;
operation of the input device by the user enabling the
memory to retain the visual image data in digital format,
the memory being suitable to provide retained visual
image data in digital format;
media supported by the portable housing, the media being
suitable to embody at least one compression algorithm;
at least one processing platform supported by the portable
housing, the at least one processing platform being operable to execute the at least one compression algorithm,
the at least one processing platform being provided the
retained visual image data in digital format, execution of
the at least one compression algorithm providing compressed visual image data; and
a mobile phone supported by the portable housing, the
mobile phone being operable to send to a remote recipient a wireless transmission, the wireless transmission
conveying the compressed digital image data.
27. Apparatus comprising:
a portable housing, the portable housing being wireless;
an image collection device supported by the portable housing, the image collection device being operable to provide visual image data of a field of view;
memory supported by the portable housing, the memory
being suitable to receive visual image data in digital
format, the memory being suitable to retain the visual
image data in digital format,
an input device supported by the portable housing, the
input device being operable by the user;
operation of the input device by the user enabling the
memory to retain the visual image data in digital format,
the memory being suitable to provide retained visual
image data in digital format;
media supported by the portable housing, the media being
suitable to embody at least one compression algorithm;

at least one processing platform supported by the portable
housing, the at least one processing platform being operable to execute the at least one compression algorithm,
the at least one processing platform being provided the
retained visual image data in digital format, execution of
the at least one compression algorithm providing compressed visual image data;
a display supported by the portable housing, the display
being operable to display for viewing by a user a perceptible visual image of the field of view, the perceptible
visual image being generated from the retained visual
image data in digital format;
a mobile phone supported by the portable housing, the
mobile phone being selectively operable to send to a
remote recipient a wireless image transmission, the
wireless transmission conveying the compressed digital
image data, the mobile phone being selectively operable
to send to a remote recipient a wireless voice transmission, the mobile phone being selectively operable to
receive from a remote sender an incoming wireless
image transmission; and
the display being operable to display for viewing by a user
a perceptible visual image of the incoming wireless
image transmission.
28. The apparatus according to claim 27 and further comprising:
the display including at least one of:
a viewfinder, and
a display screen apart from the viewfinder.
29. Apparatus comprising:
a portable housing, the portable housing being wireless;
an image collection device supported by the portable housing, the image collection device being operable to provide in digital format visual image data of a field of view;
memory supported by the portable housing, the memory
being suitable to receive the visual image data in digital
format, the memory being suitable to retain the visual
image data in digital format,
an input device supported by the portable housing, the
input device being operable by the user;
operation of the input device by the user enabling the
memory to retain the visual image data in digital format,
the memory being suitable to provide retained visual
image data in digital format;
at least one compression algorithm embodied at least in
part in suitable progrannned media, the media being
supported by the portable housing;
at least one processor supported by the portable housing,
the at least one processor being operable to execute the at
least one compression algorithm, the at least one processor being provided the retained visual image data in
digital format, execution of the at least one compression
algorithm providing compressed visual image data;
at least one display supported by the portable housing, the
at least one display being operable to display for viewing
by a user a perceptible visual image of the field of view,
the perceptible visual image being generated from at
least one of:
the visual image data in digital format, and
the retained visual image data in digital format;
a mobile phone supported by the portable housing, the
mobile phone being operable to send to a remote recipient a wireless transmission, the wireless transmission
conveying the compressed digital image data.
30. Apparatus according to claim 29 and further comprising:

10

15

20

25

30

35

40

45

50

55

60

65

US 7,643,168 B2

21
the image collection device including an analog to digital
converter, the analog to digital converter being operable
to provide the visual image data in digital formal.
31. The apparatus according to claim 29 and further comprising:

22
the at least one display including at least one of:
a viewfinder; and
a display screen apart from the viewfinder.

* * * * *