Olivistar, LLC v. Facebook, Inc.

Filing 1

COMPLAINT against All Defendants ( Filing fee $ 400 receipt number 0540-4611897.), filed by Olivistar, LLC. (Attachments: # 1 Civil Cover Sheet, # 2 Exhibit A, # 3 Exhibit B)(Hansley, Austin)

EXHIBIT B

US008239481B2

(12) Ulllted States Patent

(10) Patent N0.:

Alexander et a].
(54)

US 8,239,481 B2

(45) Date of Patent:

SYSTEM AND METHOD FOR

4,581,634 A

IMPLEMENTING OPEN-CONTROL REMOTE

2

*Aug. 7, 2012

4/1986 Williams

1%;

$331121

DEVICE CONTROL

Inventors: Bruce Alexander, Poulsbo, WA (U S);
Liem Bahneman, Bothell, WA (US)

4,339,640 A
4,962,473 A

6/19g9 ()Zer
10/1990 Crain

4,998,279 A

(75)

48163658 A

3/1991 Weiss

5,097,505 A

3/1992 Weiss

4,837,568 A

(73) Assignee: Vigilos, LLC, Tyler, TX (US)

3/1989 Khandwala
6/1989 Snaper

(Continued)
(*)

Notice:

Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U-S-C- 154(1)) by 1109 days-

FOREIGN PATENT DOCUMENTS
0804031 A2 10/1997

EP

This patent is subject to a terminal disclaimer.

(Continued)
OTHER PUBLICATIONS

(21) Appl.No.: 12/054,217
(22)

Filed:

“EyeCast.com Introduces SchoolCast Services for School Safety
Officials and Law Enforcement Agencies,” EyeCast.com Press

Mar, 24, 2008

Release, Sterling, Va., Apr. 28, 1999, <http://WWW.eyecast.com/
(65)

Prior Publication Data

US 2008/0215987 A1

neWs/releases/090798.asp> [retrieved May 18, 2000], 2 pages.

Sep. 4, 2008

(Continued)

Related US. Application Data
_

(63)

_

_

_

Primary Examiner * JungWon Chang

Continuation of application No. 10/013,408, ?led on
Dec. 6, 2001.

(74) Attorney) Agent] or Firm i Andrews Kunh LLP

(60) I6’ro2\(/)132)onal application No. 60/254,031, ?led on Dec.

(57)

ABSTRACT

A system and method for implementing open-protocol
(51)

remote device control are provided. A user accesses a com
mon user interface for controlling one or more networked
devices_ Utilizing the interface’ the user Selects one or more
actions' The Selection is encoded in a Standard protocol and

709/224, 217, 223; 340/541, 506; 348/1405;

(52)

Int‘ Cl‘
G06F 15/16
(200601)
US. Cl. ........................... .. 709/217; 709/223; 726/4
0f Classi?cation Search ................ ..

transmitted to a premises server. The premises server obtains

345/1-1; 710/11; 726/4

the selection, accesses a device interface database and trans

See application ?le for Complete Search 11151013’-

lates the selection into a device-speci?c protocol. The trans

References Cited

lated instruction is transmitted to the selected device for
implementation. The user interface then obtains any device

(56)

return data for display on the user interface.

U.S. PATENT DOCUMENTS
4,216,375 A
4,218,690 A

8/1980 Ulch
8/1980 Ulch

50 Claims, 10 Drawing Sheets

224

(5) STANDARD COIW‘ROL
m

204

“0mm,
nvsmvcrmm
\ COMPUTING mzvm; ............................................ __
com-ml.
APPIJCA non

“Pl-1C4 770”
VIEWER

m

‘ ____________________________________
(10) smmww

CENTRAL
SER VER
.

ENCODED RESULTS 1‘I!

,1

(a) smvmnn 001mm]. ,1’
msnvmozvs

I,’ (9) STANDARD ENCODED

-'

,f

.5

‘a

mm. 1s

I"

‘
202

m DEVICE SPECIFIC

mamas (a) DEVICE SPECIFIC
SEK VER
23"

msnr UCTIONS
23‘ /\" MUNIT[HUNG
1mm].
0 DEVICE .li

usurn

f

US 8,239,481 B2
Page 2
2002/0019945 A1

U.S. PATENT DOCUMENTS

5,210,873
5,367,624
5,475,375
5,475,378
5,544,062
RE35,336
5,600,368
5,614,890
5,629,981
5,654,696
5,675,738
5,678,039
5,680,328
5,682,142
5,729,471
5,742,286
5,768,119
5,870,733
5,903,455
5,923,264
5,960,174
6,011,547
6,064,723
6,076,111
6,085,227
6,133,941
6,157,956
6,166,729
6,233,588
6,253,228
6,271,752
6,298,474
6,317,781
6,356,949
6,362,836
6,430,740
6,529,936
6,564,380
6,686,838
6,785,730
6,867,749
7,356,579
7,370,074
2001/0042142

ED>m

5/1993
11/1994
12/1995
12/1995
8/1996
9/1996
2/1997
3/1997
5/1997
8/1997
10/1997
10/1997
10/1997
10/1997
3/1998
4/1998
6/1998
2/1999
5/1999
7/1999
9/1999
1/2000
5/2000
6/2000
7/2000
10/2000
12/2000
12/2000
5/2001
6/2001
8/2001
10/2001
11/2001
3/2002
3/2002
8/2002
3/2003
5/2003
2/2004
8/2004
3/2005
4/2008
5/2008
11/2001

3/2002 Toyoshima

2003/0140112 A1 *

Barrett
Kaarsoo

7/2003 Ramachandran et al.

Johnston, Jr.
Matthews, III

“EyeCast.com Adds 360-Degree Continuous Pan Rotation Cameras

to It’s[sic] EyeView Service,” EyeCast.com Press Release, Sterling,
Va., Mar. 15, 1999, <http://www.eyecast.com/news/releases/03l599.
asp> [retrieved Sep. 21, 1999], 2 pages.

Skorupski
Loosmore
Jain

“Take a Step Into the Future . . . ,”A-TechVideo Solutions, Inc., 1999,

<www.remotecams.com> [retrieved Sep. 17, 1999], 6 pages.
“EyeCast Secures DealsiSecurity Companies to Use Firm’s Off
Site Video Surveillance Technology,” Washington Business Journal,

Kung
Havekost
Bass

Aug. 13-19, 1999, <http://www.eyecast.com/news/washbiZ.asp>

Sharpe, Jr.
Lavelle
Dew
Shiota
Cohn
Chiu
Edlund
......................... ..

348/14.05

[retrieved Sep. 21, 1999], 2 pages.
“EyeCast.com Announces EyeView Control,” EyeCast.com Press
Release, Sterling,Va., Oct. 12, 1998 <http://www.eyecast.com/news/
releases/l0l298.asp> [retrieved Sep. 24, 1999], 2 pages.
“EyeCast Announces EyeCapture Services,” EyeCast.com Press
Release, Sterling, Va., Jul. 8, 1998 <http://www.eyecast.com/news/
releases/070898.asp> [retrieved Sep. 27, 1999], 2 pages.
“Providing Live Interactive Video for Surveillance & Monitoring
Over the Internet,” EyeCast.com, Inc., at least before Dec. 26, 2001,

Jensen
Acosta
Marchoili
Ferris et al. ................. .. 709/203
.......................... .. 340/541

Blowers
De Boor et al. ............. .. 709/217

Katsandres
Shaw
Hart

27 pages.
“Axis 200 + Web Camera,” © 1998 Axis Communications AB, 2
pages.
“Axis 240 Camera Server,” © 1998 Axis Communications AB, 2
pages.
“30 Frames/Second,” © 1993-1999 Axis Communications, <www.

axis.se/products/cami240/> [retrieved Sep. 28, 1999], 2 pages.
“Network Cameras Applications and Solutions,” © 1993-1999 Axis

Mayo
Murphy
ReZvani et al.

2/1997
4/2001

OTHER PUBLICATIONS

Fox
Nerlikar
Barrett
Suzuki
Hinks

Vaios

709/217

FOREIGN PATENT DOCUMENTS
WO 97/07486 A1
WO 01/28251 A1

Ulch

Ono

2/ 2002 Houston

2002/0029263 A1

Gay
Cooper

Communications,
............. .. 340/506

<ww.axis.se/products/cameraiservers/cami

appisol.htm> [retrieved Sep. 28, 1999], 8 pages.

Taylor ....... ..

.

709/230

“Network Camera Servers: Features and Bene?ts,” © 1993-1999

Il et al. ......... ..

.. 345/1.1

Motoyama et al.

. 709/224

Axis Communications, <www.axis.se/products/cameraiservers/
camilb.html> [retrieved Sep. 28, 1999], 3 pages.

Alexander et al. .

Fukunaga et al.

. 709/203

............ .. 710/11

* cited by examiner

US. Patent

Aug. 7, 2012

Sheet 1 0f 10

US 8,239,481 B2

‘N

@N
‘N

kzosm

.‘M3a5? 93E

.RE
‘N

5:2 i

$1:26?3 25»

US. Patent

Aug. 7, 2012

Sheet 6 0f 10

US 8,239,481 B2

@56 E:SE

mmhSwm. i.zs
._vQ3S.52‘.8 w“EQ8€\z52‘cimS8w
3Ni83m5b28m

RNFN“A.

v5mi3ka%w:?

NNQU:

$5298/“\i

/m9u,5swq8

mSEuRN /853 2
g
@NN

.2

US. Patent

Aug. 7, 2012

Sheet 7 0f 10

US 8,239,481 B2

N3

E5
5;

. 2bu@E6nw2mg8z

@Q3$3m5q2eu‘“z8:.m

@5R&?z58keg
3/X.UN. NZS.QEU >53@8%2?56
3AQE52Z8Q

\EQgMSQGB:ESUFMGE

3w3522m:

2...

5i
5;

HO mgZQBbhU.?
.3
HE

vn@E2 5g:

uZEQ\e3/N

J7.HN?:k. \u.‘qmEe2zaw

‘a\

/58 28

6
.ME
MNN

US. Patent

Aug. 7, 2012

Sheet 8 0f 10

US 8,239,481 B2

NE
\

‘E\_ F

US. Patent

Aug. 7, 2012

Sheet 9 0f 10

START STANDARD DE VICE
CONTROL ROUTINE

US 8,239,481 B2

800

V

TRANSMIT DE VICE

802 ’\ CONTROL REQUEST TO
CENTRAL SER VER
V

OBTAIN DYNAMICALLY
GENERA TED CONTROL AND
VIEWER APPLICA TION

’\ 804

V

ESTABLISH COMMUNICA TION

806/\

AND VERIFY ACCESS WITH
PREMISES SER VER

TRANsMIT STANDARD
PROTOCOL ENCODED

’\-/ 808

INSTRUCTIONS
V

OBTAIN STANDARD PROTOCOL
810
ENCODED RESULTS AND DE VICE N
sTA TUS

ADDITIONAL
CONTROL
INSTRUCTIONS
?

812

Fig.8.

US. Patent

Aug. 7, 2012

US 8,239,481 B2

Sheet 10 0f 10

START STANDARD PROTOCOL
TRANSLA TION ROUTINE

900

OBTAIN STANDARD PROTOCOL ENCODED
CONTROL INSTRUCTION FROM BROWSER
COMPUTER
V

OBTAIN DE VICE-SPECIFIC PROTOCOLS
CORRESPONDING TO DESIGNA TED
MONITORING DE VICE

TRANSLA TE STANDARD PROTOCOL
INSTRUCTION T0 DE VICE-SPECIFIC PROTOCOLS

TRANSMIT DE VICE-SPECIFIC PROTOCOLS TO
DESIGNA TED MONITORING DEVICE
V

OBTAIN DE VICE-SPECIFIC RESULTS FROM
MONITORING DEVICE

TRANSLA TE DE VICE-SPE CIFIC RES UL TS T0
STANDARD PROTOCOL
V

TRANSMIT STANDARD PROTOCOL RES UL TS TO
BROWSER COMPUTER

END

Fig.9.

916

N 908

US 8,239,481 B2
1

2

SYSTEM AND METHOD FOR
IMPLEMENTING OPEN-CONTROL REMOTE
DEVICE CONTROL

often be required to upgrade, or otherWise maintain, each
instance of the user interface in the event the template is
modi?ed in any manner.
In a still further aspect, the addition or modi?cation of one
or more devices Within the netWork can create a need to delete
some or all of the custom user interfaces on each computer

CROSS-REFERENCES TO RELATED
APPLICATIONS

maintained by the monitor. Similarly, if a monitor Were to
only require access to a netWorked device one time, the moni
tor Would still be required to load and store the custom con
?gured user interface for that device on the user computer. In

This application is a continuation of application Ser. No.
10/013,408, ?led Dec. 6, 2001, Which claims the bene?t of

Provisional Application No. 60/254,031, ?led Dec. 6, 2000,
and both of Which are incorporated herein by reference.

a still further aspect, a user, such as a monitor, may often have

to manipulate multiple instances of the same user interface to
BACKGROUND

control multiple netWorked devices at one time. Accordingly,
the conventional common template approach remains de?
cient in requiring repeated actions, or the management of

In general, the present invention relates to electronic hard
Ware and computer softWare, and in particular, to a system
and method for controlling netWorked devices through a com

multiple interfaces at one time.
Based on the above-described de?ciencies, there is a need

mon, remote user interface. Generally described, a commu

nications netWork, such as a security-monitoring netWork,
can often utiliZe a variety of devices Within the netWork. For
example, a security-monitoring netWork can include image

for a system and method for implementing a common user
20

interface for supporting different hardWare device protocols
in a netWork.

capture monitoring devices, motion detection monitoring
devices, loudspeaker output devices, and the like. Often, to
manipulate a particular device, or obtain data from the device,

SUMMARY
25

the device requires some form of control/instruction from a

proprietary user interface and/or proprietary protocol. For
example, video camera manufacturers typically utiliZe pro
prietary protocols to govern control of both the mechanical
features (pan, tilt, Zoom, etc.) and electronic features (elec
tronic shutter speed, etc.). Moreover, a single manufacturer
may utiliZe different protocols for the different model devices

identify key features of the claimed subject matter, nor is it
intended to be used as an aid in determining the scope of the
30

A system and method for implementing open-protocol
monitoring devices. UtiliZing the interface, the user adminis
35

trator selects one or more actions. The selection is encoded in
a common general language and transmitted to a device
server. The device server obtains the selection, accesses a

device interface database and translates the selection into a

communicate With the respective hardWare device. HoWever,
as the number of devices connected to the netWork increases,

claimed subject matter.
remote device controls are provided. A user accesses a com
mon user interface for controlling one or more netWorked

or even different versions of the same model of device.

In one embodiment, in the event a netWork supports mul
tiple netWorked devices, an authorized user Within the net
Work can utiliZe each individual manufacturer-provided user
interface, such as a proprietary graphical user interface, to

This summary is provided to introduce a selection of con
cepts in a simpli?ed form that are further described beloW in
the Detailed Description. This summary is not intended to

device-speci?c protocol. The translated instruction is trans

maintaining each user interface becomes problematic. For

mitted to the selected device for implementation. The user
interface then obtains any device return data for display on the

example, a user, such as a security monitor, must receive

user interface.

training and be pro?cient in each type of proprietary user
interface. Additionally, the siZe and/or usability of a central
control panel, such as a computer display screen, having each

40

DESCRIPTION OF THE DRAWINGS
45

the ability of a user to implement a common task, such as the

The foregoing aspects and many of the attendant advan
tages of this invention Will become more readily appreciated

activation of all the cameras, must be executed individually,

as the same become better understood by reference to the

user interface display can become burdensome. Still further,

one interface at a time.

In another embodiment, a netWork can attempt to imple
ment a reduced number of device interfaces by incorporating

50

FIG. 1 is a block diagram illustrative of an Internet envi

a common user interface template, such as a common graphi

ronment;
FIG. 2A is a block diagram of an integrated information

cal user interface, in Which each instance of a user interface is

con?gured With the particular communication protocols of a
selected hardWare device. Although this conventional
approach attempts to mitigate the number of interfaces a
monitor Would be required to learn, this approach can remain

system in accordance With the present invention;
55

output devices Within a premises in accordance With the

present invention;
FIG. 3 is a block diagram depicting an illustrative archi
60

multiple computing devices. Additionally, the monitor may

tecture for a central server in accordance With the present

invention;

riZed users may gain access to netWorked devices by access
ing the resident user interface on the monitor’s computer. In
another aspect, because the custom user interfaces are resi
dent on the client computer, the monitor is limited to either

utiliZing the same computer system for all device controls or
to loading and maintaining the custom user interfaces on

FIG. 2B is a block diagram of an integrated information

system illustrating a premises server, monitoring devices, and

de?cient for a number of reasons. In one aspect, the custom

iZed user interface for each device remains resident Within the
memory of the monitor’ s computer. Accordingly, non-autho

folloWing detailed description, When taken in conjunction
With the accompanying draWings, Wherein:

FIG. 4 is a block diagram depicting an illustrative archi
tecture for a premises server in accordance With the present

invention;
65

FIG. 5 is a block diagram of an integrated information

system depicting the generation of a graphical user interface
in accordance With the present invention;

US 8,239,481 B2
4

3

on the Internet. Each hyperlink is assigned a Uniform

FIG. 6 is a block diagram of an integrated information

system depicting the transmission of standard protocol con

Resource Locator (“URL”) that provides the exact location of

trol instructions to a premises server and the translation of the

the linked document on a server connected to the Internet and

describes the document. Thus, Whenever a hypertext docu

instructions into device-speci?c protocols in accordance With
the present invention;

ment is retrieved from any Web server, the document is con
sidered retrieved from the World Wide Web. As is knoWn to
those skilled in the art, a Web server may also include facili

FIG. 7 is a block diagram illustrative of a screen display of
a graphical user interface for controlling netWorked devices
in an integrated information portal in accordance With the

ties for storing and transmitting application programs, such as
application programs Written in the JAVA® programming

present invention;

language from Sun Microsystems, for execution on a remote
computer. LikeWise, a Web server may also include facilities

FIG. 8 is a How diagram illustrative of a device control

routine implemented by a computing device having a broWser
application in an integrated information system in accordance
With the present invention; and

for executing scripts and other application programs on the
Web server itself.
A consumer or other remote access user may retrieve

FIG. 9 is a How diagram illustrative of a standard protocol
communication translation routine implemented by a pre

hypertext documents from the World Wide Web via a Web
broWser program. A Web broWser, such as Netscape’s NAVI

mises server in an integrated information system in accor

GATOR® or Microsoft’s Internet Explorer, is a softWare

dance With the present invention.
DETAILED DESCRIPTION
20

As described above, aspects of the present invention are
embodied in a World Wide Web (“WWW” or “Web”) site
accessible via the Internet. As is Well knoWn to those skilled
in the art, the term “Intemet” refers to the collection of net
Works and routers that use the Transmission Control Protocol/
Internet Protocol (“TCP/IP”) to communicate With one

higher-level protocol than TCP/IP and is designed speci?
25

another. A representative section of the Internet 20 is shoWn in
FIG. 1, Wherein a plurality of local area netWorks (“LANs”)
24 and a Wide area netWork (“WAN”) 26 are interconnected

by routers 22. The routers 22 are special purpose computers

30

tion links Within the LANs may be twisted Wire pair, coaxial
cable, or optical ?ber, While communication links betWeen

system 200 is a subscriber-based system allowing a number

netWorks may utiliZe 56 Kbps analog telephone lines, 1 Mbps
35

of netWorked devices Within one or more premises 202 to be
monitored and/ or controlled from a single user interface that
may be remote from the one or more premises. In accordance

With an illustrative embodiment of the present invention uti
liZing a monitoring netWork, data from one or more net

links knoWn to those skilled in the art.

Furthermore, computers 28 and other related electronic

Worked monitoring devices can be processed according to

devices can be remotely connected to either the LANs 24 or
the WAN 26 via a modem and temporary telephone or Wire

less link. It Will be appreciated that the Internet 20 comprises

cally for the requirements of the WWW. HTTP runs on top of
TCP/IP to transfer hypertext documents betWeen server and
client computers. The WWW broWser may also retrieve pro
grams from the Web server, such as JAVA applets, for execu
tion on the client computer.
Referring noW to FIGS. 2A and 2B, an integrated informa
tion system 200 for use With the present invention Will be

described. Generally described, an integrated information

used to interface one LAN or WAN to another. Communica

digital T-1 lines, 45 Mbps T-3 lines, or other communications

application program for providing a graphical user interface
to the WWW. Upon request from the consumer via the Web
broWser, the Web broWser locates and retrieves the desired
hypertext document from the appropriate Web server using
the URL for the document and the HTTP protocol. HTTP is a

one or more rules that are stored and evaluated by a central
40

a vast number of such interconnected netWorks, computers,
and routers and that only a small, representative section of the

processing server 204, or group of servers. In turn, the central
processing server 204 can customiZe one or more output

devices according to the preferences and rights of various

Internet 20 is shoWn in FIG. 1.

system users. HoWever, one skilled in the relevant art Will

The Internet has recently seen explosive groWth by virtue
of its ability to link computers located throughout the World.

appreciate that the disclosed integrated information system
45

As the Internet has groWn, so has the WWW. As is appreciated
by those skilled in the art, the WWW is a vast collection of

200 is illustrative in nature and that the present invention may
be utiliZed With alternative netWorks in communication With
one or more devices.

interconnected or “hypertext” documents Written in Hyper

With reference to FIG. 2A, in communication With the

Text Markup Language (“HTML”) or other markup lan

central server 204 is a central database 206 that includes a

guages, Which are electronically stored at “WWW sites” or

50

“Web sites” throughout the Internet. Other interactive hyper
text environments may include proprietary environments,

asset rules database 210, a resource rules database 212, an

such as those provided in America Online or other online

service providers, as Well as the “Wireless Web” provided by

various Wireless netWorking providers, especially those in the
cellular phone industry. It Will be appreciated that the present
invention could apply in any such interactive hypertext envi

55

asset inventory database 214, a resource inventory database
216, a device rules database 218, and an active events data
base 220. The utiliZation of some of the individual databases
Within the central database 206 Will be explained in greater
detail beloW. As Will be readily understood by one skilled in
the relevant art, the central database may be one or more
databases that may be remote from one another. In an alter
native embodiment, the central server 204 also maintains a

ronments; hoWever, for purposes of discussion, the Web is
used as an exemplary interactive hypertext environment With

regard to the present invention.

variety of databases including an event logs database 208, an

60

device interface database for translating standard protocol

A Web site is a server/ computer connected to the Internet

encoded tasks into device speci?c commands, as Will be

that has massive storage capabilities for storing hypertext

explained in greater detail beloW. Accordingly, the central

documents and that runs administrative softWare for handling

server 204 may perform some or all of the translation actions

requests for those stored hypertext documents. Embedded

in accordance With the present invention.

Within a hypertext document are a number of hyperlinks, i.e.,
highlighted portions of text that link the document to another
hypertext document possibly stored at a Web site elseWhere

65

With continued reference to FIG. 2A, the central server 204
communicates With one or more noti?cation acceptors 222. In

an illustrative embodiment, the noti?cation acceptors 222 can

US 8,239,481 B2
5

6

include one or more authorized users Who are associated With

that Will be transmitted to the central server 204 and/ or the

the noti?cation acceptor 222. Each authorized user has a
preference of noti?cation means and rights to the raW and

broWser computing device 224.
In accordance With an illustrative monitoring netWork
embodiment, the premises server 230 can communicate With

processed monitoring data. The authorized users include pre
mises oWners, security directors or administrators, on-site

one or more monitoring devices 236. In an illustrative

embodiment, the monitoring devices 236 can include smoke,
?re and carbon monoxide detectors. The monitoring devices

security guards, technicians, remote monitors (including cer
ti?ed and non-certi?ed monitors), customer service represen

236 can also include door and WindoW access detectors, glass

tatives, emergency personnel, and others. Moreover, the noti

break detectors, motion detectors, audio detectors and/or
infrared detectors. Still further, the monitoring devices 236

?cation acceptor 222 may be a centralized facility/ device that
can be associated With any number of authorized users. As

can include computer netWork monitors, voice identi?cation
devices, image capture devices, such as video cameras and

Will be readily understood by one skilled in the art, various
user authorizations may be practiced With the present inven

still cameras, microphones and/or ?ngerprint, facial, retinal,

tion. Additionally, it Will be further understood that one or
more of the rules databases may be maintained outside of the

or other biometric identi?cation devices. Still further, the
monitoring devices 236 can include conventional panic but

central server 204.

tons, global positioning satellite (“GPS”) locators, other geo
graphic locators, medical indicators, and vehicle information

In an illustrative embodiment of the present invention, the
central server 204 communicates With the noti?cation accep
tors 222 utilizing various communication devices and com

munication mediums. The devices include personal comput

20

systems. The monitoring devices 236 can also be integrated
With other existing information systems, such as inventory
control systems, accounting systems, or the like. It Will be

ers, hand-held computing devices, Wireless application

apparent to one skilled in the relevant art that additional or

protocol enabled Wireless devices, cellular or digital tele
phones, digital pagers, and the like. Moreover, the central

alternative monitoring devices 236 may be practiced With the
present invention.

server 204 may communicate With these devices via the Inter
net utilizing electronic messaging or Web access, via Wireless

The premises server 230 also communicates With one or
25

transmissions utilizing the Wireless application protocol,
short message services, audio transmissions, and the like. As
Will be readily understood by one skilled in the art, the spe
ci?c implementation of the communication mediums may
require additional or alternative components to be practiced.

more monitoring devices 236. In an illustrative embodiment,

the monitoring devices 234 can include audio speakers, dis
play or other audio/visual displays. The monitoring devices
234 may also include electrical or electro-mechanical devices

present invention.

that alloW the system to perform actions. The monitoring
devices 234 can include computer system interfaces, tele
phone interfaces, Wireless interfaces, door and WindoW lock
ing mechanisms, aerosol sprayers, and the like. One skilled in

In an illustrative embodiment of the present invention, a
subscriber may request access to the integrated information

the relevant art Will understand that the type of output device
236 is associated primarily With the type of action the system

30

All are considered to be Within the scope of practicing the

system 200 by utilizing a broWser computing device 224
connected to the system via a communication netWork, such
as the Internet 20. Alternatively, the broWser computing
device 224 may be in direct communication With the central
server 204, or other computing device on the netWork. In
accordance With an actual embodiment of the present inven
tion, the central server 204 authenticates a user corresponding
to the broWser computing device 224 and can transmit a
control application 226 and/ or a vieWer application 228 to the
broWser computing device 224 such that the user is given

35

devices 234 are considered to be Within the scope of the

present invention.
Generally described, the central server 204 obtains various

monitoring device data, processes the data, and outputs the
40 data to one or more authorized users. Additionally, some of

the monitoring device 23 6 data may be directly transmitted to
the broWser computing device 224 for display to an autho
rized user. In an illustrative embodiment, the communication
betWeen the central server 204 and the premises server 230 is
remote and tWo-Way. One skilled in the relevant art Will
understand that the premises server 230 may be remote from

access to one or more devices contained With the integrated

information system 200. Accordingly, by manipulating the
control application 226 and/ or the vieWer application 228, the
user can manipulate any number of devices in the integrated
information system 200. A more detailed description of the

generation and manipulation of the control application 226

produces. Accordingly, additional or alternative monitoring

50

and vieWer application 228 Will be described beloW.
With reference noW to FIG. 2B, each premises 202 can

the premises 202. In such an alternative embodiment, the
monitoring devices 236 transmit the monitoring data to a
remote premises server 230 or alternatively, they transmit the
monitoring data directly to the central server 204. Altema
tively, one skilled in the relevant art Will also appreciate that
the premises server 230 may also perform one or more of the
functions illustrated for the central server 204.

include one or more premises servers 230 operable to com

municate With the components of the integrated information

For certain type of monitoring devices 236, such as image

system 200. The premise server may include one or more 55 capture devices, additional devices or processes associated

device interface databases 232 for storing various device spe

With imaging processing, usually called grabbers 238 are

ci?c communication protocols and one or more standard inte

connected to or controlled by monitoring devices 236. Images
from the image capture monitoring devices 236 are processed

grated information system 200 communication protocols. As
Will be explained in greater detail beloW, utilizing the device
interface database 232, the premises server 230 can translate

60

by the grabber 238 into certain generally acceptable standard
image formats, such as bitmap, joint photographic expert

standard communication protocol embedded control instruc

group (“jpeg”), or the like. Additionally, the outputs from the

tions transmitted from the central server 204 or broWser com

grabber 238 may be transmitted to a Web server 240 for

puting device 224 into device-speci?c control instructions

delivery to the broWser computing device 224.

that Will be sent to netWorked devices in communication With
the premises server 230. The premises server 230 can also

translate device-speci?c outputs, such as digital images, from
netWorked devices into standard protocol embedded results

65

FIG. 3 is a block diagram depicting an illustrative archi
tecture for the central server 204. Those of ordinary skill in
the art Will appreciate that the central server 204 includes
many more components then those shoWn in FIG. 3. HoW

US 8,239,481 B2
7

8

ever, it is not necessary that all of these generally conventional
components be shoWn in order to disclose an illustrative
embodiment for practicing the present invention. As shoWn in

for connecting to the Internet through a PPP or SLIP connec
tion as knoWn to those skilled in the art.

FIG. 3, the central server 204 includes a netWork interface
300 for connecting directly to a LAN or a WAN, or for

402, a display 404, a device interface 406 and a mass memory
408, all connected via a communication bus, or other com

connecting remotely to a LAN or WAN. Those of ordinary
skill in the art Will appreciate that the netWork interface 300
includes the necessary circuitry for such a connection, and is
also constructed for use With the TCP/IP protocol or other
protocols, such as Internet Inter-ORB Protocol (“IIOP”). The
central server 204 may also be equipped With a modem for

munication device. The device interface 406 includes hard
Ware and softWare components that facilitate interaction With
a variety of the monitoring devices 236 via a variety of com

connecting to the Internet through a point-to-point (“PPP”)

tion mediums including telephone landlines, Wireless net
Works (including cellular, digital and radio netWorks), cable

The premises server 230 also includes a processing unit

munication protocols including TCP/IP, X10, digital I/O,
RS-232, RS-485 and the like. Additionally, the device inter
face facilitates communication via a variety of communica

connection or a serial-line Internet protocol (“SLIP”) connec
tion as knoWn to those skilled in the art.

netWorks, and the like. In an actual embodiment of the present
invention, the I/ O interface is implemented as a layer betWeen

The central server 204 also includes a processing unit 302,
a display 304, and a mass memory 306, all connected via a
communication bus, or other communication device. The
mass memory 306 generally comprises a RAM, ROM, and a
permanent mass storage device, such as a hard disk drive, tape

drive, optical drive, ?oppy disk drive, or combination thereof.

the server hardWare and softWare applications utiliZed to con

20

trol the individual digital image devices. One skilled in the
relevant art Will understand that alternative interface con?gu
rations may be practiced With the present invention.
The mass memory 408 generally comprises a RAM, ROM,

The mass memory 306 stores an operating system for con

and a permanent mass storage device, such as a hard disk

trolling the operation of the central server 204. It Will be

drive, tape drive, optical drive, ?oppy disk drive, or combi

appreciated that this component may comprise a general

nation thereof. The mass memory 408 stores an operating

purpose server operating system as is knoWn to those skilled
in the art, such as UNIX, LINUXTM, or Microsoft WIN
DOWS NT®. In an illustrative embodiment of the present
invention, the central server 204 may also be controlled by a
user through use of a computing device, Which may be
directly connected to or remote from the central server 204.
The mass memory 306 also stores program code and data

system 410 for controlling the operation of the premises
25

server 230. It Will be appreciated that this component may
comprise a general-purpose server operating system as is
knoWn to those skilled in the art, such as UNIX, LINUXTM, or
Microsoft WINDOWS NT®. The memory also includes a
WWW broWser 412, such as Netscape’s NAVIGATOR® or

30

Microsoft’s Internet Explorer, for accessing the WWW.

for interfacing With the premises devices, for processing the

The mass memory also stores program code and data for

device data, and for interfacing With various authorized users.

interfacing With various premises’ monitoring devices 236,

More speci?cally, the mass memory 306 stores a premises

for processing the monitoring device data, and for transmit

interface application 310 in accordance With the present
invention for obtaining data from a variety of monitoring
devices 236 and for communicating With the premises server
230. The premises interface application 310 comprises com
puter-executable instructions that When executed by the cen

ting the data to the central server 204 or broWser computing
device 224. More speci?cally, the mass memory stores an

tral server 204, interface With the premises server 230, as Will
be explained beloW in greater detail. The mass memory 306

35

interface application 414 in accordance With the present
invention for obtaining standard protocol-encoded com
mands from the broWser computing device 224 or central
server 204.Additionally, the interface application 414 obtains
40

also stores a data processing application 312 for processing
monitoring device data in accordance With rules maintained

central server 204, and for controlling the features of the

individual monitoring devices 236. The interface application

Within the central server 204. The mass memory 306 further
stores an authoriZed user interface application 314 for out

putting the processed monitoring device data to a variety of

414 comprises computer-executable instructions Which,
45

authoriZed users in accordance With the security process of
the present invention. It Will be appreciated that these com
ponents may be stored on a computer-readable medium and
loaded into the memory of the central server 204 using a drive

mechanism associated With the computer-readable medium,

transmittal application program 416 for transmitting the
device data to the central server 204 or broWser computing

device 224. It Will be appreciated that these components may
50

55

400.
With reference noW to FIGS. 5 and 6, an embodiment for
accessing one or more monitoring devices 236 via a broWser
computing device 224 utiliZing a common user interface uti

liZing standard protocol enabled communications Will be
described. Generally described, the present invention utiliZes
60

premises server 230 includes a netWork interface 400 for
connecting directly to a LAN or a WAN, or for connecting
remotely to a LAN or WAN. Those of ordinary skill in the art

Will appreciate that the netWork interface 400 includes the
necessary circuitry for such a connection, and is also con
structed for use With the TCP/IP protocol or other protocols.
The premises server 230 may also be equipped With a modem

be stored on a computer-readable medium and loaded into the
memory of the premises server 230 using a drive mechanism
associated With the computer-readable medium, such as a

?oppy, CD-ROM, DVD-ROM drive, or netWork interface

be shoWn in order to disclose an illustrative embodiment for

practicing the present invention. As shoWn in FIG. 4, the

When executed by the premises server 230, obtains and trans
mits device data. The mass memory 408 also stores a data

such as a ?oppy disk, CD-ROM, DVD-ROM drive, or net
Work interface 300.
FIG. 4 is a block diagram depicting an illustrative archi
tecture for a premises server 230 formed in accordance With

the present invention. Those of ordinary skill in the art Will
appreciate that the premises server 230 includes many more
components then those shoWn in FIG. 4. HoWever, it is not
necessary that all of these generally conventional components

monitoring device data from the connected monitoring
devices 236 and manipulates the data for processing by a

an application program interface (“API”) for the communi
cation and control of netWorked devices, such as monitoring

devices 236 and monitoring devices 234, in the integrated
information system 200. To initiate control, a user submits a
control request for manipulating devices to a central server
65

204 through Internet. In an illustrative embodiment of the
present invention, the control request may be initiated as a
direct communication to the central server 204 or as a request

US 8,239,481 B2
9

10

submitted through an interface, such as a Web page. The user

of pan, tilt, or Zoom activity, alloWing the device to pan left or

request can include an identi?cation of one or more net

right, tilt up or doWn, or Zoom near or far. The standard

Worked devices desired to be controlled/monitored. Alterna
tively, the request may include one or more search terms for

protocol encodes the user’s instructions in an established

standard language rather than a manufacturer- speci?c proto
col. Accordingly, the control application 226 is not required to

identifying any netWorked devices that match inputted crite
ria. The user request can also include login information and
security information that alloWs the central server 204 to
verify the identi?cation of the user and to evaluate security
issues relating to accessing one or more of the devices.

maintain, or otherWise, any manufacturer-speci?c protocols.
For example, With regard to controlling an image capture
device, a user indication of panning the device to the left 50%
of the maximum range of movement, can generate an instruc

Upon obtaining the control request, the central server 204

tion in standard protocol, for example as “PAN L/50.” Like

responds by dynamically generating and sending a control

Wise, in the case of controlling a thermostat, a user may Want
to set a neW temperature, at 72 degrees, then the user may type

and/or vieWer application to the broWser computing device
224. In an illustrative embodiment of the present invention,
the control and vieWer application are sent as Java applets,
that When executed by a broWser softWare application creates

in 72 at the temperature setting ?eld and the control applica
tion 223 Will generate an instruction in standard protocol
language, such as “SET TEMP/72”.

the control application 226, and vieWer application 228. At
this time, the premises server 230 and the monitoring devices

Upon receiving the standard protocol encoded instruc
tions, the premises server 230 identi?es the targeted device
and translates the instructions into device speci?c protocol

236 in a premises 202 are not involved. During this process,
the central server 204 may authenticate the user, verify the

privilege level of the user, and determine the currently avail
able devices 236, 234 for manipulation and the premises

20

servers 230 controlling those devices. Accordingly, the cen
tral server 204 can dynamically cover the broWser application

corresponding device-speci?c protocol. The premises server

to include the necessary graphic and protocol interfaces for
each requested netWorked device to be controlled in the same

25

instance of the broWser application.
With reference to FIG. 6, once the control application 226
and the vieWer application 228 are executed on the broWser
computing device 224, the user can choose a device from a list

of available devices to be manipulated and choose control
instructions to manipulate the selected device. In an illustra
tive embodiment of the present invention, the user communi

execution back to the premises server 230. In an illustrative
premises server 230 can also be translated into a standard
30

send the executing result back to the vieWer application 228
directly if the device can generate the executing results in the
35

standard protocol. For example, an image capture monitoring
device 234 may generate images in a generally acceptable
standard format, such as a bitmap or jpeg ?le.
With reference noW to FIG. 8, a standard device control

can manipulate a graphical image of a compass rose. In turn,
40

FIG. 7 is a block diagram illustrative of a screen display

700 generated by the broWser computing device 224 and
including a control application 226 and the vieWer application
228. The screen display 700 includes a graphical area 702

protocol by the premises server 230, in the event the output is
proprietary to the device. Alternatively, a device may also

manipulation or device control requests, by using the input

the control application 226 accepts the user’s request and
translates the request into a standard protocol command for
the request.

230 then transmits the device speci?c control instruction to
the targeted device, or devices. The device 234, 236 executes
the device speci?c instruction and returns a result of the

embodiment of the present invention, the result from the

cates various selections, such as a particular device for

devices (e.g., a mouse) to select portions of a graphical tem
plate relating to their desired action. For instance, to control
the pan, tilt, Zoom (“PTZ”) of an image capture device, a user

instructions. In an illustrative embodiment of the present

invention, the device interface database 232 maintains infor
mation correlating the standard control instructions and a

45

routine 800 implemented by a broWser computing device 224
in accordance With the present invention Will be described. At
block 802, the broWser computing device 224 transmits a
control request to the central server 204. As explained above,
in an illustrative embodiment of the present invention, the
broWser computing device 224 may transmit a request in the
form of communication including an identi?cation of one or
more netWorked devices to control, user identi?cation and

operable to display the digital or analog images outputted by

authentication information, and the like. Alternatively, the

a selected monitoring deviceian image capture device.

request can include one or more search criteria that Will alloW

BeloW the graphic image area 702 is a roW of control buttons

the central server 204 to select any netWorked device match

704 operable to control the display of the output. For
example, a user may manipulate one of the control buttons
704 to control the playback of a motion video or to scan
through motion video. The screen display 700 can also

50

one or more ?elds/component to select desired netWorked

include additional elements corresponding to a control appli
cation 226. For example, the screen display 700 can include a
compass rose 706 to control the movement of a device, such
as an image capture device. The screen display can also

include additional graphical and textual display areas 708,
710 for displaying data for additional devices Within the
integrated information network. For example, areas 708 and
710 may represent additional digital capture devices in com

55

central server 204. In accordance With an illustrative embodi

60

ate a graphical user interface. The utiliZation of Java com

mands, or applets, is Well knoWn in the relevant art and Will
not be explained in greater detail. Both the control and vieWer

may toggle.
In accordance With an illustrative embodiment of the

ling basic device activity that is generally common to a par
ticular type of device. For instance, most cameras are capable

devices.
At block 804, the broWser computing device 224 obtains a
control application 226 and a vieWer application 228 from the

ment of the present invention, the control and vieWer appli
cations 226, 228 are dynamically generated and include Java
commands, Which, When executed by a Web broWser, gener

munication With the broWser computing device that the user

present invention, the standard protocol utiliZed by the con
trol application 226 is a generic language capable of control

ing the criteria. In an alternative embodiment, the control
request may be transmitted by displaying a Web page on the
broWser computing device that alloWs a user to manipulate

65

application 226, 228 may include one or more components
that are unique to a particular type of netWorked device. For
example, a thermostat control application 226 may include a

sliding scale graphical component that can be manipulated to
set a desired temperature. LikeWise, an image capture control

US 8,239,481 B2
11

12

application 226 may include graphical components, such as a

illustrative embodiment of the present invention, the results

compass rose, to alloW a user to control the pan, tilt, and Zone
of a device.

from the netWorked device Will be encoded in a standard
communication protocol. One skilled in the relevant art Will

appreciate that outputs can include image data, audio data,

In an illustrative embodiment of the present invention, the
Java commands may be operable to generate both the control
application 226 and the vieWer application 228 as part of a

device parameter status and the like. Additionally, one skilled
in the art Will appreciate that the standard communication
protocol for encoding instructions may be the same as the

common user interface. An example of a combination control

standard communication protocol for encoding results. Alter
natively, the standard communication protocols may be dif

and vieWer application is illustrated in screen display 700

(FIG. 7). Additionally, in accordance With the present inven

ferent.

tion, the Java commands may be operable to generate control
and vieWer applications for multiple devices in the same

At decision block 812, a test is conducted to determine
Whether there are any additional control instructions to be
transmitted. For example, a user may designate a single
instruction to be sent. Alternatively, the user may designate a

broWser application. Accordingly, a user may toggle, or oth

erWise select, Which control or vieWer components they Wish
to manipulate. Still further, in an illustrative embodiment of
the present invention, a single control application 226 or
vieWer application 228 may be utiliZed to correspond to mul
tiple devices. For example, a user may be able to control the

recording function of any number of image capture devices
by manipulating a single control button, such as control but
ton 704. An example of a dynamically generated user inter
face is illustrated in co-pending US. application Ser. No.
09/966,814, entitled SYSTEM AND METHOD FOR
DYNAMIC INTERACTION WITH REMOTE DEVICES,

series of instructions that are to be sent to one or more net

20

by a premises server 230 for translating standard protocol
control instructions Will be described. At block 902, the inter
face application 414 of the premises server 230 receives a
standard protocol encoded instruction. In an illustrative

Which is hereby incorporated by reference.
At block 806, the broWser computing device 224 estab

Worked devices. If there are additional control instructions,
the routine 800 returns to block 808. Alternatively, if there are
no further instructions to be transmitted, the routine 800
terminates at block 814.
With reference noW to FIG. 9, a routine 900 implemented

25

embodiment of the present invention, the standard control

lishes communication With a premises server 230, or pre

instruction can include data identifying the one or more net

mises servers 230, corresponding to the selected netWorked

Worked devices that are to be manipulated by the control

device(s) and veri?es access to the premises server. In an

instructions. Each instruction can correspond to a single net

illustrative embodiment of the present invention, the control
and/or vieWer application may include identi?cation infor
mation, such as an Internet Protocol address, that alloWs the

Worked device (e.g., a particular image capture device) or to
a group of netWorked devices (e.g., all the image capture
devices in communication With the premises server 230). At

broWser computing device 224 to communicate directly With

block 904, the interface application 414 obtains device-spe

the premises server 230 via the communication netWork.

ci?c protocols for the one or more devices designated in the
control instruction. In an illustrative embodiment of the

30

Alternatively, the broWser computing device 224 may route
all communications through the central server 204. In an

35

illustrative embodiment of the present invention, the premises
server 230 can transmit one or more reply communications

that verify the access and/or transmit the current state of the
selected device. For example, if the netWorked device is a
loudspeaker, the premises server 230 may transmit a con?r

40

mation communication including the current decibel level of

instruction in a device-speci?c protocol. Additionally, in the
event the device-speci?c protocol supports additional fea

At block 808, the control application 226 or vieWer appli

device, data to be outputted by a device, requests for data
generated by the device, and the like. Additionally, in accor
dance With the present invention, the control instructions
generated by the broWser computing device 224 are encoded

236 or output device 234. In an illustrative embodiment of the

present invention, the translation can include the correlation
of the standard encoded instruction into a corresponding

the loudspeaker.
cation 228 canbegin to transmit control instructions. In accor
dance With the present invention, the control instructions can
include instructions to manipulate one or more settings of the

present invention, the premises server 230 obtains the device
speci?c protocols from the device interface database 232.
At block 906 the premises server 230 translates the control
instruction into a device-speci?c protocol corresponding to a
designated netWorked device, such as a monitoring device

45

tures and/or attributes not speci?ed in the standard encoded
instruction, the translation can also include setting one or

more default settings. At block 908, the interface application
414 transmits to the designated netWorked devices. In an
50

illustrative embodiment of the present invention, the interface
application 414 may transmit each instruction individually, or

in a standard communication protocol. In an illustrative

as a mass transmission.

embodiment of the present invention, the standard commu

As described above, in one embodiment of the present
invention, outputs from a netWorked device, such as a moni

nication protocol de?nes functions that are common to a

particular type of device, regardless of the manufacturer. The
standard communication protocol may include industry des

55

toring device 236, may be encoded in a device-speci?c pro
tocol. Accordingly, in an illustrative embodiment of the

60

present invention, the interface application 414 obtains
device-speci?c protocol encoded output results at block 910.
At block 912, the data transmittal application 416 translates
the output results from a device-speci?c protocol into the
standard protocol. As described above, the standard protocol

ignated communication protocols, proprietary communica
tion protocols, or other communication protocols adopted by
the integrated information system 200 as a communication
standard. In an illustrative embodiment of the present inven

tion, the standard protocol encoded instructions may be trans

may be the same standard protocol utiliZed to encode the
instruction from the broWser computing device 224, or may

mitted as a single transmission or set of transmissions.

At block 810, the broWser computing device 224 obtains
standard protocol encoded results and/or netWorked device

be a separate protocol. At block 914, the data transmittal
application 416 transmits the standard protocol results to the

status. As described above, one or more outputs from a net

Worked device, such as a monitoring device 236, may be
originally generated in a proprietary protocol or a standard
communication protocol. As Will be described beloW, in an

65

broWser computing device 224. Additionally, the output
results may also be transmitted to the central server 204 for

further processing. At block 916, the routine 900 terminates.

US 8,239,481 B2
13

14

One skilled in the relevant art Will appreciate that blocks
910-914 may be omitted if the translation is not required.
Additionally, as illustrated in FIG. 2B, processing of the
output of the results may be conducted by additional comput

3. The method as recited in claim 1, Wherein the selected
netWorked device is a monitoring device.
4. The method as recited in claim 3, Wherein the monitoring

device is an image capture monitoring device.

ing devices con?gured for a particular device, such as grabber

5. The method as recited in claim 4, Wherein the user

interface includes a display area operable to display outputs

238.

corresponding to the image capture monitoring device.

Although illustrative embodiments of the present invention
have been described With regard to an integrated information

6. The method as recited in claim 3, Wherein the monitoring
device is a netWork security monitoring device.

system 200 con?gured for security monitoring, the present
invention is not limited to such an implementation. Any net
Worked device capable of control can be managed through a
broWser computing device 224 in accordance With the present

invention Without requiring the broWser computing device
224 to maintain communication protocols for every net

Worked device. For example, the present invention may be

implemented in a Wide variety of implementations including
controlling moving equipment such as vehicles, sub
mersibles, etc. Moreover, one skilled in the relevant art Will

further appreciate that the present invention may be imple
mented in a different netWork con?guration, such as a dedi

20

deleting the user interface from the display after obtaining the
output corresponding to the device status.

cated device control netWork, in Which a dedicated device
server is utiliZed.

The present invention facilitates use of multiple, dissimilar

12. The method as recited in claim 1, Wherein the standard

devices by providing standard interface templates. Addition
ally, by establishing a dedicated communication channel With
the premises server, thereby bypassing a Web or application
server, the present invention mitigates unnecessary process
ing steps that impede the How of communication. In accor
dance With the present invention, the con?guration of a dedi
cated communication channel alloWs for increased scalability
of the number of monitoring devices utiliZed in the integrated
information system and controlled by the common user inter
face.
While illustrative embodiments have been illustrated and
described, it Will be appreciated that various changes can be
made therein Without departing from the spirit and scope of
the invention.

7. The method as recited in claim 1, Wherein the selected
netWorked device is an output device.
8. The method as recited in claim 1, Wherein the output
includes a con?rmation corresponding to the selected opera
tion of the selected device.
9. The method as recited in claim 1, Wherein the output
includes data indicative of a netWorked device status.
10. The method as recited in claim 1, Wherein the user
interface application includes one or more Java applets that
are operable to generate a graphical user interface.
11. The method as recited in claim 1, further comprising

communication protocol is device independent.
25

13. The method as recited in claim 1, Wherein the user
interface is a Web-based graphical user interface.
14. The method as recited in claim 13, Wherein the user

interface is dynamically generated.
15. The method as recited in claim 1, Wherein obtaining a
30

user selection of an operation corresponding to at least one

selected netWorked device includes obtaining a user manipu
lation of a graphical icon.
1 6. The method as recited in claim 1, Wherein the computer
system is a security monitoring netWork and Wherein the
35

netWorked devices correspond to the security monitoring
computer system.
17. A computer-readable medium having a computer-ex
ecutable program therein for performing the method of con

The embodiments of the invention in Which an exclusive
property or privilege is claimed are de?ned as folloWs:

trolling devices in a computer system, the method compris
40

1. A method for controlling devices in a computer system,

obtaining a user selection of one or more of a plurality of

the method comprising:

netWorked devices to be manipulated from a user inter

face, Wherein at least one of the plurality of netWorked

obtaining a user selection of one or more of a plurality of

devices requires device-speci?c protocol instructions

netWorked devices to be manipulated from a user inter

face, Wherein at least one of the plurality of netWorked

ing:

45

devices requires device-speci?c protocol instructions

that are different than protocol instructions required by

that are different from protocol instructions required by

at least one of the other plurality of netWorked devices;
obtaining a user interface application corresponding to the

at least one of the other plurality of netWorked devices;
obtaining a user interface application corresponding to the

transmitting, to at least one user interface selection device,

selected one or more netWorked devices;

selected one or more netWorked devices;
50

transmitting, to at least one user interface selection device,

selected one or more netWorked devices so that the user

the user interface application corresponding to the

interface can be displayed on the at least one user inter

face selection device;

selected one or more netWorked devices so that the user

interface can be displayed on the at least one user inter

face selection device;

the user interface application corresponding to the

55

obtaining a user selection of an operation corresponding to
at least one selected netWorked device;

obtaining a user selection of an operation corresponding to
at least one selected netWorked device;

encoding the selected operation according to a standard

encoding the selected operation according to a standard

transmitting the selected standard protocol instruction to a
server corresponding to the selected netWorked device;
and
obtaining an output corresponding to the selected opera
tion of the selected netWorked device.
18. The method as recited in claim 17, further comprising

communication protocol instruction;

communication protocol instruction;
transmitting the selected standard protocol instruction to a
server corresponding to the selected netWorked device;
and
obtaining an output corresponding to the selected opera
tion of the selected netWorked device.
2. The method as recited in claim 1 further comprising

authenticating user privilege levels prior to displaying the
user interface.

60

authenticating user privilege levels prior to displaying the
65 user interface.

19. The method as recited in claim 18, Wherein the moni

toring device is a netWork security monitoring device.

US 8,239,481 B2
15

16
37. The method as recited in claim 35, Wherein the selected
netWorked device is a monitoring device.
38. The method as recited in claim 35, Wherein the selected
netWorked device is an output device.
39. The method as recited in claim 35, Wherein the output
includes a con?rmation corresponding to the selected opera
tion of the selected device.
40. The method as recited in claim 35, Wherein the output
includes data indicative of a netWorked device status.
41. The method as recited in claim 35, Wherein the user
interface application includes one or more Java applets that
are operable to generate a graphical user interface.
42. The method as recited in claim 35, further comprising
deleting the user interface from the computer system after

20. The method as recited in claim 18, Wherein the moni

toring device is an image capture monitoring device.
21. The method as recited in claim 17, Wherein the selected
networked device is a monitoring device.
22. The method as recited in claim 21, Wherein the user
interface includes a display area operable to display outputs

corresponding to the image capture monitoring device.
23. The method as recited in claim 17, Wherein the selected
netWorked device is an output device.
24. The method as recited in claim 23, Wherein the user

interface includes a display area operable to display outputs

corresponding to the image capture monitoring device.
25. The method as recited in claim 17, Wherein the output
includes a con?rmation corresponding to the selected opera
tion of the selected device.
26. The method as recited in claim 17, Wherein the output
includes data indicative of a netWorked device status.
27. The method as recited in claim 17, Wherein the user
interface application includes one or more Java applets that
are operable to generate a graphical user interface.
28. The method as recited in claim 17, further comprising

obtaining the output corresponding to the device status.
43. The method as recited in claim 42, Wherein the user

interface is dynamically generated.
44. The method as recited in claim 35, Wherein the standard
20

deleting the user interface from the computer system after
obtaining the output corresponding to the device status.
29. The method as recited in claim 28, Wherein the user

25

interface is dynamically generated.
30. The method as recited in claim 17, Wherein the standard

communication protocol is device independent.
31. The method as recited in claim 17, Wherein the user
interface is a Web-based graphical user interface.
32. The method as recited in claim 17, Wherein obtaining a
user selection of an operation corresponding to at least one
selected netWorked device includes obtaining a user manipu
lation of a graphical icon.
33. The method as recited in claim 17, Wherein the com

communication protocol is device independent.
45. The method as recited in claim 35, Wherein the user
interface is a Web-based graphical user interface.
46. The method as recited in claim 35, Wherein obtaining a
user selection of an operation corresponding to at least one
selected netWorked device includes obtaining a user manipu
lation of a graphical icon.
47. The method as recited in claim 35, Wherein the com

puter system is a security monitoring netWork and Wherein
the netWorked devices correspond to the security monitoring
30

computer system.
48. A non-transitory computer readable medium providing
instructions for controlling a device in a computer system, the

instructions comprising:
obtaining a user selection of one or more of a plurality of
35

netWorked devices to be manipulated from a user inter

puter system is a security monitoring netWork and Wherein
the netWorked devices correspond to the security monitoring

face, Wherein at least one of the plurality of netWorked

computer system.

that are different from protocol instructions required by

devices requires device-speci?c protocol instructions

34. The method as recited in claim 33, Wherein the moni

toring device is an image capture monitoring device.

40

35. A method of controlling devices in a computer system,

at least one of the other plurality of netWorked devices;
obtaining a user interface application corresponding to the
selected one or more netWorked devices;

the method comprising:

transmitting, to at least one user interface selection device,

the user interface application corresponding to the

obtaining a user selection of one or more of a plurality of

netWorked devices to be manipulated from a user inter

selected one or more netWorked devices so that the user

face, Wherein at least one of the plurality of netWorked

interface can be displayed on the at least one user inter

devices requires device-speci?c protocol instructions

face selection device;

that are different than protocol instructions required by

obtaining a user selection of an operation corresponding to
at least one selected netWorked device;

at least one of the other plurality of netWorked devices;
obtaining a user interface application corresponding to the
selected one or more netWorked devices;

encoding the selected operation according to a standard
50

the user interface application corresponding to the
selected one or more netWorked devices so that the user

interface can be displayed on the at least one user inter

face selection device;
obtaining a user selection of an operation corresponding to
at least one selected netWorked device;

the method comprising:

encoding the selected operation according to a standard

obtaining a user selection of one or more of a plurality of

communication protocol instruction;
transmitting the selected standard protocol instruction to a
server corresponding to the selected netWorked device;
and
obtaining an output corresponding to the selected opera
tion of the selected netWorked device.
36. The method as recited in claim 35, further comprising

authenticating user privilege levels prior to displaying the
user interface.

communication protocol instruction;
transmitting the selected standard protocol instruction to a
server corresponding to the selected netWorked device;
and
obtaining an output corresponding to the selected opera
tion of the selected netWorked device.
49.A method for controlling devices in a computer system,

transmitting, to at least one user interface selection device,

netWorked devices to be manipulated from a user inter
60

face, Wherein at least one of the plurality of netWorked

devices requires device-speci?c protocol instructions
that are different from protocol instructions required by
at least one of the other plurality of netWorked devices;
generating a user interface application corresponding to
65

the selected one or more networked devices;

transmitting, to at least one user interface selection device,

the user interface application corresponding to the