Eolas Technologies Incorporated v. Adobe Systems Incorporated et al

Filing 875

***FILED IN ERROR. SEE DOCUMENT 877 FOR CORRECT PLEADING*** MOTION to Seal Document [DEFENDANTS' MOTION FOR SUMMARY JUDGMENT OF INVALIDITY FOR LACK OF WRITTEN DESCRIPTION by Adobe Systems Incorporated, Amazon.com Inc., CDW Corporation, Citigroup Inc., Google Inc., J.C. Penney Company, Inc., Staples, Inc., The Go Daddy Group, Inc., Yahoo! Inc., YouTube, LLC. (Attachments: # 1 Affidavit, # 2 Exhibit A, # 3 Exhibit B, # 4 Exhibit C, # 5 Exhibit D, # 6 Exhibit E, # 7 Exhibit F, # 8 Exhibit G, # 9 Exhibit H, # 10 Exhibit I, # 11 Exhibit J, # 12 Exhibit K, # 13 Exhibit L, # 14 Exhibit M, # 15 Text of Proposed Order)(Reines, Edward) Modified on 8/18/2011 (mll, ).

EXHIBIT C

906 PH Ex. 3

I hereby certify that this correspondence is being
deposited with the United States Postal Service as
first class mai l ih an envelope addressed to:
ssistant Commissioner for Patents,
shington, D.C. 20231,

PATENT

tf .. U .. 9(,

J

Attorney Docket No. 023071-553

TOWNSEND and TOWNSEND and CRIW LLP

~~

By_ _ _ _ _ _ _ _ _ __

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
In re application of:

)
)

MICHAEL D. DOYLE et al.

E7afui~~l?:--)D.

)
)

Application No.: 08/324,443

)

Dinh

4rt Unit: 2317

)

Filed: 10/17/94

)

AMENDMENT

)

For: EMBEDDED PROGRAM OBJECTS IN)
DISTRIBUTED HYPERMEDIA
)
SYSTEMS
)

RECEIVED
AUG 20 1996
-GROUp 2300

------------------------------)
Assistant Commissioner for Patents
Washington, D.C.
20231
Sir:

Responsive to the Office Action mailed May 6, 1996,
please amend the above identified application as follows:

I

IN THE CLAIMS:
please cancel claim 16.

I

please amend the followin
1

2

claims:

A method for running an application

1.

program in a com uter network environment, comprising:
providi

3

least one client workstation and one

network

to said network environment, wherein said

network

4

a distributed hypermedia environment;
at said client workstation

a

lication

that

8

identif

9

document and for res

10

initiate

distributed h

a browser

ermedia document to

in the distributed h

ermedia

redetermined text formats to

rocesses s

PH 001 0000783879

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 2
11

PATENT

said browser to display [ing] , on said client
of a first hypermedia document

12

workstation, a

13

received over

14

hypermedia

15

controlled

16

~~~-=~~~====~~~~e~r~m~e~d==i=a~d~o~c~u=m~e=n~t

id network from said server, wherein said first
within a first browsersaid client workstation and wherein said

17

18

document and that s ecifies t

21

22
23

241

e

said browser to identif and locate an
external to the first distributed

19

20

includes an embed text
an ob'ect external to the

executable a
h ermedia

ith said browser a
executable a

lication said
rocess said ob'ect. within

rolled window while a

ortion of said first

25

distributed h

26

~~~~~~~-=====~==~~w~l='n==d=o~w

27

28

application; and
interactivel

29

application from said. c ient workstation via communications sent

30

over said distributed

1

2.

2

4

executable a lication
comprising the step of:
interactivel

5

from said

6

~d~i~s~t~r~l='b==u~t~e~d~h~~~~==~~~;=r~o=n=m~e=n==t

7

using a hypermedia browser

1

3. (Amended)
instructions for controllin

3

2
3
4

document continues to be dis

(Amended)

ed within

[an embedded controllable

controlling said embedded controllable
ermedia environment] .
The method of claim I, wherein said
a controllable a

lication and further

said controllable a

lication

n via communications sent over said
[displaying is performed by

pplication].
method of claim 2, wherein
said [embedded] controllable

application reside on said n twork server, wherein said step of
interactively controlling sa'd [embedded] controllable

6

application includes the foIl
issuing, from the c

7

commands to the network

5

substeps:
workstation, one or more

I

PH

001 0000783880

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 3
ting, on the network server, one or more

8
9

instructions i

response to said commands;

send'ng information from said network server to said

10
11

PATENT

client workstat'on in response to said executed instructions; and
sing said information at the client workstation

12
13

to interactivel

14

application.

1

4.

control said [embedded] controllable

(Am

2

instructions for

3

The method of claim 2, wherein

application resid

I:

6

on said client workstation.

5.

1
2

ontrolling said [embedded] controllable

The method of claim 2, wherein the

communications to

nteractively control said [embedded]

controllable applic

from said client workstation continue to
the controllable application and the

be exchanged

the controllable application

hypermedia browser
program has been lau ched.

The method of claim 3, wherein said

6.

1
2

[embedded] controllab e application is a multi-dimensional

3

viewer.
(Amended)

The method of claim 3, wherein said

1

7.

2

[embedded] controllabl

1

The method of claim 3, wherein said
[embedded] controllable application is a database program.

2

8.

(Amended)

9.

1

(Amended)

2

[embedded] controllable

1

~

application is a spreadsheet program.

14.

2

HyperText

3

controllable applica ion

The method of claim 3, wherein said
pplication is a word processor.
method of claim 13, wherein
used to specify said [embedded]
'thin said hypermedia document.

PH

001 0000783881

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 4
15.

1

2

A method for running an application

program

uter network environment, comprising:
providi

3

PATENT

least one client workstation and one

4

network

5

including a plura

general purpose workstations, wherein

6

said

is a distributed hypermedia environment;

to said network environment, said network

at said client workstation

7

lication

that

a browser

8

a

9

identif

10

document

redetermined text formats to

initiate

the text format·

rses a distributed h

ermedia document to

s included in the distributed h

ermedia

display [ing] , on said client
a portion of a hypermedia document received
over said network fro

said server, wherein said hypermedia

15

document is dis la ed within a browser controlled window and

16

includes at least a f'rst

17

and locates

18

external to

ensional data visualization application
ermedia document;

19
20

lication

invokin
multi-dimensional

21

[embedded]' text format that identifies

said

isualization a lication· and

interactively controlling said [embedded] multi-

22

dimensional data visual zation application from within said

23

browser window at said

lient workstation via communications sent

24

over said distributed h

ermedia environment wherein data image

25

rendering is performed b

26

workstations using distr
(Amended)

1

said plurality of general purpose
processing.
The method of claim 15, wherein a

2

hypermedia bowser is executing on the client workstation,

3

wherein commu ications to 'interactively control said [embedded]

(:

controllable a
be exchanged

6

hypermedia brows

7

lication from said client workstation continue to
controllable application and the
even after the controllable application

program has been

PH

001 0000783882

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 5

PATENT

1

24.

A computer controlled method for

2

interactively

3

to in a docume t displayed in a document window on a client

4

computer, where'n the client computer includes a processor

5

coupled to a di

6

the processor is further coupled to a computer network, wherein

7

the computer net ork is coupled to a server computer and one or

8

more additional c

9

local storage dev

ontrolling an [embedded] external object referred

lay device and to a user input device, wherein

the server computer includes a
containing a document, wherein the document

~~~~~~~t~o

10

an [embedded] external object, wherein an

11

application progra

for manipulating the [embedded] object

12

resides on a first

dditional computer, the method comprising the

13

following steps:
the network, at least a portion of

14

, ~:

the document from

server computer to the client computer;
to locate a reference to the

17
18

identif

in the document·

external

19

the external ob'ect·

and

accepting f'rst signals from the user input device that

20

indicate that the [ern

21

manipulated;
issuing

22

with the reference

dded] external object is to be
the client computer to the first

25

additional computer in esponse to the first signals;
executing, by using the first additional computer,
instructions in the app ication program in response to the issued

26

commands, wherein the e ecuted instructions generate information

27

about manipulating the [ mbedded] external object;

23
24

28

communicating, via the network, the information about

29

manipulating the [embedde ] external object from the first

30

additional computer to th

31

dis

32

window at the

33

using the

34

object according to

client computer;
information in said document
and
computer to manipulate the [embedded]
municated information displayed.

PH

001 0000783883

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 6
26.

1

PATENT

The method of claim 24, further
executing instructions in a second

application program
5

additional computer in response

to the
second additional co

dded] object being generated more quickly.

6

I~

,

3

the instructions executed by the
uter result in information about

28.

The method of claim 26, wherein the

[embedded] objec

is a multi-dimensional image displayable in any

of a plurality of
A method for displaying a three

1

2

dimensional i

3

computer inclu

4

wherein the pro essor is further coupled to a computer network,

5

wherein the comp ter network is coupled to a server computer and

6
7

one or more addit'onal computers, wherein the server computer
includes a local
containing a hypermedia document,

8

wherein the hyperm dia document includes a reference indicating

9

the identit

ation of a three dimensional image object

[embedded

ternal to the hypermedia document, wherein

)~~~
~

object on a client computer, wherein the client
s a processor coupled to a display device,

13

the three
image object is displayable in a plurality
of orientations, the
comprising the following steps:
transferrin , over the network, at least a portion of

14

the hypermedia

15

computer;

12

from the server computer to the client

displaying in a document window on the display device,

16

17

by using the processor,

t least a portion of the hypermedia

18
19

document, wherein the di played portion of the hypermedia
dimensional image object displayed in
document includes the

20

a first orientation;
computer to issue commands over the

21

22
23

network;

24
25

response to the issued
instructions determine

26

three dimensional image obje

executing instruc

on a first additional computer in
nds, wherein the executed
nd orientation for display of the

PH

001 0000783884

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 7

PATENT

via the network, information about the
second orientatio
client computer;

from the first additional computer to the
nd

using t

client computer to redisplay the three

dimensional image

bject in the second orientation.

Please add the following claims:
2

44. ( ew) A computer program product for use in a
system having
one client workstation and one network

3

server coupled

4

environment is a

5

program product co

1

network environment, wherein said network
'stributed hypermedia environment, the computer

a compute

6

medium having computer readable

7

program code physica ly embodied therein for causing a client

8

workstation to invok

9

10

referenced by a
external object

11

computer

an external executable application
document to display and process an
by the hypermedia document, said
t further comprising:
readable program code for causing said

client

to execute a browser application to parse

a distributed hype media document to identify text formats
included in the dis ributed hypermedia document and to
respond to predeter
17

specified by the tex

18

formats to initiate processes
format;

computer r

code for causing said

19

client workstation

utilize said browser to display, on

20

said client workstati n, at least a portion of a first

21

hypermedia document re eived over said network from said

22

server, wherein said f rst hypermedia document is displayed

23

within a first browser controlled window on said client

24

workstation and wherein said, first distributed hypermedia

25

document includes an em

specifies the

26

location of an object e

distributed

27

hypermedia document and

hat specifies type information

28
29

utilized by said browser to identify and locate an
executable application ex ernal to the first distributed

30

hypermedia document;

I

PH 001 0000783885

MICHAEL D., DOYLE et al.
Application No.: 08/324,443
Page 8

31

co

PATENT

uter readable program code for causing said

32

client

33

said executab e application to display and process said

34
35

object within the first browser-controlled window while a
portion of sa d first distributed hypermedia document

36

continues to

37

window.

1
2
3

tion to invoke, with said browser application,

e displayed within said browser-controlled

45. (New) The computer program product of claim 44,
wherein said execut
application is a controllable application
and further comprisi
computer r

4

program code for causing said client

5

workstation

6

application from sai

client workstation via communications sent

7

over said distribute

hypermedia environment.

I:
4

ctively control said controllable

e computer program product of claim 45,

46.

wherein instructions

or controlling said controllable

application reside on said network server, wherein said step of
interactively control ing said controllable application includes:
computer re dable program code for causing said client

5
6

workstation to issue, from the client workstation, one or more

7

commands to the networ

8

computer rea

9

10
11

server to execute one

server;
code for causing said network
r more instructions in response to said

commands;
computer rea able program code for causing said network

12

sever to send informati n to said client workstation in response

13
14

to said executed instru tions; and
computer read ble program code for causing said client

15

workstation to process

16

to interactively control said controllable application.

1

47.

(New) The

id information at the client workstation

omputer program product of claim 45,

2

wherein instructions for controlling said controllable

3

application reside on sa d client workstation.

PH 001 0000783886

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 9
48.

1

PATENT

(New) The computer program product of claim 45,

2

wherein

mmunications to interactively control said

3

controllable

pplication from said client workstation continue to

4

be exchanged

5

hypermedia bro ser even after the controllable application

6

program has be
49..

1

2

3

wherein
viewer.

2

(:
1

ew) The computer program product of claim 46,

(N w) The computer program product of claim 46,

wherein

ollable application is a spreadsheet program.
51.

) The computer program product of claim 46,

wherein

ollable application is a database program.
52.

1

2

launched.

trollable application is a multi-dimensional

50.

1

tween the controllable application and the

The computer program product of claim 46,

wherein

lIable application is a word processor.
53.

(New) The computer program product method of claim

2

52, wherein HyperTe t Markup Language is used to specify said

3

controllable applic tion within said hypermedia document.

1

54.

(New)

A computer program product for use in a

2

system having at lea t one client workstation and one network

3

server coupled to sa'

4

environment is a dist ibuted hypermedia environment, the computer

5

program product compr

6

network environment, wherein said network

a computer

medium having computer readable

7

program code physicall

8

application program in a network environment being a distributed

9

hypermedia environment

10

by the hypermedia

11

embodied therein for running an
0

process an external object referenced
said computer program product further

comprising:
program code for causing

12
13

said

station to execute a browser

PH 001 0000783887

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 10

PATENT

14

ap lication, that parses a distributed hypermedia

15

do ument to identify text formats included in the

16

ributed hypermedia document and to respond to

17

etermined text formats to initiate processes

18

by the text format;

19

computer readable program code for causing

20

said client work station to utilize said browser to

21

disp ay at least a portion of a hypermedia document

22

rece·ved over said network from said server, wherein

23

said

24

lIed window and includes at least a first text
that identifies and locates a multi-dimensional

25

~~

~ ~8

ypermedia document is displayed within a browser

data

isualization application external to the

distri uted hypermedia document;
computer readable program code for causing

29

said c ient work station to invoke, through said

30

browser application, said multi-dimensional data

31

visuali ation aplication; and

32

computer readable program code for causing

33

said cl ent work station to interactively control said

34

multi-d·mensional data visualization application from

35

id browser. window at said client workstation

37

nications sent over said distributed
hypermed'a environment wherein data image rendering is

38

performed

said plurality of general purpose

39

workstati

using distributed processing.

36

1

55.

(New)

computer program product for use in a

2

system including a c

which includes a processor

3

coupled to a display

4

the processor is furt er coupled to a computer network, wherein

5

the computer network's coupled to a server computer and one or

6

more additional comput rs, wherein the server computer includes a

7

local storage device c ntaining a hypermedia document, wherein

8

the hypermedia documen

9

object, wherein an appl'cation program for manipulating the

evice and to a user input device, wherein

includes a reference to an external

I

PH

001 0000783888

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 11
10
11
12

13

14
15
16

17
18

19

PATENT

t resides on a first additional computer, the computer
product comprising:
a computer usable medium having computer readable
program code physically embodied therein for interactively
controll'ng an external object referred to in a hypermedia
document isplayed in a document window on a client computer,
product further comprising:
computer readable program code for causing
s id network to transfer at least a portion of the
ermedia document from the server computer to the

20
21
2

26

27

28
29

30
31
32
33
34

35
36

37

38
39

40
41

42
43
44

45

computer readable program code for causing
work station to parse said hypermedia
to locate a reference to the external object
in the hypermedia document, with the reference
and locating the external object;
computer readable program code for causing
nt work station to accept first signals from
the user input device that indicate that the external
object is to be manipulated;
computer readable program code for causing
said clien work station to issue commands from the
to the first additional computer in
response to the first signals;
co puter readable program code for causing
said first a ditional computer to execute instructions
in the applic tion program in response to the issued
commands, wher
the executed instructions generate
information ab
manipulating the external object;
er readable program code for causing
said first addit'onal computer to communicate, via the
network,
about manipulating the
the first additional computer to
external
the client compute
computer
program code for causing
display communicated
said

PH 001 0000783889

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 12
46

PATENT

said document window at the client
and

47

computer readable program code for causing

48
said

49

ient work station to manipulate the object
communicated information displayed.

50

56.

1

) A computer program product for use in a

2

system including

client computer which includes a processor

3

coupled to a displ y device, wherein the processor is further

4

coupled to a

5

coupled to a

computer and one or more additional

6

computers,

he server computer includes a local storage

er network, wherein the computer network is

device containing

wherein the hypermedia

document includes a

eference indicating the identity and

location of a three

imensional image object external to the

hypermedia document,

herein the three dlmensional image object

11

is displayable in a p

12

of orientations, the computer

program product compr

13

a computer u

14

program code physicall

15
16

dimensional image exte nal object referred to in a document
a client computer, said
displayed in a documen

17

computer program
said network

20
21
22

embodied therein for displaying a three

further comprising:
uter readable program code for causing

18

19

medium having computer readable

o transfer at least a portion of the
from the server computer to the

client
computer readable program code for causing

24

station to display, in a document
said
window on the d splay device, by using the processor,

25

at least a port

the hypermedia document, wherein

26

the displayed p

of the hypermedia document

23

e dimensional image object displayed

27

28

in a first orien
readable program code for using the

29

30

client computer t

issue commands over the network;

PH

001 0000783890

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 13
31

PATENT

co puter readable program code for executing

32

instruction

a first additional computer in response

33

to the issued commands, wherein the executed

0

instructions

~

second orientation for display

of the three

~ 37
=~

ensional image object;

compu

readable program code for

communicating,

the network, information about the

38

second orientati

from the first additional computer

39

to the

and

40

readable program code for using the

41

client computer

42

image object in

redisplay the three dimensional
e second orientation.

~

REMARKS
Claims 1-43 have been examined, claims 1-9, 14, 15, 23,
24, 26, 28 and 34 are amended, claim 16 is cancelled, and claims
44-56 have been added.

Accordingly, claims 1-15 and 17-56 are

now pending in the application.

Reexamination and

reconsideration are requested.
Claims 1-4 and 15-16 are rejected under 35 U.S.C. Sec.
102(a) as being anticipated by the University of Southern
California's Mercury Project (in public use from Sept. 15, 1994
to March 31, 1995 at http://www.usc.edu/dept/raiders/).
The present invention, as defined for example in
amended claim 1, includes the steps of executing, at the client
workstation, a browser application that parses a distributed
hypermedia document to identify text formats included in the
distributed hypermedia document and for responding to text
formats to initiate processes specified by that text format.

The

browser is also utilized to display at least a portion of the
distributed hypermedia document within a browser-controlled
window.
The distributed hypermedia document includes an embed
text format the specifies the location of an object external to
the distributed hypermedia document and that specifies type
information utilized by the browser to identify and locate an
executable application external to the distributed hypermedia

PH

001 0000783891

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 14
document.

PATENT

The browser invokes the executable application to

display and process the object within the browser window.
The Mercury Project is an interactive Web page that
utilizes CGI (Common Gateway Interface) scripts and the HTML
<FORM> tag to facilitate interaction between the user and the Web
page.
CGI is a protocol that allows a Web server and an
external program to communicate.

An example is a form which

utilizes the following HTML format:
<FORM
ACTION="identity of program to invoke on server"
METHOD="specify method of reading info"
>.

<INPUT
TYPE="type"
NAME = "name"
SIZE="size"
>

etc.
</FORM>
Information is entered by the user and passed through
the Web server to the CGI server identified by the ACTION=
attribute.

The CGI program generates a new result Web page which

is sent back to the browser and displayed in place of the
original page displayed in the browser-window.
For example, at the bottom of page 2 of the cited
document it is stated that after clicking on the map the arm will
move and a new image will be returned.
The HTML of the page 2 of the cited Mercury Project
document is appended to this amendment.

The page has been

decommissioned so the <FORM> tags' have been removed.

However, it

is apparent that all images are in-line GIF and MPEG images
identified by their extensions.

Also, appended is a page linked

to the Mercury page, the Telegarden, page that utilizes the
<FORM> tag to execute control.

PH 001 0000783892

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 15

PATENT

The <FORM> tag causes the browser to send a string of
characters, entered into a form in the original HTML document, to
the Web server application.

The Web server invokes a CGI

application identified by the ACTION= attribute of the tag and
passes the string to the CGI application.

In response to the

character string the server application generates and sends a new
HTML document to be displayed by the browser in place of the
ordinal HTML document.
For example, in the Mercury Project when the arm is
moved by clicking on an in-line image included in a first HTML
document, displayed in a first browser-controlled window, a
string is sent to the Web server with information on how far the
arm is moved.

The Web server invokes the CGI server which

generates a new HTML document with an in-line image showing the
arm in the new position and sends the new document to the browser
to be displayed in place of the first HTML document.

Some

browsers would cache the first HTML document so that the first
and new HTML documents could be viewed in different windows.
In the Telegarden page, a new HTML document including a
revised image of the garden is sent by the server and displayed
by the browser in place of the original document.

Also, forms

are very popular in search pages where a new HTML document is
sent by the sever and displayed by the browser in place of the
original document to show the results of the search.
The examiner states that the Mercury Project operated
using a method substantially as claimed.

This rejection is

respectfully traversed for the following reasons.
There is no disclosure of the claimed step of utilizing
a browser to display a first hypermedia document in a first
window with the hypermedia document including a tag format
specifying the location of an external object and an external
executable application.

As described above, the Mercury Project

utilizes CGI where a <FORM> tag identifies a program on the
server but not an external object.

Additionally, the claimed

step of invoking the executable object to display and process the
object within the first browser-controlled window while a portion
of the first hypermedia document is displayed is not disclosed.

PH 001 0000783893

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 16

PATENT

In the Mercury Project a new HTML document is generated at the
server and displayed by the browser in a new window.
The claimed combination is fundamentally different from
the Mercury Project.

In the claimed combination, the external

object and executable object are embedded by reference in the
HTML document and the object is displayed and processed within
the same window where a portion of the original document is
displayed.

In the Mercury Project information is passed back to

the server and a new document is generated and displayed.

There

is no display and processing the external object within the
window in which a portion of the original document is displayed.
A major difference between CGI and the claimed

combination is that in CGI there is no enforced continuity
between the documents.

The CGI responds to form information by

generating new documents each being a static document independent
of the previous document which generated the form string passed
to the Web server.

For example, in the Mercury Project separate,

independent HTML documents are generated for each position of the
arm.

There is no disclosure of the claimed step of invoking the

executable application to display and process said object within
the window while a portion of the first distributed hypermedia
document is displayed in the window.
Thus, unlike CGI, the claimed executable application
does not generate a static HTML document to be displayed in place
of the first document but displays and processes the object in a
portion of the window.
Claims 1-43 are rejected under 35 U.S.C. Sec. 103 as
being unpatentable over Applicant's disclosed prior art and
further in view of Hansen "Enhancing Documents with Embedded
Programs: How Ness Extends Insets in the Andrew ToolKit".
The Hansen reference discloses embedding an executable
script in a document.· The Ness script is a sequence of attribute
specifications, i.e., declarations of global variables, global
functions, and extend blocks.

An extend block associates a set

of contained attributes with some named object and has the
following syntax:
extend <name>

PH

001 0000783894

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 17

PATENT

<attributes>
end extend

where <name> must be a string constant giving the name of the
associated object.

(Page 25).

One attribute is an event

specification such a mouse click.
The operation of Ness scripts is illustrated in the
"Extended Birthday Card" example at pages 30 and 31.
the object named is: extend "visible cake".

Note that

Both the executable

script and the object to be manipulated are within the document.
In view of the above, it is believed that the claims
are not obvious over the disclosed prior art in view of Hansen.
There is no disclosure in the references, singly or in
combination, of displaying a hypermedia document in a first
window including a text format specifying the location of an
external object and identifying an external executable
application or of invoking the external application to display
and process the external object within the first window.
The system of Ness provides for interaction with an
object embedded in a document by executing code embedded in the
document.

However, there is no teaching or suggestion of the

claimed system of utilizing a browser to invoke an external
application identified by an original document, being displayed
by a browser within a first window, to display and process an
external object within the first window.
In view of. the above, claim 1 is deemed to be
patentable over the cited references.
Claim 15 recites that the browser application invokes
an external application which is a multi-dimensional
visualization application.

The multi-dimensional visualization

application is controlled from within the browser window via
communications sent over the distributed hypermedia environment.
As described in the application, a 3-D image, located
external to the original document, may be displayed within the
first window and processed by an executable application external
to the browser.
Thus, unlike the Mercury Project, a multi-dimensional
object may be displayed and manipulated within the browser window

PH 001 0000783895

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 18

PATENT

by an application running on a remote computer.

Also, Ness is

distinguished because in the Ness system the application code is
included in the hypermedia

document.

Thus, the combination

claimed in claim 15 is a significant advance over systems such as
disclosed in Hanson or the Mercury Project and is not suggested
by any of the cited references.
Claim 24 recites accepting first signals from a user
input device indicating that the external object, referenced in a
hypermedia document displayed in a document window on a client
computer, is to be manipulated.

Commands are issued to a first

additional computer in response to the first signal and the first
additional computer responds to the commands by executing
instructions in the application program to generate information
about manipulating the external object.

The information is

communicated to the client computer which displays the
information in the document window and is used to manipulate the
object according to the information displayed.
As described above, in the Mercury Project an object in
a document window can not be manipulated.

The user can indicate

a desired change to the object, e.g., move the arm, which is
communicated to the Web server and transferred to the CGI server.
The CGI server then generates a new document with an image
showing the arm moved and transfers the new document back to the
client which displays the new document in place of the original
document.

Thus, the Mercury Project does not provide for

interaction with an object displayed in browser window.
Additionally, as discussed in the specification, the requirement
of sending a new hypermedia document to display each image change
consumes bandwidth on the network.
The Ness disclosure does not teach using an application
on a first additional computer to manipulate an object external
to the hypermedia document within' document window.

In Ness both

the object and application are included within the document
displayed.

While this feature enhances interactivity with

documents, the application is executed on the computer displaying
the document.

PH 001 0000783896

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 19

PATENT

In contrast, in the combination of claim 24 the first
computer could be much more powerful than the client computer to
run an application performing, for example, 3-D visualization or
CAD/CAM programs, and the results could be displayed in the
document window of client computer in the form of a PC or network
computer.
Accordingly, the subject matter of claim 24 is not
disclosed or suggested by the cited references, singly or in
combination.
~n

claim 24, the hypermedia document displayed in a

document window on the client computer references an external
object which is a three dimensional object to be displayed in a
plurality of orientations.

The external object is displayed in a

first orientation within the document window.

Commands are

issued to a first additional computer in response to the first
signal and the first additional computer responds to the commands
by execute instructions in the application program to generate
information about a second orientation of the external object.
The information is communicated to the client computer which
redisplays the external object in the second orientation within
the document window.
The subject matter of claim 34 differs from the cited
references for reasons similar to those discussed above with
reference to claim 24.

Again, the claimed system allows for a

much more powerful first additional computer to perform
calculations to reorient an object with the results communicated
to the client computer to redisplay the object in a new
orientation.
The claims added herein are of similar scope to the
examined claims but are recited in the form of computer readable
code, embodied on a computer readable medium, for causing a
computer to effect the novel steps recited in the method claims
previously examined.
In view of the foregoing, Applicants believe all claims
now pending in this application are in condition for allowance.
The issuance of a formal Notice of Allowance at an early date is
respectfully requested.

,

PH 001 0000783897

PATENT

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 20

If the Examiner believes a telephone conference would
expedite prosecution of this application, please telephone the
undersigned at [phone].
Respectfully sUbmitted;

A~'_

(I

r:LJ~

Charles E. Krueger
Reg. No. 30,077
TOWNSEND and TOWNSEND and CREW LLP
Two Embarcadero Center, 8th Floor
San Francisco, California 94111-3834
[phone]
Fax [phone]
CEK:db
s:\02307I\553\amend.Ol

---------------_._--------------PH 001 0000783898

Amendment

A1MlWJ'lRhJld TOWNSEND and CREW LLP

Atty. Docket No.

Center, 8th Floor
94111-3834

Date

023071-055300US
August 6, 1996

I hereby certify that this is being deposited with the United
States Postal Service as first class mail in an envelope
addressed to:
Filed 10/17/94

Assistant Commissioner for Patents
Washington, D. C. 20231.

Group Art Unit 2317
EMBEDDED PROGRAM OBJECTS
For
DISTRIBUTED HYPERMEDIA SYSTEMS

IN

, ECEIVED
AUG 20 '996
GROUfJ 2~UO

THE ASSISTANT COMMISSIONER FOR PATENTS
Washington, D.C. 20231
Sir:
Transmitted herewith is an .amendment in the above-identified application.

[l Enclosed is a petition to extend time to respond.
[Xl Small entity status of this application under 37 CFR 1.9 and 1.27 has been established by a verified statement
previously submitted.
[l A verified statement to establish small entity status under 37 CFR 1.9 and 1.27 is enclosed.
[Xl A document entitled USC Mercury Project: Inteiface
If any extension of time is needed, then this response should be considered a petition therefor.
The filing fee has been calculated as shown below:
(Col. 1)

(Col. 2)

(Col. 3)

CLAIMS
REMAINING
AFTER
AMENDMENT

HIGHEST NO.
PREVIOUSLY
PAID FOR

PRESENT
EXTRA

OTHER THAN A
SMALL ENTITY

SMALL ENTITY

RATE

ADDIT.
FEE

RATE
OR

ADDIT.
FEE

TOTAL

56*

MINUS

43**

=13

1=

$143

x22=

$

INDEP.

8*

MINUS

4***

= 4

x39=

$156

x78=

$

$

+250=

$

$299

TOTAL

$

[ ] FIRST PRESENTATION OF MULTIPLE

*

25=
TOTAL
ADDIT. FEE

If the entry in Col. 1 is less than the entry in Col. 2,
write "0" in Col. 3.

OR

**

If the "Highest Number Previously Paid For" IN THIS SPACE is less than 20, write "20" in this space.

***

If the "Highest Number Previously Paid For" IN THIS SPACE is less than 3, write "3" in this space.
The "Highest Number Previously Paid For" (Total or Independent) is the highest number found from the equivalent
box in Col. 1 of a prior amendment or the number of claims originally filed.

[l No fee is due.
Please charge Deposit Account No. 20-1430 as follows:
[xl

Claims fee

[Xl

Any additional fees associated with this paper or during the pendency of this application.

TWO

\

$-=2""9.::..9:.:=.0""0_ _ _ _ _ _ __

extra copies of this sheet are enclosed.

AMEND.TRN 4\96

PH 001 0000783899

09/10/96

12:03

'C'4V~ 1')76 0300

TTC

IlJ 001/029

Law Offices

TOWNSEND and TOWNSEND and CREW LlP
Patents, Trademarks, Copyrights, Antitrust, Commercial Litigation
TWO EMBARCADJ;RO CENTER. 8THPLOOA

SAN FR,ANCISCO, CALIFORNIA 94111-3634
TEL [phone] FAX (415) 576·0300

TELECOPIER COYER

SHE~T

IMPORTANT; Thi$ mE!55age is intl;Jnded only for the use of the individual or entity to Which it is addressed and mllY contain
information th8t i5 privileged. confidential. and/or exempt from disclosure by applicable law or Qourt order. If the reader of this
mlil$S!lgB is not the intended recipient, or the employee or ageflt respClnsible for dalivering the message to the intended racipiant.
you ara hareby notified that Bny dissemination. distribution. or copying of this communication Is strictly prohibltod. If you niillve
received this communication in error. please notify us immediately by telephonlil and raturn the original message to us at the .. bov.
San Francisco address via the United States Postal Service. Thank you.

Phone= [phone], FAX: [phone]

September 10, 1996
To:
Examiner Dinh, Group 2317
From; Charles E. Krueger
Client Number: 023071-563
At FAX Number: 703/308-5359
Number of Pages (including this page): 29
If you have any problems with reception, please call Irene Rodas
at extension 4659, or Deborah Bullock at extension 4557.
Re: Appln. No. 08/324,443 I Doyle et al.
Dear EXaminer Dinh:

Attached hereto is a copy of an amendment in the referenced application. as mailed to the
Patent Office on August 6, 1996. As discussed with my secretary I please let us know if for any
reason this amendment will not be considered as timely filed.

Krueger
CEK:db

Encl.

FAXED_______________

RETURN TO_ _ _ _ __
DENVGR. CO~OIlADO
(303) 67'.4QOO

PALO ALTO. CAL)FOIIN)A
(4'5) 32.8-2.400

SEATTLE. WAS)-lINGTO>l

(2061487-91/00

PH 001 0000783900

09/10/96

12:03

U41.!: "176 0300

TIC

--'

TOWNSEND and TOWNSEND and CREW LLP
Two Embarc;i.ciero Center. Slb Floor

Atry. Docket No.

Sa.n Francisco, CA 94111-3834

Date

/gJ 002/029
",-.
02307I-OS5300US
Augyst 6, 1296

[phone]
1 bereby certiiY that this is being deposited with the United
States Postal Service as first tlass mail in an envelope
addressed to:

In rc application of MICHAEL D. DOYLE et a1.
Applil. No. 08/324,443

Assistant Commis:sioncr for Patents
Washington, D. C. 20231.

Filed 10117/94
Group Art Unit 2317

For

EMBEDDED PROGRAM OBJECTS
DISTRIBUTED HYPERMEDIA SYSTEMS

IN

THE ASSISTANT COMMISSIONER FOR PATENTS
Washington, D.C. 20231

: J

OFfiCIAL

Sir:

Transmitted herewith is an amendment in the above-identified "PPlkation.

[J

Enclosed is a pe:dtioD to cxbtn4 time to respond.
[X] Small entity status of this applil;ation under 37 CPR 1.9 and l.Z7 has been established by a verified statell1ent
previously submitted.

[]

A verified statement to establish smaU entity status under 37 CPR 1.9 and 1.27 is enclosed.

[Xl A document entitled USC Merr::ury Project: InteT/aCt!.
If any e"tcnslon of time is needed. then this response should

be tonsidered a petition tber~foL

The filing fee has been calculated as shon below:
OTRER TIiAN A
(CD\. 2)

(Col. 3)

SMALL ENTITY

SMALL ENTl'IY

HlOaESTNO.
PltEV10US1.Y

PAID FOR.

PRESENT
EX'l'RA

AATS

RATE

ADDIT.

rEE

OR

A.DDrr.
FEE

OR.

*

..,.

If the entry in Col. 1 is less than the entry in Col. 2,
write "0" in Col. 3.
If the "Highest Number Previously Paid For" IN TIllS SPACE is leSS than 20. write -20" ill this space.
If the "Highest Number Previously Paid For" IN TIllS SPACE is Jess than 3, write "3" in this space .
The "Highest Number Previously Paid For" (Totll or Independent) is the highest number found from the equivalent
box in Col. 1 of a prior amendment or the number of claitnS 'origillally filed.

[J No fee is due.
Please charge Deposit Account No. 20-1430 as follows:
[x]

[Xl

ClabtlS fee
Any additional fees

S~9!OO
asso~iated

with this paper or during the pendency of this application.

__TW.....:.:~O<--__ ex.tra copies of dUs sheet are enclosed.

. hacl E. Woods I Reg. No.: 33.466
AltDIllCY$ for ApJillicant

PH 001 0000783901

!

09/10/96

12:04

'a'415 $76 0300

TIC
@003/029

---

'-

1 hereby certify that this corr_spondance Is bel"g
wi~h th~ United States PDstal Service as
first class mail in an envelop' addressed to:
A$sistant commissioner for Pat~tsr
Washington, D.C. 20231,

deposited

tf-(, .. r~

on

TOWNSEND and

T~NSI~D

Attorney Docket No. 023071-553

and CReW LLP

r:Lf~

BY________________________

IN THE UNITEO STATES PATENT AND TRADEMARK OFFICE
In re application of:

)
)

MICHAEL D. DOYLE et al.

)

Examiner: D. Dinh ,\

)

Application No.: 08/324,443

)
)

Art Unit: 2317

Filed: 10/17/94

)
)

,....

n~

, .. .,

AMEND~NI

("'if'

,

For: EMBEDDED PROGRAM OBJECTS IN)

DISTRIBUTED HYPERMEDIA

)

SYSTEMS

)

------------------------------)
Assistant Commissioner for Patents
Washington, D.C.
20231
Sir:
Responsive to the Office Action mailed May 6, 1996,
please amend the above identified application as follows:
IN THE CLAIMS·:

Please eancel claim

~6.

Pleas$ amend the following claims;
1.

1
2

(Amended)

A method for' running an application

program in a computer network environment, comprising:
providing at least one client workstation and one

3

6

network server coupled to said network environment, wherein said
network environment is a distributed hypermedia environment;
~xecutin~. at said cli~nt workstation, a browser .

7

ayplication. that parses a distributed hypermedia dQcument tq

8

identify

t~xt

9

dQ~ument

and for responding to Phedeterroined text format§

4

5

10

formats included in the ~istributed hypermedia
~

init;Late Rroce§!SeS specified by the teJCt format ...

PH 001 0000783902

09/10/96

12:04

'ft41~ 576 0300

MICHAEL D. DOYLE et al.
Application No.: 08/324,443

Page

TIc

Ig) 004/029

PATENT

:2

20

utilizing said browser tg display [ing] , on said client
workstation, at least a portion of a fi~st hypermedia document
received over said network from said server, .wherein said first
hypermedia document is displayea ~ithin a first browsercQntrolled window on said cli~nt workstation and wherein ~a~d
first distributeg hypermedia dgcument includes an embed tex~
format that specifies the location of an object external to the
first distributed hypermedia document and that spec~fies type
information utilized by said browser to identify and lQcate an
~xecutaQle application §xternal to the first distribute;

21

hygermedia document;

22

with said brQ~ser aRplication. saig
§~ecutahle application to dis~lay and proc~ss·said object within
the first browser-cQntr91led window while a portion of saig first
di§tri~uted bypermedia document continu§§ to be displayed w1thin
said prowser~gontrolled window [an embedded controllable
applicationj and

11

12
13
14
15
16
17
18

19

23
24

25
26
27
28
29

3.0
l

:2

~
.;I.

5
6

7
1
2

3
4

5

6

7

~nvoking!

interactively controlling said embedded controllable

application from said client workstation via communications sent
over said distributed hypermedia environment] .
(Amended)
The method of claim 1, wherein said
executable application is a ~ontrollable ,application and further
comprising the step of:
,
interactively controlling said controllable application
from said client workstation via communications sent over said
di§tributeg hypermedia environment [displaying is performed by
using a hypermedia browser application] .
2.

3. (Amended)

The method of claim 2, wherein
instructions for controlling said [embedded] controllable
application reside on said network server, wherein said step of
interactively controlling said [embedded] controllable
application includes the following substeps:
issuing, from the client workstation, one or more
commands to the network server;

'--------.---.-----~
PH 001 0000783903

09/10/96

12:05

fl"41!' 1)76 0300

TIC

14/0051029

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 3
executing, on the network server, one or more

B

:>

PATENT

instructions in response to said commands;
sending information from said network server to said

10
11

client workstation in response to said executed instructions; and

12
13

processing said information at .the client workstation
to interactively control said [embedded] controllable

14

application.

1

4.

(Amended)

The method of claim 2, wherein

2

instructions for controlling said [embedded] controllable

3

applic~tion

1

2

The method of claim 2, wherein the
communica.tions to interactively control said (embedded)

3

controllable application from said client workstation continue to

4

be exchanged between the controllable application and the

5

hypermedia browser

6

program has been launched.

1

6. (Amended)
The method of claim 3, wherein said
[embedded] controllable application is a multi-dimensional

2
3

1

2
1

reside on said client workstation.

5.

(Amended

e~en

after the controllable application

viewer.
7.

(Amended)

The method of claim 3, wherein said

[embedded] controllable application 'is a spreadsheet program.
B.

(Amended)

The method of claim 3, wherein said

2

(embedded] controllable application is a database program.

1

The method of claim 3, wherein said
9 . (Amended)
[embedded) controllable application is a word processor.

2

1

14.

(Amended)
~an9uage

The method of claim 13, wherein

2

HyperText Markup

is used to specify said [embedded)

3

controllable application within said hypermedia document.

PH 001 0000783904

09/10/96

12:05

'lt41R 576 0300

TIC

liJ 006/029

'-

.......-

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 4
1

2

3
4

5
6

7

15_

(Amended)

PATENT

A method for running an application

program in a computer network environment, comprising:
providing at leaat one client workstation and one
network server coupled to said network environment, said network
including a plurality of general purpose workstations, ~herein
aaid network environment is a distributed hypermedia environment;
~ecuting,

at saig client workstation, a.browser

8

application, that parses a gistributed hypermedia dRcument tQ

9

igentify text formats inqluded in the

distr~buted
t@~t

hypermedia
fQrm~ts

10

document and for kes£ondinq to predeterm1ned

II

14

initiate processes specified by the text formati
utilizing said browser to display (ing] , on said client
workstation, at least a portion of a hypermedia document received
over said network from said server, wherein said hypermedia

15

document is displayed within a browser controlled winggw

16

includes at least a first

17

snd locates a multi-dimensional data

18

external to the di§tributed hypermedia document;
invoking, with said brow~er application, said
IDMlti-dimensignal data visualization aplicationi and
interactively controlling said [embedded) multi-

12
13

19
20

21

tq

an~

[embedded]- text fqrmat that identifies
vi~ualization

application

24

dimensional data visuaXization application from within said
prowser window at said client workstation via communications sent
over said distributed hypermedia environment wherein data image

25

rendering is performed by said plurality of general purpose

26

workstations using distributed processing_

22

23

1

23.

(Amended)

The method of claim

~5,

wherein a

S

hypermedia browser is executing on the client workstation,
wherein communications to interactively control-said [embedded]
controllable application from said client workstation continue to
be exchanged between the controllable application and the

6

hypermedia bro'Wsereven after the controllable application

7

program has been launched.

2
3
4

PH 001 0000783905

09/10/96

12:05

'5'415 '\76 0300

TIC

@007/029

_.

PATENT

MICHAEL P. DOYLE et a1.
Application No.: 08/324,443
Page 5
1
2

3

24. (Amended)
A computer controlled method for
interactively controlling an [embedded) external object relerred
to in a document displayed in a dgcument windQ~ on a client

5

computer, wherein the client computer includes a processor
coupled to a display device and to a user input device. wherein

6

t.he processor is further coupled to a computer network, wherein

7

the computer network is coupled to a server computer and one or

8

11

more additional computers, wherein the server comput~r includes a
local storage device containing a document. wherein the document
includes a reference to an [embedded) external object. wherein an
application program for manipulating the [embedded] object

12

resides on a first additional computer, the method comprising the

1.3

14

following steps:
transferring, over the network, at least a portion of

15

the document from the server computer to the client computer;

4

9

10

1.6

17

18
1.9

~ar~in9

said gocument to locate a reference to the

external object included in the document. with the reference
id§ntifying ang locating the external object;
accepting first signals from the user input device that

20

indicate that the [embedded] external object is to be

2:1,

manipulated;
issuing commands from the client computer to the first

22
24

additional computer in response to the first signals;
executing, by using the first additional computer,

2S

instructions in the application p;ogram in response to the issued

26

commands, wherein the executed instructions generate information

27

29

about manipulating the [embedded] exte~al object;
communicating, via the network, the inf·ormation about
manipulating the [embedded] ~xternal object from the first

30

additional computer to the client computer;

23

28

31.

displaying cqmmunicated intormation in Raid document

33

wingow at the client cgmputer; and
using the client com~uter to manipulate the [embedded]

34

obj ect according to the communicated informat'ion displayed.

32

PH 001 0000783906

09/10/96

12:06

B41S 0176 0300

'fTc

raJ 008/029

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 6
2G.

1

(Amended)

PATENT

The method of claim 24, further

2

comprising the steps of executing instructions in a second

3

applicati~n

4

to the issued commands, wherein the instructions executed by the

5

second additional computer result in information about

6

manipulating the [embedded) object being generated more quickly.

program on a second additional computer in response

28.

1

(Amended)

The method of claim 26, wherein the

2

(embedded] object is a multi-dimensional image displayable in any

3

of a plurality of orientations.
34.

1

(Amended)

A method for displaying a three

2

dimensional image object on a

3

computer includes a

cli~nt

computer,

wher~in

the client

-,

coupled to a display device,
wherein the proces~or is further coupled to a computer network,
wherein the computer network is coupled to a server computer and
one or more additional computers. wherein the server computer
includes a local storage device containing a hypermedia document,

8

wherein the hypermedia document includes a

9

the identity and locatiQn

4
5

6

proces~or

ot

~eference

indicating

a three dimensional image object

13

[embedded within] external tQ the hypermedia document, wherein
the three dimensional image object is displayable in a plurality
of orientations, the method comprising the following steps:
transferring, over the network, at least a portion of

14

the hypermedia dccument from the

15

computeri

10

11
12

s~rver

computer to the client

displaying in a document window on the display device,

16

17

by using the processor, at least a portion of the hypermedia

18

document, wherein the displayed portion of the hypermedia

19

document includes the three dimensional image object displayed in

20

21

a first orientation;
using the, client computer to issue commands over the

22

network;

23

executing instruction on a first additional computer in

24

response to the issued commands, wherein the executed

25

instructions determine a second orientation for display of the

26

three dimensional image objecti

PH 001 0000783907

09/10/96

12:06

'a'415 "i76 0300

TIC

Igj 009/029

PATENT

MICHAEL D. DOYLE et al.
Application No.: Q8/324,443
Page 7
27
28

29
30
31

communicating, via the network, information

a~out

the

second orientation from the first additional computer to the
client computer; and
using the client computer to redisplay the three
dimensional image object in the second orientation.
please add the following claims:

2

44. (New) A computer program product for use in a
system having at least one client workstation and one network

3

server coupled to said network environment, wherein said network

4

environment is a distributed hypermedia environment, the computer
program product comprising:

1

5

B

a computer usable medium having computer readable
program code physically embodied therein for causing a client
workstation to invoke an external executable application

$I

referenced by

G

7

~

hypermedia document to display and process an

10

external object referenced by the hypermedia document, said

11

computer program product further compriSing:

12

computer readable program code for causing said

13

client workstation to execute a browser 'application to parpe

14,

18

a distributed hypermedia document to identify text formats
included in the distributed hypermedia document and to
respond to predetermined text formats t9 initiate processes
specified by the text formatj
computer readable program code for causing said

19

client workstation to utilize said browser to display,. on

20

said client workstation, at least a portion of a first

21

hypermedia document received over said network from said
server, wherein said first hypermedia document is displayed
within a first browser-controlled window on said client
workstation and wherein said first distributed hypermedia
document includes an embed text format that specifies the

15
16
17

22
23
24

25
27

location of an object ext~rnal to the first distributed
hypermedia document and that specifies type information

28

utilized by said browser to identify and locate an

29

executable application external to the first distributed

30

hypermedia document;

26

PH 001 0000783908

09/10/96

12:07

ft415 !'\76 0300

'LTc

~010/029

-'

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 8
31

PATENT

32

computer readable program code for causing said
client workstation to invoke, with said browser application,

33

said executable application to display and process said

34

object within the first browser-controlled window while a

35

portion of said first distributed hypermedia document

36

continues to be displayed within said.browser-controlled
window.

37

1
2

45. (New) The computer program product of claim 44,
wherein said executable application is a controllable application

4

and further comprising!
computer readable program code for causing said client

5

workstation to interactively control said controllable

6

application from said client workstation via communications sent
over said distributed hypermedia environment.

3

7

46.

1

(New) The computer

progra~

product of claim 45,

2

wherein instructions for controlling said contrdllable

3

application reside on said network server, wherein said step of

4

interactively controlling said controllable application includes~
co~puter readable program code for causing said client

5
6

7
8

9
10

11

workstation to issue, from the client workstation, one or more
commands to the network server;
computer readable program code for causing said network
server to execute one or more instructions in response to said
comma.nds;
computer readable 'program code for causing said network

1.2

sever to send information to said client workstation in response

13

to said executed instructions; and
computer readable program code for causing said client
workstation to process said information at the client workstation
to interactively control said controllable application.

14
15

16
1

47.

(New) The computer program product of claim 45,

2

Wherein instructions for controlling said controllable

3

application reside on said client workstation.

--'--------- - - - - - - - - -

PH 001 0000783909

09/10/96

12:07

'8'415 !'i76 0300

TIc

!gJ 011/029

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
J?aga 9

PATENT

3

48. (New) The computer program product of claim 45,
wherein the communications to interactively control said
controllable application from said client workstation continue to

4

be exchanged between the controllable application and the

5

hypermedia browser even after the controllable application

6

program has been launched.

1

49. (New) The computer program product of claim 46, .
wherein said controllable application is a multi-dimensional
viewer.

1

.2

:2

3

1

SO.

(New) The computer program product of claim 46,

.2

wherein said controllable application is a spreadsheet program .

1

51. (New) The computer program product of claim 46,
wherein said controllable application is a database program.

2

1

2

1

.2
3

1

52.

(New) The computer program product of claim 46,

wherein said controllable application is a word 'processor.
53.

(New) The computer program product method of claim

52, wherein HyperText Markup Language is used to specify said
controllable application within said hypermedia document.
54.

(New)

A computer program product for Use in
c~ient

~

2

system having at least one

3

server coupled to said network environment, wherein said network

4

environment is a distributed hypermedia environment, the computer

5

program product comprising:
a computer usable medium having computer readable
progxam code physically embodied therein for running an
application program in a network environment being a distributed
hypermedia environment to process an external object referenced

6
7

8
9

workstation and one network

10

by the hypermedia document, said computer program product further

11

comprising:

12

13

computer readable program code for causing
said client work station to execute a browser

PH 001 0000783910

09/10/96

12:08

fS'415 576 0300

_'
DOYLE et

TIc

_.,

....

MICHAEL D.

Appli~ation

~012/029

al.

PATENT

No.: 08/324,443

Page 10

14

application, that parses a distributed hypermedia

l.5

document to identify text formats included in the

16

distributed hypermedia document and to respond to

17

predetermined text formats to initiate processes

18

19

specified by the text format;
computer readable program code for causing

20

said client work station to utilize said browser to

21

display at least a portion of a hypermedia document

22

received over said network from said server J

23

said hypermedia document is displayed within a browser

24

controlled window and.includes at least a first text

25

format that identifies and locates a multi-dimensional
data visualization application external to the

26

~herein

28

distributed hyp~rmedia document;
computer readable program code for causing

29

said client work

30

browser application, said multi-dimensional data

31

visualization aplication; and

27

stat~on

to invoke, through said

computer readable program code for causing

32
33

said client work station to interactively control said

34

multi-dimensional data visualization application from

35

within said browser window at said client workstation

36

via communications sent over said distributed

37

hypermedia environment wherein data image rendering is

38

performed by said plurality of general purpose

39

workstations using distributed processing.

1

55.

(New) A computer program product for use in a

2

system including a client computer which includes a processor

3

coupled to a display device and to a user input device, wherein

4
5

the processor is further coupled to a computer network, ~herein
the computer network is coupled to a server computer and one or

6

more additional computers, wherein the server computer includes a

7

local storage device containing a hypermedia document, wherein

8

the hypermedia document includes a reference to an external

9

Object, wherein an application program for manipulating the

PH 001 0000783911

09/10/96

12:0B

'5'415 ~76 0300

TTC

fgJ 013/029

...........

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 1.1.

PllTENT

11

object resides on a first additional computer, the computer
program product comprising:

12

a computer usable medium having computer readable

10

13

program code physically embodied therein for interactively

14

15

controlling an external object referred to in a hypermedia
document displayed irt a document window on a client computer,

16

said computer program product further comprising:

17

computer readable program code for causing

18

said network to transfer at least a portion of the

19

hypermedia document from the server computer to the

20

client computer;

21

computer readable program code for causing

22

said client work station to parse said hypermedia

23

document to locate a reference to the external object

24

included in the hypermedia document/ with the reference

25

identifying and locating the external object;

26

computer readable program code for causing

27

said client work station to accept first signals from

28

the user input device that indicate that the external

29

object is to be manipulated;

30

computer readable program code for causing

31

said client work station to issue commands from the

32

client computer to the first additional computer in

33

response to the first signals;

34

computer readable program code for causing

3S

said first additional computer to execute instructions

36

in the application program in response to the issued

37

commands, wherein the executed instruC!t:.ions generate

36

information about manipulating the external object;

39

computer readable program code for causing

41

said first additional computer to communicate/ via the
network, the information about manipulating the

42

externalobjeC!t from the first additional computer to

43

the client computer;

40

44
45

computer readable program code for causing
said client work station to display communicated

PH 001 0000783912

09/10/96

12:09

'6'415 ~76 0300

--"

MICHAEL D_ DOYLE et al.
Application No.: 0$/324,443
Page 12

TIC

~014/029
...

_-'

l?ATENT

46

information in said document window at the client

47

and
computer readable program code for causing
said client work station to manipulate the object
according to the communicated information displayed.

48

49

SO
1

computer;

56.

(New) A computer program product for use in a

2

system including a client computer which includes a processor

3

coupled to a display device, wherein the processor is further

4

coupled to a computer network, wherein the computer network is

5

9

coupled to a server computer and one or more additional
computers, wherein the server computer includes a local storage
de~ice containing a hypermedia document, wherein the hypermedia
document includes a reference indicating the identity and
location of a three dimensional image object external to the

10

hypermedia document, wherein the three dimensional image object

11

is displayable in a plurality of

1.2

13

program product comprising:
a computer usable medium having computer readable

14

program coda physicallY embodied therein for displaying a three

~5,

dimensional image external object referred to in a document
displayed in a document window on a client computer, said
computer program product fUrther comprising:
computer readable program code for causing

6

7
8

~6

17

18

19
20

orient~tions,

the computer

said network to transfer at least a portion of the
hypermedia document from the server computer to the

24

client computer;
computer readable program code for causing
said client workstation to display, in a document
window on the display device, by using the processor,

25

at least a portion of the hypermedia document, wherein

26

the displayed portion of the hypermedia document

27

includes the three dimensional image object displayed

2B

29

in a first orientation;
computer readable program code for using the

~O

client computer to issue commands over the network;

21
22
23

------------

PH 001 0000783913

09/10/96

12: 09

'5"415 ~76 0300

'--

MICHAEL O. DOYLE at al.
Application No-: 08/324,443
Page 13
31

32
33
34;

35
36
37

38
39
40

41
42

TIC

la!o15/029

I?ATENT

computer readable program coae for executing
instruction on a first additional computer in response
to the issued commands, wherein the executed
instructions determine a second orientation for display
of the three dimensional image object;
computer readable program code for
communicating, via the network, information about the
second orientation from the first additional computer
to the client computer; and
computer readable program code for using the
client ~omputer to redisplay the three dimensional
image obje~t in the second orientation.
REMARKS
Claims 1-43 have been examined, claims 1-9, 14, 15. 23,
24, 26, 28 and 34 are amended I claim 16 is cancelled, and claims
44,-56 ha.ve been added. Accordingly, claims 1-15 and 17 S6 are
now pending in the application. Reexamination and
reconsideration are requested.
Claims ~-4 and 15-16 are rejected under 35 U.S.C. Sec_
102{a) as being anticipated by the University of Southern
California's Mercury Project (in public use from Sept. ~51 1994
to March 31, 1995 at http://www.usc.edu/deptjraiders/) .
The present invention, as defined for example in
amended claim 1, includes the steps of executing, at the client
workstation, a browser application that parses a distributed
hypermedia document to identify text formats included in the
distributed hypermedia document and for responding to text
formats to initiate processes specified by that text format. The
browser is also utilized to display at least a portion of the
distributed hypermedia document within a browser-controlled
window.
The distributed hypermedia document includes an embed
text format the specifies the location of an object external to
the distributed hypermedia document and that specifies type
information utilized by the browser to identify and locate an
executable application external to the distributed hypermedia

PH 001 0000783914

09/10/98

12:09

'8'415 ~'16 0300

'LTC

IaI 016/029

.

' ....-'.

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page

FATENT

~4.
"

document. The browser invokes the executable application to
display and process the object within the browser window.
The Mercury Project i9 an interactiv~ Web page that
utilizes CQI (Common Gateway Interface) scripts and the HTML
<FORM> tag to facilitate interaction between the user and the Web
page.
CGI is a protocol that allows a Web server and an
external program to communicate. An example is a form which
utilizes the following HTML format:
<FORM
ACTION"",lIidentity of program to invoke on server ll
METHODoc"specify method of reading info"
:>.

<INPUT
TYPE= II type II
NAME,., II name II
SIZE:!l':lfsizel!

etc.
</FORM:>

Information is entered by the user and passed through
the Web server to the CGI server identified by the ACTION~
attribute. The CGI program generates a new result Web page which
is sent back to the browser and displayed in place of the
original page displayed in the browser-window.
For example, at 'the bottom of page 2 of the cited
document it is stated that after, clicking on the map the arm will
move and a new image will be returned.
The HTML of the page 2 of the cited Mercury Project
document is appended to this amendment. The page has been
decommissioned so the <FORM, tags have been removed. However, it
is apparent that all images are in~line GIF and MPEG images
identified by their extensions. Also, appended is a page linked
to the Mercury page, the Telegarden, page that utilizes the
<FORM> tag to execute control.

PH 001 0000783915

09/10/96

12:10

'C'415 :176 0300

TIC

!ill 017/029

--

PATENT

MICHAEL D. DOYLE et al.'
Application No.: 08/324,443
Page lS
The

~PORM>

tag causes the browser to send a string of

characters, entered into a form in the original ETML document, to
the Web server application.
application identified by the

se~er

The Web
ACTION~

invokes a CGI

attribute of the tag and

passes the string to the CGI application.

In response to the

character string the server application generates and sends a new

HTML document to be displayed by the browser in place of the
ordinal HTML document.
For example, in the Mercury Proj'ect when the arm is
moved by clicking on an in-line image included in a first HTML
document, displayed in a first browser-controlled window, a
string is sent to the Web server with information on how far the
arm is moved.

The Web server invokes the CGI server which

generates a new HTML document with an in-line image showing the
arm in the new position and sends the new document to the browser
to be displayed in place of the first HTML document.

Some

browsers would cache the first HTML document so that the first
~nd new HTML documents could be viewed in different windows_

In the Telegarden page, a new HTML document including a

.

revised image of the garden is sent by the server and displayed
by the browser in place of the original document.
Also, forms
are very popular in search pages where a new HTML document is
sent by the sever and displayed by the browser in place of the
original document to show the results of the search.
The examiner states that the Mercury Project operated
using a method substantially as claimed.

This rejection is

respectfully traversed for the following reasons.
There is no disclosure of the claimed step of utilizing
a browser to display a first hypermedia document in a first
window with the hypermedia document including a tag format
specifying the location of an external object and an external
executable application. As described above, the Mercury Project
utilizes

cor

where a <FORM> tag identifies a program on the

server but not an external object_

Additionally, the claimed

step of invoking the executable object to display and process the
object within the first browser-controlled'window while a portion
of the first hypermedia document is displayed is not disclosed.

PH 001 0000783916

09/10/96

12:10

'ZS'415 .!i76 0300

TIC

@018/029

MICHAEL D. DOYLE et al."
Application No.; 08/324,443
Page 1.6

PATENT

In the Mercury project a new RTML document is generated at the
server and displayed by the browser in a new window.
The claimed combination is fundamentally different from
the Mercury Project.

In the claimed combination, the external

object and executable object are embedded by reference in the
\

HTML document and the Object is displayed and processed within
the same window where a portion of the original document is
displayed.

In the Mercury Project information is passed back to

the server and a new document is generated and displayed.

There

is no display and processing the external object within the
window in which a portion of the. original document is displayed.
A major difference between CGr and the claimed
combination is that in CGI there is no enforced continuity

The CGr responds to form information by
generating new documents each being a static document independent
of the previous document which generated the form string passed

between the documents.

to the Web server.
i~dependent HTML

For example, in the Mercury Project separate,

documents are generated for each position of the

the
executable application to display and process said object within
arm.

There is no disclosure of the claimed step of

in~oking

the window while a portion of the first distributed hyPermedia
document is displayed in the window.
Thus, unlike CGI, the claimed executable applicat.ion
does not generate a static HTML document to be displayed in place
of the first document but displays and processes the object in a
portion of the window.
Claims 1-43 are rejected under 35 U,S.C. Sec. 103 as
being unpatentable over Applicant's disclosed prior art and
further in view of Hansen IIEnhancing Documents ...,ith Embedded
Programs: How Ness Extends Insets in the Andrew ToolKit".
The Hansen reference discloses embedding an executable
script in a document_

The Ness script is a sequence of attribute

specifications, i. e. ( declarat"ions
functions, and extend blocks.

of global V'ariables, global

An extend block

associates a set

of contained attributes with some named object and has the
following syntax:

extend <name>

PH 001 0000783917

09/10/96

12:11

tt415

1'(

7 6 0300

_.,

TI'C

~019/029
.t-,.......

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 17
<attributes::.
end extend
where <name> must he a string constant g~v~ng the name of the
associated object.
(Page 25). One attribute is an event
specification such a mouse click.
The operation of Ness scripts is illustrated in the
"Extended Birthday Card,j example at pages 30 and 31. Note that
the object named is: extend "visible cake". Both the executable
script and the object to be manipulated are within the document.
In view of the above, it is believed that the claims
are not obvious over the disclosed prior art in view of Hansen_
There is no disclosure in the references, singi y or in
combination, of displaying a hypermedia document in a first
window including a text format specifying the location of an
external object and identifying an external executable
application or of invoking the external application to display
and process the external object within the first ~indow.
The system of Ness provides for interaction with an
Object embedded in a document by executing code embedded in the
document. However. there is no teaching or suggestion of the
claimed system of utilizing a browser to invoke an external
application identified by an original document, being displayed
by a browser within a first window, to display and process an
external object within the first window.
In view of the above, claim 1 is deemed to be
patentable over the cited references.
Claim 15 recites that the browser application invokes
an external application which is a mUlti-dimensional
visualization application. The multi-dimensional visualization
application is controlled from within the browser window via
communications sent over the distributed hypermedia environment.
As described in the application, a 3-0 image, located
external to the original document, may be displayed within the
first window and processed by an executable application external
to the browser.
Thus. unlike the Mercury project, a multi-dimensional
object may be displayed and manipulated within the browser window

- - - _...

---,~---

.-'-.~

_ _ M-"'-""_' _ _ _ _•_ _ _ _ _ _ __

PH 001 0000783918

09/10/96

12:11

'5'415. ~76 0300

'ITC

~020/029

.. ...
~

MICHAEL P. DOYLE et al.
Application No.: 08/324,443
Page 18

PATENT

by an application running on a remote computer.

Also, Ness is

distinguished because in the Ness system the application code is
included in the hypermedia

document.

Thus, the combination

claimed in claim lS is a significant advance over systems such as
disclosed in Hanson or the Mercury Project and is not suggested
by any of the cited references.

Claim 24 recites accepting

fir~t

signals from a user

input device indicating that the external object, referenced in a
hypermedia document displayed in a document window on a client
computer, is to be manipulatedaddi~ional

Commands are issued to a first

computer in response to the first signal and the first

additional computer responds to the commands by executing
instructions in the application program to generate information
about manipulating the external object_ The information is
communicated to the client computer Which displays the
information in the document window and is used to manipulate the
object according to the information displayed.
As described above, in the

Mer~ury

a document window can not be manipulated_

Project an object in

The user can indicate

a desired change to the object, e.g., move the arm, which is
communicated to the Web server and transferred to the CGI server.
The CGI server then generates a new document with an image
showing the arm moved and transfers the new document back to the
client which displays the new document in place of the original
document.

Thus, the Mercury Project does not provide for

interaction with an object displayed in browser window.
Additionally, as discussed in the specification, the requirement
of sending a new hypermedia document to display each image change
consumes bandwidth on the network_
The Ness disclosure does not teach using an application
on a first additional computer to manipulate an object external
to ~he hypermedia document within document window.
In Ness both
the object and application are included within the document
displayed.

While this feature enhances interactivity with

documents, the application is executed on the computer displaying
the document.

-.~--- -~--~--.

---~-

-~-----

PH 001 0000783919

09/10/96

12:12

'6'415 ~76 0300

TIC
.

MICHAEL D. nOYLE et al.
Application No.: 08/324,443
Page 1.9

~0211029

--'

PATENT

'

In contrast, in the combination of claim 24 the first
computer could be much more powerful than the cli@nt computer to
run an application performing, for example, 3-D visualization or
CAD/CAM programs, and the results could be displayed in the
document window of client computer in the form of a PC or network
computer.
Accordingly, the subject matter of claim 24 is not
disclosed or suggested by the cited references, singly or in
combination.
In claim 24, the hypermedia document displayed in a
docu!', :ant window on the client. computer references an external
object which is a three dimensional object to be displayed in a
plurality of orientations.

The external object is displayed in a

first orientation within the document window.

Commands are

issued to a first additional computer in response to the first
signal

an~

the first additional

compute~

responds to the commands

by execute instructions in the application program to generate

information about a second orientation of the external object.

The information is communicated to the client computer which
redisplays the external object in the second orientation within
the document window.
The subject matter of claim 34 differs from the cited
references for reasons similar to those discussed abo.va with

reference to claim 24.

Again, the claimed system allows for a

much more pOWerful first additional comput@r to perform
calculations to reorient an object with the results communicated
to the client computer to redisplay the object in a new
orientation.
The claims added herein are of similar scope to the
'examined claims but are recited in the form of computer readable
code, embodied on a computer readable medium, for causing a
computer to effect the novel steps recited in the method claims

previously examined.
In view of the foregoing, Applicants believe all claims
now pending in this application are in condition for allowance.

The issuance of a formal Notice of Allo~ance at an ear~y date is
respectfully requested.

PH 001 0000783920

09/10/96

12:12

'a'415 1';76 0300

TI'C

I4.J 022/029

PATENT

MICHAEL D. DOYLE et al.
Application No.: 08/324,443
Page 20

If the Examiner believes a telephone conference would
expedite prosecution of this application; please telephone the
undersigned at [phone].
Respectfully Submitted;

--~~

(J

y-J~

Charles E. KrUeger
Reg. No. 30;077
TOWNSEND and TOWNSEND and CREW LLP
Two Embarcadero Center, 6th Floor
San Francisco, california 94111-3834
(415)

576-0200

Fax [phone]

CBK:db
s;\a~3a7I\$53\amend.Ol

----....,"----_ --------...

"--.-"~--­

----

PH 001 0000783921