Apple Inc. v. Samsung Electronics Co. Ltd. et al

Filing 559

Declaration of Deok Keun Matthew Ahn in Support of #558 Response ( Non Motion ), filed byApple Inc.. (Attachments: #1 Exhibit 1.01, #2 Exhibit 1.02, #3 Exhibit 1.03, #4 Exhibit 1.04, #5 Exhibit 1.05, #6 Exhibit 1.06, #7 Exhibit 1.07, #8 Exhibit 1.08, #9 Exhibit 1.09, #10 Exhibit 1.10, #11 Exhibit 1.11, #12 Exhibit 1.12, #13 Exhibit 1.13)(Related document(s) #558 ) (Jacobs, Michael) (Filed on 12/29/2011)

EXHIBIT 1.12

S. Patent
(

Jun. 5, 1990

Sheet 20 of 23

4,931,957

START )

- ENTER
FX (X= 1 TO10)

S1

S2
FX =
F i TO F4
NO
NO

YES

S3
Sil

NO

FX =F10

?

YES

YES

FX =LAST
FUNCTION
NO. ?

YES

S7

a

RE3

NO

S4

FUNCTIONS

- RDED

S
FX newnu
IN TRANSFER
TABLE

?

SS

MARKING FRAME

363
6LEAf?
Tote (G)
a
ERASE
MARK ING
FRAME

NO
RECORD
FUNCTION
NO. ON TABLE(0)
&
D I SPLAY
(S5

SS
RCUTE DOCU:weis t
|DATA TRANSFER
I
I
'~- STO
CLEAR
i
TABLE (O )

FIG.19

APLNDC00024600

U.S. Patent

Jun. 5, 1990

Sheet 21 of 23

4,931,957

(0) DESI GNAT lON TABLE
NUMBER OF
DESIGNATED
i ST
2ND
3RD
ICONS

(b) TRANSFER TABLE
NO

NUMBER OF
DESIGNATED
ICONS

I

2

SCANNER DISFšLAY

2

2

SCANNER PRIFN2TER

3

2

s

4

2

5

2

6
7

2
2

DISPLAY PRINTER
F3
F2
DIS
Y FILE

S

3

SCANNER DISPLAY PRINTER
Fi
F3
F2

9

3

SCANNER DISPLAY FILE

10

3

i ST

FILE

Fi
y

FILE
F4

2ND

DI

F3

3RD

Y

F4

DI "' ^Y PRINTER
F3
F2

F I G. 20

APLNDC00024601

U.S. Patent

Jun. 5, 1990

Sheet 22 of 23

4,931,957

( START )

S101
IS "STOP"
DESIGNATED

YES

'?

NO

S104
CONTINUATION ENTER

$102

Fx(x= 1 To io)

ARE
DOCUMENTS IN
FIRST DEVICE
31039

NO

CANC
FUNCTION
SELECT

YES

+
F i ~ F4

UTE A SEQU¯¯ ·
OF DOCUMENT
DATA TRANSFER
l
|

CHANGE PROPERTY
ON PROPERTY
S-- OF EACH
DEVICE

S105
N

FIG.21

APLNDC00024602

U.S. Patent

Jun. 5, 1990

Sheet 23 of 23

4,931,957

(o)
Fi

F2

F3

F4

FS

F6

F7

F8

SCANNER PRINTEROISPLAY Fil.E

F9

F(0

EXCU. :'ANCEL

(b)
I

t
F1

F2
F3
F4
¡PRINTER DISPLAY FILE

F5

F6

F7

FS

FS

F6

F7

FS

F9

FiO

F9
FIO
EXCU. CANCEL

(c)
I
Fi

F2

F5

F4

PRINTER ISPLAY FILE

FIO

EXCU.

ANCEL

F9

FIO

(d)
O
MN

F2
F3
F4
RINTER DISPLAY FilL

FS

F6

F7

FS

THE DOCUMENT READ BY
THE SCANNER IS RECORDED
INTO THE vr: ICAL DISK
PR

TE DISF3

F

FS

F6

FA7

FS

F9

Fi

F5

Fe

F7

FS

F9

Flo
CANCEL

(f)
Ft
F2
F3
F4
CANNER PRINTER DISPLAY FILE

FIG.22

APLNDC00024603

1

4,931,957

2

the screen of the display device and is moved on one of
the display areas by means of a pointing device such as
a mouse, to designating a desired processing execution.
However, the document filing apparatus of the type
nrm n OF THE INVENTION
5 described above has not been used with a display device
This invention relates to an image information pro.
having a plurality of display areas.
cessing apparatus which is adapted for storing and re·
SUMMARY OF THE INVENTION
trieving image information by using an optical disk
memory. More specifically, the invention relates to an
Accordingly, it is an object of the present invention
image information processing apparatus for execadng 10 to provide an improved image information processing
an image processing operation according to a menn
apparatus which has a plurality of display areas for
diàplayed on a display device which includes a plurality
image information.
of display areas.
It is another object of the present invention to proBACKGROUND OF THE INVENTION
15 vide an image information processing apparatus having
a plurality of display areas capable of executing image
In reccat times, several data processing apparatuses
processing operations, such as image retrieval and
have been developed and put to practical use.
image record, with a few key operations.
For example, an imase information processing appaIn accordance with the present invention, the foregoratus, such as a document filing apparatus, is used for
ing objects and others are achieved by providing an
storing and retrieving image information on and from
image information processing apparatus including se•
an opdcal disk memory. One conventional document
Icoting means for sequential manual selecting at least
filing apparatus is disclosed in U.S. Pat. No. 4604,653.
two from among a plurality of image processing comIn the document filing apparatas of the type described
mands including at least a scanning command, a display
above, image information on documents is read by a
scanner and such image information is stored on the 25 command and a file command; scanning means for inputdag image information from an original image only
optical disk memory. The apparatus is provided with a
in response to sequential selection of the sennning comdisplay device using a cathode ray tube. The document
mand and at least one of the display command and the
is w•=n•d by the scanner and the scanned image is
file enmmand in the selection means, optical memory
transferred to the display device. Corresponding image
information obtained from the en==ing is stored on the 30 means for storing the image information input by the
•¤•••i=g eans only in response to sequential selection
m
optical disk memory. Desired image information is rcin the selection means of the scanning command foltrieved as needed and displayed by the display device.
lowed by at least one ofthe file command and a sequenThe above-mentioned apparatus can perform a varitial combination of the display command and the.file
ety of operations such as image retrieval, image recording, image deletion, and others. To operate the appara. 35 enmmand display means, including at least two display
tus, an operator designates or selects one of the above
areas, for fisplaying the image information from one of
operations, as desired, whereupon the apparatus perthe scanning means and the optical memory means in
forms the desired operation.
only one of the two display areas in response to one of
For example, when the operator designates "anage
sequential selection of the scanning command and the
retrieval", the apparatus then operates in the image 40 display com,n.na and sequential selection of the file
retrieval mode and, having retrieved the desired image
command and the display enmmuna, respectively and
information from the opdcal disk memory, displays tb
designation means for manually designating the one of
image information in the display device, and prints the
the two display areas to display the image information.
unage information.
Each operationmode ofthe apparatus is composed of 45 BRIEF DESCRIFITON OF THE DRAWINGS
many hierarchy sub•mades, which implies that, in any
PIG. 1 shows a block diagram of an image informaIMAGE INFORMATION PROCESSING
APPARATUS

optt
Im a
operation, it must return to the initial mode. Consegg &
mm
à
diferent modes, and its operation as a whole is rather
ineñicient.
55
To solve the above problem, a related U.S., application, Ser. No. 099,902 filed September 22, 1987, now
U.S. Pat. No. 4885,704 discloses a document filing
apparatus capable of crecuting a plurality of processing
operations with a few ley operadons.
do
Also, as is wen known, a data processing apparatus,
such as a personal computer system, having a plurality
of display areas has been developed. The above-men.
tioned system is disclosed in "Window and Window
Based Tools: Beginner's Guide" Part No.: 800-1287-03 65
Revision A of February 17, 1986 pp394. In the apparatus, a plurality of display areas are displayed on one
screen ofa display device. Also, a cursor is displayed on

d

em

r

t

a display device including a single
display area on a display screen; display devices, each
FIGS. 3A, 3B and 3C show
containing four display areas;
FIG. 4 shows a display device displaying scanner
Ni
FIG. 5 shows a display device displaying printer
properties;
FIG. 6 shows a display device displaying display
properties;
FIG. 7 shows a display device displaying file properties:
FIGS. 8 to 18 diagrammatically show transient phases of various document data transfer modes;
PIG. 19 is a flowchart illustrating a flow of a document data transfer operation;
PIG. 20 shows a designation table and a transfer
table;

APLNDC00024604

3

4,931,957

FIG. 21is a flowchart illustrating a flow of the document data transfe°r operation when a continuous document read-out mode is used; and

Funcdon area 202 cont
icons F1 to F10 indicating
various devices for inputting and outputting image information such as scanner 1, printer 5, display device 9,
FIG. 22 shows a transient phase of document data
and optical diskmemory 13 (file). The functions of these
transfer operations, using a function area with a func- 5 icons F1 to F10 are:
Scanner (F1): To enter the document data from scanner
tion for starting document data transfer operations.
1, and transfer it to another device.
DETAILED DESCRIFFION OF TfiE
Printer (F2): To print the document data transferred
PREFERRED EMBODIMENTS
from another device, by printer 5.
In an image information processing apparatus shown 10 Display (F3): To display the document data transferred
in FIO. 1, a scanner 1 and a printer 5 are connected to
from another device by display device 9, and to store
the docmnent data into internal image buffer memory
a scanner/printerprinter interface 1 Interface 2 is con4. Purther, this icon indicates that the document data
nected to image data buses (I) and (II), and control
is read out from internal image memory buffer 4 and
buses (ly and (IIT. These bases (1) and (II), and (I)' and
(fly are coupled with an image-enlarging/reducing 15 transferred to another device.
circuit 6, a character generator 11, and a compander 12.
File (F4): To record the document data transferred
from another device on opdcal disk memory 13, to
Compander 12, coupled with an optical disk memory
readoutthodocumentdatafromopticaldiskmemory
13, appropriately compresses and expands image infor13, and to transfer it to another device.
mation recorded and reproduced on and from optical
disk memory 13.
20 Many processing operations can be performed by
Image bases (I) and (II), and control buses (ly and
appropriately combining the above four devices represeated by F1 to F4, and by transferring the document
(II)' connected through an image bus select controller3
data betweca devices. For example, if the document
to memory data buses (1) and (II). Memory data buses
data is transferred from scannet 1(F1) to printer 5 (F2),
(1) and (II), and control bus (17 and controlbuses (I) and
(II) are coupled with an image buffer memory 4 a dis- 25 a hard copy of the document data can be obtained.
play memory 1, a display controller 8, a vertical/horiThe image information processing apparatus accordzontal conversion circuit 10 and two-dimensional ading to the present invention can execute ten types of
dress generators 15 and 16. Generators 15 and 16 are
document data transfers, or ten types of docwnent data
transfer modes as given below, by appropriately comconnected through an address (ADRS) bus (I) to ima8
buffer memory 4, and through an address (ADRS) bus 30 bining the scanner (FI), the printer (F2), the display
(II) to display memory 7. Display memory 7 is coupled
(F3) and the fue (F4).
with display controller 8 for controlling a display de(1) Scanner (F1)/Display (F3); Mode 1 Enter the docuVice 9.
ment data from scanner 1 and to display it on display
Scanner printer interface 2, image-enlarging/reducdevice 9.
ing circuit 4, display controner 8, vertical/horizontal 35 (2) Scanner (F1yprinter (F2); Mode 2 Enter the docu•
conversion circuit 10, character generator 11, comment data from scanner 1 and to print it by printer 5.
pander 12, and two-dimensional address generators 15
(3) Scanner (P1yfBe (F4); Mode 3 Enter the document
and 16 are coupled via the CPU bus to a CPU 14. The
data from scanner 1 and to record it on optical disk
CPU bus is connected to a CPU memory 17, an inter13.
face 18, a mouse 19, and a keyboard 20.
40 (4) File (F4)/display(F3); Mode M4 Retrieve the docuIntheapparatusshowniaFIG.1,theimageinformament data ikom optical disk 13 and to display it in
tion read out by scanner 1 is loaded into the agiparatus
display area 201 of display device 9.
through anterface 2, and stored via image bus select
(S) File (F4)/printer (P2); Mode MS Retrieve the docu•
controßer 3 into image buffer memory 4.
ment data from optical disk 13 and print it by printer
The image information stored in image buffer mem- 45 5.
oty 4 is subjected to enlarging or reducing by circuit 6,
(6) Display (F3)/printer (F2): Mode M6 Print out the
and stored into display memory 7, and is displayed by
document data currently displayed within display
display device 9 under control of display controHer 8.
device 9 by printer 5.
When it is not necessary to enlarge or reduce the image
(7) Display (F3)/fie (F4); Mode M7 Record the docuinfor-tin= image-enlargiaS/teducing aircuit 6 does 50 ment datacurrently displayed within display area 201
not perform its operation. The image information is
on optical disk 13.
transferred from display memory 7 to ima8e buffer (8) Scanner (F1)/display (FS)/pdater (F2); Mode MS
memory 4 in a nimilar way.
Enter the document data from scanner 1, and display
FIG. 2 shows an initial display on the screen of disit on display device 9, and check and print it by
play device 9 in the image informationprocessing appa- 55 printer 5.
ratos according to the present invention. As shown in
(9) Scanner (F1)/display (F3)/file (F4); Mode 9 Enter
FIG. 2, a display area 201for displaying image informathe document data from scanner 1, display it on distion including characters is substandany centered in the
play device 9, and check and record it on optical disk
display screen. Icons are arrayed in the right portion of
13.
display are 201, and give an operator various necessary 60 (10) Pile (F4)/display (F3)/printer (F2); Mode M10
indications, such as image-enlarging and reducing, and
Retrieve the documcat data from optical disk 13,
rotation and scroll of the displayed image information.
display it in display device 9, and check and print it
The icons are designated by mouse 19 or related keys on
by printer 5.
keyboard 20. For example, if the "Enlarge" icon is
As seem from the above descriptions, most of the
designated, the image information displayed within 65 retrieving and recording operations of those filing operdisplay area 21 is enlarged.
ations can be made by transferring among those devices
The display further contains a function area 202 prosuch as scanner 1, printer 5, display device 9 and optical
vided in connection with function keys F1 to F10.
disk memory (file) 13.

APLNDC00024605

4,931,957

6

As shown in FIG. 2, DB function in menu bar area
As shown in FIG. 5, the property sheet of printer 5 is
203 contains a display mode, an edition function and DB
used for setting the property of the number ofcopies to
print, for example. As shown in FIG. 6, the display
function. These are for executing the followingprocessing operations.
property sheet is used for setting a display time in disDisplay mode: Changes the number of display areas 201 5 play area 201. The display time is useful when scanner
displayed by display device 9 to one of 1 and 4, as
1 is operating in the ADF mode. For example, when
shown in FIGS. 2 and 3.
document data are successively transferred from scanner 1, one sheet of the document is displayed for this
Editing function: Edits the document image displayed
in display area 201, for example, composing, layout,
display time. When the display dme terminates, a sctext input, etc.
10 quence of entering the next document begins.
DB fbnction: To format, open and close optical disk 13,
As shown in FIG. 7, in the property sheet ofoptical
disk 9, display device 9 displays information indicating
and to arrange all of the documents recorded on
optical disk 13 under predetermined conditions, and
the number of documents currently stored in optical
disk 13, and which document data is now read out from
to save the arranged document data into a file or to
delete documents meeting predetermined conditions. 15 optical disk 13. When the document data is read out
As shown in FIGS. 2 and 3, if the display mode in a
from optical disk 13, the continuous mode or batch
menu bar arca 203 is designated, one and four display
mode is selected. This is similar to the automatic feed
mode in the scanner property sheet.
areas 201 can be alternately displayed. Four image
buffermemories corresponding to the four display.areas
Ten types of document data transfers are described
are provided in the processing apparatus. Also, as 20 below.

shown in FIG. 3 an indicia 204 represented by a black
Mode 1
mark is displayed at the top of the menu bar area ofone
In the initial state, display device 9 displays the image
of four display areas 201. When four display areas 201
are used, the document data transferred from scanner 1
as shown in PIGS. 2 and 3. FIO. 8 shows the operations
or optical disk 13 is displayed on display area 201a 25 and the transient phases of changing states of the funcincluding indicia 204 Also, when four display areas are
tion area when the document data transfer mode of
scanner (F1)/display (F3) is performed. Icon Fx (where
used, indicia 204 indicates that area 201a is to be recorded on optical disk 13 or printed out by printer 5.
x=1 to 10) indicates the operation to push a keyboard
Every time the space key on keyboard 20 .is defunction key or the operation to click the left button by
pressed, indicia 204 is shifted from one display area.to 30 settin5 the mouse cursor to the icon corresponding to
the function key within the function area.
another display area. When the space key is depressed,
In operation, as shown in FIG. 8, for example, icon
indicia 204 is cyclicaBy shifted among those four display areas 201. This aRows the operator to display a
F1 is designated by the mouse cursor and at this designatedposition, the button ofmouse 19 is clickéd (step a).
maximum of four documents in desired display areas
201, and further to record the document data in desired 35 In response to the click action, a marking frame is displayed on icon F1(step (b)). Then, the mouse cursor is
display areas 201 on optical disk 13 or to print the desired document data by printer 5.
moved to icon F3 and the inouse button is clicked, and
In the display of FIG. 3(a), display area 201a in the
the marking frame is displayed on F3 icon (step c).

upper left an the screen is the input/output display area.
Underthis condition, whenicon P3 is being indicated, if
In the display of FIG. 3(b), display area 201a is in the 40 the mouse button is clicked again, the document data
right upper is the input/ontput display area. As shown
transfer from scanner 1 to display device 9 starts. That
is, when CPG14 detects that icon F3 corresponding to
in FIG. 3(c), indicia 204 represented by a bhick mark
canbe represented by other marks such as a stripe mark,
the device finally designated has been designated two
times, CPU 14 outputs a signal (conunand) representing
etc.
Scanner 1. printer 5. display device 9 and optical disk 45 an execution of processing.
At this time, icons F1 and F3 are shaded, in step (d).
(iDe) N Imve theirown properties affecting imagninfor-

mation transfers. Pmperty shee

or

Then, the document data is entered from scanner 1, and
the document image is displayed on display area 201a
including indicia 204 shown in PIG. 3. At the same
With these propetttes. Elese properties can be displayed 50 time, the "Next page" is displayed on icon P7 in the
by operating the function keys corresoondmg to hmefunction area 202, (step e). Under this condition, when
obecking the properties of these devices can be gjs.
01ayed by displav device 9. PIGS. 4 to 7kw d_hplays

tion selece keys ostettוrsXInegrearties oago
be anglayea og usmg mouse u. In tms case, a mouse
cursor is moved to a desired
and me right button
(not snown) ormouse un uusnea ana releases from its 55

icon P7 is designated by monse 19 or keyboard 20, the
next page of document data is transferred from scanner

1 to display device 9. When F10 icon (cancel) is desig-

nated, the document filing apparatus can be returned to
the initial state in (step f), Icon F10 can be designated at
any time. At steps (b) and (c), the designation of icon F1
19 for property sheet erasure, the mouse cursor is set to
or icons F1 and F3 is cancelled. At step (e), the docuthe icon of P9 (confirmation) or P10(erasure), and the
ment data transfer from -......... 1 to display device 9 is
left button (not shown) of mouse 19 is clicked.
fio ended.
As shown in PIG. 4, the property sheet of scanner 1
In swomary, the document data transfer is operated
is used for setting properties such as the size of an input
in the following way. In the order of the devices to
document, document density, read-out resolution, and
which the document data are transferred, the icons
feed mode (book mode) or ADF (automatic document
corresponding to those devices are successively desigfeed) mode). The book mode enters the image informa- 65 nated one time cach. PinaBy, the icon corresponding to
tion ofone sheet ofdocument. The ADF mode succesthe last device is designated a second time. Then, the
sively enters the image information of the documents
document data transfer according to an executionsignal
contained in the ADF holder.
from CPU 14. The designations already made can be

APLNDC00024606

4,931,957

8

that the density of scanner 1 is improper, he selects the
cancelled any time by designating the cancel icon P10,
before the document transfer starts.
scan property sheet shown in FIG. 4 and alters its properties and designates "Reenter" icon F8. Upon this
Modes 2 and 3
action by the operator, scanner 1 rescans the document
PIGS.9 and 10 diagrammatically show the operation 5 using the properties from the altered property sheet and
modes 2 and 3 of the scanner (F1)/printer (F2) and the
displays the document data in display area 201a including indicia 204. If the operator decides that the docuscanner (F1)/fHe (F4). These operations are almost the
same as the scanner (F1)/display (F3) operation. The
ment data in diaplay area 201a is satisfactory, the print
icon FI is designated, so that the document data in
only difference is that the document data input by scanner 11s not displayed on display device 9, but is printed 10 display area 201a is transferred between display device
9 and printer 5 (step g). At this time, the icon F7 disout by printer 5 or recorded on optical disk 13.
plays "Next page".
Modes 4 and 5
When the icon F7 of displaying "Next page" is designated, the operation returns to step (c), and the mode 8
FIGS. 11 and 12 are diagramatical representations of
the operationmodes 4 and 5 ofthe file (F4)/display (F3) 15 for the scanner 1-display device 9-printer 5 is reexecuted from the first step. When icon F10 of "Canand the file (F4)/printer (P2). In the mode 4 of PIG. 11,
oml" is designated, the document data transfer operathe file-to-display document data transfer is executed
tions is stopped. The operation of displaying the propwhen icon F4 is designated one time and icon F3 is
erty sheets of the printer, displaying and filing, and
desi8nated two times. In the mode S of FIG. 12, the
file-to-print document data transfer is eKecuted when 20 checking and changing the properties may be performed at any time.
icon P4is designated one time and icon F2 is designated
two times.
Modes 9 and 10
In the operations of the above modes 4 and 5 shown
in FIGS. 11 and 12, the steps (a) to (b) are the same as
FIGS. 16 and 17 show a sequence of document data
those of the previous modes. In step (e), one document 25 tranfers operations of each of modes 9 and 10. Mode 9
is read out from optical disk 13. The read out document
transfeis documcat data among scanner 1 (F1), display
data is displayed in display area 201a in the mode 4 of
device 9 (F3), and optical disk 13 (file) (F4). Mode 10
FIG. 11, and is printed out in the mode 5 of PIG. 12.
transfers document data among optical disk 13 (file)
Also la step (e), "Next page" and "Previous page" are
(F4), display device 9 (F3) and printer 5 (P2).
displayed on icons F7 and F8. When "Next page" ap- 30 In the operation modes, as mentioned above, the
pears, the counter, which indicates which page of the
properties of warmer 1 and the file each indicates the
document data being read out, is incremented by one.
book mode and the successive readeut mode. Byery
When "Previous page" appears, the counter is decretime one document is transferred, the step to check the
mented by one. Then the operation returns to step (d),
displayed document data is needed. This step correand a similar document transfer is performed. When the 35 sponds to the steps (f) and (g) in FIG. 16.
cancel icon F10 is designated, the document transfer is
The operation of the document filing apparatos when
the property ofscanner 1is the ADF mode, willnow be
ended.
described. The batch read-out mode operates similarly.
Modes 6 and 1
° °
FIG. 18 diagrammatically shows a sequence of docuFIGS. 13 and 14 show the operation modes M6 and 40 ment data transfer among scanner 1 (F1), display device
M7 of display (F3)/printer (F1) and display (F3)/file
9 (F3) and optical disk 13 (file) (F4) whenscanner l is in
the ADF modc. In this operation sequence, the steps (a)
(F2). The operations of those modes are similar to the
above ones. Inanely, in step (d), the document data
to (e) are for directing the document data transfer. This
displayed on display area 201a o printed out from
mode is different from the above-mentioned one in that
printer 5 in the mode M6 of FIO. 13, and is recorded 45 in step (e) "Stop" is displayed on icon F6. Unless the
onm optical disk 13 in the mode M7 of FIG. 14. The
"Stop"icon is designated in step (e), scanner 1scans and
operations of modes 1 to 7 are for document transfer
reads out the document data of all of the documents
between two devices. Doomnent transfer among three
contained in the ADF holder of scanner 1. Each of
devices is performed as follows:
these documents is displayed for a predetermined period of time on display area 201a, and then these docuMode 8
ment data are successively stored into optical disk 13.
FIO. 15 shows a sequence of mode 8 operations of
The display time of a document on display area 202a
scanner (F1)/display (F3)/printer (F2). In this mode,
is set by the display property. When an operator desigicons FI and F3 are designated one time each in a sucnates the icon "Stop" in step (e), the document data
cessive manner. Finally, icon F2 is designated two 55 transfer is temporarily stopped, and function area 202
times. When CPU 14 detects that icon F2 has been
shows the display shown in step (g). Under this condidesignated two times, the document data is transferred
tion, if "1L..t/ (PS) is designated, scanner 1reads out
througit the route of scanner 1-display device 9-the document data.
printer S.
When the stop of document transfer is removed and
Steps (a) to (e) are for directing the document data 60 the document data transfer is started again, icon (F6) of
transfer. In step (f), the document data is scanned by
"Continue" is designated, and the operation returns to
scanner 1 and displayed in display area 201a including
step (e). When the document data transfer of the ADF
indicia 204 At this point, the document data has been
holder contained documents is completed, or when the
transferred between scanner 1 and display device 9.
icon "Cancel" (F10) is designated, the document data
Also in step (f), "Print" and *Reenter" are displayedon 65 transikt is completed and operadon passes to step (f).
the icons P7 and P8.
As described above, when using the image informaUnder this condition, the operator checks the doontion filing system according to the present invention,
ment data in display ares 201a. If the operator decides
the dircodons for retrieval, recording, and the like can

APLNDC00024607

4,931,957

10

be executed by merely designating three to four icons
S1. If the designated and entered data is F10 (811), the
designation table (a) is cleared, and the marking frame
representing devices.
of the icon is erased (S6), and the operation returns to
The operations of the FIG. 1 circuit relating to the
step SL
document tlata transfer operations as illustrated in
FIGS. 8 to 18, will be described referring to a flow- 5 If the designation table (a) stores the function numbers in the order of F1-F3-F4 corresponding to the
chart ofFIG. 19. Tables to be used in the description of
the operations are inustrated in FIG. 20. A designation
document data transfer operation of FIG. 14 the document is read out by scanner 1, and the document data is
table (a) holds the number of icons designated by the
transferred to image data bus (II) via scanner printer
operator, and the order in which the icons were designated. A transfer table (b) holds valid combinations of 10 interface 1 The document data on image data bus (II) is
transferred through image bus select controller 3 to
icons for the document data transfer that can be die
played by the image information processing apparatus,
image buffer memory 4 and display memory 7. The
and the order of function numbers. These tables are
document data in display memory 7 is read out by display controller 8, and input to display device 9, and
referred to during the document data transfer procese
ings. These tables (a) and (b) are stored in CPU memory 15 displayed in the form of a document image. The document data in image buffer memory 4 is read out, and
17.
input to compandar 12 via image bus select controller 3
In operation, when the power supply is turned on, the
and the image data bus. The document data is subjected
initial states at the respective portions of the image
to the companding processing in compander 12, and is
information processing apparatus are set up according
to a program stored in CPU memory 17. At this time, 20 input to and stored in optical disk 13 as the file. In this
way, the document data 1 is transferred to display dedisplay device 9 displays display area 202, function area
201, and mena bar area 203, as shown in PIG. 2. This
vice 9 and optical disk 13 from scanner 1.
FIG. 211s a flowchart showing the operation of FIG.
display pattern data is the data as transfered from the
CPU memory 17 or an external floppy disk to display
18 in which the mode ofthe first device in the document
memory 7. Under this condition, the data correspond- 25 data transfer contains the ADF made for automatically
feeding documents.
ing to any of icons F1 to F10 is designated and entered
When the document data transfer processing begins,
by means of the keyboard or the mouse 19 (S1). The
CPU 14 checks the read-out mode of the first device
entered data is checked by CPU 14 to determine if it
(the first device in the designation table (a)), for examcoincides with one of icons F1 to F4 (32). Ifthe answer
is YES, CPU 14 checks if the function number corre- 30 ple, scanner 1, in the document data transfer. When this
mode is the batch read-out mode such as the ADF
sponding to the input or entered data coincides with the
mode, the following operation procedure will be perlast function number in the designation table (a) of FIG.
20 (83). IfNO, CPU14 checks if the function numbers
formed. CPU 14 checks if the "Stop" icon is designated
(8101). If the answer is NO, the CPU checks whether
of three or more have been recorded on the designation
table (84). If the answer is No, the number of icons in 35 the document to be transfered to scanner 1is present or
not (8102). If YES, a sequence of document data transthe designation table is increased by one, and the funofer processings are executed without interruption
tion number as designated and entered is written into
(8103). For example, when the designation for scanner
the designation table (SS). The marking frame is dis1, display device 9 and printer 5 is inade, the document
played on the icon corresponding to the function number recorded anew (85). After this, the operation re- 40 data enter, the document display, and the document
print are successively executed in connection with the
turns to step SL
first sequence of document data transfer processings.
If more than three fbuction numbers are stored in the
designation table, i.e., if the answer in step S4 is YES,
After completion of the first sequence of the docuthe designation table (a) is cleared, and the marking
ment data transfer processings, CPU 14 returns to step
frame of icon is erased (86). If the designated and on- 45 S101 to check the designation and entering of the
tered function number coincides with the last function
"Stop". The second and subsequent seqüences of docunumber in the designation table (SS), the order (e.g.,
ment data transfer procaninen will be continued uninF1-F3) ofthe function numbers in the dc¢gnation table
terruptedly until the "Stop" is designatpd or no docu(a) is compared with each ofthe orders (P1-F3, F1-F2,
ments remain to transfer. As when no documents reP1-FA . . .) offunction numbers in the transfer table (b) 50 main to transfer, the document data transfer processing
(87). If the same order is found, the marking frame in
ends.
the icon is erased (38) and the document data transfer
When "Stop" is designated (8101), the document data
processing is started in the order shown in the <1Agnntransfer operation is stopped until the next designation
tion table (a) (S9). For example, when the function
and entering of data. When the "Continue" is designumbers are stored in the designation table in the order 55 nated (8104) CPU 14 returns to check whetbar or not
of F1-F3, the document is read out by scanner 1, and
the document to be transferred is contained in the first
the document data is transferred to image data bus (1)
device, and enters the control loop for the sequence of
through scanner printer interface 1 The document data
document data transfer processings.
in display memory 7 is read out by display controller 8,
In step S104 for designation and entering of data, the
input to display device 9, and displayed as a document 60 function select and F1 to F4 are designated and entered,
image. Thus, the document data transfer from scanner 1
the property sheets of the devices corresponding to F1
to display device 9 is automatically performed.
to F4 are displayed and the properties of these devices
Upon completion of the document data transfer, the
are checked and if necessary, changed (S105). The condesignation table (a) is cleared (SIO ) and operation
trol returns to step S104.
returns to step St. If the order in the designation table 65 In the above-mentioned embodiment, at the start of
(a) is not registered in the transfer table (b) (SA), the
document data transfer, the icon corresponding to the
designation table (a) is cleared and the marking frame of
fmally designated device is designated two times. An
the icon is erased (56), and the operation returns to step
alternative measure to start the document data transfer

APLNDC00024608

11

4,931,957

12

means for cyclically shifting the indicia from one disis illustrated in FIG. 22. In FIG. 22, Icon F9 is desig.
play area to another display area.
nated by a mark cursor or by related corresponding
6. An iinage information processing apparatus comfunction keys on the keyboard. More specifically, as
premg.
shown in FIG. 22, to start the execution of the mode M3
selecting means for sequentially manually selecting at
of the scanner-Eile document transfer, the icons are 5
least two image processing commands from among
designated in the order of F1(scanner), F4 (file) and F9
a plurality of image processing commands includ(execution). After the start ofdata transfer processing,
ing a file command, a display command and a
the word "Execution" disapcars from icon P9.
printer command;
As described above, the document data transfer processing can be repeatedly executed uninterruptedly by 10 optical memory means for storing the image information;
setting the first device in the continuous read-out mode.
display means, including a display screen having at
As described above, the number of steps for.many
least two display areas, for displaying the image
operations, for example, document data retrieval, is
information from the optical memory means in
reduced, and the operation shifts canbe mede smoothly.
response to sequential selection of the file comWhat is claimed is:
15
mand and the display command and sequential
1. An image information processing apparatus comselection of the file command followed by at least
pasmg:
one of the display command and a sequential comselecting means for sequentially manually selecting at
bination of the display command and the printer
least two image processing commands from among
commanda plurality of image processing commande includ- 20 printing means for printing the image information
ing a scanning command, a display command and a
from one of the optical memory means and the
file command;
display means in response to sequential selection in
scanning means for inputting image information from
the selection means of the file command and the
an original image only in response to sequential
printing command and sequential selection in the
selection of the sennning command and at least one 25
selection means of the file command, the display
of the display command and the file command in
command and the printing command; and
the selectins m
designation means for manuaHy desigliating the one
optical memory means for storing the image informaof at least two display areas to display the image
tion input by the scanning means only in response
information from the optical memory means in
to sequential selection in the selecting means of the 30
only one ofat least two display areas or to print the.
scanning command followed by at least one of the
nuage information displayed on the one of at least
file co
da-s tial co
n of the disc
6,
co
buffet
display means, including a display screen having at
least two display areas, for displaying the image 35
information from one of the scanning means and
the optical memory means in response to one of
sequential selection of the scanning command and
the display command and sequential selection of
the IHe command and the display command, re- 40
spectively; and
designation means for manually designating the one
of at least two display areas to display the image
information from the one of the scanning means
and the optical memory means in only one of at 45
Icast two display areas,
1 The apparatus of claim 1, wherein the seleadon
means also includes means for selecting a print com.
mand from among the plurality of image processing
commands, and printing means for prindug the image 30
information from one ofthe scanning means, the display
means and the memory means in response to
selection in the selection means of une of the se anning
command, the display command, and the file command,
followed by the printing command
55
3. The apparatos of claim 2, wherein the R
"- .to aclud neæssc=fo
n
a

the optical memory means.
8. The apparatus of claim 6, wherein the designation
means includes an indicia indicating a current display
area for displaying the image information from the optical memory means or for displaying the image informadon to be printed and shilWng means for cyclically shifting the indicia from onc display area to another display
area.
9. An image information processing apparatus compnsm5=
selecting means for sequentially manually selectin5
two image processing commands from among a
plurality of image processing commands including
a display command and a file command;
display means, including a display screen having at
least two display areas, for displaying the image
information;
optical memory means for storingthe image informadon displayed in only one of the display areas in
response to segnantisi selection in the selection
m-= of the display command and the file commank a
designadon means for manuaBy designating the one
two
s
e

means in response to sequential selection of one of tlie
10. The apparatus of claim 9, further comprising
scanning command and the file command, respectively, 60 buffer memory manne for storing theimage information
foHowed by the display command and the print comdisplayed in the display means.
mand.
11. The apparatus of claim 9, wherein the designation
4. The apparatus ofclaim 1, further comprising Wer
means includes an indicia indicadng a current display
memory means for storing the image information inputarea from which to store the displayed image informated by the scanning means.
65 tion into the optical memory means and shifting means
5. The apparatus of claim 1, wherein the designation
for cyclically shifting the indicia from one display area
means includes an indicia indicating a current display
to another display area.
area for displaying the image information and shifting
* * * * *

APLNDC00024609

IIll\\\\\\\\\\\\llllllllllllllllllllllllllI\\Illllllllllllllllllllllllll
US005091866A

United States Patent (19]
Takagi

[11]
[45]

[54] INFORMATION PROCESSING APPARATUS

4,772,882 9/1988 Mical .............................. 340/710 X
4,806,919 2/1989 Nakayama et al. ................. 340/721

D•--YING MULTIPLE WINDOWS AND
Shiro Takagi, Yokohama, Japan
Kabusblki Kaisha Toshiba, Kawasaki,
Japan
[21] Appl. No.: 489,724
(22] Filed:

Mar. 2, 1990

Related U.S. Application Data
[631

Continuation of Ser. No. 136,391, Dec. 22, 1987, abandoned.

5,091,866
Feb. 25, 1992

4,819,189 4/1989 Kikuchi et al. ..................... 364/521

DISTINGUISHING INDICIA

[75] Inventor:
[73] Assignee:

Patent Number:
Date of Patent:

4,829,294 5/ 989 Iwami et al. .................... 364/521 X
4,833,596 5/ 989 Buckland et al.
364/521 X
4,890,098 12/ 989 Dawes et al. ............-......... 340/721

4,890,257 12/ 989 Anthias et al. ...................... 364/900
Primary Examiner-Heather R. Herndon
Attorney, Agent or Firm-Finnegan, Henderson,
Farabow, Garrett, and Dunner
[57]
ABSTRACI'
A display unit displays data to be processed. The display unit is capable of displaying a plurality of windows

Dec. 26, 1986 [JP) Japan ................................ 61-315332

for displaying the data therein. A controller outputs the
control data to display the plurality of windows and an
indicia on the display unit. An operating unit supplies
the controller with a position signal to rnove the indicia

5

to a desired location. An area unit checks whether the

(30]

Foreign Application Priority Data
Int. 01.5

(52] U.S. Cl.

GO6F 15/62

.................. 395/158; 395/157

[58] Field of Search ................ 364/518, 521; 340/707,
340/710, 716, 721, 723; 382/44-48

(56]

References Cited

indicia is located a predetermined window area of the
windows being displayed on the display unit, any data
displayed in the predetermined window area being processed prior to the data displayed in any other window

area. A specifying unit supplies signals to the contioller,

U.S. PATENT DOCUMENTS

the signals specifgg, in accordance with the check
results made by said area check unit, a condition in

4,651,146 3/1987 Lucash et al. ...................... 340/721
4,653,020 3/1987 Cheselka et al. .................... 364/900
4,661,810 4/1987 Himelstein et al. ............ 340/710 X

4,683,468 7/1987 Himelstein et al. ............ 340/710 X
4,710,767 12/1987 Sciacero et al. .................... 340/799

which the indicia is displayed to demonstrate whether
the indicia is being displayed in the predetermined window area or in the other window areas.

4,769,762 9/1988 Tsujido ........................... 340/716 X

11 Claims, 8 Drawing Sheets
CPU

1,CI

MOUSE
(POINTING
DEVICE)
.. ...'

(30

27

12

RECORDER

23

OPTICAL
DISK

26

COMMUNICATION
enNTROLLER

APLNDC00024610

U.S. Patent

Feb. 25, 1992

Sheet 1 of 8

CPU

-

5,

1,866

12

MAIN

PAGE

MEMORY

BUrre.n

COMPANDER
/EXPANDER

KEYBOARD

29

WI I

-

220

16

DISPLAY
l INTERrw r

24
HKEYBOARD

15

PATTERN
GENERATOR

I MAGNETIC
DISK

4

-17 (
i

22

CRT
- Ë
CONTROLLER (2
-- oo

AD MNE SIONA

MOUSE
DISPLAY
CONTROLLER CONTROLLER
KI,CI
30

RECORDER

OPTICAL
DISK

M·--

(POINTING ~27
DEVICE)
:

'19
23
20
26

COMMUNICATION
CONTROLLER
25

F I G. i

APLNDC00024611

U.S. Patent

Feb. 25, 1992

31
AREA '
, DETECTOR/
.

al
a
o

Sheet 2 of 8

33
i CURSOR
' SHAPE
SETTER

-

-

5,0 1,866

---

e
us

K/

WI
CI

.

(

34

/ CLICK

o

OUTSiDE
(35
WINDOW
\ SELECTOR
\

DETECTOR/

CLICK
L
\ INDICATOR I
29

32

INSIDE

220

TO
CORRESPONDING -30
TASK

FIG.2
WINDOW A

WINDOW B

B

A

K

F i F2 F3 F4

Fi

F2

F I G. 3

APLNDC00024612

U.S. Patent

Feb. 25, 1992

WINDOW A

Sheet 3 of 8

5,091,866

/

/

WINDOW B

A
K
'A

Fi
Fi

F2

-

F I G. 4A
-

A

WINDOW A

WINDOW B
B^

K

Fi

F I G. 4 B

81

Ft

F2

F2

Al

WINDOW A
WINDOW B

A

Al F I G.4C
Fl

F2

B

APLNDC00024613

U.S. Patent

Feb. 25, 1992

Sheet 4 of a

5,091,866

41

Fe
OO000000

CT KEY

43

(O 45tËCT KEY

44

KEY SPECIFYlNG UNIT

52

TO
CORRESPONDING

TASK

53

54

CRT CON:nuuLER

I

55

TO
CORRESPONDING

TASK

220
CRT
DISPLAY

22

F I G. 5

APLNDC00024614

U.S. Patent

Feb. 25, 1992

Sheet 5 of 8

5,091,866

WINDOW C
WINDOW D

DFi F2

D;AFi F2

-Ci

F

FIG.6A
WINDOW C
WINDOW D

~C

D-

F

Di- Fi F2

FIG.6B

APLNDC00024615

U.S. Patent

Feb. 25, 1992

(

Sheet 6 of 8

START

5,09 ,866

)

DIRECT THE CRT CONTR^I i = TO
REMOVE ine INTENSIFYING FRAME
FROM i ne FUNCT ION AREA OF THE ~ST 1
WINDOW CtRRENTLY OCCUPYING THE

FUNCTION KEY.

COMPu le THE NUMBER SUBSEQUENT
TO THAT OF THE WINDOW CURRENTLY
OCCUPYING THE FUNCTION KEY.
NOTIFY THE FUNCTION NOTIFYING
UN IT THAT I nc COMPUTED NUMBER

IS USED AS THE NUMBER OF THE
WINDOW NEWLY OCCUPYING THE
FUNCTION KEY.

DIRECT THE CRT CONTROL1£R TO
DISPLAY THE INTENSIFY1NG FRAME
IN THE FUNCTION AREA OF THE
WINDOW OCCUPYlNG THE NEW
FUNCTION KEY.
(

END

ST2

~ST3

ST4

)

F I G.7

APLNDC00024616

U.S. Patent

Feb. 25, 1992

Sheet 7 of 8

.

5,091,866

WINDOW A
i

~A

WINDOW B
K(RED)

Fi

F1

F2

F2

--Al

FL G. 8 A

gg

WINDOW A
WINDOW B

B-

/

(GREEN)

Fi

F I G.8B

81

F1

F2

F2

Al

WINDOW A

l

^

WINDOW B

K (RED)

A*
F1

F2

F I G. 8C

St

APLNDC00024617

U.S. Patent

Feb. 25, 1992

Sheet 8 of 8

.

5,091,866

WINDOW A
WINDOW B

Fi

Fi

F2

-

F2

-

'At

F I G. 9A

B

WINDOW A
WINDOW B
BK
Fl

F2

F I G. 9 B

Ai

81
WINDOW A

WINDOW 8
i

K

FIG.9C
Fi

F2
81

APLNDC00024618

1

5,091, 866

2

means for displaying a distinguishing indicia in the

window area determined not to be a hidden window
area.
-•-DESCRIPTION OF THE DRAWINGS
5
These and other objects and features of the present
This application is a continuation, of application Ser.
invention can be understood through the following
No. 07/136,391, filed Dec. 22, 1987, now abandoned.
embodiment by reference to the accompanying drawBACKGRvom- OF THE INVENTION
ings, in which:
This invention relates to an information processing 10 FIG. 1 shows a block diagram of an information
processing apparatus according a first preferred emapparatus and, more particularly, to a multi-window
bodiment of this invention;
display controlling device of a data processor for conFIG. 2 shows a block diagram of a display control
trolling various types of operations by means of a cursection in the FIG. 1 circuit;
sor, which is moved by a pointer device such as a
mouse.
15 FIG. 3 shows an example of display where two windows are displayed partially overlapping;
Information processing apparatuses having a multiFIGS. 4A to 4C show an example of a display further
task/multi-window system are well-known. In such an
explaining the display operation of FIG. 3;
apparatus, a cmsor is displayed on a CRT screen, for
FIG. 5 shows a diagram illustrating a keyboard and
example, and is moved to a predetermined location on
its related circuit;
the screen by means of a pointing device such as a
FIGS. 6A and 6B show displays explaining the operamouse, to designate a desired processing operation.
tion of the circuit of FIG. 5;
In the information processing apparatus, if the cursor
FIG. 7 shows a flow chart further explaining the
is moved to a specific area on the CRT screen, the shape
operation of the circuit of FIG. 5; and
of the cursor is changed to show the operator the comFIGS. BA to 8C and 9A to 9C show other examples
mand that will be executed when the mouse is operated.
of displays.
For example, when a line is typed and echoed onto the
screen, the cursor is shaped like a "pen." To move a
DET - -· -· - DESCRIPTION OF THE
displayed object, the cursor is shaped like a "pincette."
PRcrrm e rv errv:-IMENTS
A preferred embodiment of this invention will be
Indicating a command by an exact shape at the spedescribed referring to the accompanying drawings.
INFORMATION PROCESSING APPARATUS
DISPLAYING MUL- --- - WINDOWS AND
DISTINGUISHING INDICIA

cific cursor location makes it easy for an operator to
understand the operation performed by the command.

FIG. 1 shows the construction of an information

processing apparatus. Main controller 11 comprises
In such a multi-task/multi-window apparatus, a pluCPU 12, main memory 13, page buffer 14, companderrality of windows are displayed on one screen of the 35 /expander 15, pattern generator 16, and display interCRT display and tasks corresponding to those windows
face 17, as shown in FIG. 1. CPU 12 is operable in a
are executed concurrently. If the cursor shape is
multi-task mode for executing various types of operachanged every time the cursor is moved to a specific
tions. Main memory 13 stores a control program, for
location in each window in such a multi-task/multi-winexample. Page buffer 14 has a memory capacity of 512
dow data processing apparatus, the operator is often 40 kilo bytes (= 128 blocks), for example. Compander/exconfused.
pander 15 compresses and expands the image data. As is
In this type of data processing apparatus, windows
known, data compression reduces data redundancy and
frequently partially overlap. If the cursor shape is
data expansion restores the original redundancy of the
changed when the cursor is below an overlapping windata. Pattern generator 16 stores the data in patterns
dow, the changed shape of the cursor does not present 45 comprised of characters and symbols.
any effective information to the operator because the
Two dimensional scanner 19 scans an image on a
cursor is in the limited part of the window not being
docùment by laser beams, for example, and produces
displayed. Additionally, every time the cursor is moved
electrical signals representing the image data read in.
on the CRT screen, the system must determine the
Optical disk 20 sequentially stores the image data,

position of the cursor relative to the various to the 50 which is supplied from two dimensional scanner 19
various window regions resulting in increased response
through main controller 11.
time for the system.
Keyboard 21 is used for entering the retrieval data
relating to the image data and various typesofoperation
SUMM^RY OF THE --- --· -ON
commands. The output signal ofkeyboard 21is supplied
It is an object of the present invention to provide a ss to CPU 12 via keyboard controller 21a. .
new and improved information processing apparatus in
A cathode ray tube display device 22 (referred to as
which the operation is smooth even when an indicia,
a CRT display) displays the image data, which is colsuch as the cursor, is moved on the multi-window dislected by two dimensional scanning device 19 and supplay, and the response time of the indicator is reduced.
plied to CRT display 22 through main controller 11.
According to the present invention, there is provided 60 CRT display 22 also displays the image data, which is
an information processing apparatus comprising:
read out from optical disk 20 and supplied to CRT
means for displaying a plurality of window areas,
display 22 through main controller 11. CRT display
each of which includes information to be processed,
device 22 is controlled by CRT controller 22a. CRT
controller 22a controls the display of multi-windows
wherein a window area at least partiallÿ overlapped and
hidden by others of the plurality of windows defines a 65 and the display of the cursor moved by a pointing dehidden window area,
vice.
Recorder 23 is a printer, for example, and prints the
means for determining a window area which is not a
image data, which is collected by two dimensional scanhidden window area, and

APLNDC00024619

3

5,091,866

4

previous image data. When function key 1 is operated in
ning device 19 and supplied thereto through main conwindow A, the enlargement processing of the image
troller 11, or the image data, which is read out from
data displayed in window A is executed.
optical disk 20 and supplied thereto through main controller 11.
As described above, when cursor K is located in the
Magnetic disk 24 stores a table of titles (also called 5 area of windows other than the top window, the shape
of cursor K is set to the standard shape. Under this
retrieval data), which are respectively assigned to the
condition, if mouse 27 is operated and cursor K is
image data.
moved to the area of the top window A, cursor K is
Communication controller 25 is coupled with au

changed to the shape in window A as shown in FIG.
cxternal device via -.......: .tion line 26, and transmits an image retrieval request signal and the retrieval 10 4(A). As shown, the cursor contains character "A".
data, for example, and receives an image retrieval request signal and the retrieval data, and supplies them to

Under this condition, mouse 27 is operated, and cursor
K is moved form the area of window A to that of win-

main controller 11.

dow B. The shape of cursor K is changed to the stan-

dard shape again. In this display state, if click button 28
Mouse 27 is a kind of pointing device. Mouse 27 is
connected to mouse controller 29. Mouse controller 29 15 of mouse 27 is operated, windows A and B are inter-

outputs a position signal KI as an indicia ofCRT display
22, and operation signal CI indicative of an operation
state of click button 28. These signals output from
mouse controller 28 are supplied to display controller

changed, as shown in FIG. 4(c), with window B becoming the top window.Under this display state, ifcursor K
is in the area of window B, cursor K is changed into the

shape of window B.
30,
20
As shown in FIGS. 4A and 4C, when cursor K is
moved to the top window A or window B, the click
FIG. 2 shows a block diagram of display controller
button 28 of mouse 27 is operated and the position data
30. The cursor position signal KI output from mouse
controller 29, together with a window position signal
of cursor K is sent to the task corresponding to the top
WI supplied from CPU 12, is supplied to area detector
window, and a predetermined process is executed.
31. This area detector 31 detects the cursor movement 25 According to this embodiment, when the cursor is in
into or out of the area of the window currently located
the top window, its shape is changed to the shape in the
top window. When the cursor is moved to other winat the frontmost position on the screen (referred to as
the top), on the basis of the input cursor position signal
dows than the top window, the shape of 'cursor is
changed into the standard shape. Therefore, the operaKI and the window position signal WI. This detected
output signal is supplied to selector unit 32 and cursor 30 tor can easily understand to which window the cursor
shape setter 33. Cursor shape setter 33 sets the shape of
corresponds, and the operator's recognition tasks are
cursor to a standard shape when the detected output
made easier.
signal from area detector 31 represents cursor moveIn moving the cursor it is necessary to check only
ment out of the window. When the cursor moves into
whether the cursor is in the top window. This fact leads
the window, cursor shape setter 33 sets the unique or 35 to the improvement of the processing speed and the
distinguishing cursor shape corresponding to that of the
response speed of the cursor.
window currently located at the top, or frontmost posiWhen the cursor is moved to any windows other than
tion. The output signal of cursor shape setter 33 is supthe top window, and the click button is operated, the
plied to CRT controller 22a. Operation signal CI output
top window is changed. This feature makes the data
from the mouse controller 9 is supplied to click detector 40 processing apparatus easier to operate.
34. Click detector 34 detects a transient state of the
Keyboard controller 21a will now be described. As
seen from FIG. 5, keyboard 21 contains function keys
input operation signal when it changes from an off-state
41, normal keys 42, function select key 43, and order
to an on-state. The detected signal is supplied to selector
select key 44. Normal keys 42 consist of hiragana (Japa32. Selector 32 sends a signal to window selector 35
when the cursor is located outside the top window. In 45 nese phonetic symbols) keys, alphabet keys and the like.
response to this signal, window selector 35 outputs a
Function select key 43 selects either of function keys 41
select request signal to CRT controller 22a. The select
or normal keys 42. Order select key 44 selects the order
request signal requests the CRT controller to move the
of windows.
window currently indicated by the cursor to the top. If
Keyboard controller 21a contains a key specifying
selector 32 decides that the cursor is present in the top 50 unit 51. By using the key code input from keyboard 21,
window, click indicator 36 notifies the task correspondthis unit specifies function keys 41, function select keys
ing to the top window of the cursor position data.
43, order select key 44, or normal key 42. When key
The operation of the data processing apparatus thus
specifying unit 51specifies the function key by the input
key code, the input key code is input to function notifyarranged will now be described.
FIG. 3 shows an example of display by CRT display 55 ing unit 52. When the key specifying unit 51 specifies
22. As shown, CRT display 22 displays two windows A
the function select key, the input key code is input to
and B overlapping with each other and also displays
function key select unit 33. When the input key code
cursor K. These windows A and B respectively contain
specifies the order select key 44, the input key code is
function areas Al and B1 each containing commands
input to order select unit 54. When the key code is for
corresponding to the function keys. In this display, 60 the normal keys 42, it is inpat to normal key notifying
unit 55.
some items ofimage data are retrieved from optical disk
device 20, using a function key in the window A, and
Function notifying unit 52 transfers the input function
the retrieved data is displayed in window B. In this case,
key code to the task operating in the window having the
ownership of the function key.
to sequentially display a plurality of retrieved image
data in window B, function key I or 2 is operated for 65 Function key select unit $3 switches the window
having the function ownership from the current winwindow A. Function key 1 directs the display of the
dow to another window, and notifies the function notiimage data next to the image data currently displayed in
fying unit 52 and CRT controller 22a of the window
window B. Function key 2 directs the display of the

APLNDC00024620

5,091,866
having a new function key ownership. CRT controller
22a controls the CRT display so that the window hav-

6

blinking pattern in at least one window, for example, as
shown in FIGS. 9A to SC. The designer can use any

ing the function key is displayed in an intensified man-

method to distinguish the indicia displayed in the top

ner.
window from those displayed in other windows while
Order select unit 54 is used for selecting a desired 5 remaining within the scope and spirit of the present

order of the window, and notifies normal key notifying
unit 55 and CRT controller 22a, of the new top window. CRT controller 22a updates the screen of CRT

inventioli.
What is claimed is:
1. An information processing apparatus comprising:

display 22 according to the signal from order select unit

means for displaying a plurality of window areas,

code to the task operating in the top window, according
to the signal supplied from order select unit &

ity of distinguishing indicia, wherein a window
area at least partially overlapped and hidden by

FIGS. 6A and 6B show display examples of CRT
display 22, respectively. As shown, windows C and D

others ofsaid plurality of windows defines a hidden
window area;
means for determining a window area which is not a

R
Normal key notifying unit 55 supplies a normal key 10

are displayed overlapping with each other. Function
areas C1 and DI are contained in each of windows C
and D. Names of commands, which are executed by
each of the function keys are displayed in function areas
C1 and D1. For example, when function key 1 is opersted in window C, the enlargement of the image being
displayed in window C is executed. Intensifying frame
F is displayed in the function area of the window cur
rently having the function key ownership. When the
operator sees the mtensifying frame F, the operator
knows what command is to be executed by operating
the function key 31 on keyboard 21
FIG. 7 shows a flowchart for explaining the opera~
tion of function key select unit 53. Function select key
ymg t Isai
o un n y
t 3

15

each of which includes information to be processed
and each ofwhich has an associated one of a plural-

hidden window area; and

means for causing display, in the window area determined not to be hidden window area, of a distinguishing indicia associated with the window area
20
determined not to be a bidden window area.
2. An apparatus according to claim 1, wherein said
distinguishing indicia has a predetermined shape.
3. An apparatus according to claim 1, wherein said
distinguishing indicia has a predetermined color.
2s

4. An apparatus according to claim 1, wherein said
distinguishing indicia has a predetermined blinking
state
5. An apparatus according to claim 1, wherein said
~ distinguishing indicia has a predetermined cursor shape.

function area intensifying frame of the window currently having the ownership of the function key. This is
done in step ST1. In step ST2, a window number different from that of the window currently having the func- 3s
tion key ownership is computed. Subsequently, in step
ST3, the window bearing the computed number is
transferred as a new window having the function key
ownership, to function key notifying unit 52. In step
ST4, control directs CRT controHer 22a to display the
intensifying frame in the function area of the new win- 40
dow.
FIG. 6A shows the display when the window D has
the ownership of the function key.Underthis condition,
if function select key 43 is input, the intensifying frame
is displayed in the function area C1 of window C, as 45
shown in FIO. 6B. The display apparatus is placed in a
state that the command in window C can be specified by
the function key.
As seen from the foregoing description, when the
area detector 31decides that the indicia is located in the y
area in the top window as displayed by the display
means (CRT 22), the shape setdag means (the cursor
shape setter 33, for example) changes the shape of the
indicia into the shape as set in that window. When the
indicia is located in any window other than the top
window being displayed, the shape of the indicia is
changed into the standard shape. in this way, the indicia
can be discriminated for each window. Even if the
cursor is moved the operator can smoothly operate the
display apparatus without being confused. Furthermore, the response speed of the indicia is improved.
It should be understood that this invention may variously be changed and modified within the scope of the
invention.
In the above-mentioned embodiment, the shapes of
indicias are different, thereby identifying specific win. 65
dows. Also, the color ofthe indicia may be changed for
the same purpose as shown in FIGS. 8A to SC. Additionally, the indicia may be intermittently activated in a

6meanbs
i p an
à dow areas,
each of which has an associated task, at least two of
said plurality of window areas being displayed in
an overlapping manner;
means for determmmg an uppermost window area
and another window area of the plurality of window areas, wherein at least a portion of the other
window area is covered by the uppermost window

area; and

means for causing display of a distinguishing indicia
in the uppermost window area and for displaying a
standard indicia in the other window area.
7. An apparatus according to claim 6, wherein said
standard indicia has a different shape from a shape of
said distinguishing indicia.
8. An apparatus according to claim 6, wherein said
standard indicia has a different color from a color of
said distinguishing indicia.
9. An apparatus according to claim 6, wherein said
standard indicia has a different blinking state from a

blinking state of said distinguishing indicia.
10. An apparatus according to claim 6, wherein said
standard indicia has a different cursor shape than a
cursor shape of said distinguishing indicia.
11. An information processing apparatus comprising:
means for displaying a plurality of window areas and
an indicia, wherein each of the window areas has
an associated task and an associated distinguishing
indicia, said displayed indicia being one of the distinguishing indicia, and wherein a windowarea not
overlapped by others of said window areas defines
a top window area;
means for moving the indicia displayed on said display means;
means for determining the top window area; and .
means for changing said indicia to a distinguishing
indicia corresponding to the top window area
when said moving means moves the indicia intothe
top window area.
* * * * *

APLNDC00024621

EMIEEElilililli
US005640498A

United States Patent [19]

ini Patent Number:

Chew

[451 Date of Patent:

[54] ACCESSBARARBITER

(73] Assignee: WMid Corporation, Redmond,
'
|21] AppL No.: 468,453
[22] Filed•
Jun. 6, 1995
.

[52] U.S. Cl· ....
[58] Field of Search
[56]

GO6F 15/00

bars. Thus, for the abcessbars displayed on a computer

395/133
395/138, 133,
395/162, 164; 345/117, 118

display to operate together. a centralized mechanism for
governing accessbars' location and behavior is desirable.
The system described herein provides such a medianism,
known as an accessbar arbiter. The system described hereia
governs accessbats' location by receiving requests for proposed locations and by granting therequests if the proposed
locations would not conflict with another accessbar. If such
a conflict would occur, the systemdescribedhereinprovides
an alternate location. The system described herein governs
accessbats' behaylor by providing a number of notiñcations

References Cited
U.S. PATENT DOCUMENTS

5,424,966 6/1995 Hirayama .....-.
... 395/155
Mry Emmineau K. Nguyen
Attorney, Agent, or Firm-Seed and Berry LLP
[57]

Jun. 17, 1997

negatively affecting another screen object. An example of
these screen objects includes accessbars. An accessbar is a
consistently visible user interface element that trovides a
user with access to computer pregems. In a computer
system, accessbars are typicaRy anchored at the edge of the
display and there is no limit to the number of accessbars that
can appear on the displayat a given time, thus problemsmay
arise. For example, more than one accessbar may wish to be
displayed at a given location. In addition, the functionality
of one accessbar may affect the processing of other --

[75] Inventor Chee Hcag Chew, Redmond, Wash.

[51] Int. CI.'

5,640,498

ABSTRACT

to the accessbars whenever an event occurs that may affect
the processing of the accessbars. Such an event includes

As accessbar arbiter is provided that resolves conûiedng

changes to another accessbar on the same side of the display.

requestsfrom screen objects fut locations on avideo display.

or the start of afullscreen application, such as a screen saver.

In addition, the accessbar arbiter governs the behavior of
screen objects so as to prevent one screen object from

24 Ciahns, 18 Drawing Sheets

100

102
CPU

104
Mouse

120

106

Memory

114

Application
Program
Operating
System

108
Keyboard

Storage

116

122

Video Display

'

118

APLNDC00024622

U.S. Patent

Jun. 17, 1997

Sheet 1 of 18

5,640,498

100

102

104

CPU

-

Mouse

120
106

108

Secondaty
Storage

-

Keyboard

112

110

Mernory

116

122

Video Display

Application

Program
114

Operating
System

-118
,

119 -·7

FIG. 1

APLNDC00024623

U.S. Patent

Jun. 17, 1997

Sheet 2 of 18

5,640,498

110

2ee

- 204

208

208

210

212

FIG. 2A

APLNDC00024624

U.S. Patent

Jun. 17, 1997

Sheet 3 of 1s

5,640,498

110

203

'
204

208

gge

- -210

202
212

FIG. 28

APLNDC00024625

U.S. Patent

Jun. 17, 1997

Sheet 4 of 18

5,640,498

110

200

218

41

202
204

208

2 8

210

214\212

na ac

APLNDC00024626

U.S. Patent

Jun. 17, 1997

Sheet 5 of 18

5,640,498

110

200

APLNDC00024627

U.S. Patent

Jun. 17, 1997

Sheet 6 of 18

5,640,498

He

244

X:

'abiš>

.

4:LP,, s,.

not

.:: ,..,b.t<., . L A A.' "' é<.

'A

,2 A;A '

.

ai'

V/ af

r k"

x,,> R. ..«¾¢...?,.sk. ..«<:,5.. .. W 4..dsats. .4

228

APLNDC00024628

U.S. Patent

Jun. 17, 1¾

Sheet 7 or is

5,640,498

it0

200

204

206

208

210

212

APLNDC00024629

U.S. Patent

Jun. 17, 1997

Sheet 8 of 18

5,640,498

Accessbar

Arbiter

302
Receive
Registration
304
Register
Accessbar

N

306
Receive
Deregistration

Y

N

Accessbar

0
Position Request?

312
View state ofvideo
N

suitable position
for the accessbar

314
Event Occur?

Y

'
316
Send notification
to the application

N

programs having
a registered
accessbar

FIG. 3

APLNDC00024630

U.S. Patent

Jun. 17, 1997

Sheet 9 of 18

5,640,498

110

200

4 '

APLNDC00024631

U.S. Patent

Jun. 17, 1997

Sheet 10 of 18

5,640,498

110

20e
.:
de

a;:a y a A
te

4 :

'

s

?

5-

4Ú

Aan

+-^>3 >; .

.

:..

7

//

*

'

' . ; ^. :- . 22:}:

', :·.

'

. A:4

:,)

202

FIG. 48

APLNDC00024632

U.S. Patent

Jun. 17, 1997

Sheet 11 of 18

5,640,498

110

aos

404

APLNDC00024633

U.S. Patent

Jun. 17, 1997

sheet 12 of is

5,640,498

Arbiter

502
Wait Until
Receiving an Event

504
Is it an

ABM NEW

Y

Message?

506
Add Data

N

Structure to List
508

Is it an
ABM_REMOVE
Message?

)

Y

510

N

Remove Data
Structure from List

512
Is it an

ABM Qutw YPOS
Üessage?

514
Determine if any

N

A

Portion of Rectangle
is Being Used
516
Return Usable
Portion of
Rectangle

FIG. 5A

APLNDC00024634

U.S. Patent

Jun. 17, 1997

Sheet 13 of 18

5,640,498

A

518
Is it an
ABM SetPos
Message?

520
Determine ifany
Portion of Rectangle
is Being Used

522
Shrink Work Area
of Display

N

524
Broadcast
ABN POSCHANGED
Notification

V

526
Is it an
ABM_WindowPoschanged
Message?

Y

528
Broadcast
ABN POSCHANGED
Notification

N

530
Is it an

y

ABM GETAUTOHIDEBAR
Message?

532
Return Hwnd ofthe
AutoHide Accessbar
on the Specified Side

N

534
Is it an

ABM SETAUTOHIDEBAR
Message7

Y

536
IfThere is Already an

N

AutoHide Bar on the
Specified Side,
Reject This Attempt.

C

Otherwise, Allow It.

FIG. 58

APLNDC00024635

U.S. Patent

Jun. 17, 1997

Sheet 14 of 18

5,640,498

c
538
Is it an
ABM_GetSW
Message?

Y

540
Return Visibility
State ofTask Bar

N

542
Is it an

ABM_GETASKBARPOS
Message?

544
Return Position
ofTask Bar

N

546
Is it an
ABM _Activate
Ivlessage?

548
Pop AutoHide Hot
N

Bar to Top

550
Positr

552

N

Broadcast
N POSCHANGED

D

554

Did Visibility

N

Change?

Y p 556
FIG. 5C

Bmadcast
_STATECHANGED

B

APLNDC00024636

U.S. Patent

Jun. 17, 1997

Sheet 15 of 18

5,640,498

D

558
Full Screen
Application Start
or Finish?

Y

560
Broadcast
ABN_r ooLSCREENAPP

N
562

User Rearrange
Windows?
N

Y
564
Broadcast
ABN_WINDOWARRANGE

FIG. 5D

APLNDC00024637

U.S. Patent

lun. O, 1997

Sheet 16 of 18

5,640,498

Application
Program

602
Send an ABM_NEW,
Quey_POS and a
Set POS Message

604
Wait Until Receiving
an Event

606
Receive a
WM ACTIVATE
Message?

Y

608

N

Send ABM_Aouv ATE
Message

610
User Resize

Y

or Move?
612
Validate Attempt, Move

N

Window and Send
ABM_WINDOWPosChanged
Message

614

User Request

Y

h

AutoHide Mode?
616
N
E

Send ABM SetAutoHide,
Display on AutoHide
Accessbar and Send an
ABM_Remove

FIG. 6A

APLNDC00024638

U.S. Patent

Jun. W, 19W

Sheet U of 18

5,640,498

E

618
User Request
Non-AutoHide

y

Mode?

N

Send an ABM_SetAutoHide,
ABM New,
ABM_QueryPOS, and
ABM SetPos Message

.
622

.

Receive an
ABN_POSCHANGED
Notification?

Y

620

I

I

y

626

Recive
ABN_STA i roxyGE7

y

Determme Size, Send a
QueryPos and SetPOS
Message and Move the
Accessbar

624

Send an
ABM GetState
Message

N

628

N
If the Always-On-Top V- 630
ofthe Task Bar Changes,
Change the Accessbar's
Mode Accordingly

632
Receive
ABN_FullScreenApp9

Y

634
Starting the
Application?

N
G

N

Y

638
Push Accessbar
to Bottom

636
Pop Accessbar
to Top

FIG. BB

- '

F

APLNDC00024639

U.S. Patent

Jun. 17, 1997

Sheet 18 of 18

5,640,498

G

640
Receive
ABN_WindowArmnge?

Y

642
N

Push Accessbar to
Bottom and Pop When
Receive Another
ABN _WindowArrange

Terni ina

Nr

646

Send ABM Remove
N

and Terminate

Accessbar

F

APLNDC00024640

5,640,498
1

2

ACCESSBAR ARBITER

containing a proposed location af the screen object on the

TECHNICAL FIELD

screen object at theproposedlocation. When itis detemdned
that the screen object is to be displayed at the proposed
location, the computerprogram displays the screen object at
the proposedlocation on the video display. However, when
it is determined that the screen object is not to be displayed
at the poposed location, the arbita detennines an altemative location, and the computerprogram displays the smeen
object at the alternative location on the video display.
In accordance with a second aspect of the present
invention,adataprocessingsystemisprovidedthatincludes
a video display for displaying a plurality of screen objects
and a memory. The memoryfurther comprises an arbiter and
a compute program. The arbiter has a receive component
for receiving a request to display a smeen object at a
requested location. The arbiter also has a detamination
component for determining whether to display the saeen
object at the requested location. Further, the arbiter has a
location component for dernmining an alternative location
when the determination component determines not to display the screen object at the requested location and the
arbiter has an indication component for returning an indicated location. The indicated locatîon is the requested location when the determination component detennines to display the smeen object at the requested location. The
indicated location is the altemative location when the determination component determines not to display the screen
object at the requested location. The computer program
sends the request to the arbiter to display the screen object
at the requested location, receives the indicated location
from the arbiter and causes the video display to display the
screen object at the indicated location.

video display. The arbiter determines whether to display the

This invention relates generally to data processing systems and, more particularly, to the management of accessbars on a video display of a data processing system.

BACKGROUND OF THE INVENTION
Today's computer systems typically display screen 10
objects on the video display of the computer system. A
screen object is a user-visible object displayed on the video
display 1hat conveys infonnation to the user. It is common

for more than one smeen object to be displayed on the video
display at a time. Thus, conflicts arise when two screen 15
objects wish to be displayed at the same location on the

video display. In conventional computer systems, these
condicts are left unresolved.

Thee are other types of conflicts that arise between
screen obje<ts displayed on a video display. For example, *
one screen object may perform functionality that can have
an effect on. another screen object. Such functionality
includes when one screen object moves so as to ovedap a

second screen object, thereby preventing the second screen
objectfrom being visible. These condicts are left unresolved
by conventional cornputer systems.
SUMMARY OF THE INVENTION

An accessbar arbiter is described herein that resolves
connicting requests from screen objects for locations on a
video display. In addition, the accessbar arbiter govems the
behavior of screen objects so as toprevent one screen object
from affecting another screen object. An exaruple of these
screen objects includes accessbars. An accessbar is a consistently visible user interface element that provides a user
with access to computer programs. In a computer system,
accessbats are typically anchored at the edge of the display,
and there may be many accessbars that can appear on the
displayat a given tirne,thus potentialconflictsmay arise that
require arbitration. For example, mate than one accessbar
maywish to be displayedat a givenlocation. In addition,the
functionality of one accessbar may affect the processing of
other accessbars. Thus, for the accessbare displayed on a
computer display to operate together, a centralized Manism for governing accessbars' location and behavior is
deskable. 'Ibe system described herein provides such a
mechanism, known as an accessbar achiten The system
described herein governs accessbars' location by receiving
requests for proposeslocations and by grandng the requests
if the proposed locations would not conBict with another
accessbar. If such a con0ict would occur, the system
described herein provides an alternate location. The system
described herein govems accessbats' behavlorbyproviding
a number of notlâcadons to the accessbars whenever an
event occurs that may affect the proœssing of the accessbars. Such an eventincludes changes to anotheraccessbar on
the same side of the display or the start of a fullscreen
application, such as a screen savec
In accordance with a first aspect ofthe present invention,
a method is practiced in a computer system having a video
display for displaying screen objects, a computer program
for causing the video display to display one of the screen

so

a

4o

4s

so

ss

BRIEF DESCRIPTION OFTHE DRAWINGS
FIG. I depicts a computer system suitable for pradicing
the preferred embodiment of the present invention.
FIG. 2A depicts a taskhar displayed on the video display
of the computer system of PIG. 1.
FIG. 28 depicts aa appbar displayed with the taskbar of
FIG. 2A.
RG. 2C depicts a window displayed after the invocation
of a taskbar button on the taskbar of NG. 2A.
NG. 2D depicts the movement of the taskbar of RG.2A
from the bottom edge of the video display to the left-hand
side edge (relative to the user) of the video display and the
resulting displacement of the icons on the video display
from their original location.
MG. 2B depicts the taskbar of FIG. 2A as it appears in
autchide mode.
MG. 2F depicts the displaying of the taskbar of FIG. 2E
in autohide mode after the user has touched the hotbar with
the mouse cursor.
FIG. 3 depicts a flowchart ofa functional overview ofthe

accessbar arbiter of the preferred embodiment of the present
invention.
FIG. 4A depicts the state af the video display of the
do computer system of HG. 1 containing a taskbar and two
appbats.
PIG.4B depicts the state of the video display after one of
the appbars of FIG. 4A has been moved from the bottom
edge of the video display to the right-hand side edge of the
video display.
FIG. 4C depicts the state of the video display after the
taskbar of FIG. 4A has been placed in autohide mode.

APLNDC00024641

5,640,498
3

4

122. The CPU 102 also has access to memory 112 and
FIGS. 5A, SB, 5C, and SD depict a ûowchart of the steps
secondary storage 106. The memory 112 holds copies of an
performed by the accessbar arbiter of the preferred embodiapplication program 116 and an operating system 114. The
ment of the present invention.
operating system 114 contains the accessbar arbiter 118 of
FIGS. 6A, 6B, and 6C depict a flowchart of the steps
the present invention. The
performedby an application programnuliving the accessbar 5 the preferred embodiment ofan appRcationprogram interaccessbar arbiter 118 provides
arbiter of the preferred emboclhnent ofthe present invention.
face 119 so as to allow access to the arbiter. Those skilled in
the art will appreciate that the accessbar arbiter 118 of the
DETAILED DESCRIPITON OF THE
present invention is not limited to beingpart of an operating
INVENTION
system; rather, the accessbar arbiter 118 may also be impleThe preferred embodiment of the present invention uti- 10 mented in an application program. For purposes of the
lizes an accessbar arbiter for resolving conflicts between
discussionbelow,itisassumedthattheoperatingsystem114
screen objects competing for a location on a video display.
is the "MICROSOFI" "WIblDOWS" 95 Operating System
In addition, the accessbar arbiter govems the functionality of
from Microsoft Coxparation. Those skuled in the art will
screen objects to prevent the functionality of one screen 15 appreciate that the present invention may also be practiced
object from negatively affecting another screen object. An
with other operating systems.
example of these sateen objects includes accessbars. An
Accessbars are typically implemented by either an appli"accessbar" is a general tamthat encompasses both taskbars
cation program 116 at the operating system 114 as a winand appbars. A "taskbar" is a consistently visible user
dow. A window is created based upon a window class. The
interface alcment that informs a user of which tasks are
window class identifies a window procedure that processes
active and have an active window. An active task is a
messages that are sent to the window. The operating system
computer program that is loaded into primary memory The
114 is a messagobased operating system such that operataskbar is constructed so that it is not obscurable by open
tions are achieved by passing messages between windows.
windows, unless the user so selects to obscure the taskbar.
The operating system114 supports a RegisterClass() funcThe taskbar also displays indicators or buttons used for
tion that enables an application to register window classes.
non..minimizing currently active task windows. The taskbar
The window procedure is a funcdon that receives and
includes a button for each active task. Users merely need to
processes messages that are sent to the window.
single click on a taskbar button provided for a task to open
In order to more fully understand the processing of the
the task window. These buttons may also be used to switch
accessbar arbiter ofthe prefen ed embodiment ofthe present
tasks. The taskbar usually remains anchored at a fixed
invention, the functionality of an accessbar Inquircremplalocation on the user interface (see FIG. 2&) which may be
nation. Thus, the fonowing description is presented in two
changed by a user. The tashbar runs typically as part of the
parts: first, an overview of the functionality of accessbars is
operating system and provides other functionality that is
presented and second, the details ofthe accessbar arbiter are
more cleady described in U.S. patent application Scr. No.
presented.
08ß54,916, entitled 'Taskbar With Start Menu," which is
Accessbar Overview
hereby incorparated by reference.
FIG. 2Adepicts an example afthe graphical userinterface
An "appbar" shares many of the same characteristics as a
provided by the operating system 114. A taskbar 202 is
taskbar withthe exception that an appbarprovides access to

positioned at the bottom of a virtual desktop 200 on the

computerprogrants that are both loadedinto memory as wel
video display 110. In the example shown in FIG. 2A, the
as not loaded into memory. An appbar serves as a shortcut 4e taskbar 202 is a rectangle that extends from the left-hand
to run related computer programs. Typically an appbar has
side (relative to the user) of the video display to the
a button for each related computer program to which the
right-hand side of the video display and is anchored to the
appbar provkles access. These buttons, unlike the compabottom edge of the video display. The taskbar 202 includes
rable taskbar buttons, are permanently visible. For example,
a start menu button 204 thatprovides access to programs so
a company that develops multiple computer programs may 45 that the programs may be invoked. The taskbar 202 also
implement an appbar with a button that provides access to
indicates the tasks that are active by displaying tashbar
each computer program so that users may have easy access
buttons such as buttons 206, 208, 210, and 212. A user
to the company's computer programs.
displays an active task window, for example, from the
In a computer system, there are usually a number af
taskhar 202 of FIG. 2A by positioning a mouse cmsor 214
accessbars that can appear on the display at a given time. so to point at a taskbar button using the mouse at other suitable
Since the accessbars are typically anch0ECÊ 8Í & ÍËICÊ
input device and then single clicking the mouse bution to
location, such as the edge ofthe display,problems may arise.
open the window associated with the task to display it in a
For example, more than one accessbar may wish to be
visible, non-minimized state. For example, FIG. 2C depicts
displayed at a particular location. Thus, the functionality of
a window 216 displayed in non-minimimi form after the
one accessbar may affect other accessbars. Thus, for the ss user has depressedtaskbar button 210 af the tashbarof PIG.
accessbars displayed on a computer display to operate
2A. The window 216 displays the user interface af the
together, a centralizedinerhanim for governingaccessbars'
Schedulee scheduling program available from Microsoft
location and behavior is desirable. The preferred embodiCorporation. However, with reference to FIG. 2B, on an
ment of the present invention provides such a mechanism,
appbar 203, the buttons 205, 207 refer to both computer
known as an accessbar arbita.
,a programs that are loaded into mamary and computa proFIG. 1is a block diagram of a computa system100 that
gramsthathavenotbeenloadedintomemory.Thus,clieking
is suitable for practicing the preferred etabodiment of the
on appbar buttons 205, 207 launches the computerprogram
present invention. The computer system 100 includes a
if it has not been loaded into mamary and thm displays the
central processing unit (CPU) 102, which has access to
window associated with the computer program in a nonseveral peripheral devices, including a mouse 104, a key- 65 minimimt form, regardless of whether
board 108, and avideo display 110. The mouse 104 includes
gram had been loaded into memory.
at Icast a left mouse button 120 and a fight mouse button
functionality of an accessbar in

APLNDC00024642

5,640,498
5

6

taskbar, however, it should be appreciated that an appbar

cursar214soas to toudithchotbar226andthercupon(FEG.

perfonns similst functionality.

As previously stated, although an accessbar is usually

anchoredto a side of the video displaÿ 110, it can be moved
to another side of the video display. The movement of an 5
accessbar occurs in response to user iEpUt. The îÿÿO Of USCO
inputrequired depends on theimplementation ofthe accessbar.Forexample,inardertomovethetashbar203shownin
FIG. 2A, the user moves Ihe mouse cursor 214 to refer to a
location on the taskbar without a taskbar button, depresses 10
the left mouse button and then moves the mouse to position
the mouse cursar near a diiEerent edge of the video display
110. FIG. 2D depicts the state of the video display 110 after
the mouse button has been released and a move of the

2F) the accessbar (e.g., taskbar 202) reappears and becomes
visible to the user.
The Accessbar Arbiter

The preferred embodiment of the present invention provides an accessbar arbiter to ensure that accessbars work
properly together and work propedy in response to outside
events, such as when a fullscreen application is invoked. A
"fullstreen application" is an application program that takes
total control of the video display by displaying information
at all portions of the video display. Examples of fuliscreen
applications include video games as well as screen savers.
Thus, when a fuuscreen appHcation is invoked, all accessbars should be informed so that they can relinquish control
taskbar 202 bas occurred. In general, when an axessbar has y, oftheirarea of the display.The accessbar arbiterensures that
beenmoved, anys<rcen objects (e.g., windowsoricons) 218
accessbars workproperlytogetherby actingas a centralized
currently being displayedwithin the area to be occupied by
mechanism that centrally manages all accessbars. This centhe accessbar are moved out of the way of the accessbar in
tralized management (or arbitration) is facilitated by applia direction toward the center of the video display. In this
cationprograms that display an accessbar sendingmessages
manna, the screen objects 218-2visible and accessible y to the accessbar arbiter andby the accessbar arbiter sending
to the user.
notifications to the application programs when an event
occurs. The messages, notifications andthe events for which
Each accessbar on the video display 110 typically has
properties associated therewith. These properties can be
accessed in a number of ways, such as.clicking the fight

the accessbar athiter sends the notifications are further
discussed below.

mouse button whenthemouse cursarrefers to an area of the y

FIG. 3 depicts a flowchart of a functional overview of the
accessbar arbiter of the preferred embodiment. Dming its
processing, the accessbar arhiter may .J.. registration
"autohide" Iroperty. The alwayson-top property refers to
requests, deregistration requests, andposition requests from
the accessbar being placed in a mode where it is always
application programs having an accessbar. In addition, the
displayed at the top of the Z ardo. The "Z order" refers to go accessbar arbiter deledsãf an event has occurred that may
the depth of the screen dbjects displayed on the video
affect the processing of the accessbars displayed on the
display H0. That is, the video display is typically viewed as
video display. The first step pcrformed by the accessbar
a two dimensional plane of points that are referenced using
arbiter is to determine if it received a registration request
Cartesian coordinates. Athird axis, the 'Z' axis, may also be
(step 302). If the accessbar arbiter received a registration
designatedthat identifies the logical depth of screen objects as request, the accessbar arbiter registers the accessbar by
on the video display.The '2 arder" refers to the order ofthe
storing information pertaining to the accessbar (stcp 304).
screen objects along the Z axis. The top of the Z order refers
This information is fmther described below. If the accessbar
to a screen object that appears closest to the user and is
arbiter did not receive a registration request, the accessbar
accessbar without a taskbar button. Two properties of par
ticular relevance are the "always-on-top" property and the

unobstructed by another screen object. Consequently, the

arbiterdeterminesifitreceivedaderegistrationrequest(step

bottom of the Z order refers to a screen ob¡ect that appears 4e 306). In this case, the accessbar arbiter deregisters the
fathest away from the user and can be obstructed by many
accessbar by deleting the stored information (step 308).
screen objects.
Upon registering an accessbar with the accessbar arbiter, an
applicationprogramcanmakearequestforapositionforthe
The always-on-topproperty has aparticular elfeet whena
accessbar on the video display. Thus, the accessbar arbiter
user attempts to resize or move a window on the video
display. When attengting to resize a window, the user is 4s may receive a position request (step 310). The accessbar
arbiter, afterreceiving thepositicarequest, views the state of
prevented fromresizing the window so as to encroach upon
an area of the video display 110 occupied by an amessbar.
the video display, determines if there are any other accessbars currently displayedat therequestedposition andreturns
In other words, the "wark area" af the video display 110 is
a response to the application program containing a suitable
reduced when an accessbar is displayed in always-on-top
mode. When an accessbar is placed in always-on-top mode so position for the accessbar (siep 312). The accessbar arbitcr,
in performing this processing, provides preferential treatand a window is moved so as to encroach upon the area
menttothetaskbar.Thatis,inthepreferredembodiment,the
occupied by the accessbar, the accessbar is displayed on top
taskbar does not request a position from the accessbar
of the encroaching window (i.e., at the top of the Z order).
arbiter.Instead,thetaskbarmerelymovestothepositionthat
Conversely, when an accessbar is not in always-on-top
mode,theusermayresizethewindowsothatitdocsovedap ss it prefers and the accessbar arbiter ensures that all other

accessbars accommodate the preferences of the taskbar. It
should be appredated that anothe embodiment of the
Similady, wheathe accessbaris not in always n-top mode,
present invention could have the taskhar communicate with
the accessbar arbiter.
the user may move the window so that it ovedaps the
accessbar.
so In addition to the functionality described above, the
Autohide mode refers to when an accessbar is initially
accessbar arbiter detects if an event has occurred that may
presented to the user such that the accessbar is invisible, as
afect the functionality of the accessbars displayed on the
shown in FIG. 2E. When invisible, instead of displaying the
video display (step 314). Such events include when a fuH
accessbar, a "hotbar" 226 is displayed that is only a couple
screen application has taken control of the video display,
of pixels in width so that it is barely visible to the user. The
same side as the applihotbar 226 acts as a mechanism for displaying an
movederrepositioned,
in a user visible manner.This is done by movingthe
the same side as the
the accessbar. 'Ihus, the work area of the video display
includes the area of the window occupied by the accessbar.

APLNDC00024643

5,640,498
7

8

theAppBarData structure is an idendfier that the ap¡iication
application program's accessbar has became autohidden. If
such an event occurs, the accessbar arbiter sends a notifiprogram specifies and that is returned to the application
cation to the application programs having a registered
program when the accessbar arbiter sends a notification to
accessbar that indicates the event that occared (step 316).
the application program. The "uEdge" elementrefers to one
Notifications are discussed in more detail below.
s of the edges of the video display, including bottom, left,
To illustrate the need for notifications, consider PIG. 4A,
right, and top. The "rc" parameter contains the bounding
rectangle, specliied in screen coordinates, of an accessbar.
which depicts three accessbars on thevideo display 110.One
ofthe accessbarsis the taskbar202 and two ofthe accessbars
The bounding rectangle specifies the perimeta or boundary
are appbars 402, 404. If appbar 402 were moved to another
of the accessbar. The use of the "LParam" clement depends
edge of the video display, the application program display- 10 upon the particular message and is discussed below.
ing appbar 404 needs to be notified so that it can reposition
Aspreviously stated, the SHAppBarMessagefunction has
the appbar closer to the taskbar 201 Otherwise, the area
a parameter that speciftes the message or notißcation being
previously occupied by the appbar 402 would become
transferred. These messages fallinto various categories that
unusable space on the video display 110. PIG. 4B depicts the
include: accessbar registration, accessbar posidon, autohide
state of the video display 110 after appbar 402 has been 15 accessbars and taskbar information. The messages, accordmoved to the right-hand edge of the video display in
ing to these categories, are depicted below in Table No. 2.
accordance with the preferred embodiment of the present
These messages and notißcations will be described in more
invention. In the preferred embodiment, the application
detail below.
program displaying appbar 404 is notified by the accessbar
arbiter of the movement of appbar 402 and in response, the 20
TABLE NO. 2
application program repositions the appbar 404 to prevent
Accessbar Registration
any wasted space on the video display 110.
ABM,_)TEW
Another example, referring back to FIG. 4A, is if the
ABNLREMOVE
taskbar 202 wcreplaced in autohide mode. If the appbar402
and 404 were not notified, the area of the video display that 25 Accessbar Position
Messages
was previously used for displaying the taskbar 202 would
became unusable space. FIG. 4C depicts the state af the
ABNLACTIVATE
video display 110 after the taskbar 202 has been placed in
ABM_QUERYPOS
autohide mode in accordance with the preferred embodiABNLßEIPOS
ment. The application programs that display the appbars 30
ABAL_WINDOWPOSCHANGBD
402, 404 have been notifred by the accessbar arbiter of the
Notifications
taskbar 202 beingplaced in autohide mode. In response, the
ABN._FULLSCREENAPP
application programs have repositioned the appbars 402,
404 to prevent any area of the video display 110 from
ABN_POSCHANGBD
becomingunused(i.e., closertothe bottomedgeofthe video 35 ABN_WEDOWARRANGE
display).
Auto-Hide Accessbars
In order for application programs to interface with the
ABhLGBTAUIOHIDEBAR
accessbar arbiter the accessbar arbiter provides an applicaABM.JSETAUTORIDEBAR
Hon program interface (API) 119. This APlis facilitated by
Tashbar Information
sending messages between an application program that
Messages
displays an accessbar and the accessbar arblier, and by
ABM GETSTÆE
sending notificationsfrom the accessbar arbiter to the appliÄBM-GEITASKBARPOS
cation programs having a registered accessbar.
Notification
Thismessage and notificationsendingisperformedbythe
SHAppBarMessage function that is provided by the opo 45 ABN_STATECHANGE
The ARKJNEW message is sent from the application
ating system. One parameter of the SHAppbarMessage
programto the accessbar athiter to legister an accessbar and
function is an identifier of the message or notificationbeing
to specify the message identifier that the accessbar arbiter
transferred. This parameter contains infounstion perimining
should use when sending notiûcation messages to the
to both messages and notifications. Anotherparameteris the
AppBarData structure, which is depicted la code Table No. so accessbar.Aftereceivingthis message, the accessbararbfter
states the data foundin theAppBarData structure into a list
L
that it maintains for all registered accessbars. The ABM
REMOVE message is sent by the application program to
CODE TAW E 1
indicate to the accessbar arbiter that it no longer wishes to
Opedef sonet..AggBeÐata
ss receive notifications or perform processing associated with
owoxD
ebSlæ;
an accesshar. In response to receiving this message, the
RWND
hWal;
accessbar arbiter removes the information relating to the
mNr
aca11backMems«
indicated accessbar from its intemal list.
mNr
uEdy
aser
w.
The ABMACITVAIE message is sent by the applicaunaux Leana
do tionprogramtotheaccessbarat6iteriaresponsetoreceiving
}APPBARDATA, •PAPPBARDATA:
theWMAC11VATEmessagefromthe operating system. A
WMACIIVÆE message is received by the application
The "cbSize" element of the AppBarData structure refers
program from the operating system when a user has actito the size of the AppBarData structure. The "hWad"
Vated (e.g., clicked on) the window of the appHcation
element of the AppBarData structure
handle di program. The ABR_QUERYPOS message is sent by the
application program to the accessbar arbiter to request a
of the
&&
that
proposedlocation for an accessbaron the video display.The

APLNDC00024644