Freshub, Inc. et al v. Amazon.Com Inc. et al

Filing 1

COMPLAINT ( Filing fee $ 400 receipt number 0542-12267080), filed by Freshub, Inc., Freshub, Ltd.. (Attachments: # 1 Exhibit 1, # 2 Exhibit 2, # 3 Exhibit 3, # 4 Exhibit 4, # 5 Exhibit 5, # 6 Exhibit 6, # 7 Exhibit 7, # 8 Exhibit 8, # 9 Exhibit 9, # 10 Exhibit 10, # 11 Exhibit 11, # 12 Exhibit 12, # 13 Exhibit 13, # 14 Exhibit 14, # 15 Exhibit 15, # 16 Exhibit 16, # 17 Exhibit 17, # 18 Exhibit 18, # 19 Exhibit 19, # 20 Exhibit 20, # 21 Exhibit 21, # 22 Exhibit 22, # 23 Exhibit 23, # 24 Exhibit 24, # 25 Exhibit 25, # 26 Exhibit 26, # 27 Exhibit 27, # 28 Exhibit 28, # 29 Exhibit 29, # 30 Exhibit 30, # 31 Exhibit 31, # 32 Exhibit 32, # 33 Exhibit 33, # 34 Exhibit 34, # 35 Exhibit 35, # 36 Exhibit 36, # 37 Exhibit 37, # 38 Exhibit 38, # 39 Exhibit 39, # 40 Civil Cover Sheet)(Palmer, John)

Download PDF
EXHIBIT 13 US010232408B2 (12) United States Patent (10) Patent No.: US 10 ,232,408 B2 Zsigmond et al. (45) Date of Patent: (54 ) SYSTEMS AND METHODS FOR SCANNING (56 ) INFORMATION FROM STORAGE AREA CONTENTS (71 ) Applicant: IKAN HOLDINGS LLC , New York , NY (US ) (72) Inventors : Fabio Zsigmond, Riverside, CT (US ); Mar . 19, 2019 References Cited U .S . PATENT DOCUMENTS 4,636 ,950 A 1/1987 Caswell et al. 5 ,478 ,989 A 12 /1995 Shepley (Continued ) FOREIGN PATENT DOCUMENTS Sion Elie Douer, New York , NY (US); Frederico Wagner, New York , NY (US ) Geraldo Yoshizawa, Sao Paulo (BR ) ; 100 17 503 Al 10 /2001 DE OTHER PUBLICATIONS (73) Assignee: IKAN HOLDINGS LLC , New York , NY (US) ( * ) Notice : Subject to any disclaimer, the term of this Supplementary European Search Report; Application No. 04713957 . 1 ; dated Sep . 3 , 2008 . (Continued ) patent is extended or adjusted under 35 U . S .C . 154 (b ) by 0 days . Primary Examiner — Andrew Joseph Rudy (21) Appl. No.: 16 /103,394 (74 ) Attorney, Agent, or Firm — Knobbe , Martens, Olson & Bear LLP (22 ) Filed : Aug . 14 , 2018 Prior Publication Data (65 ) US 2018 /0353998 A1 Dec. 13, 2018 Related U .S . Application Data (63 ) Continuation of application No. 15/ 905,591, filed on Feb . 26 , 2018 , which is a continuation of application (Continued ) (51) B07CCi7./04 Int. B07C 5 /34 (52) U .S. CI. ABSTRACT (57) The present invention is related to methods and systems for collected item information for stored items. In one embodi ment, a networked food storage system comprises a first sensor configured to read information from item tags coupled to items, wherein the items are stored or intended to be stored in a storage unit . A data store is configured to store food preferences for at least a first user. Instructions, stored ( 2006 . 01) ( 2006 .01) ( Continued ) in computer readable memory , are configured to : cause a first user interface to be displayed to the first user via which the first user can request a meal suggestion ; retrieve pref erence information for the first user from computer readable CPC ........... B07C 5 /34 ( 2013 . 01 ) ; G060 30 /0601 ( 2013.01); G06Q 40 /04 ( 2013 .01); H04M memory ; retrieve information read from at least a first item 1/6505 (2013.01); H04M 3/ 533 ( 2013 .01 ) preference information for the first user and item tag infor (58 ) Field of Classification Search CPC ...... B07C 5 /34 ; G06Q 40 /04 ; GO6Q 30 /0601 ; H04M 1/6505 ; H04M 3 /533 (Continued ) tag ; and provide a meal suggestion based at least in part on mation . 30 Claims, 8 Drawing Sheets 802 DIGITIZE AND RECORD SPOKEN ORDER TRANSMIT ORDER TO REMOTE SERVER 806 PERFORM VOICE RECOGNITION 808 DISPLAY TEXT VERSION OF VOICE ORDER TO USER FOR VERIFICATION 810 TRANSMIT ORDER TO ONE OR MORE PROVIDERS ( 812 RECEIVE QUOTE AND PROVIDE QUOTES TO USER 816 RECEIVE ORDER AUTHORIZATION TO USER PLACE ORDER US 10 ,Page ,2408 B2 232 Related U .S . Application Data 6 ,643 ,624 B2 No . 15 /604 ,422 , filed on May 24 , 2017 , now Pat. No. 9 , 908 ,153 , which is a continuation of application No . 11/301, 291, filed on Dec . 12 , 2005, now Pat. No. 9 ,821,344. (60 ) Provisional application No. 60/635 , 122 , filed on Dec . 10 , 2004 . (51) Int. Cl. G06Q 40 /04 ( 2012 .01) G060 30 / 06 ( 2012 . 01) H04M 3 /533 (2006 .01) H04M 1 /65 ( 2006 . 01) (58 ) Field of Classification Search USPC ........ 370 /352, 356 ; 379/88 . 1, 88 . 16 , 114 .01, 379/219; 455/ 150 . 1 , 405 , 406 , 414 . 1 ; 704 /231, 258 , 266 , 268, 270 . 1; 705 /28 – 30 ; 709/ 204, 217 – 219 See application file for complete search history . References Cited (56 ) 5 ,532,928 5 ,641,039 5 ,664, 110 5 ,699 ,525 5 ,712 ,989 5 ,841, 115 A A A A A A 5 , 901,203 A * B1 B1 B2 8 /2002 Sloane et al. 8 /2002 Fiordelisi 9 / 2002 Roh et al. B1 9 / 2002 9 / 2002 B2 10 / 2002 6 ,529 ,881 B2 * 3 /2003 B1 Schena et al. Cockrill et al. Morganstein ........ G06Q 20 / 206 Reams 704 / 251 6 ,530,518 B1 3 / 2003 Kirchilsky et al. 6 , 561,085 B15 / 2003 Durbin et al. 6 ,640 ,214 B1 10 / 2003 Nambudiri et al. 6 , 928,413 B1 6 , 934 , 279 B1 * 8 / 2005 8/ 2005 6 ,975 ,856 B2 12/2005 6 , 993 ,507 B2 1/2006 7 ,006 ,605 B1 * 2 /2006 7 ,013 , 292 B1 7 ,043, 457 B1 7 ,080 ,777 7 ,086 ,592 7 , 109 ,445 7 , 110 ,829 7 , 114 ,656 B2 B2 B2 B2 Bi 7 , 133 ,739 B2 7 , 165 ,721 B2 3 /2006 5 /2006 7 / 2006 8 /2006 Wagner et al . Bonora et al. Philyaw Odinak ... GIOL 15 /30 379 /88 .1 Philyaw Sollee ... .... ...... . H04M 1/2535 370 / 352 Ogasawara Meyer et al. Morganstein ........... G06F 21/ 32 379/ 88 .01 Hsu et al. Hansen Wagher et al. Wagner et al. 9 /2006 Patterson et al. 9 /2006 Cunningham et al. 10 /2006 Garver 11/2006 Williamson et al. 1 /2007 Wagner et al . 7 ,206 ,387 B2 * 4 /2007 Jan .... 7 , 246 ,745 7 ,281 ,655 7 ,295, 181 7 , 303, 124 7 , 328, 159 7 ,328 ,842 7 ,344, 063 Stanczyk et al. Dumont Green et al. Embutsu et al. Johnson et al. Shepley 5 / 1999 Morganstein ........... GIOL 17 / 22 379 /218 .01 5 ,914 ,472 A 6 / 1999 Foladare et al. 5 ,933, 829 A 8 / 1999 Durst 5 ,940, 074 A 8 / 1999 Britt et al. 5 ,957,695 A 9 / 1999 Redford et al. 5 , 960, 402 A 9 / 1999 Embutsu et al. 5 , 965, 858 A 10 / 1999 Suzuki et al. 5 , 969,317 A 10 / 1999 Espy et al. 5 , 978 ,773 A 11/ 1999 Hudetz et al. 5 ,979, 240 A 11/ 1999 Rix et al. 5 ,979, 757 A 11/ 1999 Tracy et al. 5 ,983, 199 A 11/ 1999 Kaneko 5 ,987, 440 A 11/ 1999 O 'Neil et al . 5 ,995 , 105 A 11/ 1999 Reber et al. 6 ,024 ,281 A 2 / 2000 Shepley 6 ,031,621 A 2/ 2000 Binder 6 ,034 ,660 A 3 / 2000 Kessenich et al. 6 ,047, 843 A 4 / 2000 Mecke 6 ,078 ,793 A * 6 / 2000 Satyamurti ............ HO1Q 11/ 12 375 / 301 6 ,085, 112 A 7 / 2000 Kleinschmidt 6 ,089, 453 A 7 / 2000 Kayser et al. 6 , 131,744 A 10 / 2000 Pratt 6 ,205 ,204 B1 * 3/ 2001 Morganstein . .......... GIOL 17/ 22 379 /67. 1 6 ,314 ,457 B1 11 /2001 Schena et al. 6 , 367 ,518 B2 4 /2002 Duncan 6 , 378 ,721 B1 4 /2002 Williams 6 , 386 , 386 B1 5 / 2002 George 6 ,425, 487 B1 7 / 2002 Emmott et al. 6 ,434 ,530 6 ,435 ,407 6 ,442, 952 6 ,446 ,979 6 , 457 , 177 6 ,473,740 B2 12 / 2003 B2 12 /2003 B1 1/2005 B2 * 4 /2005 7 ,229 ,015 B2 2 / 1996 Kumar 7 / 1996 6 / 1997 9 / 1997 12 / 1997 1/ 1998 11/ 1998 379 /88 .22 6 ,663,004 6 ,663, 148 6 ,845, 388 6 , 885 ,735 H04M 3/ 50 379 /219 7 ,224 ,779 B2 * 5 /2007 Finnigan ... ........ H04M 3 / 533 U . S . PATENT DOCUMENTS 5 ,489,773 A 11 /2003 Philipps et al. 6 ,662 , 163 B1 * 12/ 2003 Albayrak .............. H04M 3 /493 B2 B2 B2 B2 B2 B2 B2 7 , 373 ,317 B1 6 /2007 Persky 7 / 2007 10 / 2007 11/ 2007 12 /2007 2 /2008 2 /2008 3 /2008 379 /211. 02 Hudnut et al. Wagner et al. Alsio Wagner et al. Chang Wagner et al. Wagner et al. 5 /2008 Kopelman et al. 7 , 386 , 100 B2 6 / 2008 Michaelis 7 ,580 , 850 7 ,660 ,772 7 ,681,792 7 ,734 ,729 8 / 2009 2 /2010 /2010 6 /2010 7 ,392, 193 B2 * 6 /2008 Mault . .. . . . .. . . .. G06F 19 /00 704 /275 7,472 ,075 B2 * 12 /2008 Odinak .............. G06Q 30 /0266 455 / 150 . 1 B2 B2 B23 B2 Lurie Verkama Wagner et al . Du et al. 7 ,856 ,248 B1 * 12 /2010 Fujisaki ............... H04M 1575 455 /414 . 1 7 , 949 ,529 B2 8 , 131 , 093 B2 5 / 2011 Weider 3 / 2012 Kim 8 ,175 , 886 B2 * 5 /2012 Odinak .......... . GIOL 15 /26 8 , 320 ,958 B1 11 /2012 8 , 370 , 163 B2 * 2 / 2013 8 ,447 ,602 B25 / 2013 8 ,705 ,705 B2 4 / 2014 9 ,908 , 153 B2 * 3 /2018 2002/0008145 Al 1 /2002 2002 /0016731 Al 3 / 2002 2002/0059175 A1 5 / 2002 2002/0069137 A1 6 /2002 2002/ 0072923 A1 6 / 2002 2002/0073029 A1 6 / 2002 2002/0120502 A1 8 / 2002 2002 /0139848 Al 10 /2002 2002/0143550 Al 10/ 2002 2002/0161658 A1 10 / 2002 2002/0161704 Al 10 / 2002 2003/0034391 Al 2/2003 2003/ 0072488 Al 2003 /0164754 2003/0171944 2003/0195818 2004 /0100380 704 /270 . 1 Fujisaki Faisman ........... GIOL 15 /24 704 / 231 Bartosik Thenthiruperai Zsigmond ....... B07C 5 /34 Walsh et al. Kupersmit et al. Nakano Hiroshige et al. Guidry Cheaib et al. Sakaguchi Catan Nakatsuyama Sussman Powar Wagner et al. 4 /2003 Barsness et al. A1 9 / 2003 A1 9 / 2003 A1 10 /2003 A1 5 / 2004 Roseen Fine et al. Howell et al. Lindsay et al. 2004/0199545 Al 10 / 2004 Wagner et al. 2004 /0260513 Al 12 / 2004 Fitzpatrick et al. 2005 /0041840 Al 2 /2005 Lo US 10 ,Page ,3408 B2 232 References Cited ( 56 ) U . S . PATENT DOCUMENTS 2005 /0064900 A1 2005/0090233 A1 2005/0154560 Al 2005 /0189412 A 2006 /0218057 Al 2008 /0104596 A1 2008/0133264 A1 2008 /0306872 AL 2009 /0152348 Al 2014 /0214628 A1 2015 /0379607 A 2016 /0267565 AL 2017 /0293965 Al 2018/0005631 Al 3 /2005 7 / 2005 9 /2005 9 / 2006 5 / 2008 Goris et al. Fitzpatrick et al. Hudnut et al. Fitzpatrick et al. Buonanno et al. 4 / 2005 Chambers et al. 6 / 2008 Wagner et al. 12/ 2008 Felsher 6 / 2009 7 /2014 12/ 2015 9 / 2016 Ostrowski et al. Argue et al. Pedley et al. Katcher 10 / 2017 Sasaki et al. 1/2018 Lee et al. OTHER PUBLICATIONS Dietician -Healthy Eating Services, “ Transforming How Dietitians Offer Advice,” AirClic, 2001-2003 . International Search Report, International Appln . No. PCT-IB04 01076 , May 25 , 2005 . PCT International Search Report dated Feb . 24 , 2003. Shop Smart, Eat Right — Sample Grocery List, “ Guide Yourself to Healthier Eating,” Beeline Shopper, 2001 - 2002 . Shop Smart, Eat Right — Sample Recipes, “ Great Meals Made Easy,” Beeline Shopper, 2001 - 2002. Shop Smart , Eat Right, “ Healthier, More Nutritious Meals,” Beeline Shopper, 2001- 2003. * cited by examiner U . S . Patent ++ +++ +++ + NETWORK INTERFACE Mar . 19, 2019 Sheet 1 of 8 mm801 US 10,232 ,408 B2 Tannrennnnnnn INTERFACE INTERFACE DDDDDDDDDD 106 NAN RECIPIES CONTENTS TE USER PREFS. FIG . 1 U.S.Patent mann mom U . S . Patent Mar . 19 , 2019 121, US 10 ,232 ,408 B2 Sheet 2 of 8 208 7210 SCANNER SCREEN SCANNER 206 204 VAN LOCAL COMPUTER REFRIGERATOR - 202 REFRIGERATOR 1220 MICROPHONE / 1203 CAMERA REMOTE SYSTEM LY (scanner) Shelf 1 Shelf 1 (scanner ) Shelf 1 212 ( scanner ) ????????????????????????? CABINET FIG . 2 U . S . Patent Mar. 19 , 2019 Sheet 3 of 8 US 10 , 232 , 408 B2 302 PRESENT MEAL PARTICPANT SELECTION MENUE 304 RETRIEVE CONTENT INFORMATION FOR STORAGE UNITS 306 RETRIEVE MEAL PARTICPANT PREFERENCES WITH AVAILABLE ITEMS 308 VIEW SIDE - BY - SIDE CONTENTS CONTENTS DISPLAY OF SEGMENT 310 DISPLAY POTENTIAL MEAL SELECTIONS M ivvy RECEIVE USER SELECTION DISPLAY DETAILED MENU AND RECIPE FOR SELECTED MEAL FIG . 3 2312 U . S . Patent Mar . 19 , 2019 US 10 ,232 ,408 B2 Sheet 4 of 8 402 RETRIEVE EXPIRATION FOR AVAILABLE ITEMS 404 RETRIEVE PREFERENCE INFORMATION FOR ITEM ORDERING 406 COMPARE PREFERENCES WTH EXPIRATION DATES 408 PRESENT ORDER LIST RECEIVE USER SELECTION AND PLACE ORDER FIG . 4 Patent Mar. 19 , 2019 MEAL SELECTION O Breakfost Sheet5of8 US 10 , 232,408 B2 Sheet 5 of 8 COURSES O SOUP O Brunch SALAD m Lunch MAIN COURSE Dinner DESERT O Late night snack MEAL PARTICIPANTS ? MOM DAD BOBBY JANE PROVIDE O NANNY O GRANDMA RECOMMENDATIONS O GRANDPA GUEST O NUMBER OF GUEST FIG . 5 U . S . Patent Mar. 19 , 2019 Sheet 6 of 8 US 10 ,232,408 B2 SALADS TOMATO SALAD D GREEN SALAD MAIN COURSE OROASTED CHICKEN GRILLED SALMON DESSERT SORBET O CHOCOLATE CAKE PROVIDE RECIPES V AAAAAAA PROVIDE ADDITIONAL PROVIDE RECIPES SUGGESTIONS FIG . 6 U . S . Patent Mar. 19, 2019 Sheet 7 of 8 X MILK US 10 ,232,408 B2 O QUANTITY ORANGE JUICE YOGURT O QUANTITY O QUANTITY O QUANTITY O SODA SUBMIT ORDER FIG . 7 U . S . Patent Mar . 19 , 2019 Sheet 8 of 8 US 10 ,232 ,408 B2 DIGITIZE AND RECORD SPOKEN ORDER man 804 TRANSMIT ORDER TO REMOTE SERVER 806 PERFORM VOICE RECOGNITION -808 DISPLAY TEXT VERSION OF VOICE ORDER TO USER FOR VERIFICATION ( 810 TRANSMIT ORDER TO ONE OR MORE PROVIDERS 812 RECEIVE QUOTE AND PROVIDE QUOTES TO USER 816 RECEIVE ORDER AUTHORIZATION TO PLACE ORDER USER FIG . 8 US 10 ,232 ,408 B2 SYSTEMS AND METHODS FOR SCANNING INFORMATION FROM STORAGE AREA CONTENTS INCORPORATION BY REFERENCE TO ANY PRIORITY APPLICATIONS suggestion ; retrieve preference information for the first user from computer readable memory ; retrieve information read from at least a first item tag; and provide a meal suggestion based at least in part on preference information for the first 5 user and item tag information . Still another embodiment provides a method of providing meal suggestions , comprising : electronically receiving data Any and all applications for which a foreign or domestic priority claim is identified in the Application Data Sheet as filed with the present application are hereby incorporated by 10 reference under 37 CFR 1 .57 . BACKGROUND OF THE INVENTION Field of the Invention read , via a first sensor, from a first item , the data including information related to the first item ' s ingredients ; identifying a first user requesting a meal suggestion ; reading from computer readable memory food preferences for at least the first user ; and providing a meal suggestion based at least in part on preference information for the first user and item tag information . Yet another example embodiment provides a networked 15 food storage system , comprising: a first sensor configured to read expiration date information from item tags , wherein the items are stored or intended to be stored in a storage unit; a data store configured to store expiration date information ; and instructions , stored in computer readable memory , con The present invention is related to sensor systems and processes, and in particular for sensing items stored in storage units and performing related automated processes. Description of the Related Art 20 figured to : read expiration date information from the data store ; determine if a first item has an expiration date within Perishable items are often stored in refrigerated storage units , such as refrigerators . Such perishable items often have within a first time window , identify the item on a shopping a first time window ; if the first item has an expiration date & 10 list. on 25 Still expiration dates or “ best used by dates” printed thereon . 25 system ,another example embodiment provides an electronic comprising :memory digitized However, because perishable items are often densely packed voice recording from a userconfigured to store , a stored in ; and instructions into a refrigerated storage unit, and because the expiration computer readable memory , configured to : read the digitized dates are sometimes faintly or poorly printed , users often are voice not able to conveniently monitor the expiration dates . spondsrecording ; identify a productinidentifier that corre to a first the Hence , items are often retained in the refrigerated storage 30 recording ; present aitem referred to the user digitized voice shopping list to that includes at unit past their expiration date , taking up valuable storage least the first item . space . In addition , because the user is often unaware ofwhen an item has reached its expiration date , the user often does Another example embodiment provides an electronic sys tem , comprising : memory configured to store a digital not replace the expired item in a timely fashion . SUMMARY OF THE INVENTION product image from a user ; and instructions, stored in 35 computer readable memory , configured to : perform object The present invention is related to sensor systems and processes, and in particular for sensing items stored in storage units and performing related automated processes . 40 The following embodiments are intended to be illustrative examples , and not to limit the scope of the invention . One example embodiment provides a networked refrig eration system comprising a first sensor configured to read recognition with respect to the product image; select a product identifier that corresponds to the product in the image ; present a shopping list to the user that includes at least the product. BRIEF DESCRIPTION OF THE DRAWINGS Embodiments of the present invention are described herein with reference to the drawings summarized below . herein the 451 drawings and These description are information from item tags coupled to items, wherein the 45 to illustrate example the associated of the invention ,provided and not items are stored or intended to be stored in a refrigeration to limit the scope of embodiments . the invention unit ; a data store configured to store food preferences for a FIG . 1 illustrates an example embodiment of an item plurality of household members ; instructions, stored in tracking and recommendation processing system . interface to be displayed to the first user, the first user 30 sto FIG . system . an example embodiment of a networked 50 storage 2 illustrates interface listing household members ; receive a user input FIG . 3 illustrates an example meal suggestion process. indicating which household members will participate in a FIG . 4 illustrates an example order generation process. first meal; retrieve preference information for at least a FIG . 5 illustrates a first example meal suggestion request portion of the household members thatwill participate in the user interface . first meal; retrieve information read from at least a first item 55 FIG . 6 illustrates a second example meal suggestion tag ; select at least a first recipe stored in computer readable request user interface. memory based at least in part on preference information for FIG . 7 illustrates an example user interface for ordering at least one meal participant and item tag information , and items. provide the recipe to a first user. FIG . 8 illustrates an example method for processing a Another example embodiment provides a networked food 60 voice order. computer readable memory , configured to : cause a first user storage system , comprising: a first sensor configured to read information from item tags coupled to items, wherein the items are stored or intended to be stored in a storage unit ; a data store configured to store food preferences for at least a first user ; instructions, stored in computer readable memory, 65 configured to : cause a first user interface to be displayed to the first user via which the first user can request a meal DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS Example systems and methods for scanning and obtaining product information and processing such scanned informa tion will be described herein . US 10 ,232 ,408 B2 Throughout the following description , the term “ Web site ” is used to refer to a user-accessible network site that implements the basic World Wide Web standards for the coding and transmission of hypertextual documents . These user prefers foods having a certain characteristic or that are in a certain category, such as vegetarian , low fat , low sodium , and /or kosher food products. The scanner system can include or be coupled to one or standards currently include HTML (the Hypertext Markup 5 more user input and /or output devices, such as a touch Language ), HTTP (the Hypertext Transfer Protocol), Java , screen device , a non -touch screen display, an on / off switch , and XML. It should be understood that the term “ site ” is not intended to imply a single geographic location , as a Web or other network site can , for example , comprise multiple a mechanical keyboard , voice recognition system , a voice output system , a camera , a character recognition device , a printer, and/ or other types of user interfaces . The system geographically distributed computer systems that are appro - 10 optionally can include one or more function - specific hard priately linked together. Furthermore , while the following description relates to an embodiment utilizing the Internet and related protocols, other networks , such as networked keys and/ or soft keys displayed on a touch screen . The key functions can be software programmable . An example tag can include some or all of the following interactive televisions, and other protocols may be used as information : product code, expiration date, nutrition infor well. In addition , unless otherwise indicated , the functions 15 mation , dietary classification information (e . g ., low sodium , described herein are preferably performed by executable code and instructions running on one or more generalpurpose computers . For example , program code stored in non - volatile and /or volatile memory can include one or more low cholesterol, low carbohydrate , non - fat, peanut-free, gluten - free , sugar - free , non - dairy , vegetarian ), ingredient content, supplier , product, storage temperature range , dimensions ( height, length , width , weight ), cooking tem instructions, which can optionally be straight-line code 20 perature and time, a unique item /tag identifier , etc . Option and/ or organized as modules or objects configured to receive ally , the tag can further include an identifier associated with and process inputs, provide outputs , and to selectively store an intended user. data . However, the present invention can also be imple - mented using special purpose computers , state machines, If the tag is an RFID tag , the tag can include a RFID chip , with associated memory , an antenna , and optionally a bat and / or hardwired electronic circuits . While certain example 25 tery . Optionally , an RFID tag can be a chipless tag , that does processes are described herein , not all the process states need to be performed , and the order of the process can be varied . While several example embodiments are described with reference to RFID tags and RFID scanners , other tags not use integrated circuit technology to store information , but that does use materials (e . g . fiber ) that reflects a portion of the scanner 's signal back to the scanner, which can then be used as an identifier. By way of further example , if the tag ( e . g ., barcodes ) and scanners ( e . g ., a laser barcode scanner ), 30 is an RFID tag, the tag can be powered via a battery , electromagnetically by the RFID scanner , or otherwise . can be used In an example embodiment, a networked system includes one or more scanning devices that can scan product infor - mation . For example, a scanning system can optionally As will be described below , the scanning system scans item tags and optionally stores some or all of the scanned information in a computer readable data store, such as a include one or more of an optical barcode scanner , an RFID 35 database . Optionally , a user can then view some or all of the (radio frequency identifier ) scanner, a character recognition stored information via a display coupled to the scanning scanner, a camera , and/or other scanner types . The scanning system . system can be configured to scan / read opticalmarkings such By way of further example , the system can read or scan as barcodes (printed or lasered onto the item packaging or product information located on or in item tags for items the consumable item itself), RFID tags ( e .g ., a radio fre - 40 stored , or that are in the process of being stored , inside a quency transponder ), solid state memory tags , and /or mag - refrigerator and /or stored in different household locations netic tags. The foregoing data devices are generally refer - including shelves, cabinets, dry storage rooms, pantries , enced herein tags. By way of further example , the scanning system can take electronic , digital pictures of product pack automobile trunks, etc . The scanning can optionally be performed utilizing a network of scanners and / or repeaters aging or markings , or scan /read other information storage 45 in the house . Thus, for example, one or more scanners, such as an RFID In certain example embodiments , one or more scanning scanner can be placed in , or adjacent to a home refrigerator, devices . devices and / or related processing systems can be fixedly as well as on or in proximity with food storage shelves coupled or removably coupled to a utility device , such as a and /or cabinets . The scanner location can be based on the refrigerator , a conventional oven , a microwave oven , or 50 scanner range , wherein the scanner is placed within a other device . Optionally, one or more scanning devices useable range of the items to be scanned , and the location and / or related processing systems can be mounted to a wall , inside or outside of a cabinet, or on a stand . The scanner system can include or be coupled to a local can be further selected so that a barrier does not interfere with the scanner' s ability to read item tags . The scanner can be powered via a battery , AC power or content database and / or can be connected to a remote 55 otherwise . The scanner can optionally be mounted in or to a database via a network , such as the Internet. In addition , the scanner system can be coupled to a suggestion application refrigerator wall. The RFID scanner optionally includes an antenna or coil, a transceiver, and a decoder. The transceiver and database that stores food and / or meal preferences for produces signals that are emitted by the antenna as radio one ormore users . For example , a user can specify types of signals . The radio signals are optionally used to activate the foods, dishes , or other products that the user prefers or will 60 RF tag and to read and optionally write data to the tag . The not eat, wherein the user specifications are stored in the RFID scanner is optionally shielded by a substantially RF database , optionally in association with an identifier ( e. g ., a user ID and /or password ). transparent cover to protect the sensor from dirt and /or moisture . The scanner can periodically ( e. g ., every 30 seconds , By way of further illustration , the user can specify that the closing a refrigerator door), and /or other trigger (e.g., a By way of illustration , the user can specify that the user does not want to eat foods containing pork , poultry, beef, 65 every 15 minutes , every hour , or other regular or irregular fish , gluten , wheat, eggs, nuts , strawberries, and /or seafood. time period ), in response to a user action (e . g ., opening or US 10 ,232 ,408 B2 weight change detected via a weight sensor ) read items tags able in the house, including the contents inside the refrig for items stored within the refrigerator. Optionally , between erator and on other various locations in the house . scans , the scanner can enter into a power down /low power consumption state to conserve power. Optionally, the user The system can compare the available products or con tents ( e .g ., those stored in the refrigerator and/ or in other can manually cause an item tag to be scanned . For example, 5 storage locations ) with stored recipes, a serving size speci if the tag is an optical barcode, the user can manually press fied by the user, and/or user preferences, such as: special a scan button and /or pass the barcode in front of a barcode diets , including fat free diet, low carb , diet, vegetarian diet , Kosher food only , or other special diet. scanner. In addition to scanners that read tag information , one or The system can suggest one or more recipes that more more sensors can be provided that sense the presence of an item without necessarily reading an item tag . For example , closely match the user ' s preferences, the available ingredi ents , and the desired serving size , and the recipe can then be one ormore pressure sensors can be coupled to one or more prepared by or for the user. Because the system may not be shelves to detect if the shelve has an item stored thereon . aware of all the ingredients in the user ' s possession , the user Other sensors , such as capacitor sensors , millimeter wave 15 can manually specify that the user does or does not have certain ingredients available , and the foregoing information sensors , or infrared sensors can be used as well. A local and /or remote computer processing system can can affect the recipes recommended to the user . access the stored information , and based on some or all of By way of further example , the system can present on a display a list of recipe titles ( e . g., teriyaki chicken , fried examples of which are described below . Optionally, a user 20 chicken , butter chicken , etc.), optionally with a brief listing can specify how at least a portion of the information is to be of the main ingredients . The user can then select a listed recipe, the complete recipe (including a complete ingredient used . Based on the scanned tag information , the system can listing, ingredient quantities, cooking temperature , etc.) is the stored information , perform one or more of processes, determine when products that are inside the refrigerator, on then displayed , and the user can optionally print out the dry products shelves , and/ or other selected locations , will 25 recipe . Because system may not be aware of all the ingre expire and will remind or suggest to the user (through a user interface , such as a touch screen display , a voice print, a hardcopy printout, etc .) that the products be consumed on or before the expiration date. The suggestion or reminder can first be provided by the system a number of days before the 30 dients in the user 's possession , the user can manually specify that the user does or does not have certain ingredients available . By way of example , some or all of recipe infor mation ( e . g ., cooking temperature and time) can be trans mitted to a cooking device , such as an oven , which can use expiration date , wherein the number of days can be a default the information in the cooking process . value stored in computer readable memory and / or can be By way of further example , as similarly discussed above , based on a value set by the user and stored in computer the system optionally reminds the user to replace a product readable memory. Optionally, in addition , the user can before the expiration date gathered through products tags . specify that expiration notices are to be provided for certain 35 The system can optionally be configured by the user to specified items and / or the user can specify that expiration automatically trigger orders within a predetermined amount notices are not to be provided for certain specified items of time prior to the expiration date . Optionally, the order Optionally, when a suggestion or reminder is provided , timing can be based in part on the time it takes to deliver the the user can instruct the system not to provide further order once the order is placed , where , for example , the order reminders regarding the expiring product or can instruct the 40 will be placed to ensure the order will arrive on , or shortly system to provide another reminder at or after a specified time or period (e . g ., a snooze instruction ). The system will optionally suggest the reordering of before the expiration date . In addition , the user can option products based on one or more of expiration dates , con charge is greater than a certain cost, the order should not yet item inventory , and user preferences, such as : special diets, been removed from a storage area (e . g ., a refrigerator ) by as fat free diet, low carb . diet , vegetarian diet , Kosher food comparing previous scanned information with current scan information . If the system does not locate the item within a ally specify , via a user interface , that for future orders if an order value is below a certain amount and/ or a delivery sumption patterns, delivery schedules , current household 45 be placed . Optionally , the system determines if an item has only , or other special or selected diet. As similarly described above , the suggestion or reminder storage area within a predetermined amount of time (e . g., an can first be provided a number of days before the expiration 50 hour, 4 hours, 8 hours , 12 hours, or 24 hours ), the system date, wherein the number of days can be a default value optionally infers that the item has been fully consumed , and stored in computer readable memory and / or can be based on adds the item to an order. Optionally , the predetermined a value set by the user and stored in computer readable amount of time is settable by a user. reminders regarding the product or can instruct the system to provide another reminder at a specified time or period . Other consumer food -related information can also be accessed and utilized by the system from computer memory. memory . By way of example , the configuration information includes the placement, depth , width and height dimensions of the refrigerator and/ or freezer storage areas . The configu ration information can also store information regarding memory. Optionally, when a suggestion is provided , the user The physical configuration of the refrigerator storage can optionally instruct the system not to provide further 55 areas can be stored in computer local or remote physical For example , recipes can be stored on a local and / or a remote 60 storage areas intended to store a particular type of food information system . The recipes can include ingredients , quantities , and instruction of preparation . Optionally , the system can store and /or calculate from stored information , recipe ingredient quantity information for different serving sizes Optionally, the recipes can be selected or downloaded from another computer system based on the products avail- product. For example , information (e .g., dimensions, special temperature settings, etc .) regarding vegetable drawers, fruit drawers , dairy product storage areas , and the like can be stored . Shelve and drawer weight limitations (e . g ., recom 65 mended maximum weight) are optionally stored as well. Certain configuration information can optionally be down loaded over a network from a remote computer system (e. g., US 10 ,232 ,408 B2 from a Web site associated with the refrigerator or the Optionally , a user interface is provided via which the user tional storage. The system can compare some or all of the foregoing information with product and packaging information (such profiles and preferences of the meal participants, as well as the item tag , enables the system , and determine one or more laundry company or a newspaper /magazine service pro system provider ) based on , for example , the refrigerator can indicate which type of meal ( e . g ., breakfast, brunch , lunch , dinner ), meal courses ( e. g ., salad , soup, appetizer , model or serial number. In addition , the system can record which storage locations main course , dessert), and a food -type category (e . g ., fish , are occupied , and which locations are available for addi- 5 meat, etc .) the user wants . The system will then access the the item inventory , and provide a corresponding meal rec ommendation . Optionally , a trigger or as volume and dimensions including depth , width and 10 through a systemuser caninterface to provide a command om user communicate to the height), that can be read from the item tag or retrieved from central system or directly to a service provider, such as a a local or remote database using an item identifier read from vider, to order or to trigger a ways to organize items on shelves and in drawers. Option servicingdirectly as the their servicepicking up or request for , such service of delivering ally , the system can provide a user with suggestions of 15 goods, and /or to suspend a service , such as to suspend or Stionsand recommendations on how to organize the refrigerator freezer by suggesting placement of products with respect to storage shelves and drawers . By way of illustration , the system can compare product newspaper delivery for a specified period of time. Optionally , the system can further include a voice record ing device and/or the voice recording device can be inde pendent of the system . The voice recording device can dimensions and /or weight with the refrigerator or shelf 20 include digital memory ( e.g ., a disk drive, FLASH memory, configuration and /or available locations, and using the com parison results , suggest where a product or products should etc .) or analog memory (e . g ., a cassette tape). A user can record a product description on the device by activating a be placed via a user interface. This information can be record control, which can be in the form of a button , a presented in a touch screen display or other user interface . switch , a voice recognition command or other record trig By way of example , the system can display a three dimen - 25 gering method . In an example embodiment, the device sional representation of items already on storage shelves, and then highlight items that are first to be removed as part records a product description verbally provided by the user and creates a digital file . The description can be provided as of the reorganization process . Once the user has removed the part of a verbally provided product order. Optionally , a indicated items, the system displays where each of the different file is created for each recorded production descrip removed items are to be placed on the storage shelves . 30 tion . The device transfers the file to a remote database over Optionally , the system provides a printout of stored items a network such as the Internet . The transfer can be per and the storage locations so that the user can easier locate items and determine if the user has a certain items, and withouthaving to physically search for items. Optionally , an command , or on a scheduled basis . formed substantially immediately, in response to a user A remote computer processing system receives , stores, " expired ” control is provided , which , when activated , causes 35 and accesses such files, which can be received from a the system to display and / or printout a list of expired items plurality of voice recording devices . The remote computer and their locations. Optionally , the system provides a user interface with a search field , wherein the user can enter in the name of an system then utilizes voice recognition software to translate the voice recording files into text files . Optionally , the voice recognition software increases recognition accuracy by, item or an item type . The system then searches its database 40 when there are more than one potential word matches , to locate matches or near matches , and display search results placing more weight on words related to the types items to the user . The search results can include a list of the being purchased (produce, cereal, milk , etc . ) and the users matches or near matches, the quantity of the matching and past purchase history. The remote computer system can near matching items, and their storage locations . optionally match the spoken order with a SKU ( Stock recommendations to the user. For example , the system can a SKU database . The SKU database optionally stores SKUS As similarly described above , optionally , the system , via 45 Keeping Unit, e .g ., an identifier, such as a unique numeric a suggestion user interface , provides item suggestions and identifier associated with a specific product) retrieved from suggest items to be consumed ( e . g ., via a meal recommen - in association with a text description of the corresponding dation including one or more of an appetizer , a main course , item . For example, if the user verbally ordered a cereal by dessert, and/ or a drink ) based on item availability in the 50 name, the remote computer system translates the name into user ' s house and /or on information input by one or more text or other computer readable form , and matches the text users (e .g., members of the household , one or more physi with text stored in association with a SKU (or other iden information can include food preferences, special diets , recognition and/or SKU matching and identification can be ally, when a user wants the system to provide a meal suggestion icon or button. The system then retrieves the names of household members from its database , and pres- sion of the order. For example , the remote computer system web site, telephone, fax , short messaging system , or via other communication techniques. Thus, for example , the suggestions user interface , optionally in addition to an verbally with one or more product suppliers and/ or with the cians of a household member, etc . ). For example , the user tifier ) to locate the correct SKU . Optionally , the voice modes , etc ., input by the user via a keyboard , a touch screen , 55 performed instead or additionally by the user' s local system . The remote computer processing system optionally shares voice recognition , or other input method . Optionally, the system stores different profiles and pref - a text version (e . g ., the textual representation of the order erences for different users in the same household . Option and /or the corresponding SKU ) and / or recorded verbal ver recommendation , the user activates a physical or a soft meal 60 can share the text and / or verbal version of the order via a ents the names of the household members on the meals system can textually share an order that had been placed " entire household ” control. In order to indicate who will be 65 user. For example , the remote system can add the item (s ) participating in the meal, the user can select one or more of the household member names, or the “ entire household ” . identified in the verbal order to the user 's shopping cart or other shopping list, optionally in association with a digital US 10 ,232 ,408 B2 10 file that includes the user 's spoken order. Users can then preference information , user account information, etc .) verify the text conversion of the spoken order. For example , across a network , such as the Internet, a local network , the user can click on an item in an order list for which verification is requested , hear the user 's previously recorded and /or other network . The interface 108 can optionally include one or more of a digital subscriber line (DSL ) order, and determine if the written description in the shop- 5 interface , a Ti line interface, a satellite link , a cable hookup , ping list matches the user's spoken order. Optionally, the a dial-up modem , etc . The system 100 can further include system uses individual consumer information , such as the wired and /or wireless digital and /or analog input/output user' s location and the user's account information and interfaces to receive and /or transmit information to preference profile to better match the user' s spoken order more tag scanning sensors and / or presence sensors . one or with a product. The system uses the product identification 10 The system 100 can include and/ or be coupled to one or ( e.g., SKU ) generated from the verbal order to request more user interface devices ( e .g ., a touch screen display , a quotes from providers, provide quotes to the user, and to printer, a keyboard , dedicated mechanical keys, voice offer additional or alternative products to the user. The user recorder, etc .). For example , the system 100 can be coupled can then place an order for the identified product. to one or more user interface devices, sensors , scanners, Optionally , the system does not provide voice recognition . 15 and /or other systems via a USB or FireWire bus, via a wired Instead , an icon corresponding to the voice recording appears in the user 's online shopping list (e.g., an electronic local network , such an Ethernet network , and / or a wireless Optionally, in addition or instead , a picture of an item the preferences, item ordering preferences, payment prefer network , such as an iEEE 802. 11b or IEEE 802. 11g com shopping cart). Optionally , the icon has an associated pliant network , or a Bluetooth network . recording date displayed therewith . The user can click on the The example database 106 includes recipes, content infor icon , the system will play the recording to the user, and the 20 mation for one or more item storage units ( e .g ., refrigerator user can manually key in the product name and /or search an (s ), pantry , etc .), household members and /or frequent visit online catalog . ing meal participants , user preferences (e . g ., food user wants to order can be taken using a camera coupled to ences , etc . of household members and/ or frequent visitors ), the system , a cell phone camera , a standalone camera , or 25 a system serial number, and the like. The database 106 , other camera . The picture can be transmitted by the system optionally also includes dimensional and configuration or otherwise to the remote system . The remote system can information for one or more storage units (e.g ., available fruit drawers, dairy product drawer locate a corresponding SKU from a SKU database, which 30 weight limitations, etc.). Forstorage areas, shelve and 106 can example , the database optionally stores image signature information and /or an store a mapping of product codes or SKUs to product names, then perform image recognition to come up with a “ signa ture” identifying the item . The remote system can then image , in association with a corresponding SKU . The remote system uses the product identification ( e. g ., SKU ) generated from the image to request quotes from providers, provide quotes to the user, and to offer additional or alter - 35 native products to the user. The user can then place an order for the identified product. While the foregoing verbal and temperature settings , the existence of vegetable drawers , sizes, and packaging materials, as well as content informa tion regarding items placed into storage units . Optionally, the database 106 stores shopping lists , passwords and /or unique identifiers for accessing remote databases and ser vices. The following is an example database schema that photographic order processes can be used with a variety of includes fields for payment preferences, storage unit iden item types, it can be particularly useful with respect to items tifiers for one or more storage units ( e .g ., one or more that often do not have bar codes , such as fresh fruits ( e .g ., a 40 refrigerators ), storage unit shelf dimensions. food prefer single apple ) or vegetables. ences for one or more users (e . g ., food preferences for Optionally, the system does not provide image recogni breakfast, brunch , lunch , dinner, food avoidances, medical tion . Instead , a thumbnail (or larger image size ) version of or other dietary restrictions , etc .), and order generation / the picture of the item , corresponding to the image captured trigger preferences . by the camera , appears in the user 's online shopping list 45 ( e.g., an electronic shopping cart ), displayed on the user's User Database Schema local display . Optionally, the displayed picture has an asso ciated image capture date displayed therewith . The user can click on the picture , and the system will optionally display a larger version of the picture . Thus , the picture acts as a 50 FIELD reminder to the user. The user can then manually key in the product name and /or search an online catalog and /or the user ' s purchase history for the product to thereby add the product to the order list. Alternative Form of Payment Example embodiments will now be described with refer- 55 ence to the figures . Referring to FIG . 1 , an item tracking and Refrigeration recommendation processing system 100 includes a central Unit 1 Identifier removable and/ or fixed : volatile memory , such as RAM , Refrigeration Unit 1 Capacity processing unit 102 , computer readable memory 104 (e . g ., non - volatile memory, such as FLASH EEPROM , a hard disk 60 drive , an optical drive , etc .), and a database 106 , which can Shelf 1 Shelf 2 be stored , in whole or in part in the computer readable Shelf n memory 104 . A network interface 108 (e .g ., a wireless or User 1 Food Preferences wired network interface ) is provided to enable the item tracking and recommendation processing system 100 to 65 access and /or transmit data ( e.g., dimensionaldata regarding a refrigerator or other item storage system , recipes, user DATA DESCRIPTION Alternative form of payment (credit card , electronic fund transfer, check , place on account, etc . ), and corresponding payment information (credit card number, and credit card expiration date , bank account number, checking account number, etc .) Unique identifier, such as a serial number , associated with a first of the user 's disposal units The capacity in units ofmeasurement (gallons, liters, etc .) of Disposal Unit 1 Shelf 1 dimensions Shelf 2 dimensions Shelf n dimensions Food preferences -Breakfast Food avoidance -Breakfast Food preferences-Brunch Food avoidance -Brunch Food preferences -Lunch 11 US 10 ,232 ,408 B2 12 -continued FIELD DATA DESCRIPTION Food avoidance -Lunch Food preferences-Dinner User n Food Preferences Order Generation Preference Food avoidance -Dinner Dietary restrictions Food preferences- Breakfast Food avoidance -Breakfast Food preferences-Brunch Food avoidance-Brunch Food preferences -Lunch Food avoidance -Lunch Food preferences-Dinner Food avoidance -Dinner Dietary restrictions Generate/submit order preferences FIELD Ingredient 1 Ingredient 2 5 Ingredient n Cooking Instructions Calories/serving Salt, carbohydrates, protein , fiber, fat, vitamins/ serving 10 DATA DESCRIPTION Name and amount per serving Name and amount per serving Name and amount per serving Cooking method (s ), time, temperature , etc . FIG . 2 illustrates an example embodiment of a networked storage system . A computer system 202 (which can be in the form of system 100 illustrated in FIG . 1 ), is coupled to a local scanner 204 , a screen 206 ( e . g., a touch screen that can 15 receive user inputs via finger and /or pen ), and optionally a microphone and / or camera 203 . The microphone is option ally coupled to a digitizer which converts spoken language into a digital representation . The camera can be a digital still The following is an example contents database schema that stores item information for the contents of one or more 20 storage units . The information , or selected portions thereof, may have been scanned by one or more scanners from an item tag , manually entered by the user , or retrieved from a remote database using the item SKU or other identifier. The 25 example schema includes fields for a product code, ingre dients, calories, a diet category , a product name, dimensions, weight, an expiration date , a manufacturer, item location , item storage temperature , and cooking guidelines . and/or video camera that captures images and stores them digitally and/ or in analog form . The computer system 202 , scanner, 204, and /or screen 206 optionally are physical, and optionally removably , mounted to a refrigerator 208 . The computer system 202 , scanner , 204 , and /or screen 206 can optionally be mounted on a wall , a stand, or other supporting structure . The computer system 202 is optionally coupled to remote scanners via networks 218, 220 (e . g ., WiFi net works) . The remote scanners are mounted to and /or config ured to scan one or more other storage units , such as refrigerator 210 and cabinet 212 . Optionally , a storage unit, 30 such as cabinet 212 , includes multiple shelves with corre sponding scanners . Thus, optionally, one computer system Contents Database Schema FIELD DATA DESCRIPTION Product code The item SKU The item ingredients Calories The number of calories in the item or the number of calories per item unit low sodium , low cholesterol, low carbohydrate , non- fat, peanut- free , gluten - free , sugar-free , Ingredients Diet Category Product name Dimensions Weight Expiration date Manufacturer Location Information Storage Temperature Cooking Information non -dairy, vegetarian , etc . The text name of the item can collect and store information scanned from items stored in multiple storage units. Optionally, each storage unit can have a computer system that incorporates some or all of the 35 elements of system 100 . FIG . 3 illustrates an example meal suggestion process. At state 302 , a user interface is displayed by an item tracking and recommendation processing system ( ITRP ), via which a user can indicate who is going to participate in a meal and 40 the meal type (breakfast, lunch , dinner ). Optionally, the system can infer the meal type based on the time of day by One or more of length , width , height, diameter, reading a real time clock ( e. g ., if the request is at 8 :00 , the system infers the meal is breakfast). At state 304 , the ITRP Original pre -use weight Item expiration or “ best if used by ” date The name of the manufacturer or other manufacturer identifier Storage unit and /or shelf identifier of where item 45 available ( e . g ., in one or more household storage units ). At state 306 , the system retrieves food preference information for selected meal participants . At state 308 , the system matches user preferences and item availability for the meal retrieves information regarding which items are currently volume is stored The temperature or temperature range at which the item is to be stored type. At state 310 the system displays information regarding 50 one or more meals that meet the user preferences and that The temperature or temperature range at which the can be prepared using the available food items. At state 312, item is to be cooked , cooking time, cooking method (boiling, roasting, broiling , frying, microwave, etc.) the system receives a user selection of the displayed meals. 55 Recipe Database Schema At state 314 , the system displays a detailed menu corre sponding to the user selection . FIG . 4 illustrates an example order generation process . At state 402, the system retrieves expiration date information for items within one or more storage units (e.g., a refrig erator and / or cabinet ). At state 404 , the system retrieves a The following is an example recipe database schema. The user preference regarding when an order should be gener dient names , and amount per serving or per a specified prior to an expiration date selected by the user wherein the ing , and other nutritional information , such as the amount of one or more of salt , carbohydrates, protein , fiber, fat, vita - referred to as a time window ). At state 406 , the system compares the user preference with the expiration date infor example schema includes fields for ingredients ( e .g ., ingre - 60 ated relative to at least item expiration dates (e . g ., a time number of servings), cooking instructions , calories per serv - system is to ask the user if an item should be placed , also mins, etc . per serving and /or the % percentage of a recom - 65 mation and determines which items have expiration dates mended daily amount of the foregoing a serving will pro vide. that fall within the window . By way of example and not limitation , the time window can be one day or less , greater US 10 ,232 ,408 B2 13 14 than one day, and /or selected based upon a projected deliv - the user can be provided with an “ extend recording time” ery date or time. At state 408 , the system presents to the user control, via which the user can cause the system to provide via a display device a list of items identified at state 406 and additional recording time. At the end of the recording time, asks the user to select which items are to be ordered . At state the user is optionally provided the opportunity to review the selected items from a provider selected by the user. delete and re -record the shopping list if the previous record 410 , the system receives the user selections and orders the 5 recording ( e . g ., have the recording played back ), and to FIG . 5 illustrates an example meal suggestion request user ing was unsatisfactory . interface . The interface includes a Meal Selection section , For example , the user can speak the order to the micro wherein the user can indicate for which meal the user wants phone 203 , illustrated in FIG . 2 . The system then digitizes suggestions. In the illustrated example , the user can select 10 and records the spoken order in a file . At state 804 , the from : breakfast, brunch , lunch , dinner, and a late night snack . A courses section allows the user to indicate what courses suggestions are to be provided for. The course selection optionally changes depending on the meal selec - system transmits the digitized verbal order to a remote system , such as remote system 214 . At state 806 , the remote system performs voice recognition on the order in order to interpret the spoken order and converts the spoken order into tion . For example , if the user selects breakfast, optionally, 15 text. By way of example , the remote system can use gram the course selection will not include soup or salad options. mar constrained recognition and /or natural language recog indicate who is going to participate in the meal. The example ing. At state 808 , the remote system transmits the text A " meal participants” user interface enables the user to nition . The voice recognition system optionally uses train list is based on user set -up information , wherein the user version of the order to the user so that the user can verify if specifies household members and others that will be par - 20 text version is an accurate interpretation of the spoken order. ticipating in the meal. In this example , a guest field is attending for which food preference information is not For example, the remote system can transmit the text version user. Optionally, if the user determines that the order was not provided wherein the user can specify the number of guests to the system 202 or another user computer for display to the available in the system database . The system can use the correctly translated , the user can provide a corrected order guest number information when providing ingredient quan - 25 ( e . g ., via a keyboard , or by speaking the order again , to the tities as part of recipes . Referring back to FIG . 5 , a " provide remote system . recommendations” control is provided , which , when acti At state 810 , the remote system transmits the translated vated will cause the system to provide one or more meal recommendations. version of the order ( e . g ., the text version ) to one or more providers (e .g ., supermarkets , wholesale establishments , FIG . 6 illustrates another example meal suggestion 30 etc.) in order to receive quotes . The remote system can request user interface. The interface provides one or more optionally match the translated version of the spoken order course suggestions in response to the user selections made with a SKU retrieved from a SKU database , which stores via the interface illustrated in FIG . 5 , user food preferences, and item availability . In this example , suggestions are pro SKUs in association with a text description of the corre sponding item , and transmit the SKU to the providers. At vided for a salad , a main course, and a dessert . Once the user 35 state 812 , the remote system receives quotes from the selects the desired suggestions, the user can activate a “ provide recipe ” control, and the system will then provide potential providers, and transmits the quotes to the user. At state 814 , the user selects a provider and authorizes place the corresponding recipes , with the recipe portions scaled to ment of the order. At state 816 , the remote system places the the number of meal participants. The user can optionally order with the selected provider. activate a " provide additional suggestions ” control, and the 40 system will provide additional suggestions for courses It should be understood that certain variations and modi fications of this invention would suggest themselves to one of ordinary skill in the art. The scope of the present invention wherein the user has not yet made a selection . FIG . 7 illustrates an example user interface for ordering is not to be limited by the illustrations or the foregoing items. The example list includes items whose expiration descriptions thereof. dates are within a predetermined window and /or items were 45 What is claimed is : system has determined is no longer in the storage unit ( e . g ., a networks interface ; has been removed from the storage unit and not replaced within a predetermined amount of time). The user can select which items are to be ordered and the quantity of the items. 50 Optionally , the system defaults by placing check marks for a computer ; non -transitory memory that stores instructions that when present in a storage unit ( e.g., a refrigerator ), butwhich the each item and the user unchecks the item if the user does not want to order the item . Optionally , the system provides a 1. A voice processing system comprising: executed by the computer cause the computer to per form operations comprising: receive , using the network interface, a digitized order of a user from a remote system configured to receive default quantity , which can be based on a previous user user spoken words, the remote system comprising a microphone, a wireless network interface , and a By way of illustration , the user may press a " record shop digitizer is configured to convert spoken words into a digital representation ; specified value and /or on consumption patterns. 55 FIG . 8 illustrates an example method for processing a voice order. At state 802, the user verbally provides an order. ping list " control. In response , the system can prompt the user via a system display and/ or via spoken instruction to 60 verbally record a shopping list or a portion thereof. The recording can be intended as a reminder. The user may be given a limited amount of time ( e . g ., 5 seconds, 10 seconds, 30 seconds , 1 minute ) to speak the order. The system can inform the user of the limited time, and provide a clock or 65 other indicator ( e . g ., a countdown timer ) that continuously displays the time remaining to record the order. Optionally , digitizer coupled to the microphone, wherein the translate at least a portion of the digitized order to text ; match the text, translated from the digitized order, to a text description stored in a database comprising text descriptions of items and associated unique product identifiers; based at least in part on the identified match of the text translated from the digitized order to the textdescrip tion stored in a database , identify an item corre sponding to the text description ; US 10 ,232 ,408 B2 15 add the identified item to a set of items associated with the user; and enable the set of items, including the identified item , to be displayed via a user display . 16 20 . A computer - implemented method , the method com prising : receiving over a network at a network interface a digitized wherein identifying the item corresponding to the text is based in part on location information of the user. 3 . The voice processing system as defined in claim 1 , a digitizer coupled to the microphone, wherein the 2 . The voice processing system as defined in claim 1, 5 order of a user from a remote system configured to receive user spoken words, the remote system com prising a microphone, a wireless network interface , and digitizer is configured to convert spoken words into a wherein identifying the item corresponding to the text is 10 based in part on preference information of the user. digital representation; 6 . The voice processing system as defined in claim 1 , wherein the system is configured to increase recognition 20 translated from the digitized order, identifying, using the processing system , an item corresponding to the translating, using a processing system comprising at least one processing device and configured to perform trans 4 . The voice processing system as defined in claim 1 , lation of voice orders to text, at least a portion of the wherein identifying the item corresponding to the text is digitized order to text; based in part on a purchase history of the user. translated 5 . The voice processing system as defined in claim 1 , 15 matching, using the processing system , the text,associated from the digitized order, to a text description wherein the system is configured to increase recognition with a unique product identifier ; accuracy by placing more weight on words related to types based at least in part on the unique product identifier of itemsbeing purchased by the user. associated with the text description matched to the text accuracy by, when there are more than one potential matches to the text, placing more weight on words related to the user' s purchase history . 7 . The voice processing system as defined in claim 1 , wherein the system is configured to cause the set of items to 25 be audibly provided to the user via a website , short mes 21. The method as defined in claim 20 , wherein identi saging service , or telephone . 8 . The voice processing system as defined in claim 1 , wherein the system is configured to cause the set of items to be provided to the user via a website . 9 . The voice processing system as defined in claim 1 , text; causing the identified item to be placed on an item set associated with the user ; and enabling the item set, including at least the identified item , to be displayed via a user display remote from the processing system . fying the item corresponding to the text is based in part on location information of the user. 30 wherein the system is configured to cause the set of items to be provided to the user via a telephone . 10 . The voice processing system as defined in claim 1, wherein the system is configured to cause the set of items to 35 be provided to the user via a short messaging system . 22. The method as defined in claim 20 , wherein identi fying the item corresponding to the text is based in part on preference information of the user, or purchase history of the user, or both preference information of the user and purchase history of the user. 23 . The method as defined in claim 20 , the method further comprising placing more weight on words related to types of 11 . The voice processing system as defined in claim 1 , items being purchased by the user when performing recog wherein the system is configured to : nition of spoken words of the user. provide to at least one user device a first identifier 24 . The method as defined in claim 20 , the method further determined by the voice processing system as corre - 40 comprising placing more weight on words related to the sponding to a first item in a given user order and identifiers corresponding to alternative items from which the user can choose . 12 . The voice processing system as defined in claim 1, user 's purchase history when performing recognition of spoken words of the user. 25 . The method as defined in claim 20 , the method further comprising causing the item set to be audibly provided to the wherein the system is configured to use the identification of 45 user via at least one user device . the item to offer the user an additional or alternative item and to enable the user to order the additional or alternative item . 26 . The method as defined in claim 20 , the method further comprising providing to at least one user device a first 13 . The voice processing system as defined in claim 1 , identifier determined by the voice processing system as wherein the voice processing system is configured to enable corresponding to a first item in a given user order and the user to add a reminder with respect to at least one item . 50 identifiers corresponding to alternative items from which the wherein the order comprises an item name. 14 . The voice processing system as defined in claim 1 , 15 . The voice processing system as defined in claim 1 , at least one user can choose . 27 . The method as defined in claim 20 , the method further comprising enabling the user to cause the processing system wherein an item description from the user is recorded at least to add a verbal reminder. partly in response to a verbal user command . 55 28 . The method as defined in claim 20 , wherein an item 16 . The voice processing system as defined in claim 1 , description from the user is recorded at least partly in wherein a separate digital file is used to store respective response to a verbal user command . digitized item descriptions from the user. 29 . Themethod as defined in claim 20 , the method further 17 . The voice processing system as defined in claim 1, comprising enabling the user to verify that text conversion wherein the system is configured to enable the user to verify 60 of the spoken order via a user interface . that text conversion of the spoken order via a user interface . 18 . The voice processing system as defined in claim 1 , 30 . Non -transitory memory that stores instructions that when executed by a computer cause the computer to perform wherein the system is configured to enable the user to select operations comprising: among a plurality of providers, a provider to supply the 65 identified item . 19 . The voice processing system as defined in claim 1 , wherein the set of items is associated with a shopping cart. receive a digitized voice communication of a user from a remote system configured to receive user spoken words, the remote system comprising a microphone , a wireless network interface, and a digitizer coupled to US 10 ,232 , 408 B2 the microphone , wherein the digitizer is configured to convert spoken words into a digital representation ; translate at least a portion of the digitized voice commu nication to text; match the text, translated from the digitized voice com - 5 munication , to a text description associated with a unique product identifier, wherein the text description is accessed from a data store ; based at least in part on the unique product identifier associated with the text description matched to the text 10 translated from the digitized voice communication , identify an item corresponding to the text; cause the identified item to be included in an item set associated with the user ; and enable the item set, including the identified item , to be 15 displayed via a user display.

Disclaimer: Justia Dockets & Filings provides public litigation records from the federal appellate and district courts. These filings and docket sheets should not be considered findings of fact or liability, nor do they necessarily reflect the view of Justia.


Why Is My Information Online?