Systems, Devices And Methods For Sensory Augmentation To Achieve Desired Behaviors Or Outcomes

Abstract

Systems, devices and methods for altering sensory perceptions are disclosed. The systems and methods of the present invention comprise operably coupling at least one device for capturing sensory data to a computing device, identifying the captured data, querying at least one data base to identify desired behaviors and/or outcomes, querying the same data base or other data bases to identify and/or calculate modified, enhanced and/or virtual sensory data likely to achieve the desired behaviors or outcomes, generating modified, enhanced and/or virtual sensory data, and substituting the altered sensory data in real or near real time for the sensory data. The present invention advantageously alters sensory perceptions to promote health, ease patient's fears and allow safe performance of medical procedures, promote personal and public safety, and improve the success of military mission and operations.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of U.S. Provisional Patent Application Nos. 61/952,759, 61/952,781, 61/952,788, 61/952,792, and 61/952,799, all filed Mar. 13, 2014. The text and contents of each of these provisional patent applications are hereby incorporated into this application by reference as if fully set forth herein.

FIELD OF INVENTION

[0002] The subject disclosure generally relates to the field of augmented reality. Specifically, embodiments of the present invention pertain to methods and systems for modifying sensory data in order to achieve a desired behavior and/or outcome.

DISCUSSION OF THE BACKGROUND

[0003] For the purposes of this specification, the present invention will be described in language and examples relating to achieving desired personal health benefits, patient responses to medical procedures, appropriate responses to threats to personal safety, and increased effectiveness of military missions and operations. However it should be understood that the invention is not so limited, and may be applied and/or used to modify or augment sensory perception to evoke appropriate and/or desired responses and/or outcomes in a wide variety of other applications.

[0004] Human reactions to environmental stimuli are strongly related to how the stimuli are perceived. Indeed, it is the nature of human reaction that sensory data is utilized to trigger a response (a response that may, additionally, be informed by expectations, past experience, or other factors). There are numerous situations where the sensory data evokes an improper or non-optimal response. There are other situations where the sensory data evokes an evolutionarily appropriate response (such as resisting being stuck with a sharp stick), but one that is undesirable (such as when the sharp stick is in fact a needle bearing a vaccine).

[0005] Likewise, human decision making is frequently driven by vestigial instincts related to evolutionary biology. For example, hunger was a persistent problem during the primary periods during which human sensory response evolved, putting a premium on consumption of all available foods and creating a preference for high-fat food, sweet food, and other foods that provide substantial numbers of calories but which, in the presence of abundant food choices, are relatively undesirable foods.

[0006] There are numerous situations where sensory data evokes an improper or non-optimal response, whether based on evolutionary biology, social norms, personal history, or other factors. For example, an obese human may receive visual data about foods at a buffet, and while the optimal response would be to pick the healthy foods, the visual appearance, smell and/or anticipated taste of certain unhealthy foods may be so appealing as to cause the person to pick the unhealthy foods.

[0007] It is also common for humans to be deceived by presentation of environmental elements. For example, a fixed amount of food on a large plate may seem inadequate while the same amount of food on a small plate may seem to be too much. Human self-perception is also well known to create unhealthy behaviors. Anorexia and bulimia are related, in part, to a self-perception that the human's body is too fat. Less acute behavioral issues may also occur in a manner related to self-perception, such as when a person exercises excessively because they think their musculature is not yet large enough, or when a person eats too much because they have worn loose clothes and thus do not accurately perceive themselves as overweight.

[0008] Every parent has had the experience of taking a child to get an immunization or a blood draw, having the child see the size of the needle, and entering into some degree of panic, phobia, or other negative reaction. Similarly, adults and children facing medical procedures that may invoke a visceral reaction often have their reaction triggered prior to the actual procedure (particularly with regard to repeated and/or invasive procedures, as well as certain other non-medical physical experiences). For example, imagine Fred, a 10 year old, who has a violent fear of needles. Fred cannot receive immunizations without being physically restrained by several nurses. Not only does Fred put the nurses at risk of an accidental needle puncture, but Fred may harm himself or be unable to receive the treatment. Fear of the experience of the procedure may even result in a failure of a patient or guardian to consent to a medically beneficial procedure.

[0009] The currently available solutions are primitive. At best, patients are asked to look away, tricked into looking away, told to bury their faces in their parent's shoulder, presented with a needle hidden behind the nurse's back or the needle is surreptitiously stuck into them as an unsuspecting patient. In some instances, sedatives such as those from the benzodiazepine family are used to reduce patient anxiety. Ultimately, however, existing treatments rely on the patient not seeing the needle (or other implements), not knowing the needle is part of the treatment, or simply tolerating seeing the needle (or other implements). There is no known invention in the art that passively soothes and/or distracts patients with sensory stimulation to facilitate fast and safe intramuscular or transdermal injections or blood draws.

[0010] A variant of this problem presents in non-medical fields as well. For example, a person with a phobia of snakes may be unable to walk in certain wilderness areas--even areas where the only snakes present are harmless--because of this phobia. As with the medical examples, the only solutions currently available are to avoid the area or to simply deal with potentially seeing a snake.

[0011] In a somewhat opposite example, a person's retina may receive an image of a mosquito on their arm nestled among dark hair, but the sensory data may be insufficient to cause the human to identify and react to the mosquito, even though the mosquito may carry malaria or other diseases. In such situations, a response (i.e., killing of the mosquito) is desired, yet because the sensory data is insufficient, no response is forth coming.

[0012] Native human sensory capability is well suited to applications such as finding food on a savannah, but poorly suited to maximizing efficacy in military or public safety applications. Some rudimentary improvements have been made, such as utilizing wearable night vision glasses that permit humans to see in low light situations. However, simply enhancing data is insufficient to overcome the sensory deficits that put humans at risk in modern situations, and the fundamental problem remains: humans do not innately perceive combat threats or policing threats with the same native fluency as they perceive the threats human sensory systems have evolved to address. By altering the data perceived, in a manner that matches human instinct and training, it is possible to improve safety for individuals, the military, the police, the general public, and other groups of people.

[0013] Therefore, it is desirable to modify human sensory perception, such as human perception of themselves, foods, and similar elements, to achieve desired health benefits. It is also desirable to modify human sensory perception to ease patient anxiety levels in order to facilitate performing medical procedures. While in other instances, it is desirable to modify and/or enhance human sensory perception to increase the efficiency and effectiveness of military missions or operations, or to improve personal and/or public safety.

SUMMARY OF THE INVENTION

[0014] Embodiments of the present invention relate to systems, devices and methods for sensory modification and augmentation to achieve desired behaviors and outcomes. These systems and methods may be applied, at minimum, to human health, in medical settings, to personal and public safety, and in military missions and operations. Other systems, devices and methods for accomplishing similar objectives are disclosed in a co-pending application, entitled "Detecting Medical Status and Cognitive Impairment Utilizing Ambient Data", filed concurrently by the inventors hereof, which is hereby incorporated by reference into this application as if fully set forth herein.

[0015] In one embodiment, human sensory perception is modified to make the human believe his body or other features are different than they actually are. For example, an overweight man may be presented with a self-image showing him 20% more overweight than he really is. This may advantageously result in the man being more careful about food choices. Food may also be presented as different then it really is. For example, desserts may be modified to look older, drier, or otherwise less desirable, while vegetables may be presented to look more vibrant, with unappetizing visual elements removed. The changes may become more or less pronounced depending on certain factors, such as whether the person has worked out that day and needs more calories, how much the person has already eaten, or in the case of a diabetic, the current blood sugar level, etc.

[0016] In one aspect, such modifications may be accomplished by modifications made in the image presented in a mirror-style display. In another aspect, such modifications may be accomplished utilizing a heads-up or other wearable display technology, a projected image system, and/or other mechanisms described herein. In another aspect, a system may be operably coupled to elements of clothing or to other physical objects, and the properties of the clothing or objects modified. For example, a person who is trying to lose weight may enter a buffet line. When the system determines that the person is at a place where he or she will likely eat, the system may tighten the belt by 20% and/or tighten elements worn as or in addition to clothing in order to create physical sensations. In one aspect, the physical sensations are calibrated to match and/or validate the visually presented altered data.

[0017] Many children and adults exhibit some level of anxiety when faced with the inevitability of receiving an injection. In some embodiments, the present invention advantageously enables injections and other medical procedures to be conducted while altering the recipient's reaction to environmental stimuli (such as a syringe) by altering what the patient perceives, including visual, olfactory, and/or tactile sensations. In some aspects, tactile sensory stimuli may include mild to moderate vibration and simulated touches.

[0018] Visual sensory stimuli may include altering the appearance of a syringe and/or the alteration of the patient's skin in a manner that reduces the perceptibility or apparent threat posed by the syringe. In addition, the patient may be soothed by artificial or supplemental sensory input; for example, the artificially generated smell of baked cookies, while tasting a cookie or cookie flavored supplement, while listening to the ambient sounds of a bakery, and watching footage of a grandmother baking or while being immersed in a virtual reality environment. As the patient may be immersed in this artificially generated experience, simultaneously, treatment may be administered to the patient unknowingly or with minimal discomfort. In some aspects, the invention may be implemented utilizing a 3D monitor system, a projected image system, a wearable device system, or other display or sensory input modality.

[0019] The instant invention provides a way to stimulate one or more of each of the five senses (i.e., taste, touch, sight, smell and hearing) individually or in combinations, in order to alter the user's perception of receiving medical treatment. Different to the archaic deceptive methods involving sleight of hand that are often used to dupe patients into unknowingly or unpreparedly complying with the desires of the healthcare professional, among other things, the instant invention may stimulate the patient's somatosensory system to distract, delude or preoccupy the patient. The instant invention offers heath care professionals and institutions the ability to increase compliance and improve or eliminate the patient's perception of the treatment they are simultaneously receiving.

[0020] In another aspect, when a child falls down, the child often looks to an adult to determine if the child should be crying or if the child is hurt. It is frequently the reaction of others than defines or contributes to the response to an event. Aspects of the present invention permit modification of the apparent response of others. For example, a grimace by a parent may be altered to be a smile. Similarly, artificial "people" or characters may be generated and displayed to moderate the patient's view of the risk of the procedure and/or the patient's response to the procedure once completed.

[0021] People process sensory data based on evolutionary wiring, life experience, and learned information. Powerful sensory data and sensory data of the type people evolved to process, such as the roar of an attacking bear, are seldom ignored or misconstrued. However, the nearly silent approach of an electric vehicle, the nearly inaudible buzz of a mosquito carrying a parasite, or the presence of a synthesized toxin in a drink are frequently accompanied by sensory data that a person could detect, but would normally ignore even if detected. Situational inattentiveness, as described by Chabris and Simons in their book "The Invisible Gorilla, How Our Intuitions Deceive Us", may also render unnoticed data that is easily perceptible and understood if the data is presented under circumstances where it is unexpected.

[0022] In one embodiment, the invention advantageously enhances or alters sensory data in a way that triggers an appropriate and beneficial response. For example, a mosquito with malaria may not generate sufficient visual or auditory data to trigger a response by a person to avoid or kill the mosquito prior to biting and infection. However, when detected by the invention, the buzz associated with the mosquito may be modified to be similar to the far more threatening sound of a predator (or by augmenting the sound to make it more noticeable), thereby beneficially triggering a "kill the mosquito" response in the person. In this regard, the present invention advantageously modifies persons' perceptions of environmental threats so that they may react to the threats in a manner appropriate to the magnitude of the threat, without regard to the threat magnitude that would be perceived by the unaided human. In one aspect, such modifications are done highly selectively, to avoid causing a diminution in the response of the human or for other reasons. For example, the sound of a female mosquito may be amplified whereas the sound of a male mosquito may be unaltered.

[0023] In high stress environments where situational awareness and precision of executed tasks are paramount, these inventions include a sensory assistant system to aid in the safe, accurate and efficient completion of tasks. By altering sensory data provided to military and public safety professionals, threats that would not normally be recognized or understood are made clear.

[0024] Embodiments of the present invention advantageously aid military units in completing missions, such as by aiding in avoiding sniper fire while engaging in more efficient navigation to extraction points. Casualties may be reduced by presenting users with visual data describing the terrain and location and status of fellow units, as well as the position of hostile units.

[0025] Additionally the system may further assist ground units by reporting local environmental data back to a control center or base to allow the units at base to provide appropriate support. By enhancing the visual perception of ground units, sharing data between units and a control center, and alerting units of hostile units or potentially dangerous situations and aiding the units in circumventing the threats, the instant invention may advantageously improve the efficacy of military units and operations.

[0026] These and other advantages of the present invention will become readily apparent from the detailed description below.

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Various non-limiting embodiments are further described with reference to the accompanying drawings in which:

[0028] FIG. 1 schematically illustrates modification of sensory data to achieve a desired behavior according to an embodiment of the present invention.

[0029] FIG. 2 schematically illustrates modification of sensory data to achieve a desired response of eating healthy foods according to an embodiment of the present invention.

[0030] FIG. 3 schematically illustrates modification of sensory data and generation of alternative sensory data to achieve a desired outcome.

[0031] FIG. 4 schematically illustrates modification of sensory data to achieve a desired patient response to a medical procedure.

[0032] FIG. 5 schematically illustrates modification of environmental data to trigger a desired response to a threat to personal safety.

[0033] FIG. 6 schematically illustrates modification of sensory data to improve the efficiency and success of military operations.

DETAILED DESCRIPTION

[0034] Reference will now be made in detail to various embodiments of the invention, examples of which are illustrated in the accompanying drawings. While the invention will be described in conjunction with the following embodiments, it will be understood that the descriptions are not intended to limit the invention to these embodiments. On the contrary, the invention is intended to cover alternatives, modifications, and equivalents that may be included within the spirit and scope of the invention as defined by the appended claims. Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be readily apparent to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to unnecessarily obscure aspects of the present invention. These conventions are intended to make this document more easily understood by those practicing or improving on the inventions, and it should be appreciated that the level of detail provided should not be interpreted as an indication as to whether such instances, methods, procedures or components are known in the art, novel, or obvious.

[0035] For the sake of convenience and simplicity, the terms modification and enhancement may be used interchangeably herein. Also, for convenience and simplicity, the terms sensory data, environmental data and sensory perception may be used interchangeably, and wherever one such term is used, it also encompasses the other term.

[0036] As discussed in the background, there are numerous situations where sensory data evokes an improper or non-optimal response. The currently available solutions are primitive. With regard to eating habits, people are asked/expected to abstain from certain foods, or in the case of eating too much, for example, food is placed on smaller plates so as to appear as more. With regard to medical procedures, patients are asked to look away, tricked into looking away, told to bury their faces in their parent's shoulder, or surreptitiously stuck with a needle. In police or military situations, night vision goggles present some enhanced features, but are non-optimal for networking information between officers and/or troops. In public safety situations, amplified voice through microphones or megaphones may provide some instruction, but these are often not heard, not understood or may be ignored in the panic of the situation.

[0037] The various embodiments disclosed herein are directed generally to systems and methods to alter sensory perceptions to achieve desired behaviors and/or beneficial outcomes. An exemplary general system/method 100 is described in FIG. 1. The system may include a camera 105, operably coupled to a processor 115 and a computing device 125, which are also operably coupled to a user immersive device 155. In the embodiment of FIG. 1, the camera 105 captures sensory data, the processor processes the captured data and identifies images, sounds, smells, etc., the computing device 125 identifies desired behaviors, and identifies and/or calculates modified and/or enhanced sensory data. The user immersive device 155 generates and substitutes the modified/enhanced sensory data for sensory data.

[0038] The method is described in steps 110 thru 150. At step 110, sensory data is captured. In the embodiment in FIG. 1, the data is captured by camera 105. However, in other embodiments, sensory data may be captured by one or more other devices, including, but not limited to video recorders, audio recorders, odor cameras, spectography equipment, medical measurement devices (e.g., devices that measure blood pressure, blood sugar level, alcohol level, enzyme levels, etc.), GPS devices, sensors (e.g., carbon monoxide, carbon dioxide, chemical, humidity, thermal, etc.), other image recognition devices, sound recognition devices, odor or chemical recognition devices, and/or tactile sensors.

[0039] At step 120, the captured data is processed and images, sounds, odors, etc. are identified by the processor 115, which processor may comprise image, sound, odor, chemical and/or tactile recognition software. In the embodiment of FIG. 1, the processor 115 is shown separately from the computing device 125. However, in some embodiments, the computing device 125 may comprise an internal processor, and image, sound, odor, chemical and/or tactile recognition software may be located within the computing device such that the processing and identifying of the captured data may be performed solely by the computing device 125.

[0040] At step 130, one or more databases in the computing device 125 are queried to identify behaviors or outcomes that are desirable to achieve. The behaviors and/or outcomes may include, but are not limited to healthy food choices, healthy exercise choices, reduction of fear of medical procedures, appropriate responses to threat levels, avoidance of threats to human health and safety, coordinated military missions, etc. At step 140, the same or other data bases are queried to identify and/or calculate modified and/or enhanced sensory data likely to achieve the desired behavior or outcome. Such altered sensory data may include altered body image, appearance or smell of foods, altered images of personal or environmental threats, etc. At step 150, modified and/or enhanced sensory data is generated and at step 160, the modified and/or enhanced sensory data is substituted for the captured sensory data.

[0041] The modified and/or enhanced sensory data may be generated and/or substituted for the sensory data of a person by generating devices including, but not limited to speakers, headphones, amplifiers, three-dimensional monitors, digital image projectors, light projectors, stereoscopic devices, alternating shutter glasses, polarized glasses, holographic display devices, electro-holographic display devices and/or immersive visual devices. Elements may be overlaid over ambient data and/or a partially transparent and/or an opaque display modality may be utilized.

[0042] These methods and systems are described below in relation to (1) digital body or food image modification to promote healthy eating or responsible drinking, (2) altering perceptions to ease patient's fears and allow for the safe performance of medical procedures (3) modifying environmental data to promote personal or public safety, and (4) capturing, aggregating and generating enhanced and/or virtual sensory data to facilitate military mission and operations. The systems and methods described will be applied to each of these desired behaviors or outcomes in the exemplary embodiments that follow. However, it should be understood by those skilled in the art that the systems and methods described herein are not so limited and may be applied to numerous other desired behaviors and outcomes.

[0043] Exemplary Systems and Methods for Digital Body, Food, Alcohol and Tobacco Sensory Modification

[0044] In an exemplary embodiment, undesirable or habitual behaviors such as eating unhealthy types and/or amounts of food, or consuming excess amounts of alcohol may be modified. With regard to unhealthy eating habits, in one embodiment, sensory data regarding a person's appearance may be modified to promote healthy eating habits. In such embodiments, a person's image may be modified so that they appear to weigh more than they do, to promote an intake of less food, or they may appear thinner than they are (e.g., in the case of a bulimic person), to promote an intake of larger quantities of food.

[0045] In some aspects, light, sound and/or small projection technology may be incorporated into the user's environment, such as within a refrigerator, above a table or bar, within containers, plates, or glasses, and may be used to capture and/or generate modified data to alter perceptions. In other aspects, wearable technology may be utilized to alter a person's perception of his or her environment. In yet other aspects, mirrored surfaces or apparently mirrored surfaces may incorporate an opaque, non-reflective or partially reflective capability wherein part or all of the surface reflects an image while another part of the surface shows modified data. An artificial mirror may be utilized, wherein the "mirror" is a display coupled with a camera and a modification device, and the image presented to the mirror is presented to the user, as modified. The camera may be placed behind the mirror.

[0046] In another aspect, the invention may be utilized to alter smoking or inhalation behavior, whether tobacco, marijuana, or other inhaled substances. For example, the quantity of smoke apparently generated from a "drag" of a cigarette may be artificially enhanced to make the user believe he has received a greater dose of smoke than he actually has. In another aspect, the user's chest, throat, or other body parts may be warmed to simulate inhaling smoke, or warmed or cooled to simulate intake of food or liquids. Thus, for example, a person drinking a beer may expect to feel a cool sensation in the throat and chest as he drinks; by providing an artificial cooling sensation, the user may drink less. In another aspect, the smoke generation device may be modified to incorporate other, less harmful elements, such as steam, thereby diluting the concentration of the undesirable elements. Such generation is, in one implementation, coordinated with visual field modifications to make the smoke appear to be undiluted.

[0047] Object identification technology is utilized to identify objects. Images of objects are captured, and one or more databases may be queried to compare the captured images against known objects or images so as to better define and/or identify objects in a person's environment. The one or more data bases queried may be a generic database, one generated by the user, one generated by a healthcare provider, one ordered by a court, or otherwise. There may be multiple queries and not all queries must, in some aspects, be run against all databases.

[0048] Another set of queries may identify the status or preferred treatment of the objects vis-a-vis the user (e.g., "French fries are a deprecated food" for a particular user or "beer is an alcoholic beverage, and consumption of an alcoholic beverage is prohibited for this user."). In addition, databases may be searched to determine modified sensory data that is likely to evoke a particular response, and the modified data substituted for the sensory data. Such sensory data may be identified as likely to generate a desired response or behavior in any user (e.g., a beer may look or feel warm and thus unappealing, or the beer may out of date and very old so as to lead the user to believe it will taste bad), or the sensory data may be identified to likely generate a desired response or behavior peculiar to the current user. For example, if the current user has a phobia of spiders, the label on a bottle of beer may be replaced with an image of a label with the words "spider beer" on it and artwork on the label that includes spiders.

[0049] In one implementation, images of elements that are undesirable and/or of which the user is phobic may be overlaid over visual field elements for very short time periods, such as one millisecond (although longer time periods may be used as well) in order to create a subconscious perception and association of the undesirable environmental element with the element that the user is phobic of. The overlay may be made fully opaque, nearly transparent, or anywhere in between. Although the opacity of the overlay need not correlate with the amount of time the overlay is displayed and the amount of time between displays of the overlay, in one aspect the undesirable/phobic element is overlaid for a shorter period of time when the overlay has a higher opacity. In one implementation, the overlay may be projected generally over an area where the object is found without the need to overlay specifically over, and only over, the object.

[0050] Referring now to FIG. 2, an exemplary embodiment of the present invention as it relates to food image modification is shown therein. Method 200 for food image modification begins at step 210. At step 210, the actual appearance or smell of food is captured. The appearance may be captured by a camera, a video camera, a miniature camera and/or other type of video or image recorder. Smells may be captured by a smell camera. At step 220, the captured image or smell is identified (e.g., by a processor having image or odor recognition software), and at step 230 a data base is queried to determine a desired response such as to eat certain healthy foods, or to not eat certain unhealthy foods.

[0051] For example, diabetics may have to avoid certain foods that contain high concentrations of sugar, obese or overweight people may have to avoid high fat foods, and people requiring extra iron in their diet may have to eat more spinach, raisins or other foods with high iron content. The data base queried may be a general data base, or one prescribed by a physician or other nutritional professional so as to identify those foods that comport with the desired outcomes. At step 240, the same or other data bases may be queried to determine the person's likely response to the actual appearance and/or smell of the food.

[0052] For example, if the image or smell captured is of a sugary item such as a donut, and the particular person likes donuts, the likely response is that the person will eat the donut. However, if the image or smell captured is a piece of dark chocolate, and the person does not like dark chocolate because it tends taste bitter to them, then the likely response is that the person will not eat the dark chocolate. The smell or odor of an item may be detected an analyzed by electronic sensing (e-sensing) devices, including but not limited to chemosensors, gas chromatography, electronic odor detectors which store "smell prints" of food and other odiferous items, etc.

[0053] At step 250, the desired response is compared with the likely response. If the desired response is the same as the likely response, then no sensory data modification is necessary, and the method ends at step 255. However, when the likely response is not the same as the desired response, at step 260 the appearance and/or smell of the food is altered, and at step 270 the modified appearance and/or smell of the food is substituted for the actual appearance and/or smell so as to achieve the desired behavior of the person eating/not eating the appropriate foods.

[0054] In another aspect, numbing agents may be deployed to reduce sensory acuity in taste and/or smell when the user is eating or may be about to eat foods that are deprecated. For example, when the dessert course arrives at a dinner, a numbing agent may be released. The numbing agent may be contained within cutlery; may be contained within a device operably coupled to the nose and/or mouth and/or tongue; the numbing agent may be sprayed on the food from a device worn on the user or elsewhere; the numbing agent may be applied to the food (or the surface thereof) by a device in the kitchen that receives a signal from the user's device; or via other means.

[0055] In another aspect, the taste of the food the user is about to eat may be altered by, for example, requiring or otherwise providing an incentive to the user to eat another food first, the taste of which will, when combined with the taste of the deprecated food, make the deprecated food taste less appealing than it otherwise would. Similarly, the user may be required or otherwise provided with an incentive to brush his or her teeth prior to eating a deprecated food, and the act of brushing, or the taste of toothpaste may cause the user to be less likely to consume the deprecated food.

[0056] A variety of methods may be used to discourage or prevent certain undesirable or habitual behaviors. The following examples are by way of illustration and are not intended to be limiting.

[0057] In one example, a user is sitting down to a meal. The user is wearing immersive vision goggles, projection technology is available, or other modes of altering images, sounds and/or smells in real time or near-real time is utilized. The apparent size of the portions may be altered in order to cause the user to put less unhealthy food on his plate and/or to put more healthy food on his plate. Undesirable foods may be made less noticeable or even blocked from vision entirely using lighting or digital signal processing. Food appearance may be altered to make foods look less or more enticing (for example by adding a greenish or grey cast to meat).

[0058] Further, data may be generated by medical measurement devices or mechanisms, such as measurement of body fat percentage and/or blood sugar level. These measurements may be utilized to help identify and/or determine desired behaviors or outcomes. For example, if a diabetic's blood sugar level is within a certain range, eating certain foods may be acceptable, which would not be acceptable if the person's blood sugar level was outside the specified range. In addition, the invention may track daily calorie consumption, exercise and calorie utilization, activity level, sleep history, or other behavioral or health factors to further determine permissible/impermissible behaviors. The device may also import such data if it is available from another device.

[0059] The environmental stimuli presented to the user may be altered to induce the user to engage in better or more desirable behavior, and to discourage undesirable behavior. For example, immediate positive or negative reinforcement may be provided. In one aspect, a user may be presented with alterations in reflected body image that track the likely appearance of the user after a certain time period X, if the user continues to engage the activities such as the ones the user has engaged in over the past time period Y. If the user has exercised for an hour every other day for 14 days, the user might be presented with a projected body image that matches, approximates, or is slightly more similar to the appearance that is likely if the user continues that behavior for a year (if Y is 14 days and X is one year).

[0060] Apparent user appearance may be altered in other ways as well. For example, if a user is engaging in excessively strenuous weight lifting activity at the gym, the user's reflection in the mirrors may be altered to make the user appear more muscular and sweatier than he really is. If a user is about to open a refrigerator with a mirrored surface, the image may be altered to appear to make the user appear fatter than he is.

[0061] A parent may wish to get reluctant children to bathe more frequently. The image the children are presented in the mirror may be altered to make them appear dirtier than they actually are.

[0062] In one instance of the present invention, cameras may be operably connected to a computer that identifies the undesired behavior of drug use--for example, the camera captures images of hypodermic needles being filled from a spoon. In addition, microphones operably connected to the computer may detect a discussion between two or more persons about illegal drug use or the commission of some other crime. The computer may then identify the drug use as an undesirable behavior. To improve the chances that the drug use is immediately halted, the sound of police sirens (in one aspect approaching police sirens) may be generated by an audio system and played in a manner such that the persons participating in the illegal drug use are motivated to cease the drug use. Other stimuli may also be utilized to such an end.

[0063] In some aspects, the modified, enhanced and/or virtual sensory data may be further altered, rotated with other modified data, or used intermittently to prevent the users from determining that it is artificial. In the above example, the sound of sirens may be rotated with the screeching tires of police vehicles, voice commands over a loud speaker, or similar sounds that make evoke a corresponding response to cease the drug use.

[0064] The method 300 of FIG. 3, schematically illustrates how further modified or alternatively modified, enhanced and/or virtual sensory data may be substituted or rotated with initially modified sensory data. The method begins at step 310, wherein sensory data is captured. Such sensory data may be captured by the devices and/or methods described with regard to FIGS. 1 and 2 above. At step 320, the captured sensory data is analyzed and identified, also by devices and/or methods described above. At step 330, at least one data base is queried to determine a desired behavior/outcome such as those described above. At step 340, it is determined whether the sensory data is likely to triggers the desired behavior. If the desired behavior/outcome is likely triggered by the sensory data, then the method ends at step 345.

[0065] If, on the other hand, the sensory data is not likely to trigger the desired behavior or outcome, then, at step 350, one or more data bases are queried to determine or calculate what modified sensory data is likely to evoke the desired behavior or outcome. At step 360, the modified sensory data is generated, and at step 370, the modified data is substituted for the sensory data. At step 380, a determination is made as to whether the sensory data captured is sufficiently similar to past sensory data captured. In other words, if the captured data is a not a reoccurring event, the method ends at step 375. However, if the sensory data captured is sufficiently similar to past sensory data captured (i.e., the sensory data captured is a repetitive event), then alternative modified/enhanced/virtual data is generated. The generation of alternative data helps to prevent the user from discerning that the modified data is artificially generated.

[0066] In another embodiment, the effects of drugs, alcohol, or other elements that impair cognition, balance, behavior, judgment or other physical or intellectual characteristics may be exaggerated or minimized using aspects of these inventions. In one aspect, the impairment that is likely to be derived by the user of an apparently contemplated (or other) quantity of alcohol or drugs may be at least partially simulated in advance of the completion of the consumption, thereby allowing the user to cease consumption if the impairment is undesirable. In another aspect, the level of impairment that corresponds to the amount of intoxicant that the user has consumed but not yet absorbed into the blood (or otherwise felt the full effects of) may be calculated and emulated so that the user can slow or stop intake of the intoxicant based on what the effects will be. Such a system may be useful, for example, in reducing binge drinking or in preventing somebody with rising blood alcohol levels from getting into a car to drive because he hasn't yet felt the full intoxication.

[0067] For example, consumption of a pint of beer by a person who already has a blood alcohol level of 0.05 may be at least partially simulated by altering the person's visual field, making items appear closer or further than they are, delaying the visual or auditory perception of events slightly to mimic the decreased response times, or by taking similar steps. Thus, if the person feels that he or she has already consumed a larger quantity of alcohol or drugs than is actually the case, the person may be motivated to cease use sooner. In another aspect, countermeasures to decrease physical impairment may be taken, such as by making stairs more visible (e.g., well lit and colored red) so as to aid the person to safely negotiate physical obstacles.

[0068] Exemplary Systems and Methods for Improving Medical Outcomes

[0069] The methods and systems of the present invention may also be applied to medical procedures. For example, the prospect of having a sharp object penetrate the flesh tends to be a daunting thought for many. For younger children and even teens, the fears associated with receiving an injection extend beyond the syringe. In these situations children may suffer from separation anxiety; fearful that their parent may leave them alone in a fear-inducing moment. They may be fearful of general pain, not necessarily having anything to do with the syringe. A child may simply be fearful that the exam may cause pain. In some instances when met by a physician who they perceive as unfriendly, they may feel as though they upset the physician. Children may also exhibit a fear based simply out of not knowing what to expect from the experience as a whole.

[0070] This level of fear and anxiety may manifest itself in erratic and otherwise unsafe behavior that may place the healthcare provider and the patient at risk. As a result it may be necessary to distract the child from visual stimuli that may cause the child further stress, and in doing so possibly dissipate any current anxiety or fear. Existing techniques for distracting the patient are crude, and frequently ineffective. For example, simply asking a child to look away or waiting until the child looks away before injecting the child is rarely as effective as desired. The goal of achieving patient compliance with the administration of tests, treatments or injections may be achieved by utilizing the inventions described herein.

[0071] Referring now to FIG. 4, the present invention as it relates to medical procedures is generally described therein. At step 410, actual appearances, sounds, odors and/or the feel of a medical procedure is captured, and at step 420 identified (e.g., by image, sound, odor, chemical and/or tactile recognition software or other appropriate software systems). At step 430, one or more data bases are queried to ascertain previous patient response, if any, or the likely response to the medical procedure. At step 440, if the patient's previous or likely response is not one of fear, then the method ends at step 445. On the other hand, if the patient's previous or likely response is fear, than the method proceeds to step 450, where the appearance, sound, smell and/or feel of the medical procedure is altered or modified. At step 460, the altered or modified appearance, sound, smell and/or feel is substituted for the actual appearance, sound, smell and/or feel.

[0072] A variety of methods may be used to overcome fear in a medical setting. The following examples are by way of illustration and are not intended to be limiting. The invention may utilize techniques that modify the perception of sensory input to minimize the apparent danger or other fear-inducing elements; to change the appearance of environmental elements; to add virtual environmental elements; or otherwise to alter the patient's perception in a manner that improves patient compliance.

[0073] In a simple subset of the invention, a sufficient level of distraction may be achieved by altering the visual appearance of the needle or the child's arm, such as by utilizing immersive reality glasses, projected light, or an opaque barrier below which the injection site is located, and above which there is a display visible to the patient.

[0074] In a simple example, a curtain may be placed right below a patient's chin, preventing the patient from seeing their body. A camera may image the patient's body or a portion of the body (for example, an arm near an injection site). Alternatively, the image may be generated entirely by computer, or by a combination of live video and computer. The images displayed to the patient may then be modified.

[0075] For example, a computer may receive a video stream showing the needle in the nurse's hand. The needle may be digitally altered to appear smaller and thinner. The nurse may be digitally altered to appear as a cartoon princess holding the needle or, in one implementation, a magic wand that replaces the image of the actual needle. The patient's arm may be displayed as having magic bluebirds flying around on it. The actual administration of the injection may be displayed to the child as the princess (i.e. the nurse) "accidentally" is bumping the child's arm with the magic wand or as picking up one of the bluebirds on the wand, and the bluebird scratching the child as it walks onto the wand.

[0076] In another embodiment, the systems of the present invention administers sensory stimulus before, during and after a child (or other patient) receives the injection. The stimulus may take place at various points along the arm or other body portions, which will distract from the actual injection site. In the context of delivery of a subcutaneous injection, for example, the child may be told to grab hold of a rubber object that appears to be the top of a carrot while a bunny begins approaching on the screen. If the child holds the carrot still, the bunny will begin to nibble it. The visual appearance of nibbling may coordinate with the vibration the rubber "carrot top" causing the child to focus on their hand, while they observe a cat licking their arm at the injection site (as the arm is sterilized by the doctor), and then resting their head at the site as the whiskers touch the skin to simulate the actual injection. The specifics of how the images are modified may be altered as desired, for example based on the preference and age and gender of the child.

[0077] In one aspect, causing tactile stimulation in areas other than the area in which the injection is actually being administered would add value to the entire process as it will provide sensory distraction. The device may even be designed to provide stimulation in the form of pressure at multiple points along the arm at the time of injection, which may impair the brain's ability to detect the location administration, the amount of pain involved, and perhaps even preclude the brain from detecting that an injection has been administered.

[0078] The instant invention may provide unobtrusive tactile stimulation to the user by way of either vibration or air jets. Such stimulation may distract the user from the touch of the healthcare professional or the eventual pinching sensation associated with the needle breaking the skin. Such tactile stimulation could be programmed by the system to course over the patient's body in patterns based upon the selected location of the injection site.

[0079] In a further aspect of the invention, the device may have one or more openings. A child may be asked to put both arms into slots, and some or most of the action may occur at the arm that is not the subject of the injection. While a simple monitor and opaque curtain may be utilized, is should be understood that any opaque barrier, any video or audio display modality, and other mechanisms for altering the appearance of things in a visual field (or the sound of things in an audio field) may be utilized. Without limitation, these may include projected images, 3D displays, flexible displays, wearable displays, speakers, headphones, and similar technology.

[0080] The display on the instant invention may be used to show the patient a number of images or videos that may be considered soothing to the user. For example a seascape of a sunset or playing puppies may be shown to the user with or without audio to keep the patient's mind from the imminent injection.

[0081] In one aspect, olfactory senses are associated with fear of medical procedures. Indeed, olfactory stimulus has a profound relationship to memory, and even a single bad experience associated with a smell may bring that memory, together with associated fear, to the forefront when the smell is next detected. Accordingly, embodiments of the present invention may emit odors, optionally related to the visual and/or audio stimuli being provided. In one aspect, it may be useful to generate odors that are relatively unique, such as by mixing a variety of odor sources, so that the odor associated with the procedure is unlikely to be experienced again by that patient. In another aspect, odors with positive associations, such as freshly baked cookies, may be provided to reduce fear levels. This may be accomplished utilized a specialized odor mixing and emission device, but may also be accomplished by utilizing scented alcohol or other wipes, or by adding a scent to wipes.

[0082] In another aspect, certain medical procedures trigger physical responses distant from the injection site, while others trigger a taste response. For example, the injection of IV iodine contrast for certain radiological studies may cause a warm or even burning sensation around the anus. In an additional example, dental procedures frequently have associated tastes and/or physical sensation in the mouth. Just as olfactory sense memory may be modified as described above; taste sensory inputs may be utilized. For distant physical responses, it may be desirable to emulate some portion of that response prior to initiation of the procedure, in some instances in a manner that increases slowly. Utilizing the IV contrast example, a warming element may be placed near the anus and slowly warmed prior to the injection of contrast so as to prevent the sudden onset of sensation.

[0083] For a vaccination, the arm must be held still and the vaccine administered, and it may be advantageous to utilize a device to hold the arm in place. In that case, or in other cases where the patient must insert an appendage into a hole or other device, the visual field may be altered to make the hole appear bigger. The device may contract around the arm (gently) as the screen displays clouds or marshmallows or something gently wrapping around the forearm.

[0084] One problem that occurs in certain procedures, including MRI and CT scans, is that patients fear being trapped in a small space (e.g., claustrophobia or similar phobias). In those cases, it may be desirable to create a partial or full sensory immersion illusion that the patient is in a larger space. For example, a 3D display may show the patient an image of lying down in a field; a set of fans may blow air across the patient, simulating wind; speakers or a headset may simulate leaves rustling and birds chirping. In one aspect, it may be desirable to include a simulated environmental element that causes the patient to desire to stay still.

[0085] For example, a virtual house of cards may be placed on the patient's chest and the patient rewarded for not knocking the cards over. In some aspects, it may be desirable to pose the incentive to stay still as a threat, such as a rose bush with thorns that sits directly over the patient. In one aspect, the threat may be restricted to the areas at or adjacent to the areas being imaged (and thus the areas most important to immobilize). In another aspect, environmental elements may be coordinated with sounds. For example, the sound of the CT scanner rotating around the patient (which may be altered in one aspect) may be coordinated with artificial environmental elements such as placing a user in a virtual environment in a forest where there is logging going on in the distance, and the sounds of the CT scanner coordinated with the sounds of the logging machines.

[0086] Although the present invention may take many forms, it is useful to consider a sample implementation. In one implementation, the invention may present as a seat where the child rests with their chest on a cushioned upholstered platform. Their head is supported by a heavily cushioned face rest. The face rest may be shaped like a horseshoe.

[0087] Through the horseshoe shaped face rest, there may be a display for viewing programming that may occupy the child's mind. A cushioned upholstered seat may rest below the child's buttock and/or upon the child's upper hamstrings, to support the child's rear while another cushioned upholstered platform supports the child's shins or knees. An armrest may extend from the front of the instant invention to support the child's arms so that they may rest limply. When seated properly in the instant invention the child may appear to be in a prayer like position but tilted forward at a 45 degree (or other) angle. This position may take stress away from the muscle groups commonly injected for a vaccine. The shin and arm rests may be outfitted with adjustable cushioned upholstered siding that may be adjusted to fit snugly along the limbs of the child.

[0088] Weighted gears may be placed within the cushions of the rear seat, chest, shin rest and armrest cushions to gently vibrate the child to sooth and further relax the muscles of the child. This vibration may put the child further at ease as they may be concurrently engrossed in the programming playing on the display within the face rest. In another aspect, air jets may be placed in the cushions of the rear seat, chest, shin rest and armrest cushions to shoot out gentle bursts of air against the injection recipient's body to simulate the touch of an object against the recipient's body. In addition more air jets may be beneath the armrest cushion, such that the air jets may shoot air burst on the thigh muscles of the injection recipient. The face rest may serve as a comfort itself as it may simulate a parent's shoulder.

[0089] While the child may be distracted by the tactile and visual stimuli of the instant invention it may be possible for the healthcare professional to safely inject the child in the appropriate location. There are multiple sites at which it is appropriate to administer an intramuscular (or subcutaneous) injection. The appropriateness of the location varies by age of the child. The vastus lateralis muscle (the thigh) is an ideal injection site location for children of the age of three and younger. The ventrogluteal muscle is a favorable location for children seven months old and older, well into adulthood. The dorsogluteal muscle is an appropriate location for children over three years old. Children younger than three tend to have undeveloped gluteal muscles making the site unfit for intramuscular injection. The deltoid muscle, the shoulder, should be avoided in all persons who are either thin or have undeveloped shoulder muscles.

[0090] The instant embodiment may be constructed with a telescopic pipe that runs down the center of the structure connecting all of the cushions. The telescopic pipe may adjust in a way to allow the repositioning of the injection recipient to further relieve stress from certain body parts, allowing for easier intramuscular injections. For example, if a healthcare professional was administering an intramuscular injection in the shoulder of a patient, the instant invention could be adjusted such that the patient's chest resting on the chest cushion would create a 45-degree angle with the floor that the instant device is resting on. In another example, if the healthcare professional needed to administer a dorsogluteal, ventrogluteal or thigh muscle injection, the patient could be repositioned by adjusting the instant invention such that the patient is face down where the chest cushion is parallel with the floor. Such adjustments may be made by allowing the telescopic pipe joint to recede into or pull out from the larger pipe in order to change the angle of the upper part of the instant invention (including the chest, arm and face rest).

[0091] The instant invention may be constructed keeping these intramuscular sites exposed as to make injection possible. The site of the cushioned support for the child's rear may be placed beneath the gluteus muscles in an effort to expose this muscle group for the ventrogluteal injection. The placement of the shin and arm rests leave both the thigh and arms exposed for thigh or shoulder injection. The armrest may be positioned such that the arms are exposed giving access for both intramuscular injections and blood draws.

[0092] While an injection is being given the patient may be distracted by video programming being played on the display. Furthermore the patient may be distracted by the audio output from the video being played on the display. In another aspect, the audio playing to distract the patient may be played over a calibrated 5.1 or 7.1 sound system. The sound system may be calibrated for the position and height of the patient seating component of the instant embodiment such that an optimal sound field is created for the seated patient. While the patient is about to receive an injection, distracting audio may be played over the speaker systems, such that the sound jumps around from speaker to speaker, potentially making it difficult for the patient to detect the source. This may make it difficult for the patient to determine where the healthcare professional or syringe is, or where or when the injection will be administered.

[0093] Another aspect of the present invention permits modification of a response, or an apparent response of others to the treatment and/or procedure which the patient is undergoing. Such modification of the response of another person may temper or lessen the patient's fear and/or anxiety related to the treatment or procedure. This aspect is roughly analogous to when a child falls down and looks to an adult or parent to determine whether the child is hurt or should be crying. As an example, a parent's frown or grimace may be altered to look like a smile to the patient. A sharp, indrawn breath of the parent may be altered to be heard as a soothing voice or humming. In another example, fictional characters or artificial "people" may be generated and displayed to the child, which the child may recognize as being friendly or nurturing.

[0094] In some aspects, the estimated, apparent, or induced mental status of the patient may be utilized by the system. For example, a patient who has been administered an opiate may not perceive the piercing of a needle as a sharp pain, and thus the image presented may be one consonant with a rub rather than a prick. Similarly, a patient who has had local anesthetic may perceive a certain amount of pressure despite the anesthetic but no pain, and the images presented to that patient, for example while a scalpel is making an incision, may therefore be ones that reflect a pushing across the skin rather than a cutting or scratching. In the case where a sound exists (for example, a drill) and cannot be completely muted or covered up, that sound may be incorporated into the imagery presented. In the case where smells are involved (for example, burning flesh during cauterization), such smells may be incorporated into the visual cues provided (for example, by showing a scalpel being heated as if being sterilized).

[0095] Medical measurements, such as blood pressure and pulse, may be used to modify the images being presented. In one aspect, the images may be modified in a manner that heuristically seeks out a lower blood pressure, pulse, or other indicia of distress. In another aspect, the imagery may change in a manner that tracks the changes to physical distress or condition.

[0096] In one aspect, light projectors mounted on the instant invention may be used to project images on the skin of the patient, camouflaging the syringe or vacutainer, or otherwise rendering the items nearly invisible to the patient if they are otherwise able to see what the healthcare professional is doing. It may also be possible to alter the brightness and colors of the projection to account for the skin tone and complexion of the patient.

[0097] Exemplary Systems and Methods for Improving Public and Personal Safety

[0098] The methods and systems of the present invention may also be applied to improve personal and public safety. Humans have evolved to innately be fearful of loud and abrupt noises, rapidly approaching large objects, and other environmental data that is perceived as a potential threat. In the event of a threat, such as a natural disaster or an attacking animal, frequently loud noises or other indicators of danger cause a person to evade harmful objects or vacate an area. By modifying sensory data associated with less easily perceived threats, a human avoidance or safety response may be induced. In addition, the type of response, such as the direction in which a person runs, may be influenced.

[0099] FIG. 5 demonstrates, in general, a method 500 of altering environmental data to improve personal or public safety according to an embodiment of the present invention. The method begins at step 510, wherein environmental data is captured. As with other embodiments of the present invention, environmental data may be captured utilizing a camera, a video camera or another type of video recorder, microphones, sound recorder (such as a digital sound recorder), sensors and/or detectors (e.g., smoke, carbon monoxide, natural gas, thermal etc.). At step 520, the captured data is analyzed and identified. In step 530, one or more data bases are queried to determine the threat level based on the environmental data captured.

[0100] At step 540 a determination is made as to whether or not there is a significant threat to personal or public safety based on the data collected. If there is not a significant danger, then the method ends at step 545. However, if a significant danger exists, then at step 550, a determination is made as to whether the threat is likely to be perceived by the person, or if appropriate, the public in general. The likely response of a person or the general public may be identified or calculated by searching one or more data bases for information containing histories of similar responses by the person, or general information of how threats are perceived by the general public in the same or similar circumstances. If a determination is made that the threat is likely to be perceived by the target person or the general public, then the method ends at step 555. Otherwise, the method proceeds to step 560.

[0101] At step 560, enhanced data and/or virtual environmental data is generated that will likely induce the desired response. Such data likely to produce the desired response is determined by a search of one or more relevant data bases that contain information regarding what sensory data may evoke a particular response. Such sensory data may be peculiar to a particular individual (in the case of personal safety) or may be applicable, instead, to the public at large.

[0102] At step 570, the enhanced and/or virtual data is substituted for the sensory data captured, and at step 580, a determination is made as to whether the desired response (e.g., avoidance of the threat) is triggered. Such determination may be made by collecting additional, sensory data (e.g., by a video camera that may indicate when a person is fleeing an area). If the desired response is triggered, then the method ends at step 585.

[0103] However, if the desired response is not triggered, then at step 590 additional, alternative environmental data may be generated, which may then be substituted for the previously enhanced and/or virtual data generated. The method then again determines if the avoidance response is triggered. If so, then the method ends at step 575. If not, then the steps 570-590 are repeated until the avoidance response is triggered.

[0104] The methods of the present invention, may be repeated in a continuous loop in real or near real time, or may be programmed to occur at specific times and/or at regular intervals. The times and/or intervals may be dependent on the location, the time of year (e.g., during fire season), the current and/or predicted weather, the number of persons present in a given area, etc.

[0105] It should be appreciated that human perception of a scenario may be further altered by their physiological response, such as a "fight or flight" response to an eminent threat. By modifying the sensory data, altering it if necessary to make obvious the direction in which the human should perceive the threat to be approaching from in order to induce the human to run in the direction of safety, mortality and morbidity may be reduced.

[0106] In one aspect, the invention may function, utilizing sound alone, or primarily sound, as the sensory output source. As an exemplary description, an intersection with a crosswalk may be equipped with one or more cameras, a computing system capable of identifying people in the crosswalk and the speed and direction of oncoming cars. When the system identifies a vehicle that is on a course that, without intervention, may cause injury to the person in the crosswalk, the system may calculate the direction the person should move to minimize injury. For example, the system may utilize a speaker system (in many cases, a multiple-speaker or surround sound system) to cause the person in the crosswalk to perceive a loud, menacing sound coming from the direction of the oncoming vehicle. Alternatively, if desired, it may sound as if the noise is emanating from a point slightly distant from the direction of the oncoming vehicle, but distant in a manner that causes the person's reaction to be more likely the correct one. For example, if the person has just entered the crosswalk and the best path to safety is to turn around and run back to the curb, the sound may appear to come more from the far side of the street than the approaching vehicle's actual position in the street.

[0107] In another exemplary scenario, a photonic fence and laser system utilized for malaria control may be modified to include a sound generation system. There may be cases, such as when a mosquito is aligned in a manner that creates risk to human sight, in which the laser system is inappropriate to use to kill the mosquito. There may also be situations, such as fog, rain or other objects between the laser and the mosquito (in the case of rain, one may imagine the mosquito under a canopy and thus able to fly), where the laser cannot reach or effectively kill the mosquito. In such instances the present invention may utilize the location data for the mosquito and create a sound perceptible by a human near the mosquito that makes the mosquito far more likely to be detected by the human and appropriately killed or avoided.

[0108] In one aspect, the mosquito may additionally be illuminated with a low power laser or another light source to make identification and location of the mosquito simpler. It should be understood while this document discusses speaker systems, other mechanisms for generation of actual or perceived sound may be utilized. Furthermore, force feedback devices may additionally be utilized to create a sensation on a person's skin to make them aware of a mosquito that has landed on them. Indeed, in some aspect, it is not preferable to attempt to kill a mosquito with a very high powered laser when the mosquito is on a person's skin, but utilizing a laser sufficient to warm the skin, but not damage the skin, may be sufficient to trigger the person to notice and kill the mosquito.

[0109] In another aspect, the present invention may alter a user's perception of events so as to improve their response time or minimize their injury. For example, if a car is going to hit a pedestrian and the system detects that the pedestrian can likely reduce injury by standing more upright (for example, to concentrate the force on the legs rather than the pelvis or abdomen), the system may alter the view so that the vehicle appears to be much shorter than it really is, encouraging the user to try to jump over the car. Further, if a threat (such as a car) is detected but the user is not yet moving, the threat can be altered to be more noticeable to the user, such as by making the vehicle larger, by causing a noise to appear to emanate from the vehicle, to cause the vehicle to appear to be flashing its lights, etc.

[0110] Such systems may be designed with regard to new or altered threats to attach sounds and/or images that the user already associates (or likely associates) with certain risk profiles and/or responses. For example, most humans associate the sound of an internal combustion engine with a vehicle, and such sounds trigger awareness and safety-enhancing responses. If the system detects a vehicle with a silent (or nearly silent) electric motor, the system may cause the user to perceive the sound of an internal combustion engine as the vehicle approaches and/or if the system determines that there is a risk presented by the vehicle.

[0111] Similarly, chemical analysis may identify dangerous atmospheric elements (or the presence in the atmosphere of markers indicating the proximate presence of dangerous chemicals). In such a case, a smell (such as the smell of gasoline), an image (such as fire), and/or a sound (such as an alarm) may be presented to the user. In some implementations the presentation of such warning signals may be done in such a manner as to cause the person to flee in an appropriate direction and/or to take other appropriate responses.

[0112] There are multiple other uses for the invention. For example, a thermal sensor may be utilized to determine when an environmental object is at a temperature that may cause injury. In such a case, the object may be made to glow red or blue, may appear to emit a sound, or may otherwise be modified (utilizing augmented reality or other technology) to elicit a response.

[0113] In another application, if toxins are detected, such as sarin gas, or in the event of another threat where movement in a particular direction is preferable, the invention may be utilized to create a sound appearing to originate in a particular direction, either a scary or uncomfortable sound, or a sound associated with threat, optionally together with instructions to run in the direction of, or away from, the sound.

[0114] In another aspect, the system may be mounted within a vehicle. Threats to the safety of the vehicle or those outside of the vehicle may be evaluated by the system. For example, if the system identifies a bicycle, it may make a sound in the vehicle, perhaps one similar to a motorcycle, appearing to originate in the direction of the bicycle, thus notifying the driver as to the presence of the bicycle. In another example, the system may identify a vehicle that is being driven in an erratic manner or weaving, for example by tracking only one of the two lane lines, and may create an audio warning that the vehicle is erratic and a potential threat.

[0115] Exemplary Systems and Methods for Military and Public Safety Situations

[0116] The systems and methods of the present invention may also improve the efficiency and efficacy of military operations. A variety of mechanisms exist for projection of three dimensional images onto the retina. These include an assortment of stereoscopic displays that do not require glasses, displays that require alternating shutter glasses, displays that require polarized glasses, holographic and electro-holographic displays, immersive glasses (such as the Oculus Rift), and others. While embodiments of the present invention are described with regard to 3D display technology, it should be noted that in many cases 2D technology may be acceptable, and in some cases may be made efficacious by blocking the display from being viewed by one of the user's two eyes. Similarly, a variety of mechanisms exist for projection of sound, and even for simulation or release of scents, temperatures, force feedback and other sensory data.

[0117] Such mechanisms may be operably coupled with a data processing device, such as a computer, and utilized to alter user sensory perceptions in order to trigger or ease the evocation of certain human (or animal) behavior.

[0118] This alteration is particularly critical in public safety or military situations. A simple example is that while humans are innately afraid of a growling animal and will likely evaluate the risk posed currently, the sound of a bullet passing near the ear is likely to trigger perception of danger that is far smaller than the actual level of danger. Similarly, a backpack that is out of place and that may contain a bomb is likely to trigger no fear reaction, even in an environment where there has been a warning that a terror event is expected.

[0119] Further, the speed and other characteristics of certain threats can render human perception ineffective or inaccurate. For example, a sniper rifle fired from a mile away may not generate a sufficient sound when actuated to identify the location of the rifle. At the same time, the speed of the bullet may make visual or audio tracking of the bullet impossible or inaccurate. As a result, people in the target area may not know the direction the shots are coming from, and thus be unable to identify an appropriate barrier to hide behind.

[0120] Modern computers, cameras, microphones, and other data gathering devices make it possible to identify the source and true level of modern threats in a manner that an unaided human would be unlikely to achieve. As an exemplar, consider a public shooting. In such event, the instant invention can make obvious the direction of the gunshots by amplifying the sound, adding visual cues to entice the person to turn toward the danger (e.g., in the case of a police officer) or to flee the danger (e.g., in the case of a bystander). One implementation may be a green flashing pathway with arrows pointing away from the danger and/or a red flashing pathway with arrows pointing toward it. Additionally the instant invention may notify a person of his proximity to danger with a noise that increases or decreases in frequency with respect to the proximity to danger. The presentation of this actionable data in dangerous situations may be critical in saving lives.

[0121] In combat on the ground, for instance an extraction mission, the instant invention may prove invaluable in the marking and differentiation of friend or foe. When paired with a device that emits a known, unique, signature or frequency, worn only by friendly forces, in conjunction with facial recognition software, and/or in conjunction with other identification methods, the instant invention can visually differentiate those forces from hostile forces or targets with a mark such as a color or symbol. Such a differentiation may visually appear to be similar to those seen on first person shooter video games.

[0122] The uses of the instant invention in this context are multifaceted. Not only would the specified augmented reality equipment be able to display the difference between friendly and hostile units, but also do so through objects such as trees, other topography presented by the terrain, walls, or any object through which the signal emitted from the device worn by friendly forces can travel. Furthermore, the instant invention can display different states of the friendly forces, such as blinking the marker or changing the appearance of the marker, if the friendly unit is injured or in trouble.

[0123] When paired with other devices such as a microphone, radio, or other transmission devices worn by soldiers, the instant invention if networked, can provide information about the status of different quadrants of the battlefield, from a present unit to other nearby units, through the transmission of sound or visual information. The instant invention may be used to share one unit's view or perspective with other units in real time or near real time, upon request or otherwise. In this way each ground unit can provide data from a unique perspective different to the data provided by technologies such as unmanned aerial vehicles (UAV), while simultaneously enhancing or altering their own perception. The presentation of this type of data by the instant invention can increase the efficiency of ground forces while improving and preserving their personal safety. Additionally the ability of the instant invention to provide passive feedback to other units or headquarters may improve response times and adaptations to unforeseen developments in combat.

[0124] An embodiment of the present invention is described schematically in FIG. 6. In the system 600 of FIG. 6, a number of user devices 601-604 are linked to a control center 610. Any number N of user devices may be linked to control center 610. Actual environmental and sensory data from the user devices are transmitted to the control center 610, which includes a computing device 620. The computing device 620, may include a database 621 in which aggregated location, topography and other environmental data from each of the user devices 601-604 is analyzed, identified and/or stored. The same or another data base may contain instructions to transmit back to user devices 601 through 604 modified and/or enhanced location, topographic and/or other environmental data.

[0125] In one aspect, the device or devices may be associated with an individual. In another aspect, each individual may have data or other metrics tracked and utilized across one or more other user devices, optionally in conjunction with facial recognition or other tracking technology. The individuals' reactions to various signals may be recorded. In some implementations, data may be sought out by triggering user reactions, such as by showing a user which way to walk in response to a user inquiry, where different ways to show the direction may be tested for efficacy.

[0126] In some aspects, user familiarity with video games, virtual environments, drone control systems, robotic control systems, or other human/computer interfaces may be analyzed, requested, measured, or otherwise learned by the system. The system may then bias or prefer control inputs and messages to the user that are similar to the systems with which the user is familiar. In a simple example, the "survival mode" in Minecraft includes certain hostile creatures that make a very specific noise. By contrast, the zombies in the survival version of "Call of Duty" make a different, specific noise. A person who uses Minecraft frequently would be more responsive to the Minecraft noises and those noises would thus be preferred for warning that user.

[0127] In another aspect, of relevance to combat or police situations (among others), is that different weapons make distinguishable, unique sounds. For example, specific firearms (potentially in combination with specific rounds, or specific rounds on their own) make certain noise patterns on firing. Similarly, types of firearms and types of rounds make identifiable sounds. The system may identify police rounds, standard issue police weapons, or even the specific weapon owned by a user of the system or an ally of a user of the system as "friendly" rounds and provides a different kind of warning, indication of location, or even no indication for such rounds.

[0128] The system may also differentiate real weapons and real rounds from fake rounds. The system may also identify both the sound of a shot originating and the sound of a shot hitting a target, and use those points to estimate the distance of the shooter, the direction of the shots, and other data that may be of use. The system may also reference a database or compare data gathered during a single event or past events in order to predict the ballistic or other characteristics of ordinance or other threats. For example, if the system identifies the sound of an Acme Road Runner gun and the Acme Coyote bullet, it may reference a database and determine that the range of that combination of ordinance is 300 meters with an accuracy of approximately 2 feet at 300 meters.

[0129] It should be noted that in the future, direct neural input may make it possible to transmit images or other sensory data directly to a person's brain, and such technology could be used as a transmission modality for some aspects of these inventions.

[0130] The foregoing descriptions of specific embodiments of the present invention have been presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principals of the invention and its practical application, to thereby enable others skilled in the art to best utilize the invention and the various embodiments and modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the components and elements described herein and their equivalents.

Claims

1. A method of altering sensory perceptions of a person, the method comprising: operably coupling at least one device for capturing sensory data to a computing device; capturing sensory data using the at least one device; identifying the sensory data captured; querying at least one data base to identify one or more desired behaviors and/or outcomes; querying the at least one data base and/or one or more other data bases to identify and/or calculate modified, enhanced and/or virtual sensory data likely to achieve the desired behavior(s) or outcome(s); generating the modified, enhanced and/or virtual sensory data; substituting the modified, enhanced and/or virtual sensory data in real or near real time for the sensory data, wherein the modified, enhanced and/or virtual sensory data is configured to trigger the one or more desired behaviors or outcomes.

2. The method of claim 1, wherein the modified, enhanced and/or virtual sensory data is one or more of visual, auditory, olfactory, gustatory, and/or tactile data.

3. The method of claim 1, wherein the modified, enhanced and/or virtual sensory data is alternated with different modified, enhanced and/or virtual sensory data to enhance the person's perception that the modified, enhanced and/or virtual sensory data is real.

4. The method of claim 1, further comprising capturing medical data from one or more measuring devices, and utilizing the medical data to identify modified and/or enhanced sensory data likely to achieve the desired behavior or outcome.

5. The method of claim 4, wherein the medical data comprises blood pressure, pulse rate, body fat percentage, blood sugar and/or blood alcohol level.

6. The method of claim 5, wherein differences between the sensory data and the modified, enhanced and/or virtual sensory data become greater or lesser depending on the person's blood pressure, pulse rate, body fat percentage, blood sugar and/or blood alcohol level compared to a desired blood pressure, pulse rate, body fat percentage, blood sugar and/or blood alcohol level.

7. The method of claim 1, further comprising capturing calorie consumption, activity level, calorie utilization and/or sleep history data, wherein the calorie consumption, activity level, calorie utilization level and/or sleep history data is used to identify (a) the one or more desired behaviors and/or outcomes and/or (b) the modified, enhanced and/or virtual sensory data likely to achieve the desired behavior or outcome.

8. The method of claim 1, wherein the at least one device is one or more mirrors, cameras, video and/or audio recorders, microphones, speakers, headphones, amplifiers, three-dimensional monitors, digital image projectors, light projectors, stereoscopic devices, alternating shutter glasses, polarized glasses, holographic display devices, electro-holographic display devices and/or immersive visual devices.

9. The method of claim 1, wherein the sensory data is a threat to the person's safety, and the method further comprises identifying the source and level of the threat, and the modified, enhanced and/or virtual sensory data is calculated to (a) make obvious the direction from which the threat is coming, and/or (b) induce the person to avoid and/or eliminate the threat.

10. The method of claim 1, further comprising (a) capturing location, topography and/or environmental data for the person, modifying and/or enhancing the location, topography and/or environmental data, and transmitting the modified and/or enhanced location, topography and/or environmental data to other persons and/or a control center.

11. The method of claim 1, further comprising capturing location, topography and/or environmental data for one or more other living beings and/or inanimate objects, modifying and/or enhancing the location, topography and/or environmental data, and transmitting the modified and/or enhanced location, topography and/or environmental data to the person, other persons and/or a control center.

12. A system for altering sensory perceptions of a person to achieve a desired outcome, the system comprising: at least one device configured to capture and/or generate sensory data, the at least one device operably coupled to a computing device configured to (a) identify the sensory data captured, and (b) identify and/or calculate (i) desired behaviors and/or outcomes, and (ii) modified, enhanced and/or virtual sensory data likely to achieve the desired behaviors and/or outcomes in real or near real time.

13. The system of claim 12, wherein the at least one device is a light, a sound and/or a small projection device incorporated into the person's environment.

14. The system of claim 12, further comprising a support system for supporting one or more parts of a body of a person, the support system comprising (a) a seat, (b) a head rest, (c) a chest support, (d) a face rest, (e) upper legs rests, (f) lower leg rests and/or (g) arm rests.

15. The system of claim 14, where at least one position of the support system is adjustable.

16. The system of claim 14, further comprising an opaque barrier configured to shield from sight all or part of the person's body.

17. The system of claim 12, wherein the at least one device is one or more vibration generating mechanisms and/or air jets.

18. The system of claim 12, wherein the at least one device is a force feedback device.

19. The system of claim 12, wherein the modified, enhanced and/or virtual sensory data is identified and/or calculated based on sounds and/or images the person likely associates with certain risks and/or responses.

20. The system of claim 12, wherein the system is mounted in a vehicle.