U.S. patent number RE44,550 [Application Number 13/773,341] was granted by the patent office on 2013-10-22 for method and device for pictorial representation of space-related data.
This patent grant is currently assigned to ART + COM Innovationpool GmbH. The grantee listed for this patent is Art+Com Innovationpool GmbH. Invention is credited to Gerd Gruneis, Pavel Mayer, Joachim Sauter, Axel Schmidt.
United States Patent |
RE44,550 |
Mayer , et al. |
October 22, 2013 |
Method and device for pictorial representation of space-related
data
Abstract
A method and device for the pictorial representation of
space-related data, for example, geographical data of the earth.
Such methods are used for .[.visualising.]. .Iadd.visualizing
.Iaddend.topographical or meteorological data in the form of
weather maps or weather forecast films. Further fields of
application are found in tourism, in traffic control, in navigation
aids and also in studio technology. The space-related data, for
example topography, actual cloud distribution, configurations of
roads, rivers or frontiers, satellite images, actual temperatures,
historical views, CAD-models, actual camera shots, are called up,
stored or generated in a spatially distributed fashion. For a
screen representation of a view of the object according to a field
of view of a virtual observer, the required data are called up and
shown only in the resolution required for each individual section
of the image. The sub-division of the image into sections with
different spatial resolutions is preferably effected according to
the method of a binary or quadrant tree.
Inventors: |
Mayer; Pavel (Berlin,
DE), Schmidt; Axel (Berlin, DE), Sauter;
Joachim (Berlin, DE), Gruneis; Gerd (Berlin,
DE) |
Applicant: |
Name |
City |
State |
Country |
Type |
Art+Com Innovationpool GmbH |
Berlin |
N/A |
DE |
|
|
Assignee: |
ART + COM Innovationpool GmbH
(Berlin, DE)
|
Family
ID: |
7781754 |
Appl.
No.: |
13/773,341 |
Filed: |
February 21, 2013 |
Related U.S. Patent Documents
|
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
Issue Date |
|
Reissue of: |
12006231 |
Dec 31, 2007 |
Re. 41428 |
Jul 13, 2010 |
|
Reissue of: |
08767829 |
Dec 17, 1996 |
6100897 |
Aug 8, 2000 |
|
|
Foreign Application Priority Data
|
|
|
|
|
Dec 22, 1995 [DE] |
|
|
19549306 |
|
Current U.S.
Class: |
345/428; 702/3;
345/441; 345/419; 345/619; 345/629 |
Current CPC
Class: |
G06T
17/05 (20130101) |
Current International
Class: |
G06T
15/00 (20110101) |
Field of
Search: |
;345/419,426,427,428,432,433,441,619,629,631,132,133 ;702/3 |
References Cited
[Referenced By]
U.S. Patent Documents
Foreign Patent Documents
|
|
|
|
|
|
|
3639026 |
|
May 1987 |
|
DE |
|
4209936 |
|
Sep 1993 |
|
DE |
|
0 587 443 |
|
Mar 1994 |
|
EP |
|
0 684 585 |
|
Nov 1995 |
|
EP |
|
0780800 |
|
Jun 1997 |
|
EP |
|
Other References
KR. Sloan, Jr., et al., "Progressive Refinement of Raster Images",
IEEE Transactions on Computers, Nov. 11, 1979, vol. C-28, No. 11,
pp. 871-874. cited by applicant .
J.D. Foley et al., "Computer Graphics Principles and Practice",
Addison-Wesley Publishing Company copyright 1990, pp. 548-557,
844-846, 880-882. cited by applicant .
R.D. Bess (XP 000857702), "Image Generation Implications for
Networked Tactical Training Systems", published Sep. 18, 1993, pp.
308-317, Bellevue Washington. cited by applicant .
Y.G. Leclerc, et al., "SRI International-Terra Vision: A Terrain
Visualization System", Apr. 22, 1994, 20 pages. cited by applicant
.
D. Koller et al. (XP 000585396), "Virtual GIS: A Real-Time 3D
Geographic Information System", pub. Oct. 29, 1995, pp. 94-100,
Proceedings of the 6th IEEE Visualization Conf. cited by applicant
.
Sauter, Joachim, "The Terravision Project: A Global Mirror", 1995,
4 pages, www.doorsofperception.com.../doors3/transcripts/sauter.
cited by applicant .
Grueneis, et al. (XP-000986312), "T-Vision", in Visual Proceedings.
The Art and Interdisciplinary Programs of Siggraph 95, Aug. 1995,
p. 134. cited by applicant .
CD-ROM Materials from Siggraph 95, Aug. 6-11, 1995, in Los Angeles,
CA, USA: "The T.sub.--Vision Project". cited by applicant .
Declaration of Pavel Mayer filed under 37 C.F.R. 1.132. cited by
applicant .
Barbara B. Fuller et al., An Overview of the Magic Project, Dec.
1993. cited by applicant .
Y.G. Leclerc, SRI International, "Tile Set Definitions," Technical
Note No. 541, Apr. 28, 1994, 18 pages. cited by applicant .
Brian L. Tierney et al., "The Image Server System: A High-Speed
Parallel Distributed Data Server," Lawrence Berkeley Laboratory
Report 36002, 1994, 12 pages. cited by applicant .
Brian Tierney et al., "Distributed Parallel Data Storage Systems: A
Scalable Approach to High Speed Image Servers," Proc. ACM
Multimedia, 1994, 11 pages. cited by applicant .
Brian L. Tierney et al., "Using High Speed Networks to Enable
Distributed Parallel Image Server Systems," Proc. Supercomputing,
1994, 10 pages. cited by applicant .
Brian L. Tierney et al, "System Issues in Implementing High Speed
Distributed Parallel Storage Systems," USENIX Symposium on High
Speed Networking, 1994, 15 pages. cited by applicant .
Y.G. Leclerc et al, SRI International, 1994 Magic Technical
Symposium Presentation, 1994, 22 pages. cited by applicant .
Yvan G. Leclerc, Magic Final Report, SRI International, May 1996,
14 pages. cited by applicant .
Barbara Fuller and Ira Richer, "The Magic Project: From Vision to
Reality," May/Jun. 1996, 11 pages. cited by applicant .
CD-ROM Materials from Siggraph 95, Aug. 6-11, 1995, in Los Angeles,
CA, USA: "Magic Gigabit Testbed". cited by applicant .
Excerpts from Deposition of Stephen Lau, Jr., filed in Skyline
Software Systems, Inc. v. Keyhole, Inc., and Google, Inc., 17
pages. cited by applicant.
|
Primary Examiner: Nguyen; Phu K
Attorney, Agent or Firm: Baker Botts L.L.P.
Claims
What is claimed is:
1. A method of providing a pictorial representation of
space-related data of a selectable object, the representation
corresponding to .[.the.]. .Iadd.a .Iaddend.view of the object by
an observer with a selectable location and a selectable direction
of view comprising: (a) providing a plurality of spatially
distributed data sources for storing space-related data; (b)
determining a field of view including .[.the.]. .Iadd.an
.Iaddend.area of the object to be represented through .[.the.].
.Iadd.a .Iaddend.selection of .[.the.]. .Iadd.a .Iaddend.distance
of the observer to the object and .[.the.]. .Iadd.an .Iaddend.angle
of view of the observer to the object; (c) requesting data for the
field of view from at least one of the plurality of spatially
distributed data sources; (d) centrally storing the data for the
field of view; (e) representing the data for the field of view in a
pictorial representation having one or more sections; (f)
.Iadd.using a computer, .Iaddend.dividing each of the one or more
sections having image resolutions below a desired image resolution
into a plurality of smaller sections, requesting higher resolution
.[.space related.]. .Iadd.space-related .Iaddend.data for each of
the smaller sections from at least one of the plurality of
spatially distributed data sources, centrally storing the higher
resolution .[.space related.]. .Iadd.space-related .Iaddend.data,
and representing the data for the field of view in .[.a.].
.Iadd.the .Iaddend.pictorial representation; and (g) repeating step
(f), dividing the sections into smaller sections, until every
section has the desired image resolution or no higher image
resolution data is available.
2. The method of pictorial representation defined in claim 1,
further including altering the selectable location and performing
.Iadd.the .Iaddend.steps (b) through (g).
3. The method of pictorial representation defined in claim 2,
further including determining the data and/or the co-ordinates of
the data in terms of a new co-ordinate system.
4. The method of pictorial representation defined in claim 1,
further including altering the selectable direction of the view and
performing .Iadd.the .Iaddend.steps (b) through (g).
5. The method of pictorial representation defined in claim 4,
further including determining the data and/or the co-ordinates of
the data in terms of a new co-ordinate system.
6. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.step (f) further includes requesting
data of a uniform resolution for each of the smaller sections.
7. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.steps (c) and (f) further include
requesting data not already centrally stored from only one of the
spatially distributed data sources.
8. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.step (f) further includes showing only
the centrally stored data of each section with the highest spatial
density.
9. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.step (f) further includes effecting the
representation of the data in an optional pre-set form of
representation.
10. The method of pictorial representation defined in claim 1,
further including removing the data of a section from the central
store when the section passes out of the field of view due to an
alteration in the location or of the angle of the view.
11. The method of pictorial representation defined in claim 1,
further including permanently centrally storing at least one full
set of space-related data with a low spatial resolution.
12. The method of pictorial representation defined in claim 1,
further including not showing .[.the.]. regions of the object
located with respect to the observer behind nontransparent areas of
the object.
13. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.step (f) comprises dividing each of the
one or more sections using a model of the binary tree.
14. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.step (f) comprises dividing each of the
one or more sections using a model of the quadrant tree.
15. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.step (f) comprises dividing the sections
using a model of the octant tree.
16. The method of pictorial representation defined in claim 1,
further including using an adaptive sub-division model with a
plurality of models used next to one another for sub-dividing the
field of view into smaller sections.
17. The method of pictorial representation defined in claim 1,
wherein the data are present as pixel graphics and/or as vector
graphics and/or in tabular form.
18. The method of pictorial representation defined in claim 1,
wherein the object is a heavenly body.
19. The method of pictorial representation defined in claim 18,
wherein .Iadd.the .Iaddend.steps (e) and (f) further include
.[.representating.]. .Iadd.representing .Iaddend.the data with a
two-dimensional polygonal geometrical model of the topography of
the object, the spatial relationship of the data being given by the
provision of two co-ordinates on the polygonal geometrical
model.
20. The method of pictorial representation defined in claim 19,
wherein height information is represented as color vertices on the
two-dimensional polygonal geometrical model.
21. The method of pictorial representation defined in claim 19,
wherein an adaptive topographical grid model is used, the spatial
distance between two grid lines becoming smaller as the
topographical altitude becomes greater.
22. The method of pictorial representation defined in claim 19,
wherein .Iadd.the .Iaddend.step (f) further includes dividing each
of the one or more sections using a model of the quadrant tree.
23. The method of pictorial representation defined in claim 22,
wherein .Iadd.the .Iaddend.step (f) further includes dividing each
of the one or more sections using an adaptive sub-division model
such that the sub-division merges into a binary tree at the
poles.
24. The method of pictorial representation defined in claim 19,
wherein in the two-dimensional polygonal grid model, spatial data
are shown on a plurality of different two-dimensional layers.
25. The method of pictorial representation defined in claim 18,
wherein the representation in .Iadd.the .Iaddend.steps (e) and (f)
is in the form of a globe.
26. The method of pictorial representation defined in claim 18,
wherein the representation in .Iadd.the .Iaddend.steps (e) and (f)
is in the form of cartographic form of representation.
27. The method of pictorial representation defined in claim 1,
wherein the object is the earth.
28. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.steps (e) and (f) further include
representing the data with a polygonal grid model.
29. The method of pictorial representation defined in claim 28,
wherein .Iadd.the .Iaddend.step (f) comprises dividing the sections
using a model of the octant tree.
30. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.steps (e) and (f) further include
representing the data with a three-dimensional geometrical model of
the topography of the objects, the spatial relationship of the data
being given by the provision of three co-ordinates on the
geometrical model.
31. The method of pictorial representation defined in claim 1,
wherein the space-related data include CAD models.
32. The method of pictorial representation defined in claim 1,
further including inserting animated objects into the pictorial
representation.
33. The method of pictorial representation defined in claim 1,
further including inserting display tables into the pictorial
representation.
34. The method of pictorial representation defined in claim 1,
further including inserting information and/or directly generated
image material into the representation.
35. The method of pictorial representation defined in claim .[.1.].
.Iadd.34.Iaddend., wherein the directly generated image material
includes camera shots.
36. The method of pictorial representation defined in claim 1,
wherein the .[.space related.]. .Iadd.space-related .Iaddend.data
are provided with references to further spatial data.
37. The method of pictorial representation defined in claim 1,
wherein the .[.space related.]. .Iadd.space-related .Iaddend.data
are provided with references to thematically adjacent data.
38. The method of pictorial representation defined in claim 1,
wherein the .[.space related.]. .Iadd.space-related .Iaddend.data
are provided with references to data of the same area with another
resolution.
39. The method of pictorial representation defined in claim 1
further including determining a probability for .[.the.]. regions
surrounding the field of view that the regions will pass into the
field of view when there is an alteration in the location or of the
angle of view of the observer.
40. The method of pictorial representation defined in claim 39
further including requesting and centrally storing the data of the
areas with the highest probability.
41. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.steps (c) and (f) further include
transmitting data asynchronously.
42. The method of pictorial representation defined in claim 1,
wherein .Iadd.the .Iaddend.steps (e) and (f) further include
showing the data on a screen.
.Iadd.43. The method of pictorial representation defined in claim
1, wherein a plurality of computers can access the plurality of
spatially distributed data sources..Iaddend.
.Iadd.44. The method of pictorial representation defined in claim
43, further including altering the selectable direction of the
view, performing the steps (b) through (g), and determining the
data and/or the co-ordinates of the data in terms of a new
co-ordinate system..Iaddend.
.Iadd.45. The method of pictorial representation defined in claim
44, wherein a pictorial representation is provided to the observer
when the selectable direction of the view is altered and the steps
(b) through (g) are performed..Iaddend.
.Iadd.46. The method of pictorial representation defined in claim
43, further including altering the selectable location of the view,
performing the steps (b) through (g), and determining the data
and/or the co-ordinates of the data in terms of a new co-ordinate
system..Iaddend.
.Iadd.47. The method of pictorial representation defined in claim
46, wherein a pictorial representation is provided to the observer
when the selectable location of the view is altered and the steps
(b) through (g) are performed..Iaddend.
.Iadd.48. The method of pictorial representation defined in claim
43, wherein the step (c) includes requesting data for the field of
view from at least two of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.49. The method of pictorial representation defined in claim
43, wherein the step (c) includes requesting data for the field of
view from at least three of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.50. The method of pictorial representation defined in claim
43, wherein the step (c) includes requesting data for the field of
view from at least four of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.51. The method of pictorial representation defined in claim
43, further including inserting directly generated image material
into the representation, wherein the directly generated image
material includes images captured by a running camera..Iaddend.
.Iadd.52. The method of pictorial representation defined in claim
43, wherein the space-related data are provided with references to
thematically adjacent data..Iaddend.
.Iadd.53. The method of pictorial representation defined in claim
52, wherein the references are hyperlinks..Iaddend.
.Iadd.54. The method of pictorial representation defined in claim
43, wherein the space-related data are provided with references to
further spatial data..Iaddend.
.Iadd.55. The method of pictorial representation defined in claim
54, wherein the references are hyperlinks..Iaddend.
.Iadd.56. The method of pictorial representation defined in claim
43, wherein said at least one of the spatially distributed data
sources is located where the space-related data is collected or
processed..Iaddend.
.Iadd.57. The method of pictorial representation defined in claim
43, wherein the steps (e) and (f) further include representing the
data with a two-dimensional polygonal geometrical model of the
topography of the object, the spatial relationship of the data
being given by the provision of two co-ordinates on the polygonal
geometrical model, and further wherein in the two-dimensional
polygonal grid model, space-related data are shown on a plurality
of different two-dimensional layers..Iaddend.
.Iadd.58. The method of pictorial representation defined in claim
1, wherein the step (b) includes determining the field of view
using an automatic position-fixing system..Iaddend.
.Iadd.59. The method of pictorial representation defined in claim
58, further including altering the selectable direction of the
view, performing the steps (b) through (g), and determining the
data or the co-ordinates of the data in terms of a new co-ordinate
system..Iaddend.
.Iadd.60. The method of pictorial representation defined in claim
59, wherein the pictorial representation is provided to the
observer when the selectable direction of the view is altered and
the steps (b) through (g) are performed..Iaddend.
.Iadd.61. The method of pictorial representation defined in claim
58, further including altering the selectable location of the view,
performing the steps (b) through (g), and determining the data or
the co-ordinates of the data in terms of a new co-ordinate
system..Iaddend.
.Iadd.62. The method of pictorial representation defined in claim
61, wherein the pictorial representation is provided to the
observer when the selectable location of the view is altered and
the steps (b) through (g) are performed..Iaddend.
.Iadd.63. The method of pictorial representation defined in claim
58, wherein the step (c) includes requesting data for the field of
view from at least two of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.64. The method of pictorial representation defined in claim
58, wherein the step (c) includes requesting data for the field of
view from at least three of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.65. The method of pictorial representation defined in claim
58, wherein the step (c) includes requesting data for the field of
view from at least four of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.66. The method of pictorial representation defined in claim
58, further including inserting directly generated image material
into the representation, wherein the directly generated image
material includes images captured by a running camera..Iaddend.
.Iadd.67. The method of pictorial representation defined in claim
58, wherein the space-related data are provided with references to
thematically adjacent data..Iaddend.
.Iadd.68. The method of pictorial representation defined in claim
67, wherein the references are hyperlinks..Iaddend.
.Iadd.69. The method of pictorial representation defined in claim
58, wherein the space-related data are provided with references to
further spatial data..Iaddend.
.Iadd.70. The method of pictorial representation defined in claim
69, wherein the references are hyperlinks..Iaddend.
.Iadd.71. The method of pictorial representation defined in claim
58, wherein said at least one of the spatially distributed data
sources is located where the space-related data is collected or
processed..Iaddend.
.Iadd.72. The method of pictorial representation defined in claim
58, wherein the steps (e) and (f) further include representing the
data with a two-dimensional polygonal geometrical model of the
topography of the object, the spatial relationship of the data
being given by the provision of two co-ordinates on the polygonal
geometrical model, and further wherein in the two-dimensional
polygonal grid model, space-related data are shown on a plurality
of different two-dimensional layers..Iaddend.
.Iadd.73. The method of pictorial representation defined in claim
1, wherein the step (c) includes requesting data for the field of
view from at least two of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.74. The method of pictorial representation defined in claim
1, wherein the step (c) includes requesting data for the field of
view from at least three of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.75. The method of pictorial representation defined in claim
1, wherein the step (c) includes requesting data for the field of
view from at least four of the plurality of spatially distributed
data sources..Iaddend.
.Iadd.76. The method of pictorial representation defined in claim
1, wherein the data are present as pixel graphics..Iaddend.
.Iadd.77. The method of pictorial representation defined in claim
1, wherein the data are present as vector graphics..Iaddend.
.Iadd.78. The method of pictorial representation defined in claim
1, wherein the data are present in tabular form..Iaddend.
.Iadd.79. The method of pictorial representation defined in claim
1, further including inserting information into the
representation..Iaddend.
.Iadd.80. The method of pictorial representation defined in claim
1, further including inserting directly generated image material
into the representation..Iaddend.
.Iadd.81. The method of pictorial representation defined in claim
1, further including inserting directly generated image material
into the representation, wherein the directly generated image
material includes images captured by a running camera..Iaddend.
.Iadd.82. The method of pictorial representation defined in claim
1, wherein said at least one of the spatially distributed data
sources is located where the space-related data is collected or
processed..Iaddend.
.Iadd.83. The method of pictorial representation defined in claim
2, further including altering the selectable direction of the view,
performing the steps (b) through (g), and determining the data
and/or the co-ordinates of the data in terms of a new co-ordinate
system..Iaddend.
.Iadd.84. The method of pictorial representation defined in claim
2, wherein a pictorial representation is provided to the observer
when the selectable location of the view is altered and the steps
(b) through (g) are performed..Iaddend.
.Iadd.85. The method of pictorial representation defined in claim
4, wherein a pictorial representation is provided to the observer
when the selectable direction of the view is altered and the steps
(b) through (g) are performed..Iaddend.
Description
The invention relates to a method and a device for pictorial
representation of space-related data, particularly geographical
data of flat or physical objects. Such methods are used for example
for .[.visualising.]. .Iadd.visualizing .Iaddend.topographic or
meteorological data in the form of weather maps or weather forecast
films. Further fields of application arise from tourism, in traffic
control, as navigation aids and in studio technology.
Representations of geographical information are generated according
to prior art by using a so-called paintbox. The latter generates
from given geographical information maps of a desired area, which
are then selectably altered, and for example can be .[.coloured or
emphasised.]. .Iadd.colored or emphasized .Iaddend.according to
states, or even represented in an altered projection.
Another system for generating views of a topography is found in
.[.the.]. known flight .[.simulator.]. .Iadd.simulators.Iaddend..
In this case, starting from a fictitious observation point from the
cockpit of an aircraft, a view of the surroundings is
generated.
Electronic maps, such as are marketed today on CD-ROM memories, or
navigation systems in terrestrial vehicles, likewise generate from
.[.a.]. fixed databases a diagrammatic .[.vies.]. .Iadd.view
.Iaddend.of the geography of a desired area. These systems however
do not have the capacity for representing various views of the
area, but are restricted to mapping topographical features such as
the configuration of roads, railway lines or rivers.
All the .[.names.]. .Iadd.named .Iaddend.methods and devices for
.[.visualising.]. .Iadd.visualizing .Iaddend.geographical data
.[.utilise.]. .Iadd.utilize .Iaddend.fixed data sets in order to
generate the desired images. The resolution of the representation
is therefore limited to the resolution of the data sets stored in a
memory unit. Further, only those space-related data can be observed
which are provided in the respective data bank. Thus it is not for
example possible to provide representations which have been
generated on the basis of electronically stored maps in navigation
systems with the actual cloud distribution over this area. On the
other hand, flight simulators, due to the limited availability of
memory space, are limited to representing narrowly defined areas
with a pre-fixed resolution.
As representations from the previously known system are based on a
fixed set of .[.memorised.]. .Iadd.stored .Iaddend.data and
therefore the space-related data cannot be stored at any optional
resolution, none of the present systems is capable of representing
different space information as desired with any resolution and at
the same time incorporating actual information into the
representation.
Due to the large quantities of data to be processed in the systems
according to prior art, the generation of an image is either
extremely costly in time, or is limited to the representation of
restricted information. Consequently it is not possible with the
previously known systems to provide an image generation rate which
is sufficient upon alteration of the location or of the direction
of view of the observer to provide the impression of a continuous
movement of that observer.
The object of the present invention is to make available a method
and a device for representing space-related data which
.[.enables.]. .Iadd.enable .Iaddend.the data to be represented in
any pre-selected image resolution in the way in which the object
.[.has.]. .Iadd.would have .Iaddend.been seen by an observer with a
selectable location and selectable direction of view. A further
object of the invention is to keep the .[.outlay.]. .Iadd.effort
required .Iaddend.for generating an image so low that the image
generation takes place so rapidly that upon alteration of the
location and/or of the direction of view of the observer, the
impression of .[.continuos.]. .Iadd.continuous .Iaddend.movement
above the object arises.
.[.This object is.]. .Iadd.These objects are .Iaddend.achieved by
the method according to the invention in the preamble in
conjunction with the .[.characterising.]. .Iadd.characterizing
.Iaddend.features of claim 1, and by the corresponding device.
In the method according to the invention the space-related data are
called up, stored and/or generated in spatially distributed data
sources. These data sources include for example data memories
and/or other data sources which call up and/or generate
space-related data. The portion of the object to be observed, the
field of view, is determined from the selected location and the
selected direction of view of the observer. Then a first data set,
which has a coarse spatial resolution, is called up from at least
one of the spatially distributed data sources, transmitted and
centrally stored, and the field of view is shown. If the resolution
of the representation is below the desired image resolution, the
field of view is divided into sections and an investigation is
undertaken for each individual section to see whether the data
within the section are sufficient for a representation with the
desired image resolution. If this is not the case for one of the
sections, further data with a finer resolution are called up,
transmitted and centrally stored from at least one of the spatially
distributed data sources, and the section is shown with the new
data. In turn .[.an investigation is carried out into.]. .Iadd.a
check for .Iaddend.sufficient image resolution and possibly a
further sub-division of the tested section .[.is carried.].
.[.out.]. into further partial sections .Iadd.is performed
.Iaddend.as described above. If the entire representation has the
desired image resolution or if in the spatially distributed data
sources no further data of a higher resolution are present, then
the method is terminated.
The device according to the invention for carrying out this method
accordingly comprises a display unit and an input unit for the
location and the direction of view of the observer. The device
according to the invention further has a plurality of spatially
distributed data sources, a central data memory, .Iadd.and
.Iaddend.a data transmission network between these and .[.the.].
.Iadd.an .Iaddend.evaluation unit, in order to determine the
representation of the data on the display unit from the centrally
stored data.
In comparison to previous systems, the method according to the
invention has considerable advantages. By virtue of the fact that
the data are called up, generated and/or stored in a spatially
distributed manner, the magnitude of the available database is not
limited by the size of the central data memory. In principle the
amount of available data in the method according to the invention
is therefore not limited, and can be extended at will. The access
speed to the spatially distributed data is thus to a large extent
independent of the size of the database.
In particular, due to the spatially distributed call-up and storage
of the data, servicing and updating of the database can be effected
in a distributed manner and preferably in the vicinity of the
spatial area which is represented by the data which are called up
and/or stored in a spatially distributed manner.
Representation of the field of view requires in the individual
areas of the field of view different spatial resolutions of the
data, for example depending on whether a portion of the field of
view is in the immediate vicinity of the observer or at a great
distance therefrom.
The method according to the invention leads to a situation in which
the data for the field of view to be shown are called up from the
spatially distributed data sources only in the accuracy necessary
for representation of the field of view with the desired image
resolution, i.e. for example with high spatial resolution for close
areas of the field of view or in low spatial resolution in a view
to the horizon of a spherical object. The .[.number.]. .Iadd.amount
.Iaddend.of data necessary for representation of the field of view
and thus to be stored centrally is in principle determined by the
image resolution selected and is thus substantially constant for
each image. This applies for example independently of whether the
observer is at a great distance from the object or directly beside
it and whether the observer is looking frontally on to the object
or in the direction of the horizon. Therefore, the .[.outlay.].
.Iadd.effort required .Iaddend.for data transmission for
representing the various fields of view is to a large extent
constant and restricted.
Furthermore, by means of the .[.number, reduced to a minimum,.].
.Iadd.amount .Iaddend.of data to be centrally stored .Iadd.being
reduced to a minimum .Iaddend.as a result of the method according
to the invention, the memory requirement and computer time for
generating the pictorial representation is greatly reduced, so that
an extremely rapid image build-up becomes possible.
Advantageous further developments of the method according to the
invention and of the device according to the invention are given in
the dependent Claims.
If a change in the location or of the direction of view of the
observer is input, thus the field of view also changes. Immediately
after this alteration in field of view, the method according to the
invention can be restarted. In this way it is possible to generate
a representation which corresponds to the impression of a moving
observer. This can for example be used for setting up a flight
simulator.
After each transmission and central storage of data, an image
representation results, even if the data are insufficient to make
possible the desired image resolution. As a result, even if the
method is interrupted due to an alteration in the field of view and
newly begun for a new field of view, the data for an image, even at
low resolution, are always available. Thus if the observer moves
extremely rapidly, the case is avoided in which no .[.further.].
image is shown.
Thus the observer is not limited as .[.regards.]. .Iadd.to
.Iaddend.his travelling speed and yet it is ensured that an image
is always shown.
It is particularly advantageous if the same .[.number.].
.Iadd.amount .Iaddend.of data, i.e. data with the same uniform
resolution.Iadd., .Iaddend.are basically .[.also.]. always called
up for a section. .[.Due.]. .Iadd.In this way, due .Iaddend.to the
division and thus reduction in size of the sections during the
method according to the invention, .[.in this way.]. continuous
refinement of the data during the course of the method according to
the invention is achieved.
After alteration in the field of view, in order to reduce the
central storage requirement, the high-resolution data no longer
required can be removed from the central memory. If however a data
set with coarse resolution which represents the entire object is
permanently retained in the central memory, the representation can
be improved with rapid alterations in field of view.
For objects to be viewed in the plane, the binary or the quadrant
tree is suitable as a sub-division method for the field of view,
while for objects, whose three-dimensional extension must be taken
into account, an octant tree is particularly suitable.
By means of this sub-division according to a fixed scheme, each
section of the object can be given a fixed address, the address of
a section arising for example from the address of the master
section, to which there is added for the sub-sections a further
numeral, for example 0, 1, 2 and 3 for each of the four
sub-sections of the quadrant tree, or the numerals 0 to 7 for each
of the sub-sections of an octant tree. With a permanently constant
number of data per section, the number of points in a section
address at the same time determines the spatial resolution level of
the data.
These sub-dividing processes can also be used along with one
another, such an adaptive sub-division process being particularly
suitable for spherical objects, whose surface is imaged
two-dimensionally. In the planar representation of a spherical
surface, for example at the poles, the sphere can transfer from a
quadrant tree to a binary tree.
Particularly suitable as objects are heavenly bodies such as the
planets of the solar system, whose topography can be represented.
Further space-related data of such objects include among other
things meteorological or geological information, for example cloud
distributions, political, economic and social data and in
particular .[.colour.]. .Iadd.color .Iaddend.information relating
to the appearance of the heavenly bodies, as obtained for example
for the earth from satellite images and for other planets, from
images from space probes.
Consequently, any further geographically related data can be
represented. The representation may in this case be carried out
both according to cartographic points of view or also as a
globe.
In order to provide pictorial representation of the surface of
physical objects, two-dimensional representations are particularly
suitable, as due to the reduction in the number of dimensions from
three to two the number of co-ordinates to be processed and the
data to be loaded is considerably reduced and thus the power of the
method according to the invention and of the device according to
the invention, for example the image repetition rate during rapid
movements of the observer, is improved. Such a representation in
particular is sufficient when the images are shown on a
two-dimensional screen or another two-dimensional medium.
In order also to display three-dimensional information in
two-dimensional images, the two-dimensional basic layer may be
supplemented with other two-dimensional layers, upon which the
further information is displayed.
Particularly suitable as a model for two-dimensional imaging of the
surface of physical bodies is a geometric model in which the
surface is sub-divided into polygons. In the topographic grid model
the polygon grid imitates the topography of the surface. By means
of this display the provision of the two co-ordinates of a grid
point is sufficient to produce a spatial relationship between
various data and the surface of the object displayed.
The data are now displayed on the background of this grid.
Particularly simple is the display of height information by the
application of various .[.colours.]. .Iadd.colors
.Iaddend.(.[.colour.]. .Iadd.color .Iaddend.vertices). Satellite
images or information on cloud formations can also be laid over
this grid (.[.texturising.]. .Iadd.texturizing.Iaddend.). If the
grid is not equidistant but applied with different sizes of grid
squares, (adaptive grids) then it is possible .[.hetter.]. to
.[.resolve and.]. display specific areas .[.such.]., .Iadd.like,
.Iaddend.for example, areas with intense height alterations
.Iadd.with better resolution.Iaddend..
The spatially distributed raised and/or stored data of the
spatially distributed data sources can be provided at the points of
their raising and/or storage with references, which indicate the
storage points for data of adjacent areas or further data on the
same area. If such links (hyperlinks) of the spatially distributed
data exist between one another, the central system requires no
knowledge of the exact spatial storage points for all data of the
object, as it is linked, originating from one of the spatially
distributed stores, to the further data.
In principle, the location and the direction of view of the
observer is not limited. Consequently the observer can move from a
view with extremely limited resolution, e.g. the earth from space,
to a view of individual atoms. The range of spatial resolutions
covers many orders of magnitude. In order to enable any resolutions
.[.also with.]. .Iadd.while also using .Iaddend.evaluating devices
which operate internally with a limited numerical precision, for
example with computers with an address space limited to 32 bits
and/or floating-point view limited to 32 bits for numbers, after an
alteration in the location and of the angle of view of the
observer, the data are converted to a new co-ordinate system with a
new co-ordinate origin. During a continuous movement of the
observer therefore the co-ordinates of the data are constantly
subjected to co-ordinate transformation.
If the data of areas adjoining the field of view are permanently
centrally stored in a higher resolution, or if a probability
assessment is carried out for a future alteration in the field of
view, and the data of the areas with the highest probability are
previously called up, transmitted and centrally stored, the
representation can be accelerated with the desired image resolution
upon a rapid alteration in the field of view.
The data illustrated by the method according to the invention, in
addition to data of real properties of the system observed, can
also contain models, for example CAD models of buildings, or
animated objects. The representation of spatially related data, for
example temperature measurement values, can also be effected by
display tables inserted into the illustration. Furthermore, it is
possible to move from illustrated space related spatially
distributed stored data to the representation of directly generated
material. Thus for example, instead of showing spatially
distributed stored satellite images of the earth, direct camera
images from a satellite can be shown, or instead of the
illustration of a public place, images of the place generated by a
running camera can be shown. In this case the satellite represents
one of the spatially distributed data sources.
For data transmission from the spatially distributed data sources
to the central memory, asynchronous transmission methods are
suitable. because of their high data transmission rate in
particular.
Embodiments of the method according to the invention and of the
device according to the invention are given by way of example in
the following:
FIG. 1: a structure of a device according to the invention;
FIG. 2: a device according to the invention;
FIG. 3: .[.a diagram of the sub-division of the field of view in
two sections according to the model of a quadrant tree.]. .Iadd.the
categorization of the field of view into different detail
levels.Iaddend.;
FIG. 4: .[.a diagram of an adaptive sub-division of the field of
view into a binary or quadrant structure.]. .Iadd.a diagram of the
sub-division of the field of view in two sections according to the
model of a quadrant tree.Iaddend.;
FIG. 5: .[.a diagram of the sub-division of the field of view into
sections according to the model of an octant tree.]. .Iadd.a
diagram of an adaptive sub-division of the field of view into a
binary or quadrant structure.Iaddend.;
FIG. 6: .[.the interconnection of individual data sections by
transverse references.]. .Iadd.a diagram of the sub-division of the
field of view into sections according to the model of an octant
tree.Iaddend.;
FIG. 7: .[.the categorisation of the field of view into different
detail levels.]. .Iadd.the interconnection of individual data
sections by transverse references.Iaddend.;
FIG. 8: a cartographic view of a cloud distribution on the
earth;
FIG. 9: a view of a cloud distribution on the earth as a globe;
FIG. 10: a view of the earth as a globe with cloud
distribution;
FIG. 11: a view of a portion of the earth with temperature
indicator tables.
FIG. 1 shows the construction of a device according to the
invention for displaying geographically related data of the earth.
The device comprises a plurality of spatially distributed data
sources 4, a data transmission network, a plurality of devices 1, 2
and 3 as central memories.[.,.]. and devices for determining the
display of the centrally stored space-related data (evaluation
units).Iadd., .Iaddend.and a plurality of display .[.unit.].
.Iadd.units .Iaddend.5. This device according to the invention
makes it possible for a plurality of evaluation units 1, 2 and 3
.[.simultaneously.]. .Iadd.together .Iaddend.to access the common
spatially distributed data sources 4.
The data transmission device comprises a transmission network with
lines 6, 7 and 8. The network has various types of conduit. The
conduits 6 serve as a collecting network for transmitting data from
the spatially distributed data sources 4. The conduits 7 serve as
an interchange network for rapid interchange of information between
individual nodes and the conduits 8 serve as a supply network for
supplying the screen view from the evaluation devices 1, 2 and 3 to
the display unit 5.
The nodes are in turn sub-divided into primary nodes 1, secondary
nodes 2, and tertiary nodes 3. In this case a primary node is
connected both to the interchange network 7 and also via the
conduits 6 directly to the spatially distributed data sources and
by the conduit 8 directly with the display unit 5. The secondary
node .[.8.]. .Iadd.2 .Iaddend.is connected only with the
interchange network 7 and directly via the conduits 8 with the
display unit 5. The tertiary node 3 has only one connection to the
display unit 5 and to the interchange network 7.
Systems of the company Silicon Graphics (SGI Onyx) were used as a
node computer. This computer is capable of displaying more than
5.[.,.].00,000 .[.texturised.]. .Iadd.texturized .Iaddend.triangles
per second and consequently is suitable for rapid picture build-up.
It operates with floating-point views with a 32 bit representation.
As this accuracy in the present example is insufficient for example
to follow a movement of an observer from space continuously down to
a .[.centimetre.]. .Iadd.centimeter .Iaddend.resolution on the
earth, the co-ordinates of the data during such a movement were
continuously converted to a new co-ordinate system with a
coordinate origin located in the vicinity of the observer.
The geographical data required for the image are called up and
transmitted via the collecting network 6 from the spatially
distributed memories 4. The spatially distributed memories are
preferably located in the vicinity of the areas on the earth whose
data they contain. In this way the data are detected, stored and
serviced at the point where a knowledge of the properties to be
represented by the data, .[.such for example as.]. .Iadd.such as,
for example, .Iaddend.topography, political or social information,
etc. is most precise. Further data sources are located at the
points where further data are detected or assembled, .[.such for
example as.]. .Iadd.such as, for example, .Iaddend.meteorological
research stations which collect and process information received
from satellites.
A characteristic feature of the data flow in the collector network
6 is that the data flow is in one direction. The Internet or ISDN
lines were used for this network.
The interchange network 7 serves to interchange data between
individual nodes. By means of close-meshed connection of the
individual nodes, the network can be secured against the failure of
individual conduits or against load peaks. As the interchange
network 7 must guarantee a high transmission rate in both
directions, a permanent connection was used here with an
asynchronous transmission protocol with a transmission rate which
is greater than 35 MBit/s. Satellite connections are also suitable
for the interchange network 7.
In the supply network 8, substantially .Iadd.all of .Iaddend.the
image data required for representation are transmitted to the
display device 5. Consequently a high data transmission rate of up
to 2 MBit/s is required in the direction of the display unit, which
is enabled by intrinsic asynchronous connections or by bundling
ISDN connections.
FIG. 2 shows two nodes connected by an interchange network 7, a
primary node 1 and a tertiary node 3. An input medium 10 for input
of the location and the direction of view of the observer is
connected via the supply network 8 to the tertiary node 3. A
collector network 6 and a camera 9, which can be controlled by the
input medium 10, is connected to the node computer 1. The input
medium 10 .[.comprised.]. .Iadd.consists of .Iaddend.a
three-dimensional track ball in conjunction with a space-mouse with
six degrees of freedom, in order to be able to alter both the
location and the direction of view of the observer. Automatic
position-fixing systems can also be considered as further input
media, such as are used in navigation aids for motor vehicles or
aircraft.
In this embodiment given by way of example, a two-dimensional
polygon grid model is used to display the data, which serves as a
two-dimensional co-ordinate system for positioning the data.
.[.There were used as data.]. .Iadd.Data .Iaddend.to be displayed
.Iadd.includes.Iaddend., for example satellite images, i.e.
information relating to the .[.colouring.]. .Iadd.coloring
.Iaddend.of the earth surface or geopolitical data or actual or
stored meteorological data. Images of the same point on the earth
surface .[.were.]. .Iadd.may be .Iaddend.shown at different points
in time, so that a type of "time journey" .[.could.]. .Iadd.may
.Iaddend.be produced.
Data in tabular form, .[.such for example as.]. .Iadd.such as, for
example, .Iaddend.temperature information, were masked in as
display tables into the view. For certain areas, CAD-models of
buildings were available, which were inserted into the view. Then
the location of the observer could be displaced at will in these
.[.CAD-modelled.]. .Iadd.CAD-modeled .Iaddend.buildings.
Via position-fixing systems, symbols, for example for ships,
aircraft or motor vehicles, in their instantaneous geographical
positions, can be inserted into this system and/or animated.
There was used, as a model for sub-dividing the field of view into
sections and of these sections into further sections, a quadrant
tree in which a progressive sub-division of an area into
respectively four sections is carried out.
After selection of the earth as an object and input of a location
and a direction of view in the .[.final.]. .Iadd.display
.Iaddend.device 5, the node 3 determines the field of view of the
observer and calls up the data via the interchange network 7 and
the nodes 1 and 2. These nodes in turn call up, via the collecting
network 6, from the spatially distributed data sources 4 or for
example from the camera 9, the required data and transmit them over
the interchange network 7 to the node 3 for central storage. The
node 3 determines the representation of the data centrally stored
therein and sends this transmission for viewing over the supply
network 8 to the display device 5.
If the node 3 then ascertains that the required screen resolution
has not been achieved with the centrally stored data, it divides
the field of view according to the model of the quadrant tree into
four sections and checks each section to see whether, by
representation of the data contained in the sections, the required
image resolution has been achieved. If the required image
resolution is not achieved, the node 3 calls up further data for
this section. This method is repeated for each section until the
required image resolution is achieved in the entire view. Call-up
of the data is effected in this example always with the same
resolution of 128.times.128 points. Due to the sub-division of a
section into four respective sub-sections, therefore, in each data
transmission data are loaded which have a spatial accuracy four
times higher.
FIG. 3 shows diagrammatically the view of an object 18 by an
observer whose field of view is limited by the two lines 17. As the
pictorial representation remains the same, the required spatial
resolution of the data depends on its distance from the observer.
For objects located directly in front of the observer, data must be
available with a greater spatial resolution than for objects
further removed, in order to reach this image resolution.
FIG. 3 shows in all four different sub-division stages according to
the model of the quadrant tree. The object entered extends within
the field of view over three resolution stages in all. The data for
the area of the object belonging to the field of view must
therefore be loaded with greater spatial resolution in the
direction of the observer.
By virtue of the fact that the data are centrally stored in
sections only in the accuracy required for image resolution, the
.[.number.]. .Iadd.amount .Iaddend.of centrally stored data depends
substantially .[.only.]. on the desired image resolution.
If for example one is located approximately 1,000 m above the earth
surface, the field of view has an extent of approximately 50
km.times.50 km. The image resolution in this case should be greater
than 3,000.times.3,000 image points. In order to show the field of
view with this image resolution a height value is required every
150 m and an image value of a surface every 15 m. From this there
arises a central storage requirement of approximately 35.6 MBytes,
in order to store all the required information for showing the
image.
If however one is located in space and has the northern hemisphere
fully in field of view, then there is required for a representation
with the same image resolution a height value every 50 km and an
image value of the surface every 5 km. In all there arises a
central storage requirement of 39.2 MBytes, which lies in the same
order of magnitude as the storage requirement for representation of
the view of the earth surface from a height of 1,000 m in the
section 50 km.times.50 km.
FIG. 4 shows the formation of an address of a section using the
model of a quadrant tree for sub-division of the field of view 11.
In the first sub-division of the field of view 11 into four
sections 12, these are identified clockwise with the numerals 0 to
3. If a section is further sub-divided, the individual sub-sections
13 are numbered in the same way and the numbers thus obtained are
prefixed to the numbers of the master section. With a permanently
identical resolution of for example 128.times.128 points per
section, the number of points of the section number is at the same
time an indication of the level of spatial precision of the
data.
An advantage in this type of address formation is .[.further.].
that each .Iadd.further .Iaddend.section of the object to be
represented has a fixed address which to a great extent simplifies
the search for the associated data.
FIG. 5 shows how a binary tree can be mixed with a quadrant tree in
order to generate an adaptive sub-division model. In the upper row
of the squares the sub-division is shown in two slave sections 4
and 5 (vertical) or 6 and 7 (horizontal). In the lower part of the
drawing there is shown a further sub-division of the section 4 into
an elongate upper portion 46 and two lower portions 40 and 43. The
section .[.33.]. .Iadd.43 .Iaddend.is then again sub-divided
according to the model of a quadrant tree into four slave sections.
Such an adaptive sub-division model can for example be used in
representing the earth in a two-dimensional model in the region of
the poles.
FIG. 6 shows a sub-division according to an octant tree for a
representation based on a three-dimensional geometrical model. Here
a section 14 or a space is sub-divided into eight spatial
sub-sections 15. By means of the method according to the invention,
consequently here also the data of just the spatial areas are
called up in a higher accuracy, at which it is required in order to
obtain the desired image resolution. Here also the same number of
points, for example 128.times.128.times.128 points can be called
up, transmitted and centrally stored for each section, so that
during sub-division of a master section 14 into eight slave
sections 15 an improved spatial accuracy of the data in the region
of the individual slave sections 15 results.
FIG. 7 shows a model for the use of references (so-called
"hyperlinks") on different section planes. The individual sections
have references 16 to the storage point both of the data of
adjacent sections and also of the data on other topics, but with
the same spatial association. In this way, proceeding from the data
of a section, data relating to the adjacent section or further data
over the same section can be determined. In particular, the node 3
can call up the data of a section next to a section known to it
without having intrinsic knowledge of the storage points of the
adjacent section data. In this way the spatially distributed data
call-up and storage systems may be expanded or updated at will,
without the central store and evaluation units taking knowledge of
the alteration during each such alteration.
FIGS. 8 to 11 show views of the earth generated by a method using a
quadrant tree. The required data were called up from spatially
distributed databases of research institutes.
FIG. 8 shows a view of cloud distribution on the earth surface as
detected by a weather satellite. A cylindrical projection was used
as a form of representation. The upper edge represents the north
pole and the lower edge the south pole. A two-dimensional
topographic grid network of the earth surface was selected as a
representational model. As the cloud layer usually is at a distance
from the earth surface, the cloud distribution was shown on a
second layer located out-with the view of the earth surface. Thus
there results, despite the only two-dimensional view for an
observer, a possibility close to reality of approaching the earth
surface "through" the cloud layer. Data generated by satellite
surveillance systems of meteorological research institutes were
used as data sources for the actual cloud distribution existing at
the time of the imaging.
FIG. 9 shows the same cloud distribution. Now the earth has been
shown as a globe, as it would appear to an observer .[.is.].
.Iadd.in .Iaddend.space. FIG. 10 shows a view of the same cloud
distribution in connection with a representation of the land masses
of the earth as they would appear to an observer in space. In order
to show the view of the earth surface, the topographical grid
network was provided with .[.colour.]. .Iadd.color
.Iaddend.information from the pixel graphics of satellite images of
the earth surface. As at the time of image generation actual cloud
information was used for image generation, there was a view close
to reality of the earth from space at the time of image
generation.
FIG. 11 shows a view generated in this way of the American
.[.Caribbean.]. .Iadd.Gulf .Iaddend.coast, as it would have
appeared to an observer looking north in an orbit close to the
earth above the .[.Caribbean.]. .Iadd.Gulf of Mexico.Iaddend.. In
addition, the actual temperature data of selected points present in
tabular form were entered in display tables into the image. These
temperature data were called up and transmitted through the
interchange network from various meteorological research stations
at various points.
* * * * *
References