U.S. patent application number 14/954117 was filed with the patent office on 2016-03-31 for laser projection system and method.
The applicant listed for this patent is Virtek Vision International, Inc.. Invention is credited to Kurt D. Rueb.
Application Number | 20160091311 14/954117 |
Document ID | / |
Family ID | 47628050 |
Filed Date | 2016-03-31 |
United States Patent
Application |
20160091311 |
Kind Code |
A1 |
Rueb; Kurt D. |
March 31, 2016 |
LASER PROJECTION SYSTEM AND METHOD
Abstract
A laser projection system for projecting an image on a workpiece
includes a photogrammetry assembly and a laser projector, each
communicating with a computer. The photogrammetry assembly includes
a first camera for scanning the workpiece, and the laser projector
projects a laser image to arbitrary locations. Light is conveyed
from the direction of the workpiece to the photogrammetry assembly.
The photogrammetry assembly signals the coordinates light conveyed
toward the photogrammetry assembly to the computer with the
computer being programmable for determining a geometric location of
the laser image. The computer establishes a geometric correlation
between the photogrammetry assembly, the laser projector, and the
workpiece for realigning the laser image to a corrected geometric
location relative to the workpiece.
Inventors: |
Rueb; Kurt D.; (Kitchner,
CA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Virtek Vision International, Inc. |
Waterloo |
|
CA |
|
|
Family ID: |
47628050 |
Appl. No.: |
14/954117 |
Filed: |
November 30, 2015 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
13652735 |
Oct 16, 2012 |
9200899 |
|
|
14954117 |
|
|
|
|
61614252 |
Mar 22, 2012 |
|
|
|
Current U.S.
Class: |
348/94 |
Current CPC
Class: |
G01C 11/08 20130101;
G01C 11/025 20130101; G06T 7/194 20170101; G01C 15/002 20130101;
B23Q 17/2423 20130101; G01C 11/00 20130101; G01B 11/005 20130101;
H04N 9/3129 20130101; G06T 2207/30164 20130101; H04N 13/239
20180501; G06T 2207/10012 20130101; G06T 7/11 20170101; G01B
11/2545 20130101; G06T 2207/10028 20130101; G01B 11/002 20130101;
G01C 11/02 20130101; G06T 2207/30204 20130101; G06T 7/0006
20130101; G06T 2207/20224 20130101; H04N 5/225 20130101; H04N
13/254 20180501; G06T 7/74 20170101; G06T 7/001 20130101 |
International
Class: |
G01C 11/02 20060101
G01C011/02; H04N 9/31 20060101 H04N009/31; H04N 5/225 20060101
H04N005/225 |
Claims
1. A laser projection system o projecting an image on a workpiece,
comprising: a photogrammetry assembly and a laser projector, each
communicating with a computer; said photogrammetry assembly
including a first camera for scanning the workpiece, and said laser
projector projecting a laser image to arbitrary locations with said
laser image being readable by said camera; said photogrammetry
assembly signaling the coordinates of the work piece to the
computer by scanning light conveyed from the direction of the
workpiece with said computer being programmable for determining a
geometric location of the workpiece from the light conveyed from
the direction of the workpiece; and said computer establishing
geometric correlation between said photogrammetry assembly, said
laser projector, and the workpiece and signaling said laser
projector to project a template onto a geometric desirable location
of the workpiece.
2. The system set forth in claim 1, wherein said photogrammetry
assembly includes a light source for transmitting light being
readable by said photogrammetry assembly distinguishable from the
laser image.
3. The system set forth in claim 2, wherein said light source
transmits light having a light wavelength and said laser transmits
a laser image having a laser wavelength that is close in value to a
value of said light wavelength.
4. The system set forth in claim 2, further including a scale bar
having reflective targets spaced by a known distance for reflecting
light transmitted from said light source to said camera.
5. The system set forth in claim 4, wherein said scale bar
comprises unidirectional carbon fiber for providing temperature
resistant distance between said reflective targets.
6. The system set forth in claim 1, wherein said photogrammetry
assembly includes a second camera spaced from said first camera by
a known distance.
7. The system set forth in claim 6, wherein said first and second
cameras are spaced apart by a scale bar comprising unidirectional
carbon fiber.
8. The system set forth in claim 2, further including
retroreflective targets affixed to the workpiece for reflecting
light from said light source thereby conveying the light to said
camera, said camera signaling said computer a location of said
retroreflective targets and said computer determining a location of
the workpiece.
9. The system set forth in claim 8, wherein said retroreflective
targets include encoding enabling said computer to identify said
retroreflective targets from light conveyed by said retroflective
targets.
10. The system set forth in claim 2, further including a probe
having reflective targets disposed thereon for manually identifying
features of the workpiece with light transmitted from said a light
source and conveyed by said reflective targets to said
photogrammetry assembly.
11. The system set forth in claim 1, wherein said laser projector
is programmed to project an image onto the workpiece enabling said
photogrammetry assembly to determine a location of the workpiece
within a three dimensional coordinate system.
12. The system set forth in claim 1, wherein the image projected by
said laser projector is a manufacturing template providing a
location for performing work on the workpiece.
13. A method of projecting patterns on a workpiece, comprising the
steps of: providing a photogrammetry assembly and a laser
projector; conveying light from the direction of the workpiece to
said photograrnmetry assembly; determining a location in a three
dimensional coordinate system of the laser projector relative to
the photogrammetry assembly by scanning arbitrary laser images
projected by the laser projector; determining a location of the
workpiece in the three dimensional coordinate system relative to
said photogrammetry assembly and to said laser projector from light
conveyed from the direction of the workpiece to said photogrammetry
assembly; and transmitting a template onto a geometric desirable
location of the workpiece from said laser projector upon
determining a location of the workpiece in the three dimensional
coordinate system.
14. The method set forth in claim 13, wherein said step of
conveying light from the direction of the workpiece is further
defined by reflecting light from at least one of a light source or
a pattern generated by said laser projector to said photogrammetry
assembly.
15. The method set forth in claim 14, further including the step of
said photogrammetry assembly scanning a space comprising the
workpiece for establishing a background image and subtracting the
background image from the light conveyed from the direction of the
workpiece.
16. The method set forth in claim 14, further including the step of
transmitting a pattern toward the workpiece having at least four
laser spots from said laser projector with some of said laser spots
being transmitted onto the workpiece.
17. The method set forth in claim 13, further including the step of
transmitting light from a light source to reflective targets
disposed on the workpiece for conveying light toward said
photogrammetry assembly and determining a spacial relationship of
the workpiece to said photogrammetry assembly.
18. The method set forth in claim 13, wherein said step of
conveying light from the direction of the workpiece is further
defined by locating features on the workpiece by contacting the
features with a reflective probe and reflecting light toward the
photogrammetry assembly for determining a geometric location of the
features.
19. The method set forth in claim 13, wherein said step of
providing a photogrammetry assembly is further defined by providing
a photogrammetry assembly with two cameras separated by a known
length.
20. The method set forth in claim 13, further including the step of
determining a spacial relationship of the workpiece to said
photogrammetry assembly by scanning light reflected back to said
photogrammetry assembly.
21. The method set forth in claim 13, wherein said step of
providing a laser projector is further defined my providing a
plurality of laser projectors.
22. The method set forth in claim 18, further including the step of
detecting variation of the laser pattern and making an adjustment
to the laser pattern to correct the spacial relationship between
the laser pattern and the light reflected back to said
photogrammetry assembly.
23. The method set forth in claim 18, wherein said steps of
transmitting light from said light source and transmitting a laser
pattern from said laser projector is further defined by
transmitting light and transmitting a laser pattern having similar
wavelengths.
24. The method set forth in claim 18, further including the step of
periodically measuring the spacial relationship between the
reflected light and the laser pattern to verify the location of the
laser pattern and making corrections to the transmission of the
laser pattern by said laser projector.
25. The method set forth in claim 18, further including the step of
affixing reflective targets to the workpiece for conveying light to
the photogrammetry assembly generated from a light source for
determining a location of the workpiece in the three dimensional
coordinate system.
Description
PRIOR APPLICATION
[0001] This application claims priority to U.S. Provisional Patent
Application No. 61/614,252 filed on Mar. 22, 2012.
FIELD OF USE
[0002] This application relates generally to a laser projection
system for use in an industrial environment. More specifically,
this application relates to projecting a laser template on a
workpiece with the assistance of a photogrammetry assembly.
BACKGROUND
[0003] Photogrammetry processes and assemblies have been used to
identify locations of objects in various settings. In some
instances, photogrammetry has been found useful in the manufacture
of semiconductors for use in computer-based objects. However,
photogrammetry has not proven useful in the manufacture of large
scale objects in a mass production setting.
[0004] Alternatively, laser projectors have been used to project
assembly templates on objects as an assembly aid in the manufacture
of mass production products. However, projecting templates has also
not been useful on a mass production scale where various workpieces
are being produced and limited opportunity exists to project a
geometrically accurate projection image. Therefore, manufactures of
original equipment continue to use physical, and in some instances,
steel templates to direct work performed on workpieces.
[0005] Therefore, a need exists to enhance both the ability to
locate an object in a precise geometrical relationship to a laser
projector to accurately project a template for use as an assembly
aid.
SUMMARY
[0006] A laser projection system and method for projecting an image
On a workpiece includes the use of a photogrammetry assembly and a
laser projector each communicating with a computer. The
photogrammetry assembly includes a first camera for scanning the
workpiece. The laser projector projects a laser image to arbitrary
locations with the laser image being readable by the camera. The
photogrammetry assembly signals the coordinates of the work piece
to the computer by scanning light conveyed from the direction of
the workpiece. The computer is programmable for determining a
geometric location of the workpiece from the light conveyed from
the direction of the workpiece. The computer establishes geometric
correlation between the photograrnmetry assembly, the laser
projector, and the workpiece and signals the laser projector to
project a template onto a geometric desirable location of the
workpiece.
[0007] For the first time, a low cost method of generating a laser
template onto the workpiece has been achieved. The use of a
photogrammetry system to assist locating a laser projected template
within a geometric coordinate system in an industrial setting
reduces cost while increasing the quality and dimensional accuracy
of work performed on a workpiece. Where affixing a physical
template to the workpiece only provides general dimensional
accuracy, the subject method of projecting a laser image or
template with the assistance of a photogrammetry device provides a
manufacturing tolerance of less than one millimeter.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Other advantages of the present invention will be readily
appreciated, as the same becomes better understood by reference to
the following detailed description when considered in connection
with the accompanying drawings:
[0009] FIG. 1 shows a first embodiment of the laser projection
system of the present invention;
[0010] FIGS. 2a and 2b show an alternative embodiment of the laser
projection system of the present invention;
[0011] FIG. 3 shows a reflective probe for use with the second
embodiment;
[0012] FIG. 4 shows a lens view of a camera associated with a
photogrammetry assembly associated with the laser projection
system; and
[0013] FIGS. 5a and 5b show an alternative embodiment of the laser
projection system of the present invention.
DETAILED DESCRIPTION
[0014] A laser projection system for projecting an image on a
workpiece is generally shown at 10 of FIG. 1. The laser projection
system includes a photogrammetry assembly 12 and a laser projector
14, each of which communicates via a computer 16. The computer 16
communicates with the laser projector 14 by way of electrical
circuit 18 and with the photogrammetry assembly 12 by way of
electrical circuit 20. Although the electrical circuits 18, 20 are
represented as hard wires in this embodiment, it should be
understood by those of skill in the art that radio frequency or
equivalent transmission between the computer 16, the photogrammetry
assembly 12 and the laser projector 14 is within the scope of this
invention.
[0015] The photogrammetry assembly includes a first camera, 22 and,
in this embodiment, a second camera 24. It is contemplated by the
inventor that alternative embodiments may make use of only a first
camera 22 as will be explained further below. One type of camera
contemplated by the inventors is an industrial camera model
acA2500-14GM manufactured by Basler AG. However, other industrial
type cameras having equivalent functionality is suitable for use
with the inventive projection system 10.
[0016] The photogrammetry assembly 12 is adapted to scan and take
an image of a workpiece 26 and a surrounding environment 28 for the
purpose of locating the workpiece 26 in a three-dimensional
coordinate system.
[0017] The laser projector 14 projects a laser image to arbitrary
locations 30 with at least some of the laser image being projected
onto the workpiece 26. The laser image takes the form of a
plurality of laser beams, laser patterns, or manufacturing
template, or combinations thereof.
[0018] The laser image generated by the laser projector 14 is
readable by the photogrammetry assembly 12. More specifically, the
laser image is readable by the first and second camera 22, 24. The
first and second cameras 22, 24 are separated a known distance by a
spacer bar 32 manufactured from the material not subject to
dimensional variations due to temperature fluctuations. In one
embodiment, the spacer bar 32 is manufactured from a
uni-directional carbon fiber to provide temperature resistance to
dimensional variation.
[0019] The first and second cameras 22, 24 identify the arbitrary
locations 30 onto which the laser image is projected by the laser
projector 14 by triangulating the image and signaling the computer
16 to calculate where the arbitrary locations 30 are located in a
three-dimensional coordinate system.
[0020] The computer 16 is programmed to calculate the geometric
correlation between the photogrammetry assembly 12, the laser
projector 14 and the workpiece 26 by way of a signal transmitted
from the cameras 22, 24 of the scanned arbitrary locations 30 onto
which the laser image is projected. Additional accuracy is
achievable by manipulating the laser projector 14 to project a
laser image onto the various features such as, for example, corners
or apertures defined by the workpiece 26 and scanning the laser
image as set forth above. Once the computer 16 establishes a
geometric correlation between the photogramrnetry assembly 12 the
laser projector 14 and the workpiece 26, the laser image is
corrected to a geometric location relative to the workpiece 26 and
is used as a template for an assembly aid to perform work on the
workpiece 26. For example, the laser template identifies the
location of a weld operation, a machine operation, or other work
intended to be performed on the workpiece 26.
[0021] Once the laser template has been projected onto a desired
location upon the workpiece 26, the computer 16 periodically
prompts the projector 14 to project a laser image to arbitrary
locations 30 from which the photogrammetry assembly 12 scans and
signals the computer 16 to calculate the geometric correlation
between the photogramrnetry assembly 12, the laser projector 14,
and the workpiece 26 to verify none of these items have been moved,
there has been no drift of the image, and that the laser template
is projected in the correct geometric location on the workpiece 26.
In this manner, the accuracy of the laser projection of the
template is repeatedly updated during the manufacturing
operation.
[0022] An alternate embodiment of the present invention, wherein
like elements include like element numbers, is generally shown at
110 of FIGS. 2a and 2b. In this embodiment, the photogrammetry
assembly 12 includes a light source 34 (FIG. 4) transmitting light
that is readable by the photogrammetry assembly 12 separate from
the laser image. However, it is contemplated by the inventor that
the light source 34 transmits light in a similar wave-length range
as that of the laser projector 14. More specifically, it is
contemplated that green light having a wave length range between
540 and 520 nanometers is transmitted by both the light source 34
and the laser projector 14. It is further contemplated by the
inventor that the light source 34 includes a plurality of light
emitting diode spaced around each camera lens 36 of the first and
second cameras 22, 24 as best represented in FIG. 4. However, it
should be understood by those of ordinary skill in the art that the
light source 34 can be separate from the photogrammetry assembly 12
as will be explained further below.
[0023] Referring again to FIGS. 2a and 2b, the light source 34
transmit light toward the workpiece 26 onto which reflective
targets 38 are temporarily affixed. The reflective targets 38 are
contemplated to be retroreflective targets for reflecting light
back toward the photogrammetry assembly 12 into the camera lens 36
of the first and second cameras 22, 24 so that the photogrammetry
assembly 12 signal the computer 16 the location of the reflective
targets 38 allowing the computer 16 to calculate the precise
location of the workpiece 26 in a geometric coordinate system. In
this embodiment, the inventor contemplates the reflective targets
38 be encoded to enable a computer to identify which reflective
targets 38 are signaling the photogrammetry assembly 12. For
example, one method of encoding the reflective targets 38 is by way
of two reflective elements disposed upon individual reflective
targets 38 and spaced a known distance enabling the computer 6 to
read two reflective images spaced a known distance from an
individual reflective target 38. It is also believed that encoding
the reflective targets 38 reduces the probability of the
photogrammetry assembly 12 reading reflections from the environment
28 in error rendering an incorrect calculation of the location of
the workpiece 26 in the coordinate system.
[0024] The light source 34 periodically emits light contemplated to
be in the form of a flash so that the computer 16 can continuously
calculate the location of the workpiece 26 within the geometric
coordinate system. Once the workpiece 26 is established within a
geometric coordinate system, the laser projector 14 projects a
laser image to arbitrary locations as set forth in the previous
embodiment. Therefore, the photogrammetry assembly 12 scans both
light reflected from the reflective targets 38 and the laser image
projected on arbitrary locations 30 by the laser projector 14 to
accurately determine spatial relationship within a geometric
coordinate system of the photogrammetry assembly 12, the laser
projector 14, and the workpiece 26. It should be understood by
those of skill in the art that the light source 34 can also
transmit light from the location of the reflective targets 38 are
affixed. In this manner, light emitting diodes 34 would replace the
reflective targets 38 and transmit light directly to the
photogrammetry assembly 12. It should be understood that when the
term reflect or reflector is used transmitting light as described
above is also included so that light is conveyed from the direction
of the workpiece.
[0025] Included in this embodiment is a probe 40 best represented
in FIG. 3. The probe 40 includes a contact element 42 disposed upon
a distal end 44 of a shaft 46. The reflective target 48 is disposed
on an opposite end of the shaft 46 from a contact element 42. The
reflective target 48 is contemplated to include a plurality of arms
50 each having encoded reflectors 52. The use of four reflectors 52
has proven to improve the accuracy of the measurements of the
geometrically relevant features on the workpiece, particularly when
the reflectors 52 are spaced from an axis of the probe defined by
the contact element 42. The reflectors 52 are encoded by locating a
plurality of reflectors 52 on each arm 50 spaced by a known
distance. However, alternative methods of encoding may also be used
such as, for example, altering the reflectivity of an individual
reflector 52. By encoding the reflectors 52, the photogrammetry
assembly 12 is able to determine which specific probe 48 is
reflecting light from the light source 34 to the photogrammetry
assembly 12. Encoding is desirable when a plurality of probes 40
are used to identify various features on the workpiece 26 as will
be explained further below.
[0026] Referring again to FIGS. 2a and 2b, the probe 40 is shown
reflecting light received from the light source 34 to the first and
second camera 22, 24, allowing the computer 16 to determine the
location of the probe 40 in the geometric coordinate system in
which the workpiece 26 exists. The contact element 42 of the probe
40 is manually touched to a particular feature on the workpiece 26.
This approach streamlines the determination of the important
features or datums on the workpiece necessary for performing work
on the workpiece in a dimensionally accurate manner, and reduces
the time required to project the laser template onto the workpiece.
For example, the contact element 42 is touched to an edge of an
aperture (not shown) that is a datum from which a work location
must be accurately correlated. Once the computer 16 calculates the
location of the probe 40, the laser projector 14 transmits a laser
image in the form of a template further increasing the accuracy of
the location of the laser image on the workpiece 26. The contact
element 42 is touched to various edges or contours of a specific
element to further define the location of the element by way of the
probe 40 again enhancing the accuracy of the template projected on
the workpiece 26 by the laser projector 14. Alternatively, the
contact element 42 includes different shapes and sizes mirroring
the various features of the workpiece 26 requiring location
identification inside the coordinate system.
[0027] A still further embodiment of the projection system is
generally shown at 210 of FIGS. 5a and 5b. In this embodiment, the
photogrammetry assembly 12 makes use of a single camera 22 and
communicates with the laser projector 14 and the computer 16 as
explained above. Because a single camera 22 is used to scan the
workpiece 26, it is desirable to establish a geometric scale of the
relative position of the workpiece 26. As such, a scale bar 54
having scale reflective targets 56 spaced a known distance on a
scale bar 54. Through triangulation with the spaced scale
reflective targets 56 and the camera 22, the computer 16 is able to
establish a geometric scale of the workpiece 26 in a geometric
coordinate system. As set forth above, the workpiece surface is
identified by temporarily affixing reflective targets 38 which are
encoded. The light source 34 transmits light to the reflective
targets 38 and to the scale reflective targets 56 and the
photogrammetry assembly scans the reflective image to signal the
computer 16 the coordinates of the workpiece 26, allowing the
computer 16 to correlate the photogrammetry assembly 12, the laser
projector 14, and the workpiece 26 in a geometric coordinate
system. This allows the laser projector 14 to project a laser
template upon the workpiece 26 as set forth above. It should be
understood to those of skill in the art that the probe 40 may also
be used in combination with the scale bar 54 and scale reflective
targets 56 to accurately determine precise location of various
features of the workpiece 26.
[0028] The invention has been described in an illustrative manner,
and it is to be understood that the terminology which has been used
is intended to be in the nature of words of description rather than
of limitation. It is now apparent to those skilled in the art that
many modifications and variations of the present invention. are
possible in light of the above teachings. It is, therefore, to be
understood that the invention may be practiced otherwise than as
specifically described.
* * * * *