U.S. patent application number 10/889098 was filed with the patent office on 2005-10-27 for form evaluation system and method.
Invention is credited to Sato, Yutaka, Suzuki, Junichi.
Application Number | 20050239026 10/889098 |
Document ID | / |
Family ID | 35066974 |
Filed Date | 2005-10-27 |
United States Patent
Application |
20050239026 |
Kind Code |
A1 |
Suzuki, Junichi ; et
al. |
October 27, 2005 |
Form evaluation system and method
Abstract
It is sought to provide a form evaluation system, which permits
clear visual comparison of an ideal form and the own form on an
image and accurately understanding points to be improved. A
database is formed with check points of the form in golf, for
instance, as reference data of form evaluation. A predetermined
division number of still images are produced from motion picture
image data of subscriber, these still images are displayed on a
personal computer display screen, the form of the subscriber's
still images is evaluated with the database as reference, and on
the basis of the evaluation a form evaluation sheet is produced,
which contains a predetermined division number of serially changing
still images and form guide comments each provided for each of
these still images.
Inventors: |
Suzuki, Junichi; (Tokyo,
JP) ; Sato, Yutaka; (Tokyo, JP) |
Correspondence
Address: |
WENDEROTH, LIND & PONACK, L.L.P.
2033 K STREET N. W.
SUITE 800
WASHINGTON
DC
20006-1021
US
|
Family ID: |
35066974 |
Appl. No.: |
10/889098 |
Filed: |
July 13, 2004 |
Current U.S.
Class: |
434/251 ;
473/131 |
Current CPC
Class: |
A63B 2225/20 20130101;
A63B 2220/806 20130101; A63B 69/36 20130101; A63B 24/0003 20130101;
A63B 2024/0012 20130101 |
Class at
Publication: |
434/251 ;
473/131 |
International
Class: |
A63B 069/36 |
Foreign Application Data
Date |
Code |
Application Number |
Apr 5, 2004 |
JP |
2004-111142 |
Claims
1. A form evaluation system for producing a database form check
points of an ideal form of a sport such as the golf and evaluation
references of these check points as reference data of form
evaluation, while producing a predetermined division number of
still images from motion picture image data obtained by
photographing the form of an evaluated person desiring the form
checks, displaying the still images on a personal computer screen,
evaluating the form of the still images of the evaluated person
with the database as reference, producing, on the basis of the
evaluation, a form evaluation sheet containing a predetermined
division number of serially changing still images and form guide
comments each provided for each still image and providing the form
evaluation sheet to the evaluated person, wherein the personal
computer for producing the form evaluation sheet is caused to
function as: an evaluation scale storing means for storing one or
more evaluation scales used for observing deviations from the
reference form in the still images; a form evaluation database
storing means for storing data to be provided in each column of the
form evaluation sheet; a synthetic image forming means for forming
a synthetic image by displaying an evaluation scale in
superimposition on a still image displayed on the personal computer
display in a desired size and at a given position; a data input
means for inputting the synthetic image obtained from the
evaluation scale displayed on the personal computer screen and the
still image and the form guide comment in the form evaluation
database; and a form evaluation sheet producing means for producing
the form evaluation sheet from the data in the form evaluation
database.
2. A form evaluation system for producing a database from check
points of an ideal form of a sport such as the golf and evaluation
references of these check points as reference data of form
evaluation, while producing a predetermined division number of
still images from motion picture image data of an evaluated person,
displaying the still images on a personal computer screen,
evaluating the form of the still images of the evaluated person
with the database as reference, producing, on the basis of the
evaluation a form evaluation sheet containing a predetermine
division number of serially changing still images and form guide
comments each provided for each still image and providing the form
evaluation sheet via internet to the evaluated person, wherein the
personal computer for producing the form evaluation sheet is caused
to function as: an evaluation scale storing means for storing one
or more evaluation scales used for observing deviations from the
reference form in the still images; a form evaluation database
storing means for storing data to be provided in each column of the
form evaluation sheet; a synthetic image forming means for forming
a synthetic image by displaying an evaluation scale in
superimposition on a still image displayed on the personal computer
display in A desired size and at a given position; a data input
means for inputting the synthetic image obtained from the
evaluation scale displayed on the personal computer screen and the
still image and the form guide comment in the form evaluation
database; a form evaluation sheet producing means for producing the
form evaluation sheet from the data in the form evaluation
database; and an up-loading means for up-loading a form evaluation
sheet for each evaluated person to the web site on the
internet.
3. The form evaluation system according to claim 1, wherein the
form evaluation sheet has an evaluation display column, and the
personal computer is caused to function as an evaluation data input
means providing evaluation data numerically representing the
technical power level from the keyboard in the evaluation display
column.
4. The form evaluation system according to claim 1, wherein the
form evaluation sheet has an advice display column, and the
personal computer is caused to function as an advice input means
for providing an expert's advice for the keyboard to the advice
display column.
5. The form evaluation system according to claim 1, wherein the
evaluation scale is constituted by a measurement pattern suitable
for visually displaying a deviation from the reference form of the
still image, such as a lattice pattern displaying the coordinate
position of each point in the still image or a protractor form
pattern displaying the angle of a particular line in the still
image.
6. The form evaluation system according to claim 1, wherein the
predetermined division number of still image are constituted by
front and side still image produced from two motion picture image
databases obtained by motion picture image photographing the form
of the evaluated person from the front and the side at the same
time, the front and side still images being evaluated with the
ideal form database as reference.
7. A form evaluation method comprising: an ideal form database
production step of producing a database with check points and
evaluation standards as ideal form data from magazines of the sport
such as the golf and books of professionals; a motion picture image
input step of inputting motion picture images of an evaluated
person in a personal computer; a motion picture image-to-still
image conversion step of converting the motion picture images to
serially continuous still images; a still image selecting step of
extracting a predetermined number of serially changing still images
among the continuous still images; an evaluation scale producing
step of producing an evaluation scale having a lattice or
protractor pattern for visually measuring the position and angle of
various points in the still image by combining the still image; and
a personal computer process of causing a personal computer to
function as: a means for storing the motion picture images and
continuous still images; an evaluation scale storing means for
storing one or more evaluation scales in a memory; a synthetic
image forming means for forming a synthetic image by causing
display of an evaluation scale in superimposition on a still image
displayed on the personal computer screen in a desired size at a
given position; a form evaluation database storing means for
storing the synthetic images as a form evaluation database
corresponding thereto in a memory; a data input means for inputting
synthetic images obtained from an evaluation scale and a form guide
comment in the form evaluation database; and a form evaluation
sheet producing means for producing, from the data in the form
evaluation database, a form evaluation sheet containing the
synthetic images obtained from the still images and the evaluation
scale and form guide comments corresponding to the synthetic
images.
8. The form evaluation method according to claim 7, which further
comprises a web site building step of building a web site
concerning the form evaluation on an internet, and an up-loading
step of providing the form evaluation sheet in the form capable of
being read in a browser on the web site.
9. The form evaluation method according to claim 8, wherein the
form evaluation sheet is a golf swing evaluation sheet for
evaluating the golf swing, the form evaluation sheet further
comprising: a handicap authorizing step of providing a handicap and
issuing a written handicap authorization when a predetermined
standard level is met by the evaluation with the form evaluation
sheet.
10. The form evaluation system according to claim 2, wherein the
form evaluation sheet has an evaluation display column, and the
personal computer is caused to function as an evaluation data input
means providing evaluation data numerically representing the
technical power level from the keyboard in the evaluation display
column.
11. The form evaluation system according to claim 2, wherein the
form evaluation sheet has an advice display column, and the
personal computer is caused to function as an advice input means
for providing an expert's advice for the keyboard to the advice
display column.
12. The form evaluation system according to claim 2, wherein the
evaluation scale is constituted by a measurement pattern suitable
for visually displaying a deviation from the reference form of the
still image, such as a lattice pattern displaying the coordinate
position of each point in the still image or a protractor form
pattern displaying the angle of a particular line in the still
image.
13. The form evaluation system according to claim 2, wherein the
predetermined division number of still image are constituted by
front and side still image produced from two motion picture image
databases obtained by motion picture image photographing the form
of the evaluated person from the front and the side at the same
time, the front and side still images being evaluated with the
ideal form database as reference.
Description
BACKGROUND OF THE INVENTION
[0001] 1. Field of the Invention
[0002] This invention relates to a form evaluation system for
producing a predetermined division number of still images from
motion picture image data obtained by photographing the form of a
subscriber describing the check of the form, displaying these still
images on the screen of a personal computer, evaluating the form in
the still images on the basis of a preliminarily produced ideal
form database, producing, on the basis of the evaluation, a form
evaluation sheet containing a predetermined division number of
serially changing still images and from comments each provided for
each of the still images and providing the produced form evaluation
sheet via an internet to the subscriber.
[0003] 2. Prior Art
[0004] Many persons who do various sports desire improving their
technical power by having accurate evaluation concerning certain
points in their own form by advanced persons. For examples, amateur
golf players often receive swing lessons by lesson professionals in
golf training places. Also, a system is well known in the art, in
which a user client transmits photograph images of his or her golf
swing to an expert via a internet home page, and the expert
transmits analysis results and remarks on the basis of these
images, (see Patent Literature 1, for instance). Furthermore,
various systems for electronically detecting golf swing defects are
well known in the art (see Patent Literatures 2 to 4, for
instance).
[0005] (Patent Literature 1): Japanese Patent Laid-Open No.
2003-150699
[0006] (Patent Literature 2): Japanese Patent Laid-Open No.
2004-81683
[0007] (Patent Literature 3): Japanese Patent Laid-Open No.
2003-117045
[0008] (Patent Literature 4): Japanese Patent Laid-Open No.
2003-111880
[0009] However, the lessons by the lesson professionals are subject
to limitation on time and place for they should be received in
front of the lesson professionals. In addition, since the swing of
the evaluated persons is evaluated relatively in comparison with
the reference swing of the Lesson professionals, the evaluation
naturally varies in dependence on the lesson professional.
Furthermore, the Lesson is provided analog-wise by speech and is
effective only once. In other words, even when the swing form is
improved gradually by receiving a plurality of times of lessons, no
measure for evaluating the improvement has been present. More
specifically, because there has been no reference of absolute form
evaluation, in the case of continuous lesson reception, it has been
impossible to express the improvement of the technical power by the
lesson is in a numerical form. Some evaluated persons receive
lessons by lesson professionals by taking their golf swing in
images. This, however, is a mere option added to the usual
analog-wise lessons. Moreover, the electronic golf swing analysis
method has problems that it is difficult to obtain adequate advice
from electronic analysis results and that it is difficult to
visually understand points to be improved.
SUMMARY OF THE INVENTION
[0010] The invention seeks to solve the above problems, and it has
an object of providing a form evaluation system, which can evaluate
serial technical power improvement by absolutely evaluating the
form without limiting time and place of the form evaluation and
without having resort to the difference of form-evaluating lesson
professionals and accumulating the form evaluation.
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] FIG. 1 is a flow chart showing a form evaluation system
according to the invention;
[0012] FIG. 2 is a view for describing the form evaluation system
according to the invention;
[0013] FIGS. 3(A) to 3(E) are views showing the form evaluation
system according to the invention;
[0014] FIG. 4 is a view for describing an ideal form database
according to the invention;
[0015] FIG. 5 is a view for describing a form evaluation sheet;
and
[0016] FIG. 6 is a block diagram showing a form evaluation sheet
production problem according to the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] The arrangement of the form evaluation system according to
the invention will now be described with reference to FIGS. 1 to
6.
[0018] FIG. 1 shows a summary of the system, and an embodiment will
now be described, in which the case of golf club swing from
evaluation will be taken as an example. The invention is of course
applicable as well to the form evaluation for baseball butting,
swinging, etc. In FIG. 1, block 2 represents process operations on
the evaluated person or user side desiring the own form check by
utilizing the present system, and block 4 represents process
operations on the management side managing the present system. Best
users of the system are (1) those who like golfing and desire
technical power improvement or advancement even by paying
expenditures, (2) those who desire following up better swing, (3)
those who are not satisfied by receiving lessons by lesson
professionals and (4) those who desire improvement or advancement
without neighbor persons becoming area thereof.
[0019] The user can apply to the utilization of the system from the
web site (step 1) or in golf spot or golf training place (step 2).
When the user applies to the utilization, he or she makes payment
of a subscription fee and a utilization fee to a membership
registration/settlement process department on the management side 4
(step 3). When the user completes the membership registration, he
or she takes motion picture images of the swing as both front and
side views at the same time (step 4), and sends these motion
picture images to a subscriber's motion picture image utilization
acceptance process department on the management side 4 via suitable
transfer means such as data transmission or electronic mail on
network or postal mail.
[0020] When the management side 4 receives the motion picture
images, it sends out an electronic mail of acceptance confirmation
to the user (i.e., subscriber). At the same time, the management
side 4 produces a form evaluation sheet 6 (see FIG. 5) in a
computer process to be described later (see FIG. 5), then up-loads
the sheet in the web site, and sends out an up-loading report mail
to the user. When the user receives the report of up-loading in the
web site, he or she accesses a personal page in the web site with
ID/password authentication, and receives an evaluation of the swing
images (step 5).
[0021] After the user has completed the membership registration
(step 3), he or she can inquire the management side 4 about the
swing improvement or like contents (step 6). The user can also
receive the reply to the inquiry by an electronic mail from the
management side (step 7). The management side 4 builds the web site
of the system (step 8). As for the building of the web site of the
management side 4, development of swing motion picture image
process software (step 9) and development of comments assembling
process software (step 10) are made, and the web site of the
management side is built up by using these software items.
Subsequently, the management side 4 does such business activities
as securing the Lesson professional stuff (step 11). Also, the
management side 4 makes it possible, in cooperation with a golf
spot or a golf training place (step 12), to accept the user's
subscription application from these facilities.
[0022] The management side 4 executes a membership
registration/settlement process (step 14) in cooperation with a
credit authorization company (step 13). The management side 4 also
accepts swing motion picture images taken from the front and the
side at the same time and sends out from a subscriber user (step
15), and also it transfers these motion picture images to the
motion picture image processing department for a frame division
process to obtain 9-frame still images taken from the front and
those taken from the side (i.e., rearwardly of the user) (step 16).
The management side 4 further executes an evaluation scale
application process (step 17), a comments assembling process (step
18) and a lesson professional's comment check process (step 19),
these processes being described later. These processes are executed
by following a form evaluation sheet production program 8 stored in
a personal computer, and the form evaluation sheet 6 is produced
with this program 8. The produced form evaluation sheet 6 is
up-loaded in the web site of the management side (step 20).
[0023] When the site-up of the form evaluation sheet 6 including
images carrying the subscriber's swing evaluation has been
completed, the management side 4 sends out a site-up completion
report as subscriber's page renewal report by an electronic mail to
the subscriber (step 21). As for a subscriber's inquiry about the
swing improvement or the like directed to the management side, the
management side accepts such inquiry in the subscriber's inquiry
acceptance department (step 22), and transfers the accepted inquiry
to the player's comment input process department. The replier's
comment input process department produces a reply to the inquiry
(step 23) and up-loads the produced reply in the web site, while
sending a replay mail to the inquirer (step 24).
[0024] Now, the frame division process of producing time serial
continuous still images from motion picture images will be
described with reference to FIG. 2. In this process, the motion
picture image database 10 is produced from the motion picture
images taken at the same time in two directions, i.e., from the
front and the side, with such camera as a digital video camera or a
digital still camera, the motion picture images being automatically
taken in the motion picture image take-in part 12 of the from
evaluation sheet production program 8 in the personal computer. The
motion picture images of the motion picture image database 10 are
converted in the automatic still image producing part 14 to still
images as 30 frames per second (step 1), and for absolute swing
check from these still images (i.e., frames), full 9-division
frames 16 of check points in a series of swing operations, such as
addressing, take-back, top, impact and follow-through, are selected
by operator's manual operation (step 2), and are registered in the
9-frame still image storing unit 18 (step 3). The division frame
number is not limited to 9, and it may be set in dependence on the
technical power of the player, for instance 12 for middle-class
players and 16 for high-class players.
[0025] The evaluation scale synthesis process will now be described
with reference to FIGS. 3A to 3E. In this process, synthetic images
are formed by overlapping, on the screen, the evaluation scale for
visually showing deviations of the position, the angle, etc. from
an ideal form over the swing check still image displayed on the
personal computer display 19 by matching the image size with the
size of the still images. FIG. 3A shows various evaluation scales
of clock 22, matrix 24, etc. stored in the evaluation scale storing
unit 20. FIG. 3B shows a synthetic image obtained by displaying the
clock 22 in the evaluation scale on the personal computer display
19 with the image size matched to the size of the take-back still
image size and combining the still image and the clock 22. As shown
in FIG. 3A, various different evaluation scales are prepared, and
used as a tool representative of an absolute standard for the swing
evaluation.
[0026] The clock 22 is prepared for measuring and confirming the
positions of various points of image on clock display. The matrix
24 is a lattice-like scale used for confirming the positions of the
front and rearward vertical part of the swinging body and the club.
The drum can 26 is used for the check of the sway in the front
image. A check is made as to whether it is possible to turn in the
drum can 26 which is set with respect to the inter-food distance.
The protractor (i.e., semicircular protraction) 28 is used mainly
for the rearward image to measure the angle of the club and the
body. The paint 30 is a drawing tool used for showing a right
position in case when the body or the club is at a wrong position,
and it is measured not for measurement but for checking. The swing
plane 32 is used for the rearward image, that is, it is used for
checking whether the club passes through a line connecting the ball
and the shoulder by overlapping the swing plane on the line.
[0027] The gyroscope 34 is used for checking whether the club and
the back correctly turn until the impact by adding the swing plane
and the back line. The skeleton 36 is an image showing right
movement of the club and the body, and it permits finding a
correction point by overlapping it over the swing. The skeleton 35
which represents the man's body with dimple lines, are of either
type A or type B. The type A is a front view, and the type B is a
side view (i.e., rearward view). FIG. 3C shows a synthetic image
obtained from the swing plane 32 and a still image. FIG. 3D shows a
synthetic image obtained from the matrix 24 and still image. FIG.
3E shows a synthetic image obtained from the drum can 26 and a
still image. As shown in FIGS. 3B to 3E, synthetic still images are
produced by a desired evaluation scale to the still images for the
swing check. An evaluating person such as a lesson professional
evaluates the swing by referring to these synthetic still
images.
[0028] The synthetic images are used for the form check on the
basis of the ideal form database. The ideal form database is
obtained from check points used in golf magazines and books written
by lesson professionals, coaching terminals used in these writings
and evaluation standards, and an example of the database is shown
in FIG. 4. A plurality of lesson professionals or equivalent
qualified persons input evaluation points by manual operation via a
personal computer network from individual places in remote areas by
referring to the synthetic images of a desired evaluation scale
used as subscriber's swing still images. For example, when an
evaluating person determines on the basis of the synthetic still
image No. 1 in FIG. 3C that the addressing angle is 18 degrees, he
or she gives Evaluation 2, and updates the form evaluation database
38 for each subscriber and each birth date.
[0029] The evaluation is made for each check point, and a score is
determined for each evaluation. For example, the eagle is
represented by Evaluation 1, the birdie is represented by
Evaluation 2, the par is represented by Evaluation 3, the boggy is
represent by Evaluation 4, and the double boggy is represented by
Evaluation 5. The score is determined by each check point of the
form, and the score is automatically calculated as the sum of the
check point values for overall evaluation. When the swing
evaluation results are registered via the network in the form
evaluation database 38 in the host personal computer, the data in
the form evaluation database 38 are automatically converted to
HTML, and up-loaded in the web site in the form of a form
evaluation sheet 6 as shown in FIG. 5.
[0030] The form evaluation sheet production program will now be
described with reference to FIG. 6.
[0031] First in the case when the personal computer operator inputs
data concerning the still image No. 1 in the form evaluation sheet
6 by using the form evaluation production program 8, frame No. 1 of
a specified subscriber is selected from the 9-frame sill image
storing unit 18, and is displayed on the screen by controlling the
display unit 42. Subsequently, when the operator designates the
matrix 24, for instance, form the evaluation scale, the control
unit 40 selects the matrix 24 from the evaluation scale storing
unit 20, and controls the display unit 42 to display the matrix 24
in superimposition in the frame No. 1 still image on the screen. At
this time, the operator can designate the position and the size of
the matrix 24 to cause the evaluation scale control unit 44 to
shift the matrix to the desired position.
[0032] Then, the operator checks the grip, both arms, set-up and
ball position at the time of the addressing with reference to the
idea form database 46 of the golf swing while watching the
synthetic image obtained form the still image and the matrix 24. As
for the grip, the operator checks the way of gripping, and also
checks that both hands are such that the Y-figure part formed
between the roots of the thumb and the index finger is directed to
the right shoulder. As for both arms, the operator checks the form
of the arms, and also checks whether both shoulders and the grip
form V figure in front of the body. The operator determines the
evaluation as either one of five levels with reference to the ideal
form database 46 of the golf swing, for instance level 1 with a V
figure angle of 15 2 degrees and level 2 with an angle of 18.+-.2
degrees. The operator inputs evaluation data by making all
evaluations of the addressing stance in the frame No. 1.
[0033] When the evaluation data have been inputted, the evaluation
point input unit 48 inputs under control of the control unit 40, a
score of the eagle with evaluation level 1 of the addressing
stance, the birdie with level 2, the par with level 3, the boggy
with level 4 and the double boggy with level 5, in a predetermined
part of the golf from evaluation database 38, as shown in the score
columns 49 of the form evaluation sheet 6. Also, when the operator
inputs a comment of evaluation contents concerning the addressing
stance from the keyboard, the evaluation contents comment input
unit 50 inputs, under control of the control unit 40, the comment
inputted from the keyboard to a predetermined part of the form
evaluation database 38 so that the comment is displayed in the
evaluation contents column 52 of the form evaluation sheet 6. When
the evaluation of the synthetic image on the screen has been
completed, the synthetic image input unit 58 inputs, on the basis
of the operator's keyboard operation, the synthetic image to a
predetermined part of the form evaluation database 38 so that the
image is displayed in the image column 60 of the form evaluation
sheet 6.
[0034] In the above manner, for each of the 9-division still
images, synthetic image with the evaluation scale, evaluation data,
evaluation contents comment data, advice comment data and overall
advice by other lesson professionals are produced. These data are
inputted to predetermined parts, respectively, of the corresponding
form evaluation database 38 for the updating thereof. When a
database of a particular subscriber in the form evaluation database
38 has been updated, the database of that subscriber is
automatically converted to the form evaluation sheet 6 of the HTML
form, and the up-loading unit 62 does site-up to the management
side web site.
[0035] This embodiment permits conversion of motion picture images
taken with a digital camera or the like as material to 9-frame
still images for the form check, which is difficult by general
people. Since it is possible to compare the ideal swing of a lesson
professional and the own swing on the screen, it is possible to
indirectly understand the check points to be improved. Also, it is
possible to receive evaluation by selecting a suitable one of a
plurality of the lesson professionals. Furthermore, swing motion
picture images once accepted are preserved semi-permanently, and it
is thus possible to confirm changes in the own form. Still further,
the swing form may be evaluated in a point evaluation system such
that it is evaluated by at least three lesson professionals to
determine its evaluation point as the average point. Yet further,
the management side may be adopted to provide a handicap when a
predetermined standard is met.
[0036] The management side issues the written handicap
authorization, and bestows to an upper rank handicap user an honor,
which is provided together with the own comment in a handicap board
in the web site. The management side can also provide an evaluation
system which, unlike the handicap, provides an evaluation with a
point level increase in a predetermined period of time, and it may
give a certificate to an upper rank user. It is possible to build
up a database from the sex, height, body type, muscle strength,
etc. of the user, and such an arrangement may be made that the user
tries to produce an ideal form with reference to data of lesson
professionals or armatures and can understand the point of club
selection for the score-up. It is further possible, in cooperation
with a golf spot or a golf training place, to prepare fee-paying
photographers as the stuff and provide agent services from the
photographing to the user's application to the web site.
[0037] As has been described in the foregoing, with the form
evaluation system according to the invention, the user can readily
compare the ideal form of a sport such as the golf with the own
form on a screen and indirectly understand the points to be
improved. The system thus permits quick level-up in a sport such as
the golf.
* * * * *