U.S. patent application number 15/897547 was filed with the patent office on 2018-06-21 for dynamic code loading.
The applicant listed for this patent is Illumon LLC. Invention is credited to Ryan Caudy, Nathaniel J. Dorfman, David R. Kent, IV, Radu Teodorescu, Charles Wright, Mark Zeldis.
Application Number | 20180173743 15/897547 |
Document ID | / |
Family ID | 57248327 |
Filed Date | 2018-06-21 |
United States Patent
Application |
20180173743 |
Kind Code |
A1 |
Caudy; Ryan ; et
al. |
June 21, 2018 |
DYNAMIC CODE LOADING
Abstract
Described are methods, systems and computer readable media for
dynamic code loading.
Inventors: |
Caudy; Ryan; (New York,
NY) ; Kent, IV; David R.; (Colorado Springs, CO)
; Zeldis; Mark; (Randolph, NJ) ; Dorfman;
Nathaniel J.; (Sandy, UT) ; Wright; Charles;
(Cortlandt Manor, NY) ; Teodorescu; Radu; (New
York, NY) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Illumon LLC |
Plymouth |
MN |
US |
|
|
Family ID: |
57248327 |
Appl. No.: |
15/897547 |
Filed: |
February 15, 2018 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
15610162 |
May 31, 2017 |
9898496 |
|
|
15897547 |
|
|
|
|
15154998 |
May 14, 2016 |
9760591 |
|
|
15610162 |
|
|
|
|
62161813 |
May 14, 2015 |
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G06F 12/084 20130101;
H04L 51/12 20130101; G06F 3/0482 20130101; G06F 16/2365 20190101;
G06F 16/24539 20190101; G06F 40/216 20200101; G06F 3/067 20130101;
G06F 8/41 20130101; G06F 16/24561 20190101; G06F 16/278 20190101;
G06F 16/2428 20190101; H04L 63/101 20130101; G06F 2201/84 20130101;
G06F 8/30 20130101; G06F 40/183 20200101; H04L 61/2069 20130101;
G06F 3/0483 20130101; G06F 16/215 20190101; G06F 16/2255 20190101;
G06F 16/9024 20190101; G06F 16/9566 20190101; G06F 2212/1052
20130101; H04L 67/42 20130101; G06F 3/04895 20130101; G06F 2201/805
20130101; H04L 67/2847 20130101; G06F 16/2457 20190101; G06F 17/40
20130101; G06F 21/6209 20130101; H04L 63/102 20130101; G06F 16/285
20190101; G06F 3/04847 20130101; G06F 16/245 20190101; G06F 16/2455
20190101; G06F 16/9574 20190101; H04L 67/2842 20130101; G06F
12/0261 20130101; G06F 16/27 20190101; G06F 16/951 20190101; G06F
16/2291 20190101; G06F 16/907 20190101; G06F 40/166 20200101; H04L
67/2833 20130101; G06F 3/0656 20130101; G06F 16/144 20190101; G06F
16/2264 20190101; G06F 2212/154 20130101; H04L 67/34 20130101; G06F
11/1451 20130101; G06F 16/2237 20190101; G06F 40/174 20200101; G06F
16/22 20190101; G06F 16/248 20190101; G06F 2212/163 20130101; G06F
2212/60 20130101; G06F 3/0481 20130101; G06F 16/2246 20190101; G06F
16/24534 20190101; G06F 16/2379 20190101; G06F 16/2456 20190101;
G06F 3/0605 20130101; G06F 11/1469 20130101; G06F 16/2282 20190101;
G06F 16/2453 20190101; H04L 51/046 20130101; G06F 16/24537
20190101; G06F 40/274 20200101; H04L 12/18 20130101; G06F 15/17331
20130101; G06F 16/113 20190101; G06F 16/162 20190101; G06F 16/2372
20190101; G06F 16/24575 20190101; G06F 16/254 20190101; G06F 21/00
20130101; G06F 40/177 20200101; G06F 8/427 20130101; G06F 8/60
20130101; G06F 11/1464 20130101; G06F 16/2272 20190101; G06F
16/24553 20190101; G06F 16/24535 20190101; G06F 16/2358 20190101;
G06F 40/117 20200101; H04L 67/28 20130101; H04L 67/141 20130101;
G06F 16/2228 20190101; G06F 16/2308 20190101; H04L 69/16 20130101;
G06F 12/1483 20130101; G06F 16/221 20190101; G06F 16/23 20190101;
G06F 16/242 20190101; G06F 40/134 20200101; H04L 67/1002 20130101;
G06F 3/0485 20130101; G06F 16/9535 20190101; G06F 40/18
20200101 |
International
Class: |
G06F 17/30 20060101
G06F017/30; H04L 29/06 20060101 H04L029/06; H04L 29/12 20060101
H04L029/12; H04L 12/18 20060101 H04L012/18; H04L 29/08 20060101
H04L029/08; G06F 8/60 20060101 G06F008/60; G06F 11/14 20060101
G06F011/14; G06F 3/06 20060101 G06F003/06; G06F 8/41 20060101
G06F008/41; G06F 8/30 20060101 G06F008/30; G06F 12/02 20060101
G06F012/02; G06F 17/27 20060101 G06F017/27; G06F 17/24 20060101
G06F017/24; G06F 3/0485 20060101 G06F003/0485; G06F 3/0484 20060101
G06F003/0484; G06F 3/0481 20060101 G06F003/0481; G06F 15/173
20060101 G06F015/173; H04L 12/58 20060101 H04L012/58; G06F 12/084
20060101 G06F012/084; G06F 17/22 20060101 G06F017/22; G06F 3/0489
20060101 G06F003/0489; G06F 3/0482 20060101 G06F003/0482 |
Claims
1-20. (canceled).
21. A computer data system providing dynamic code loading within a
query dispatch and execution architecture, the system comprising:
one or more processors; computer readable storage coupled to the
one or more processors, the computer readable storage having stored
thereon instructions that, when executed by the one or more
processors, cause the one or more processors to perform operations
including: providing, from a computer system, first dynamic code
for execution by a remote query processor within a remote query
server computer system; making the first dynamic code available to
the remote query processor; loading the first dynamic code at the
remote query processor; accessing, at the remote query processor,
one or more data system query tasks; and executing, at the remote
query processor, the one or more data system query tasks using an
initial code deployment and the first dynamic code, wherein the
first dynamic code overrides at least a portion of the initial code
deployment.
22. The computer data system of claim 21, wherein the operations
further include: providing second dynamic code while the executing
is being performed by the remote query processor; making the second
dynamic code available to the remote query processor; loading the
second dynamic code at the remote query processor; and continuing
executing the one or more query tasks at the remote query processor
using the initial code deployment, the first dynamic code and the
second dynamic code.
23. The computer data system of claim 22, wherein the first dynamic
code includes code executable by one or more virtual machines and
the second dynamic code includes code executable by the one or more
virtual machines.
24. The computer data system of claim 22, wherein the second
dynamic code overrides at least a portion of the initial code
deployment.
25. The computer data system of claim 22, wherein the second
dynamic code adds one or more functions to the initial code
deployment.
26. The computer data system of claim 21, wherein making the first
dynamic code available to the remote query processor includes
persisting the first dynamic code on a server host at a URL forming
part of a classpath of a virtual machine of the remote query
processor.
27. The computer data system of claim 21, wherein making the first
dynamic code available to the remote query processor includes
persisting on a server host at a URL that will be searched by a
class loader of the remote query processor at runtime.
28. The computer data system of claim 21, wherein the first dynamic
code includes a data system query language portion, and wherein the
executing includes: parsing the query language portion into
computer code; compiling the computer code into executable code
configured to be executable on a virtual machine; and executing the
executable code on the virtual machine.
29. A method comprising: executing, at a remote query processor,
one or more query tasks using an initial code deployment; providing
first dynamic code during execution of the initial code deployment
by the remote query processor; making the first dynamic code
available to the remote query processor; loading the first dynamic
code at the remote query processor; and continuing executing, at
the remote query processor, the one or more query tasks using the
initial code deployment and the first dynamic code, wherein the
first dynamic code overrides at least a portion of the initial code
deployment.
30. The method of claim 29, further comprising: providing second
code while the executing is being performed by the remote query
processor; making the second code available to the remote query
processor; loading the second code at the remote query processor;
and continuing executing the one or more query tasks at the remote
query processor using the initial code deployment, the first
dynamic code and the second code.
31. The method of claim 29, wherein the first dynamic code includes
code executable by a virtual machine and the second code includes
code executable by the virtual machine.
32. The method of claim 30, wherein the second code overrides at
least a portion of the initial code deployment.
33. The method of claim 30, wherein the second code adds one or
more functions to the initial code deployment.
34. The method of claim 29, wherein making the first code available
to the remote query processor includes persisting the first code on
a server host at a URL forming part of a classpath of a virtual
machine of the remote query processor.
35. The method of claim 29, wherein making the first dynamic code
available to the remote query processor includes persisting the
first dynamic code on a server host at a URL that will be searched
by a class loader of the remote query processor at runtime.
36. The method of claim 30, wherein the second code includes a data
system query language portion, and wherein the executing includes:
parsing the query language portion into computer code; compiling
the computer code into executable code configured to be executable
on a virtual machine; and executing the executable code on the
virtual machine.
37. A method comprising: executing, at a remote query processor,
one or more data system query tasks using first dynamic code;
providing second code before or during execution of the first
dynamic code being performed by the remote query processor; making
the second code available to the remote query processor; loading
the second code at the remote query processor; and continuing
executing the one or more data system query tasks at the remote
query processor using a combination of the first dynamic code and
the second code, wherein the second code overrides at least a
portion of the first dynamic code.
38. The method of claim 37, wherein the first dynamic code includes
code executable by a virtual machine and the second code includes
code executable by the virtual machine.
39. The method of claim 37, wherein the second code includes a data
system query language portion, and wherein the executing includes:
parsing the query language portion into computer code; compiling
the computer code into executable code configured to be executable
on a virtual machine; and executing the executable code on the
virtual machine.
40. The computer data system of claim 22, wherein the first dynamic
code includes a data system query language portion, and wherein the
executing includes: parsing the query language portion into
computer code; compiling the computer code into executable code
configured to be executable on a virtual machine; and executing the
executable code on the virtual machine.
Description
[0001] This application claims the benefit of U.S. Provisional
Application No. 62/161,813, entitled "Computer Data System" and
filed on May 14, 2015, which is incorporated herein by reference in
its entirety.
[0002] Embodiments relate generally to computer data systems, and
more particularly, to methods, systems and computer readable media
for dynamic code loading.
[0003] Some conventional computer data systems may provide little
or no ability to alter software instructions once an application
has been built (e.g., compiled, linked, etc.). A user may have a
need or desire to alter functionality of a process within a
computer data system while not affecting other users or processes
within the system. A need may exist for a dynamically loading code
to a process (e.g., a remote query processor within a query
dispatch/execution architecture) such that the dynamically loaded
code does not affect other processes operating within the same
computer data system. Also, a need may exist to dynamically load
code for a process while that process is executing a query.
[0004] Further, a need may exist to permit multiple versions of a
data system to run in parallel using the same or similar source
data. A need may exist to permit users to implement and deploy
custom code without impacting other users. Also, a need may exist
to permit rapid deployment of new features/bug fixes to all or a
subset of users without a completely new system deployment.
[0005] Embodiments were conceived in light of the above mentioned
needs, problems and/or limitations, among other things.
[0006] Some implementations can include computer data system
providing dynamic code loading within a query dispatch and
execution architecture, the system can comprise one or more
processors, and computer readable storage coupled to the one or
more processors, the computer readable storage having stored
thereon instructions that, when executed by the one or more
processors, cause the one or more processors to perform operations.
The operations can include providing, from a client computer
system, first dynamic code for execution by a remote query
processor within a remote query server computer system, where the
remote query processor includes an executable code environment
established according to request parameters provided by a primary
client on the client computer system and where the remote query
processor is dedicated for processing one or more queries from the
primary client, and making the first dynamic code available to the
remote query processor. The operations can also include loading the
first dynamic code at the remote query processor, and accessing, at
the remote query processor, one or more data system query tasks
sent from the primary client. The operations can further include
executing, at the remote query processor, the one or more data
system query tasks using an initial code deployment and the first
dynamic code.
[0007] The operations can also include providing, from the client,
second dynamic code while the executing is being performed by the
remote query processor, and making the second dynamic code
available to the remote query processor. The operations can further
include loading the second dynamic code at the remote query
processor, and continuing executing the one or more query tasks at
the remote query processor using the initial code deployment, the
first dynamic code and the second dynamic code.
[0008] The first dynamic code can include code executable by one or
more virtual machines and the second dynamic code includes code
executable by the one or more virtual machines. The first dynamic
code or the second dynamic code can override a portion of the
initial code deployment. The first dynamic code or the second
dynamic code can add one or more functions to the initial code
deployment.
[0009] Making the first dynamic code available to the remote query
processor can include persisting the first dynamic code on a server
host at a URL forming part of a classpath of a virtual machine of
the remote query processor. Making the first dynamic code available
to the remote query processor can include persisting on a server
host at a URL that will be searched by a class loader of the remote
query processor at runtime.
[0010] The first dynamic code includes a data system query language
portion, and wherein the executing can include parsing the query
language portion into computer code, compiling the computer code
into executable code configured to be executable on a virtual
machine, and executing the executable code on the virtual
machine.
[0011] Some implementations can include a method that can include
providing, from a client, first code for execution by a remote
query processor, where the remote query processor includes an
executable code environment established according to request
parameters provided by the client and where the remote query
processor is dedicated for processing one or more queries from the
client. The method can also include making the first code available
to the remote query processor, and loading the first code at the
remote query processor. The method can further include receiving,
at the remote query processor, one or more data system query tasks
sent from the client, and executing, at the remote query processor,
the one or more query tasks using an initial code deployment and
the first code.
[0012] The method can also include providing, from the client,
second code while the executing is being performed by the remote
query processor, and making the second code available to the remote
query processor. The method can further include loading the second
code at the remote query processor, and continuing executing the
one or more query tasks at the remote query processor using the
initial code deployment, the first code and the second code.
[0013] The first code can include code executable by a virtual
machine and the second code includes code executable by the virtual
machine. The first code or the second code can override a portion
of the initial code deployment. The first code or the dynamic code
can add one or more functions to the initial code deployment.
[0014] Making the first code available to the remote query
processor can include persisting the first code on a server host at
a URL forming part of a classpath of a virtual machine of the
remote query processor. Making the first code available to the
remote query processor can include persisting the first code on a
server host at a URL that will be searched by a class loader of the
remote query processor at runtime.
[0015] The second code can include a data system query language
portion, and the executing can include parsing the query language
portion into computer code, compiling the computer code into
executable code configured to be executable on a virtual machine,
and executing the executable code on the virtual machine.
[0016] Some implementations can include a method that can include
providing, from a client, second code before or during execution of
first code being performed by a remote query processor, where the
remote query processor includes an executable code environment
established according to request parameters provided by the client
and where the remote query processor is dedicated for processing
one or more queries from the client, and making the second code
available to the remote query processor. The method can also
include loading the second code at the remote query processor, and
continuing executing the one or more query tasks at the remote
query processor using a combination of two or more of the initial
code deployment, the first code and the second code.
[0017] The first code can include code executable by a virtual
machine and the second code includes code executable by the virtual
machine. The second code can include a data system query language
portion, and the executing can include parsing the query language
portion into computer code, compiling the computer code into
executable code configured to be executable on a virtual machine,
and executing the executable code on the virtual machine.
[0018] The first dynamic code can include a data system query
language portion, and the executing can include parsing the query
language portion into computer code, compiling the computer code
into executable code configured to be executable on a virtual
machine, and executing the executable code on the virtual
machine.
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] FIG. 1 is a diagram of an example computer data system
showing an example data distribution configuration in accordance
with some implementations.
[0020] FIG. 2 is a diagram of an example computer data system
showing an example administration/process control arrangement in
accordance with some implementations.
[0021] FIG. 3 is a diagram of an example computing device
configured for GUI control element processing in accordance with
some implementations.
[0022] FIG. 4 is a diagram of an example query dispatch/execution
architecture in accordance with some implementations.
[0023] FIG. 5 is a flowchart showing an example method of operation
for a query dispatch/execution architecture in accordance with some
implementations.
[0024] FIG. 6 is a diagram of an example dynamic code loading
configuration within an example query dispatch and execution
architecture in accordance with some implementations.
[0025] FIG. 7 is a flowchart of an example dynamic code loading
process in accordance with some implementations.
DETAILED DESCRIPTION
[0026] Reference may be made herein to the Java programming
language, Java classes, Java bytecode and the Java Virtual Machine
(JVM) for purposes of illustrating example implementations. It will
be appreciated that implementations can include other programming
languages (e.g., groovy, Scala, R, Go, etc.), other programming
language structures as an alternative to or in addition to Java
classes (e.g., other language classes, objects, data structures,
program units, code portions, script portions, etc.), other types
of bytecode, object code and/or executable code, and/or other
virtual machines or hardware implemented machines configured to
execute a data system query.
[0027] FIG. 1 is a diagram of an example computer data system and
network 100 showing an example data distribution configuration in
accordance with some implementations. In particular, the system 100
includes an application host 102, a periodic data import host 104,
a query server host 106, a long-term file server 108, and a user
data import host 110. While tables are used as an example data
object in the description below, it will be appreciated that the
data system described herein can also process other data objects
such as mathematical objects (e.g., a singular value decomposition
of values in a given range of one or more rows and columns of a
table), TableMap objects, etc. A TableMap object provides the
ability to lookup a Table by some key. This key represents a unique
value (or unique tuple of values) from the columns aggregated on in
a byExternal( )statement execution, for example. A TableMap object
can be the result of a byExternal( )statement executed as part of a
query. it will also be appreciated that the configurations shown in
FIGS. 1 and 2 are for illustration purposes and in a given
implementation each data pool (or data store) may be directly
attached or may be managed by a file server.
[0028] The application host 102 can include one or more application
processes 112, one or more log files 114 (e.g., sequential,
row-oriented log files), one or more data log tailers 116 and a
multicast key-value publisher 118. The periodic data import host
104 can include a local table data server, direct or remote
connection to a periodic table data store 122 (e.g., a
column-oriented table data store) and a data import server 120. The
query server host 106 can include a multicast key-value subscriber
126, a performance table logger 128, local table data store 130 and
one or more remote query processors (132, 134) each accessing one
or more respective tables (136, 138). The long-term file server 108
can include a long-term data store 140. The user data import host
110 can include a remote user table server 142 and a user table
data store 144. Row-oriented log files and column-oriented table
data stores are discussed herein for illustration purposes and are
not intended to be limiting. It will be appreciated that log files
and/or data stores may be configured in other ways. In general, any
data stores discussed herein could be configured in a manner
suitable for a contemplated implementation. In operation, the input
data application process 112 can be configured to receive input
data from a source (e.g., a securities trading data source), apply
schema-specified, generated code to format the logged data as it's
being prepared for output to the log file 114 and store the
received data in the sequential, row-oriented log file 114 via an
optional data logging process. In some implementations, the data
logging process can include a daemon, or background process task,
that is configured to log raw input data received from the
application process 112 to the sequential, row-oriented log files
on disk and/or a shared memory queue (e.g., for sending data to the
multicast publisher 118). Logging raw input data to log files can
additionally serve to provide a backup copy of data that can be
used in the event that downstream processing of the input data is
halted or interrupted or otherwise becomes unreliable.
[0029] A data log tailer 116 can be configured to access the
sequential, row-oriented log file(s) 114 to retrieve input data
logged by the data logging process. In some implementations, the
data log tailer 116 can be configured to perform strict byte
reading and transmission (e.g., to the data import server 120). The
data import server 120 can be configured to store the input data
into one or more corresponding data stores such as the periodic
table data store 122. in a column-oriented configuration. The
periodic table data store 122 can be used to store data that is
being received within a time period (e.g., a minute, an hour, a
day, etc.) and which may be later processed and stored in a data
store of the long-term file server 108, For example, the periodic
table data store 122 can include a plurality of data servers
configured to store periodic securities trading data according to
one or more characteristics of the data (e.g., a data value such as
security symbol, the data source such as a given trading exchange,
etc.).
[0030] The data import server 120 can be configured to receive and
store data into the periodic table data store 122 in such a way as
to provide a consistent data presentation to other parts of the
system. Providing/ensuring consistent data in this context can
include, for example, recording logged data to a disk or memory,
ensuring rows presented externally are available for consistent
reading (e.g., to help ensure that if the system has part of a
record, the system has all of the record without any errors), and
preserving the order of records from a given data source. If data
is presented to clients, such as a remote query processor (132,
134), then the data may be persisted in some fashion (e.g., written
to disk).
[0031] The local table data server 124 can be configured to
retrieve data stored in the periodic table data store 122 and
provide the retrieved data to one or more remote query processors
(132, 134) via an optional proxy.
[0032] The remote user table server (RUTS) 142 can include a
centralized consistent data writer, as well as a data server that
provides processors with consistent access to the data that it is
responsible for managing. For example, users can provide input to
the system by writing table data that is then consumed by query
processors.
[0033] The remote query processors (132, 134) can use data from the
data import server 120, local table data server 124 and/or from the
long-term file server 108 to perform queries. The remote query
processors (132, 134) can also receive data from the multicast
key-value subscriber 126, which receives data from the multicast
key-value publisher 118 in the application host 102. The
performance table logger 128 can log performance information about
each remote query processor and its respective queries into a local
table data store 130. Further, the remote query processors can also
read data from the RUTS, from local table data written by the
performance logger, or from user table data read over NFS, for
example.
[0034] It will be appreciated that the configuration shown in FIG.
1 is a typical example configuration that may be somewhat idealized
for illustration purposes. An actual configuration may include one
or more of each server and/or host type. The hosts/servers shown in
FIG. 1 (e.g., 102-110, 120, 124 and 142) may each be separate or
two or more servers may be combined into one or more combined
server systems. Data stores can include local/remote,
shared/isolated and/or redundant. Any table data may flow through
optional proxies indicated by an asterisk on certain connections to
the remote query processors. Also, it will be appreciated that the
term "periodic" is being used for illustration purposes and can
include, but is not limited to, data that has been received within
a given time period (e.g., millisecond, second, minute, hour, day,
week, month, year, etc.) and which has not yet been stored to a
long-term data store (e.g., 140).
[0035] FIG. 2 is a diagram of an example computer data system 200
showing an example administration/process control arrangement in
accordance with some implementations. The system 200 includes a
production client host 202, a controller host 204, a GUI host or
workstation 206, and query server hosts 208 and 210. It will be
appreciated that there may be one or more of each of 202-210 in a
given implementation.
[0036] The production client host 202 can include a hatch query
application 212 (e.g., a query that is executed from a command line
interface or the like) and a real time query data consumer process
214 (e.g., an application that connects to and listens to tables
created from the execution of a separate query). The batch query
application 212 and the real time query data consumer 214 can
connect to a remote query dispatcher 222 and one or more remote
query processors (224, 226) within the query server host 1 208.
[0037] The controller host 204 can include a persistent query
controller 216 configured to connect to a remote query dispatcher
232 and one or more remote query processors 228-230. In some
implementations, the persistent query controller 216 can serve as
the "primary client" for persistent queries and can request remote
query processors from dispatchers, and send instructions to start
persistent queries. For example, a user can submit a query to the
persistent query controller 216, and the persistent query
controller 216 starts and runs the query every day. In another
example, a securities trading strategy could be a persistent query.
The persistent query controller can start the trading strategy
query every morning before the market opened, for instance. It will
be appreciated that 216 can work on times other than days. In some
implementations, the controller may require its own clients to
request that queries be started, stopped, etc. This can be done
manually, or by scheduled (e.g., cron jobs). Some implementations
can include "advanced scheduling" (e.g., auto-start/stop/restart,
time-based repeat, etc.) within the controller.
[0038] The GUI/host workstation can include a user console 218 and
a user query application 220. The user console 218 can be
configured to connect to the persistent query controller 216. The
user query application 220 can be configured to connect to one or
more remote query dispatchers (e.g., 232) and one or more remote
query processors (228, 230).
[0039] FIG. 3 is a diagram of an example computing device 300 in
accordance with at least one implementation. The computing device
300 includes one or more processors 302, operating system 304,
computer readable medium 306 and network interface 308. The memory
306 can include a query dispatch/execution application 310 and a
data section 312 (e.g., for storing query, query processor and/or
client data, etc.)
[0040] In operation, the processor 302 may execute the application
310 stored in the memory 306. The application 310 can include
software instructions that, when executed by the processor, cause
the processor to perform operations for query dispatch and
execution in accordance with the present disclosure (e.g.,
performing one or more of 502-524 described below). The application
program 310 can operate in conjunction with the data section 312
and the operating system 304.
[0041] FIG. 4 is a diagram of an example remote query dispatch and
execution architecture 400 in accordance with some implementations,
The remote query dispatch and execution architecture 400 includes a
first client 402, a second client 404, an optional load balancer
406 (e.g., one or more load balancers and/or a distributed load
balancer), a first remote query dispatcher 408, a second remote
query dispatcher 410, and a plurality of remote query processors
412-418 connected to a respective remote query dispatcher and
client. The remote query dispatcher (e.g., 408, 410) and the
corresponding remote query processors (e.g., 412-418) can reside on
a single computer system or on different computer systems. The
process of a client requesting a remote query processor from a
remote query dispatcher and a remote query dispatcher fulfilling
the client request is described below in connection with FIG.
5.
[0042] The load balancer 406 could be implemented as a sub-module
within each remote query dispatcher 408, 410. This configuration
could support a distributed system with each remote query
dispatcher participating in a distributed state exchange and a
single "leader" remote query dispatcher making scheduling decisions
for all participating remote query dispatchers. The load balancer
406 could also include a distributed 100% uptime load balancer. It
will be appreciated that if a load balancer 406 is included in an
implementation, the clients (402, 404) may connect to the remote
query dispatchers (408, 410) through the load balancer 406. When a
load balancer is not included or is integrated within each remote
query dispatcher, the clients (402, 404) may connect directly to
respective remote query dispatchers (408, 410).
[0043] In some implementations, multiple clients can connect to a
single remote query processor. Also, in some implementations a
client can connect to multiple remote query processors via multiple
intermediate clients. For example, a persistent query controller
process (e.g., 216) may connect to potentially dozens of different
remote query processors (e.g., 228, 230). Each of these connections
can be independent of the others, but it may be possible for the
client (i.e., the persistent query controller process 216 in the
controller host 204) to combine the results from multiple remote
query processors using table APIs such that the work to combine
these results occurs on the client side (e.g., in the controller
host 204).
[0044] In another example, a widget can be configured to connect to
eight different remote query processors. The widget can combine the
data from three queries together (e.g., one query contains position
data, one query contains inputs from traders, and the other query
contains data relevant to all traders for a given symbol) to make a
table that is presented to the user. This is also an example of
client side processing. The client combines the position data,
input data, and then the symbol data into one view by dividing the
symbol data into put and call options (two filters), then joining
them together, and joining the user's positions and their inputs to
the generic symbol data. As users are typically looking at a small
subset of the system at once (one symbol each out of a few
thousand), the burden on the server can be greatly reduced.
[0045] In some implementations, a client process can be a client to
multiple remote query dispatchers (via separate remote query
dispatcher-connections) and multiple remote query processors on
multiple host machines (via separate processor-connections). A
remote query processor can also serve as a client--it can request
that a remote query dispatcher create additional remote query
processors and/or serve as a client to another remote query
processor.
[0046] In some implementations, processing can be shared between a
remote query processor and a client (e.g., between 402 and 412).
For example, given a script running a very complex query and a GUI
configured to display a subset of tables from the query. All of the
tables may be hosted and updated by the server. The end user may be
looking at one of the tables and determine that they want to filter
the table so that they can see a subset of the rows (e.g., for the
symbol AAPL). This filtering may take place on the client side.
Assuming the table is not too large, filtering on the client side
can be more responsive and faster, while reducing load on the
server.
[0047] Remote query processors can be configured to stream data to
another location (e.g., a trading system, one or more other remote
query processors). For example, a GUI can be attached to a running
query script such that the remote query processor streams data from
the query to the GUI. In another example, a query script implements
a trading strategy. During the execution of the query script, a
call is made to register the remote query processor with the
trading system. During the registration process a connection is
made to the trading execution system, and information about the
remote query processor is sent to the trading execution system
(address, port, etc.).
[0048] Later in the script, calls are made to register an order
table with the trading system. This registration sets up a
communication channel to stream changes in the order table
(add/modify/delete in the current case) to the trading system.
[0049] In yet another example, a query may need data derived from a
source the user does not have permission to see. For example, a
need may exist to know a firm's net stock position (e.g., this may
be required for correct short/long marking of a sale), but not have
visibility into the individual positions of other traders. A query
can run as a privileged user, and be configured to aggregate all
the positions. The system allows other remote query processors to
connect and get the aggregate positions table (e.g., to determine
how to properly mark trades), but the system will not permit users
to see the underlying data that went into the query.
[0050] It will be appreciated that the query dispatch/execution
architecture 400 is a simplified configuration for purposes of
illustrating the principles of the disclosed subject matter. An
actual implementation may include one or more clients, zero or more
load balancers, one or more remote query dispatchers and zero or
more remote query processors associated with each remote query
dispatcher.
[0051] FIG. 5 is a flowchart showing an example method 500 of
operation for a query dispatch and execution architecture (e.g., as
shown in FIG. 2 or FIG. 4) in accordance with some implementations.
Processing begins at 502, where a client optionally provides (or
"pushes") code such as one or more client classes to a remote query
dispatcher and sends a request for a remote query processor to the
remote query dispatcher 504. The client code (e.g., one or more
classes, or the like) and the request can be sent to the remote
query dispatcher via an optional load balancer (as described
above). The code provided by the client can include executable code
components, programming language code, scripts, strings, libraries,
and/or the like. Processing continues to 506.
[0052] At 506, it is determined whether the remote query dispatcher
rejects the request for a remote query processor from the client.
For example, the remote query dispatcher may reject a request for a
number of reasons including, but not limited to, one or more of the
following: a lack of storage space on a server (e.g., not enough
RAM on the server), a server about to reboot, a server no longer
accepting query jobs, client does not have permission to run query
on the server, client has exhausted the query quota allocated to
the client. Also, the request may be rejected when a client has
specified invalid settings, either immediately determined by the
remote query dispatcher, or presumed after a configured number of
attempts to start processors for the query fail. Further, the
request may be rejected when an administrative user has requested
that the query job be cancelled or rejected. If the remote query
dispatcher rejects the request for a remote query processor,
processing continues to 508 where the remote query dispatcher
rejects the request and informs the client. Otherwise, processing
continues to 510.
[0053] At 510, the remote query dispatcher attempts to start up a
remote query processor. Starting up a remote query processor can
include the remote query dispatcher allocating resources and
instantiating the remote query processor runtime engine (e.g., Java
virtual machine or JVM), configuring garbage collection, etc. In
starting up a remote query processor, the remote query dispatcher
may specify override classes or alternative classpaths to use when
starting the remote query processor. This allows the remote query
processors to be running different code versions or allows users to
run slight tweaks in their own versions. Query related parameters
are also passed to the remote query processors. These include JVM
arguments, amount of RAM to use, etc. Start up of a remote query
processor can also be based on information received from the client
in the request for a remote query processor. The client request can
include one or more of:
[0054] (1) a description for display on various monitoring
dashboards;
[0055] (2) client authentication token;
[0056] (3) desired processor heap size;
[0057] (4) desired processor time to live;
[0058] (5) virtual machine (e.g., JVM) parameters that should be
passed to the processor--used for configuring the JVM itself (e.g.
garbage collection settings, other performance settings, etc), or
specifying "system properties" for the application code to
reference;
[0059] (6) environment variables (e.g., in the UNIX sense) that
should be set for the processor;
[0060] (7) libraries or directories that should be included in the
processor's classpath, usually including but not limited to (a) the
directory that the client's pushed classes are saved to by the
dispatcher, (b) a directory of "cached" classes generated by
compiling query language artifacts, and (c) user-specific libraries
or directories enabled according to the authentication token;
and
[0061] (8) hints about how the processor should be treated for
resource allocation purposes (interactivity flags, priority flags
used for balancing demands from the same client or user).
Processing continues to 512.
[0062] At 512, it is determined whether the remote query processor
was successfully started up. if so, processing continues to 516.
Otherwise, processing continues to 514.
[0063] At 514, the system makes a given number of retries to start
up the remote query processor. If the remote query processor is not
successfully started within the given number of retries, processing
continues to 508, where the remote query processor startup fails
and the remote query dispatcher returns a fail indication to the
client. In some implementations, the dispatcher may try multiple
times to start a remote query processor with the client's requested
parameters, and a contemplated load balancer/distributed-dispatcher
may similarly try to start a remote query processor multiple times
on the same or different hosts. There may be some requests that
will result in a rejection due to lack of entitlement, invalid
settings, or repeated processor startup errors. Rejections can be
communicated via messages to the client over the network connection
between the client and the remote query dispatcher. For example,
the rejection can be presented to the client code as a Java
Exception (or potentially similar language-appropriate mechanisms
in the future) with details that explain the reason for the
rejection.
[0064] Client requests also may specify a timeout--if the request
is not satisfied after a specified delay, the client process will
asynchronously issue a cancellation for the request already in
progress, triggering a rejection from the dispatcher.
[0065] At 516, the remote query processor registers with the remote
query dispatcher. Remote query processors register with a remote
query dispatcher at start-up. Registration can include the remote
query processor establishing a communication channel to the remote
query dispatcher (e.g., via a TCP/IP socket, connected via a
well-known port that the dispatcher listens on), sending a
registration message that signals to the remote query dispatcher
that the remote query processor is available for client
connections, and keeping this channel open for (1) heartbeat
messages in both directions, (2) control messages from the remote
query dispatcher to the remote query processor, and (3) performance
data messages from the remote query processor to the remote query
dispatcher.
[0066] If the remote query processor fails in start up, the remote
query dispatcher will not receive this registration message, and
under most circumstances it will eventually observe the remote
query processor's death (by monitoring the child process' output
streams for end-of-file, and waiting for the child process' exit
status, in the Java/UNIX sense). Processing continues to 518.
[0067] At 518, the remote query dispatcher responds to the client
with a host and a port assignment of the remote query processor. In
general, the remote query dispatcher can provide the client with
addressing information to permit the client to begin sending
messages to and receiving messages from the remote query processor.
In some implementations, the remote query dispatcher supplies a
host (or the client already knows the host) and a port that can be
used to connect a TCP/IP socket. Processing continues to 520.
[0068] At 520, the client connects to/registers with the remote
query processor. While the client is now in direct communications
with the remote query processor, the remote query processor may
maintain a connection to the remote query dispatcher. The remote
query processor-dispatcher connection may provide the remote query
dispatcher with an indication of remote query processor "liveness"
registering/monitoring as well as client-request-performance
logging data. The monitoring of remote query processor liveness can
provide an advantage of reducing or eliminating rogue remote query
processor. Processing continues to 522.
[0069] At 522, the client sends one or more queries (or other
requests) to the remote query processor. Processing continues to
524.
[0070] At 524, the remote query processor responds to the client
query (or other request).
[0071] During continued processing, there may be repeated cycles of
522/524 as the client makes requests and the remote query processor
responds.
[0072] Remote query processors may reach a termination condition. A
remote query processor can terminate under certain circumstances,
including, but not limited to: an unrecoverable error (e.g., JVM
heap exhaustion); "primary" client disconnection from the remote
query processor for any reason (where the primary client is the
initial client that requested and first connected to the remote
query processor); a remote query dispatcher requests that a remote
query processor terminate (e.g., due to administrator command, or
in response to primary client disconnection from the remote query
dispatcher, etc); and a remote query dispatcher disconnects from
the remote query processor for any reason (e.g., as a fail-safe to
keep unmanaged processes from continuing).
[0073] FIG. 6 is a diagram of an example dynamic code loading
configuration 600 including a client 602, code being pushed from
the client 604, an optional load balancer 606, a dispatcher 608, a
remote query processor 610, dynamically loaded code from the client
612, an optional portion of an initial (or regular) deployment
overridden by dynamically loaded code from the client 614, an
initial software deployment 616, and code built dynamically by the
remote query processor as part of query execution 618. It will be
appreciated that the example configuration shown in FIG. 6 is
simplified for purposes of illustrating principles of the disclosed
subject matter. An actual implementation of the subject matter
disclosed herein could include multiple clients on one or more
client hosts, multiple load balancers, multiple dispatchers and
multiple remote query processors.
[0074] In general, the client 602 requests a remote query processor
from the dispatcher 608 to perform a job (e.g., one or more
sequences of query task executions). In order to perform the job,
the remote query processor needs code to execute, The code a remote
query processor executes to perform the job can be provided to the
remote query processor using one or more of the methods described
below.
[0075] In a first method, a remote query processor 610 may use code
deployed as part of the initial software deployment 616. This can
establish a baseline environment for all queries on a given server
host. in a Java language example, the initial deployment can
include a deployment of jar files (e.g., via RPM installation,
etc.), or class files deployed as part of a one-off deployment. The
class files may be thought of as "overriding" a portion of an
initial software code deployment.
[0076] In sonic implementations, the first method can include the
client supplying additional paths to include as part of a remote
query processor's classpath (e.g., for previously deployed "extra"
libraries). Also, scripts used by the dispatcher to start the
remote query processor can dynamically select classpath elements to
include (e.g., because the authenticated user that requested the
remote query processor is entitled to use additional libraries,
scripts, code repositories, etc.),
[0077] In a second method, the client 602 may push one or more code
classes 604 to the dispatcher 608 to be persisted on the server
host (e.g., 208-210) in URLs that will be part of the remote query
processor JVM's classpath. While code classes are used herein as an
example, it will be appreciated that other code portions could be
provided such as individual modules, files, libraries, etc. The
dynamically loaded code 612 may "override" a portion 614 or all of
the initial code deployment 616. This method can permit classes
that are available at remote query processor-request-time (e.g.,
prior to remote query processor start up) to be available to the
remote query processor, and may provide an advantage of being a
mechanism that can reliably and safely replace (or augment) core
data system engine/server component classes as well as a mechanism
for deploying new functionality to all or a subset of users.
[0078] In a third method, the client 602 can push classes to the
dispatcher 608 to be persisted on the server host (e.g., 208-210)
in URLs that will be searched by ClassLoaders on the remote query
processor 610 at runtime. This method can permit classes that are
created after the remote query processor is created (and after the
remote query processor starts up) to be available to the remote
query processor. The third method may provide greater flexibility
than the second method, but may be less powerful in the sense that
the third method may encounter runtime conflicts if used for core
classes. In some implementations, the third method can be
implemented without involvement by the dispatcher (e.g., provided
directly from a client, provided from a load balancer, etc.).
[0079] In a fourth method, the remote query processor 610 can
compile additional code in the remote query processor 610 to class
files 618 to be persisted by the remote query processor 610 and
loaded using the second method or third method described above,
This method can be used for truly dynamic classes created as part
of query execution.
[0080] In some implementations, a typical query task is submitted
as (a) an instance of a class implementing a remote query
interface, (b) a remote method invocation on a Table handle object,
or (c) a script (or line of scripting code) to be evaluated by an
interpreter on the remote query processor. In the case of (a), the
class that the query is an instance of, and any classes it directly
depends on, are made available to the remote query processor using
one of the first three methods described above. The method most
appropriate for a given situation depends on the use case. The
first method can be used for non-experimental "production"
work-flows because it may be somewhat easier to debug and
administer than the other methods. In some implementations, a
remote query processor may typically use the first and fourth
methods described above along with one of the second or third
methods.
[0081] The second method described above was developed to provide,
among other things, wider latitude in the classes that might be
replaced by making them available to a system ClassLoader in the
remote query processor at start up time. This can help avoid the
risk of loading the wrong version of a class, or creating runtime
conflicts between objects instantiated using different
ClassLoaders. One difficulty for method three described above is
that it may often need to violate the standard ClassLoader
delegation model, by design.
[0082] FIG. 7 is a flowchart of an example dynamic code loading
process 700 in accordance with some implementations. Processing
begins at 702 where a client provides code to a dispatcher for
dynamic loading to a remote query processor. For example, a client
602 can push one or more Java class files to the dispatcher (or
directly to a remote query processor). Processing continues to
704.
[0083] At 704, the dispatcher makes the code provided by the client
available to a remote query processor. In some implementations, the
dispatcher can make the code available by writing class files to a
directory that the remote query processor is aware of, which is
then used on-demand as a result of interpreting client query task
instances, For example, the dispatcher can place the code from the
client into a URL in the classpath of the JVM, or place the code
into a URI searched by a ClassLoader of the remote query processor.
Processing continues to 706.
[0084] At 706, the remote query processor dynamically loads the
code provided by dispatcher. The dynamically loaded code can be in
addition to a regular software distribution or may override a
portion of the regular software distribution. Processing continues
to 708.
[0085] At 708, the client sends a job (e.g., a series of one or
more query tasks) to the remote query processor. Processing
continues to 710.
[0086] At 710, the remote query processor processes the job request
from the client and responds with a result determined in part using
the dynamically loaded code from the client. Processing continues
to 712-716, which are optional.
[0087] 712-716 provide a method for the remote query processor to
dynamically load code during query job processing (i.e.,
"mid-query"). This may be done by end users to incorporate new
functionality not available in a regular software deployment of the
data system.
[0088] At 712, the client provides new code during the processing
of a job by the remote query processor. Processing continues to
714.
[0089] At 714, the new code is made available to the remote query
processor using one or more of the techniques described above. For
example, the new (or override) code can he provided from the
client, an alternative classpath, etc. The mechanism used to get
the code to the remote query processor can include one or more of
providing the code directly from the client, providing the code
from the dispatcher, and/or providing the code via an alternative
classpath. Further, the code may be dynamically generated from a
data system query language string or portion provided from the
client. For example, for a given query such as
t2=t2.update("A=sqrt(2*B)+C"), the string "A=sqrt(2*B)+C" can be
parsed, converted to programming language code (e.g., Java),
compiled, and used in the resulting query. Processing continues to
716.
[0090] At 716, the remote query processor dynamically loads the new
code and continues processing the job to produce a result that is
based at least in part on the newly loaded code.
[0091] In some implementations, the code can be provided as
compiled class files. The class files can be anything suitable to
execute on a virtual machine (e.g., JVM). The code can range from a
single class up to the code for an entire computer data system. The
class files can include a) Java code that has been compiled to JVM
bytecode files; b) non-Java code (e.g. scala, groovy, etc.) that
has been compiled to JVM bytecode files; and/or c) NM classes and
objects that have been dynamically generated. For example,
functions, closures, and classes written in a Groovy command line
session can be automatically pushed to back end remote query
processors for use in queries.
[0092] In general, any technique suitable for creating JVM bytecode
could be used. In some implementations, class files created from a
variety of languages using either static or dynamic compilation are
sent to the remote query processors from clients via a dispatcher
or directly from the client to the remote query processor. Also,
dynamically interpreted scripts could be provided.
[0093] It will be appreciated that the modules, processes, systems,
and sections described above can be implemented in hardware,
hardware programmed by software, software instructions stored on a
nontransitory computer readable medium or a combination of the
above. A system as described above, for example, can include a
processor configured to execute a sequence of programmed
instructions stored on a nontransitory computer readable medium.
For example, the processor can include, but not be limited to, a
personal computer or workstation or other such computing system
that includes a processor, microprocessor, microcontroller device,
or is comprised of control logic including integrated circuits such
as, for example, an Application Specific Integrated Circuit (ASIC),
a field programmable gate array (FPGA), graphics processing unit
(GPU) or the like. The instructions can be compiled from source
code instructions provided in accordance with a programming
language such as Java, C, C++, C#.net, assembly or the like. The
instructions can also comprise code and data objects provided in
accordance with, for example, the Visual Basic.TM. language, a
specialized database query language, or another structured or
object-oriented programming language. The sequence of programmed
instructions, or programmable logic device configuration software,
and data associated therewith can be stored in a nontransitory
computer-readable medium such as a computer memory or storage
device which may be any suitable memory apparatus, such as, but not
limited to ROM, PROM, EEPROM, RAM, flash memory, disk drive and the
like. The processor and/or computer readable medium can include
photonics, spintronics, and/or quantum devices.
[0094] Furthermore, the modules, processes systems, and sections
can be implemented as a single processor or as a distributed
processor. Further, it should be appreciated that the steps
mentioned above may be performed on a single or distributed
processor (single and/or multi-core, or cloud computing system).
Also, the processes, system components, modules, and sub-modules
described in the various figures of and for embodiments above may
be distributed across multiple computers or systems or may be
co-located in a single processor or system. Example structural
embodiment alternatives suitable for implementing the modules,
sections, systems, means, or processes described herein are
provided below.
[0095] The modules, processors or systems described above can be
implemented as a programmed general purpose computer, an electronic
device programmed with microcode, a hard-wired analog logic
circuit, software stored on a computer-readable medium or signal,
an optical computing device, a networked system of electronic
and/or optical devices, a special purpose computing device, an
integrated circuit device, a semiconductor chip, and/or a software
module or object stored on a computer-readable medium or signal,
for example.
[0096] Embodiments of the method and system (or their
sub-components or modules), may be implemented on a general-purpose
computer, a special-purpose computer, a programmed microprocessor
or microcontroller and peripheral integrated circuit element, an
ASIC or other integrated circuit, a digital signal processor, a
hardwired electronic or logic circuit such as a discrete element
circuit, a programmed logic circuit such as a PLD, PLA, FPGA, PAL,
or the like. In general, any processor capable of implementing the
functions or steps described herein can he used to implement
embodiments of the method, system, or a computer program product
(software program stored on a nontransitory computer readable
medium).
[0097] Furthermore, embodiments of the disclosed method, system,
and computer program product (or software instructions stored on a
nontransitory computer readable medium) may be readily implemented,
fully or partially, in software using, for example, object or
object-oriented software development environments that provide
portable source code that can be used on a variety of computer
platforms. Alternatively, embodiments of the disclosed method,
system, and computer program product can be implemented partially
or fully in hardware using, for example, standard logic circuits or
a VLSI design. Other hardware or software can be used to implement
embodiments depending on the speed and/or efficiency requirements
of the systems, the particular function, and/or particular software
or hardware system, microprocessor, or microcomputer being
utilized. Embodiments of the method, system, and computer program
product can be implemented in hardware and/or software using any
known or later developed systems or structures, devices and/or
software by those of ordinary skill in the applicable art from the
function description provided herein and with a general basic
knowledge of the software engineering and computer networking
arts.
[0098] Moreover, embodiments of the disclosed method, system, and
computer readable media (or computer program product) can be
implemented in software executed on a programmed general purpose
computer, a special purpose computer, a microprocessor, or the
like.
[0099] While code classes are used herein as an example, it will be
appreciated that other code portions could be provided such as
individual modules, files, libraries, etc.
[0100] It is, therefore, apparent that there is provided, in
accordance with the various embodiments disclosed herein, methods,
systems and computer readable media for dynamic code loading.
[0101] Application Ser. No. 15/154,974, entitled "DATA PARTITIONING
AND ORDERING" (Attorney Docket No. W1.1-10057) and filed in the
United States Patent and Trademark Office on May 14, 2016, is
hereby incorporated by reference herein in its entirety as if fully
set forth herein.
[0102] Application Ser. No. 15/154,975, entitled "COMPUTER DATA
SYSTEM DATA SOURCE REFRESHING USING AN UPDATE PROPAGATION GRAPH"
(Attorney Docket No. W1.4-10058) and filed in the United States
Patent and Trademark Office on May 14, 2016, is hereby incorporated
by reference herein in its entirety as if fully set forth
herein.
[0103] Application Ser. No. 15/154,979, entitled "COMPUTER DATA
SYSTEM POSITION-INDEX MAPPING" (Attorney Docket No. W1.5-10083) and
filed in the United States Patent and Trademark Office on May 14,
2016, is hereby incorporated by reference herein in its entirety as
if fully set forth herein.
[0104] Application Ser. No. 15/154,980, entitled "SYSTEM
PERFORMANCE LOGGING OF COMPLEX REMOTE QUERY PROCESSOR QUERY
OPERATIONS" (Attorney Docket No. W1.6-10074) and filed in the
United States Patent and Trademark Office on May 14, 2016, is
hereby incorporated by reference herein in its entirety as if fully
set forth herein.
[0105] Application Ser. No. 15/154,983, entitled "DISTRIBUTED AND
OPTIMIZED GARBAGE COLLECTION OF REMOTE AND EXTORTED TABLE HANDLE
LINKS TO UPDATE PROPAGATION GRAPH NODES" (Attorney Docket No.
W1.8-10085) and filed in the United States Patent and Trademark
Office on May 14, 2016, is hereby incorporated by reference herein
in its entirety as if fully set forth herein.
[0106] Application Ser. No. 15/154,984, entitled "COMPUTER DATA
SYSTEM CURRENT ROW POSITION QUERY LANGUAGE CONSTRUCT AND ARRAY
PROCESSING QUERY LANGUAGE CONSTRUCTS" (Attorney Docket No.
W2.1-10060) and filed in the United States Patent and. Trademark
Office on May 14, 2016, is hereby incorporated by reference herein
in its entirety as if fully set forth herein.
[0107] Application Ser. No. 15/154,985, entitled "PARSING AND
COMPILING DATA SYSTEM QUERIES" (Attorney Docket No. W2.2-10062) and
filed in the United States Patent and Trademark Office on May 14,
2016, is hereby incorporated by reference herein in its entirety as
if fully set forth herein.
[0108] Application Ser. No. 15/154,987, entitled "DYNAMIC FILTER
PROCESSING" (Attorney Docket No. W2.4-10075) and filed in the
United States Patent and Trademark Office on May 14, 2016, is
hereby incorporated by reference herein in its entirety as if fully
set forth herein.
[0109] Application Ser. No. 15/154,988, entitled "DYNAMIC JOIN
PROCESSING USING REAL-TIME MERGED NOTIFICATION LISTENER" (Attorney
Docket No. W2.6-10076) and filed in the United States Patent and
Trademark Office on May 14, 2016, is hereby incorporated by
reference herein in its entirety as if fully set forth herein.
[0110] Application Ser. No. 15/154,990, entitled "DYNAMIC TABLE
INDEX MAPPING" (Attorney Docket No. W2.7-10077) and filed in the
United States Patent and Trademark Office on May 14, 2016, is
hereby incorporated by reference herein in its entirety as if fully
set forth herein.
[0111] Application Ser. No. 15/154,991, entitled "QUERY TASK
PROCESSING BASED ON MEMORY ALLOCATION AND PERFORMANCE CRITERIA"
(Attorney Docket No. W2.8-10094) and filed in the United States
Patent and Trademark Office on May 14. 2016, is hereby incorporated
by reference herein in its entirety as if fully set forth
herein.
[0112] Application Ser. No. 15/154,993, entitled "A
MEMORY-EFFICIENT COMPUTER SYSTEM FOR DYNAMIC UPDATING OF JOIN
PROCESSING" (Attorney Docket No. W2.9-10107) and filed in the
United States Patent and Trademark Office on May 14, 2016, is
hereby incorporated by reference herein in its entirety as if fully
set forth herein.
[0113] Application Ser. No. 15/154,995, entitled "QUERY DISPATCH
AND EXECUTION ARCHITECTURE" (Attorney Docket No. W3.1-10061) and
filed in the United States Patent and Trademark Office on May 14,
2016, is hereby incorporated by reference herein in its entirety as
if fully set forth herein.
[0114] Application Ser. No. 15/154,996, entitled "COMPUTER DATA
DISTRIBUTION ARCHITECTURE" (Attorney Docket No. W3.2-10087) and
filed in the United States Patent and Trademark Office on May 14,
2016, is hereby incorporated by reference herein in its entirety as
if fully set forth herein.
[0115] Application Ser. No. 15/154,997, entitled "DYNAMIC UPDATING
OF QUERY RESULT DISPLAYS" (Attorney Docket No. W3.3-10059) and
filed in the United States Patent and Trademark Office on May 14,
2016, is hereby incorporated by reference herein in its entirety as
if fully set forth herein.
[0116] Application Ser. No. 15/154,998, entitled "DYNAMIC CODE
LOADING" (Attorney Docket No. W3.4-10065) and filed in the United
States Patent and Trademark Office on May 14, 2016, is hereby
incorporated by reference herein in its entirety as if fully set
forth herein.
[0117] Application Ser. No. 15/154,999, entitled "IMPORTATION,
PRESENTATION, AND PERSISTENT STORAGE OF DATA" (Attorney Docket No.
W3.5-10088) and filed in the United States Patent and Trademark
Office on May 14, 2016, is hereby incorporated by reference herein
in its entirety as if fully set forth herein.
[0118] Application Ser. No. 15/155,001, entitled "COMPUTER DATA
DISTRIBUTION ARCHITECTURE" (Attorney Docket No. W3.7-10079) and
filed in the United States Patent and Trademark Office on May 14,
2016, is hereby incorporated by reference herein in its entirety as
if fully set forth herein.
[0119] Application Ser. No. 15/155,005, entitled "PERSISTENT QUERY
DISPATCH AND EXECUTION ARCHITECTURE" (Attorney Docket No.
W4.2-10089) and filed in the United States Patent and Trademark
Office on May 14, 2016, is hereby incorporated by reference herein
in its entirety as if fully set forth herein.
[0120] Application Ser. No. 15/155,006, entitled "SINGLE INPUT
GRAPHICAL USER INTERFACE CONTROL ELEMENT AND METHOD" (Attorney
Docket No. W4.3-10063) and filed in the United States Patent and
Trademark Office on May 14, 2016, is hereby incorporated by
reference herein in its entirety as if fully set forth herein.
[0121] Application Ser. No. 15/155,007, entitled "GRAPHICAL USER
INTERFACE DISPLAY EFFECTS FOR A COMPUTER DISPLAY SCREEN" (Attorney
Docket No. W4.4-10090) and filed in the United States Patent and
Trademark Office on May 14, 2016, is hereby incorporated by
reference herein in its entirety as if fully set forth herein.
[0122] Application Ser. No. 15/155,009, entitled "COMPUTER ASSISTED
COMPLETION OF HYPERLINK COMMAND SEGMENTS" (Attorney Docket No.
W4.5-10091) and filed in the United States Patent and Trademark
Office on May 14, 2016, is hereby incorporated by reference herein
in its entirety as if fully set forth herein.
[0123] Application Ser. No. 15/155,010, entitled "HISTORICAL DATA
REPLAY UTILIZING A COMPUTER SYSTEM" (Attorney Docket No.
W5.1-10080) and filed in the United States Patent and Trademark
Office on May 14, 2016, is hereby incorporated by reference herein
in s entirety as if fully set forth herein.
[0124] Application Ser. No. 15/155,011, entitled "DATA STORE ACCESS
PERMISSION SYSTEM WITH INTERLEAVED APPLICATION OF DEFERRED ACCESS
CONTROL FILTERS" (Attorney Docket No. W6.1-10081) and filed in the
United States Patent and Trademark Office on May 14, 2016, is
hereby incorporated by reference herein in its entirety as if fully
set forth herein,
[0125] Application Ser. No. 15/155,012, entitled "REMOTE DATA
OBJECT PUBLISHING/SUBSCRIBING SYSTEM HAVING A MULTICAST KEY-VALUE
PROTOCOL" (Attorney Docket No. W7.2-10064) and filed in the United
States Patent and Trademark Office on May 14, 2016, is hereby
incorporated by reference herein in its entirety as if fully set
forth herein.
[0126] While the disclosed subject matter has been described in
conjunction with a number of embodiments, it is evident that many
alternatives, modifications and variations would be, or are,
apparent to those of ordinary skill in the applicable arts.
Accordingly, Applicants intend to embrace all such alternatives,
modifications, equivalents and variations that are within the
spirit and scope of the disclosed subject matter.
* * * * *