Title: Grid Service Audit and Accounting Query Interface

Technologies:    OSGA-DAI, Globus Resource Allocation Manager (GRAM)

Definition:

TeraGrid wants to enable gateways (grid clients/users) to retrieve usage
information for a GRAM job.  Ideally, the grid user would not have to learn the
details of which local resource manager was used, nor the details of the local
accounting system.  Grid services return a unique handle/EPR/contact/... from a
service request.  This handle is used to control the WS resource (i.e. to
cancel a job).  This handle could also be converted into a Grid job ID used to
fetch information related to the job, like usage info, the local RM job id, the
Grid ID for the service used to stage a file, ...

It would be ideal for a grid client to interact with a grid service for access
to this audit and accounting information.  The client should not have to learn
the details of where this information is stored.  For example, the gram audit
DB is on host X in a PostgresSQL DB, the job accounting DB is on host Y in a
MySQL DB.  Also, the client should not have to learn the relationship between
the grid provider's DBs.  For example, on TeraGrid, to identify a unique job
usage record requires the local job id, the compute resource name (a human
determined label) and a approximate time of when the job was submitting (in
order to handle repeated or rolling job ids).

For the simple use case of - client provides a Grid Job ID / service returns
the usage amount, an application-specific service could be written to provide
this capability.  However, we anticipate that more open ended SQL querying of
audit and accounting records will be desired.  If so, then it would make sense
to provide this interface through the OGSA-DAI port types.  Essentially the
client will have to call the OGSA-DAI 'perform' operation with an XML document
that specifies the activities and parameters he wishes to execute.  This will
look something like:

<?xml version="1.0" encoding="UTF-8"?>
<perform xmlns="http://ogsadai.org.uk/namespaces/2005/10/types">
  <session/>
  <getChargeFromGridJobId name="myActivity">
    <GridJobId>theGridJobId</GridJobId>
    <chargeOutput name="charge"/>
  </getChargeFromGridJobId >
</perform>

The client will get a response document which contains the result.  For
example:

<?xml version="1.0" encoding="UTF-8"?>
<response xmlns="http://ogsadai.org.uk/namespaces/2005/10/types">
  <session id="sesssionId"/>
  <request status="COMPLETED"/>
  <result name="myActivity" status="COMPLETED"/>
  <result name="charge" status="COMPLETED"/>
     11.56
  </result>
</response>

Using the OGSA-DIA Java client toolkit, a client/gateway would code something
like:

// Set up stuff required once
String handle =
    "http://localhost:8080/wsrf/services/ogsadai/DataService";
String id = "MySQLResource";
DataService service =
    WSRFServiceFetcher.getInstance().getDataService(handle, id);

// Code required per query
getChargeFromGridJobId usageQuery = new
    getChargeFromGridJobId(gjid);
service.perform(usageQuery);
double charge = usageQuery.getCharge();


Deliverables:

1) General OGSA DAI Software Version
2) Specific getCharge Activity software
3) Simple client getCharge prototype

Tasks:

1) install OGSA-DAI WSRF 2.2 - Download from:
http://www.ogsadai.org.uk/downloads/
2) Create a data service called DataService
3) Create a getCharge "activity" that will connect to the GRAM Audit DB and the
TG accounting DB to fetch the info
4) Expose this resource to the data service
5) write a simple client to call the OGSA-DAI 'perform' operation with a
getCharge
6) Test

Time Estimate:

5 days