com.cerner.bunsen.spark

Class SparkRowConverter

java.lang.Object

com.cerner.bunsen.spark.SparkRowConverter

public class SparkRowConverter
extends Object

Support for converting FHIR resources to Apache Spark rows and vice versa.

Method Summary

Modifier and Type	Method and Description
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	emptyDataFrame(org.apache.spark.sql.SparkSession spark) Returns an empty data frame that has the Spark schema for the resource.
static SparkRowConverter	forResource(ca.uhn.fhir.context.FhirContext context, String resourceTypeUrl) Returns a row converter for the given resource type.
static SparkRowConverter	forResource(ca.uhn.fhir.context.FhirContext context, String resourceTypeUrl, List<String> containedResourceTypeUrls) Returns a row converter for the given resource type.
String	getResourceType() Returns the FHIR type of the resource being converted.
org.apache.spark.sql.types.StructType	getSchema() Returns the Spark schema equivalent for the FHIR resource.
org.apache.spark.sql.Row	resourceToRow(org.hl7.fhir.instance.model.api.IBaseResource resource) Converts a given FHIR resource to a Spark row.
org.hl7.fhir.instance.model.api.IBaseResource	rowToResource(org.apache.spark.sql.Row row)
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	toDataFrame(org.apache.spark.sql.SparkSession spark, List<org.hl7.fhir.instance.model.api.IBaseResource> resources) Returns a dataframe.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

forResource

public static SparkRowConverter forResource(ca.uhn.fhir.context.FhirContext context,
                                            String resourceTypeUrl)

Returns a row converter for the given resource type. The resource type can either be a relative URL for a base resource (e.g., "Condition" or "Observation"), or a URL identifying the structure definition for a given profile, such as "http://hl7.org/fhir/us/core/StructureDefinition/us-core-patient".

Parameters:

context - the FHIR context

resourceTypeUrl - the URL of the resource type

Returns:

a row converter instance.

forResource

public static SparkRowConverter forResource(ca.uhn.fhir.context.FhirContext context,
                                            String resourceTypeUrl,
                                            List<String> containedResourceTypeUrls)

Returns a row converter for the given resource type. The resource type can either be a relative URL for a base resource (e.g. "Condition" or "Observation"), or a URL identifying the structure definition for a given profile, such as "http://hl7.org/fhir/us/core/StructureDefinition/us-core-patient".

Resources that would be contained must be statically declared through this method via similar URLs.

Parameters:

context - the FHIR context

resourceTypeUrl - the URL of the resource type

containedResourceTypeUrls - the list of URLs of contained resource types

Returns:

an Avro converter instance.

resourceToRow

public org.apache.spark.sql.Row resourceToRow(org.hl7.fhir.instance.model.api.IBaseResource resource)

Converts a given FHIR resource to a Spark row.

Parameters:

resource - the FHIR resource

Returns:

the row

rowToResource

public org.hl7.fhir.instance.model.api.IBaseResource rowToResource(org.apache.spark.sql.Row row)

getSchema

public org.apache.spark.sql.types.StructType getSchema()

Returns the Spark schema equivalent for the FHIR resource.

Returns:

the Spark schema

getResourceType

public String getResourceType()

Returns the FHIR type of the resource being converted.

Returns:

the FHIR type of the resource being converted.

emptyDataFrame

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> emptyDataFrame(org.apache.spark.sql.SparkSession spark)

Returns an empty data frame that has the Spark schema for the resource.

Parameters:

spark - the spark session

Returns:

an empty data frame with the expected schema.

toDataFrame

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> toDataFrame(org.apache.spark.sql.SparkSession spark,
                                                                          List<org.hl7.fhir.instance.model.api.IBaseResource> resources)

Returns a dataframe.

Parameters:

spark - the spark session.

resources - the resources to convert into Spark rows.

Returns:

a dataframe containing the resources in row form.