redshift

Linear Supertypes

AnyRef, Any

Ordering

Inherited

Visibility

final case class MergeRedshiftSchemasResult(goodModel: GoodModel, recoveryModels: Map[SchemaKey, RecoveryModel]) extends Product with Serializable
sealed trait ShredModel extends Product with Serializable
Shredded table model for redshift.
Shredded table model for redshift.
Extracting data from json into tsv-ready List[String] Warehouse table representation. "Good" version of this trait also supports migrations.
entries - list of model entries, containing the schema pointers and bottom level sub schemas schemaKey - schema key of corresponding top level schema
case class ShredModelEntry(ptr: SchemaPointer, subSchema: Schema, isLateAddition: Boolean) extends Product with Serializable
Single bottom level entry of the schema model.
Single bottom level entry of the schema model. Each entry matches a single column in warehouse.
ptr
- json pointer. A cursor that could be used to extract the data from json event.
subSchema
- jsonschema of the element to where pointer is directed.
isLateAddition
- entry added as a result of migration, so it must be NOT NULL.

def assessRedshiftMigration(src: List[IgluSchema], tgt: IgluSchema): Either[NonEmptyList[Breaking], List[NonBreaking]]
def assessRedshiftMigration(src: IgluSchema, tgt: IgluSchema): Either[NonEmptyList[Breaking], List[NonBreaking]]
def foldMapMergeRedshiftSchemas(schemas: NonEmptyList[IgluSchema]): MergeRedshiftSchemasResult
Build a map between schema key and a merged or recovered model.
Build a map between schema key and a merged or recovered model. For example if schemas X and Y and mergable, both would link to schema XY (product).
schemas
- ordered list of schemas for the same family
def foldMapRedshiftSchemas(schemas: NonEmptyList[IgluSchema]): Map[SchemaKey, ShredModel]
Build a map between schema key and their models.
Build a map between schema key and their models.
schemas
- ordered list of schemas for the same family
def isRedshiftMigrationBreaking(src: IgluSchema, tgt: IgluSchema): Boolean
def isRedshiftMigrationBreaking(src: List[IgluSchema], tgt: IgluSchema): Boolean
object ShredModel extends Serializable
object ShredModelEntry extends Serializable

Packages