package etl

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. etl
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. trait BatchOptions extends AnyRef
  2. trait ConnectionPool extends Object with IEventEmitter
    Annotations
    @RawJSType() @native()
  3. type DataRecord = Object

    Common data record format for many ETL functions.

  4. trait Header extends Object

    Header associated with an ETL payload.

    Header associated with an ETL payload. Contains information that can help formulate a request.

    Annotations
    @ScalaJSDefined() @RawJSType()
  5. case class InputContext[A](input: A, source: String) extends Product with Serializable

    TODO: Make extensible.

  6. trait LookupManager extends AnyRef
  7. trait LookupManagerImpl extends LookupManager

    Create smart lookup functions that can take into acount caching, etc.

  8. type LookupOption = (String) ⇒ Either[String, Int]
  9. type LookupText = (String) ⇒ Either[String, (String, String)]

    Lookup a text value and return (fieldname, value) for use in a JSON payload.

  10. class MSSQLConfig extends Object
    Annotations
    @ScalaJSDefined() @RawJSType()
  11. class MSSQLOptions extends Object
    Annotations
    @ScalaJSDefined() @RawJSType()
  12. trait Operator extends AnyRef

    Contains a transform and other metadata needed to automatically pre- and post-process an input record.

  13. case class OptionSetLookupOptions(lcid: Option[Int] = None) extends Product with Serializable
  14. class PoolOptions extends Object
    Annotations
    @ScalaJSDefined() @RawJSType()
  15. final case class ProcessingError[I](details: String, source: Option[String] = None, input: Option[InputContext[I]] = None, messages: Seq[String] = Nil, cause: Option[Throwable] = None) extends RuntimeException with TransformFailure[I] with Product with Serializable
  16. trait ProcessingUnit[T <: Any] extends Object

    A unit consists of a header and the data playload.

    A unit consists of a header and the data playload.

    Annotations
    @ScalaJSDefined() @RawJSType()
  17. trait RecordSet[A] extends Array[A]
    Annotations
    @RawJSType() @native()
  18. class Request extends Object with IEventEmitter
    Annotations
    @RawJSType() @native()
  19. case class Result[O](source: String, output: Stream[IO, O], messages: Seq[String] = Nil) extends Product with Serializable

    A result is really a fancy tuple of the input and output along with some result information.

  20. trait SQLResult[A] extends Object
    Annotations
    @RawJSType() @native()
  21. trait StreamValue[A] extends Object
    Annotations
    @ScalaJSDefined() @RawJSType()
  22. case class TextLookupOptions(lookedUpAttribute: Option[String] = None, bind: Boolean = true, lcid: Option[Int] = None) extends Product with Serializable
  23. type Transform[I, O] = Kleisli[IO, InputContext[I], TransformResult[I, O]]

    Basic transform takes one input and returns a TransformResult wrapped in an effect.

  24. sealed trait TransformFailure[I] extends RuntimeException
  25. type TransformResult[I, O] = Either[TransformFailure[I], Result[O]]

    The result of a transformation.

    The result of a transformation. Outputs in Result are wrapped in a Stream effect.

Value Members

  1. val DeepCopy: Pipe[IO, DataRecord, (DataRecord, DataRecord)]

    Deep copy the input object.

    Deep copy the input object. The deep copy is _2.

  2. def DropTake[A](drop: Int, take: Int): Pipe[IO, A, A]
  3. def EmitResult[I, O]: Pipe[IO, TransformResult[I, O], Result[O]]

    Emit valid result part of TransformResult or emit an empty stream.

    Emit valid result part of TransformResult or emit an empty stream. Left transform result errors are silently dropped.

  4. def EmitResultData[I, O](): Pipe[IO, TransformResult[I, O], O]

    Emit the individual results objects.

    Emit the individual results objects. Since you lose the TransformResult, you will want to log or process the result prior to this. This pipe is typically used between successive pipe that are running different transforms and you don't care about the source tag.

  5. def EmitResultDataWithTag[I, O](): Pipe[IO, TransformResult[I, O], (O, String)]

    Emits individual result objects but pairs each output O ith the source tag.

  6. def FilterAttributes(drops: Seq[String] = Nil, renames: Seq[(String, String)] = Nil, keeps: Seq[String] = Nil): Transform[DataRecord, DataRecord]

    Transform that drops, renames and filters attributes on the input record.

  7. def LogErrorsOnly[O](r: Result[O]): None.type
  8. def LogTransformResult[I, O](f: (Result[O]) ⇒ Option[String] = LogErrorsOnly[O]): Pipe[IO, TransformResult[I, O], TransformResult[I, O]]

    A logger pipe.

    A logger pipe. Logs errors mostly.

  9. def PrintIt[A](marker: String = ">"): Pipe[IO, A, A]
  10. def ResultToInputContext[I, O]: Pipe[IO, Result[O], InputContext[O]]

    Use Result output to create InputContext.

  11. def UpdateObject[A](drops: Seq[String], renames: Seq[(String, String)], f: (A) ⇒ DataRecord): Pipe[IO, A, A]

    Pipe to mutate a DataRecord.

    Pipe to mutate a DataRecord. f identifies the object to mutate. Can use identity if the object is not wrapped. Easier than using xf and filterAttributesTransform.

  12. def mkPipe[I, O](t: Transform[I, O]): Pipe[IO, InputContext[I], TransformResult[I, O]]

    Make a pipe from a transform.

    Make a pipe from a transform. The transform is eval'd in this pipe.

  13. object MSSQL extends Object with IEventEmitter
    Annotations
    @native() @JSImport( "mssql" , JSImport.Namespace )
  14. object Processors
  15. object Transform

    Tracks names to objects that can transform data prior to some operation.

  16. object TransformResult
  17. object sources

Inherited from AnyRef

Inherited from Any

Ungrouped