Learn about the concept of User Code, which is custom code that users write to process their data in pipelines.
December 4, 2023
In HPE ML Data Management, user code refers to the custom code that users write to process their data in pipelines. User code can be written in any language and can use any libraries or frameworks.
HPE ML Data Management allows users to define their user code as a Docker image, which can be pushed to a registry and referenced using the Transform attribute of the pipeline’s specification. The user code image contains the necessary dependencies and configuration for the code to run in HPE ML Data Management’s distributed computing environment.
User code can be defined for each pipeline stage in HPE ML Data Management, allowing users to chain together multiple processing steps and build complex data pipelines. HPE ML Data Management also provides a Python library for building pipelines, which simplifies the process of defining user code and specifying pipeline stages.