User Code

About #

In HPE Machine Learning Data Management, user code refers to the custom code that users write to process their data in pipelines. User code can be written in any language and can use any libraries or frameworks.

HPE Machine Learning Data Management allows users to define their user code as a Docker image, which can be pushed to a registry and referenced using the Transform attribute of the pipeline’s specification. The user code image contains the necessary dependencies and configuration for the code to run in HPE Machine Learning Data Management’s distributed computing environment.

User code can be defined for each pipeline stage in HPE Machine Learning Data Management, allowing users to chain together multiple processing steps and build complex data pipelines. HPE Machine Learning Data Management also provides a Python library for building pipelines, which simplifies the process of defining user code and specifying pipeline stages.