Skip to content

[Feature] [Performance] [Docs] Disabling object spilling is not documented #21998

@franekbcorp

Description

@franekbcorp

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

Object spilling is a useful feature of Ray. However, certain use cases require the object spilling to be disabled and the way to do so is not obvious whatsoever.

Disabling object spilling is not even mentioned in the docs, which describe only the ways of configuring object spilling and specifying its configuration.

From an investigation of the source code, it seems like setting the environment variable RAY_automatic_object_spilling_enabled to false (or otherwise specifying automatic_object_spilling_enabled to false) should be sufficient (

RAY_CONFIG(bool, automatic_object_spilling_enabled, true)
). It is however unclear whether this is a preferred or guaranteed way to disable spilling.

Can we please look to explicitly describe how to disable object spilling in the docs?

Use case

There are use cases for Ray where spilling objects onto disk might cause errors or simply not be an option for security reasons. A clearly defined way to disable object spilling can improve feasibility of Ray in high-security applications.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1Issue that should be fixed within a few weeksbugSomething that is supposed to be working; but isn'tcoreIssues that should be addressed in Ray Coreperformance

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions