d134ff9b4d
After a long period of development with many starts and stops, we finally got this where we wanted it. This commit introduces 2 new MCA params (note that the "maffinity_libnuma_policy" MCA param introduced by r24290 was removed when libnuma support was removed). Remember that maffinity policies are only in effect when paffinity is enaabled -- i.e., when processes are bound to processors! * '''maffinity_base_alloc_policy:''' Policy that determines how general memory allocations are bound after MPI_INIT. A value of "none" means that no memory policy is applied. A value of "local_only" means that all memory allocations will be restricted to the local NUMA node where each process is placed. Note that operating system paging policies are unaffected by this setting. For example, if "local_only" is used and local NUMA node memory is exhausted, a new memory allocation may cause paging. * '''maffinity_base_bind_failure_action:''' What Open MPI will do if it explicitly tries to bind memory to a specific NUMA location, and fails. Note that this is a different case than the general allocation policy described by maffinity_base_alloc_policy. A value of "warn" means that Open MPI will warn the first time this happens, but allow the job to continue (possibly with degraded performance). A value of "error" means that Open MPI will abort the job if this happens. This needs at least a little soak time on the trunk before going to v1.5. This commit was SVN r24639. The following SVN revision numbers were found above: r24290 --> open-mpi/ompi@afa654746c The following Trac tickets were found above: Ticket 2698 --> https://svn.open-mpi.org/trac/ompi/ticket/2698
44 строки
1.1 KiB
Plaintext
44 строки
1.1 KiB
Plaintext
# -*- text -*-
|
|
#
|
|
# Copyright (c) 2011 Cisco Systems, Inc. All rights reserved.
|
|
# $COPYRIGHT$
|
|
#
|
|
# Additional copyrights may follow
|
|
#
|
|
# $HEADER$
|
|
#
|
|
# This is the US/English help file for Open MPI's maffinity base support
|
|
#
|
|
[invalid policy]
|
|
WARNING: An invalid value was given for the
|
|
maffinity_base_general_alloc_policy MCA parameter. This MCA parameter
|
|
determines the policy used for general memory allocations. Note that
|
|
this parameter *only* has effect when MPI processes are bound to
|
|
specific processors.
|
|
|
|
The value provided was:
|
|
|
|
Local host: %s
|
|
PID: %d
|
|
Value: %s
|
|
|
|
Valid values are:
|
|
|
|
none: no memory binding policy is enforced
|
|
prefer_local: try allocating memory on the local NUMA node, but
|
|
allow spilling over to remote NUMA nodes if necessary
|
|
local_only: fail an allocation if it cannot be placed entirely on
|
|
the local NUMA node
|
|
|
|
Your job will now abort.
|
|
#
|
|
[mbind failure]
|
|
Open MPI failed to bind internal memory to a specific NUMA node. This
|
|
message will only be reported at most once per process.
|
|
|
|
Local host: %s
|
|
PID: %d
|
|
File: %s:%d
|
|
Message: %s
|
|
Severity: %s
|