1
1
openmpi/oshmem/mca/memheap
Mike Dubman 6fb0dbdab5 OSHMEM: port 6 patches from git mirror to svn
Subject: [PATCH 1/6] OSHMEM: mkey refactoring
mkey can be either shared memory style id or it can be
arbitrary byte string
removed hack that used spml_context to store generic keys
coding style fixes

Subject: [PATCH 2/6] OSHMEM: added support of MXM 2.0 rc transport
coding style fixed, typos, check error condition

Subject: [PATCH 3/6] OSHMEM: mxm2.0: remove PTL_SELF
There is no need to have special case for 'self'
connection in mxm 2.0. It also solves the problem
of passing incorrect mkey when doing put/get to
self

Subject: [PATCH 4/6] OSHMEM: fixes mxm fadd
give a dummy buffer if doing atomic add

Subject: [PATCH 5/6] OSHMEM: mxm2.0: do not use MXM_REQ_FLAG_SEND_LAZY
Subject: [PATCH 6/6] OSHMEM: remove unused include, causes compilation fail on ubuntu

Refs trac:3763

This commit was SVN r30129.

The following Trac tickets were found above:
  Ticket 3763 --> https://svn.open-mpi.org/trac/ompi/ticket/3763
2014-01-07 11:56:36 +00:00
..
base OSHMEM: port 6 patches from git mirror to svn 2014-01-07 11:56:36 +00:00
buddy C99ing ... 2013-11-26 12:46:56 +00:00
ptmalloc fix memheap void pointer arithmetics 2013-12-11 06:35:03 +00:00
configure.m4 Per the RFC schedule, this commit adds Mellanox OpenSHMEM to the trunk. It does not yet run on OSX or with CM PML for an MTL other than MXM. Mellanox is aware of these issues and is in the process of resolving them. This should be added to \ncmr=v1.7.4:subject=Move OSHMEM to 1.7.4:reviewer=rhc 2013-09-10 15:34:09 +00:00
Makefile.am Per the RFC schedule, this commit adds Mellanox OpenSHMEM to the trunk. It does not yet run on OSX or with CM PML for an MTL other than MXM. Mellanox is aware of these issues and is in the process of resolving them. This should be added to \ncmr=v1.7.4:subject=Move OSHMEM to 1.7.4:reviewer=rhc 2013-09-10 15:34:09 +00:00
memheap.h Adding more fixes to stomp casting/addressing issues on 32-bit systems. 2013-09-13 20:37:30 +00:00
README Per the RFC schedule, this commit adds Mellanox OpenSHMEM to the trunk. It does not yet run on OSX or with CM PML for an MTL other than MXM. Mellanox is aware of these issues and is in the process of resolving them. This should be added to \ncmr=v1.7.4:subject=Move OSHMEM to 1.7.4:reviewer=rhc 2013-09-10 15:34:09 +00:00

# Copyright (c) 2013      Mellanox Technologies, Inc.
#                         All rights reserved
# $COPYRIGHT$
MEMHEAP Infrustructure documentation
------------------------------------

MEMHEAP Infrustructure is responsible for managing the symmetric heap.
The framework currently has following components: buddy and ptmalloc. buddy which uses a buddy allocator in order to manage the Memory allocations on the symmetric heap. Ptmalloc is an adaptation of ptmalloc3. 

Additional components may be added easily to the framework by defining the component's and the module's base and extended structures, and their funtionalities.

The buddy allocator has the following data structures: 
1. Base component - of type struct mca_memheap_base_component_2_0_0_t
2. Base module - of type struct mca_memheap_base_module_t 
3. Buddy component - of type struct mca_memheap_base_component_2_0_0_t
4. Buddy module - of type struct mca_memheap_buddy_module_t extending the base module (struct mca_memheap_base_module_t)

Each data structure includes the following fields:
1. Base component - memheap_version, memheap_data and memheap_init
2. Base module - Holds pointers to the base component and to the functions: alloc, free and finalize
3. Buddy component - is a base component.
4. Buddy module - Extends the base module and holds additional data on the components's priority, buddy allocator, 
   maximal order of the symmetric heap, symmetric heap, pointer to the symmetric heap and hashtable maintaining the size of each allocated address.

In the case that the user decides to implement additional components, the Memheap infrastructure chooses a component with the maximal priority.
Handling the component opening is done under the base directory, in three stages: 
1. Open all available components. Implemented by memheap_base_open.c and called from shmem_init. 
2. Select the maximal priority component. This procedure involves the initialization of all components and then their
   finalization except to the chosen component. It is implemented by memheap_base_select.c and called from shmem_init.
3. Close the max priority active cmponent. Implemented by memheap_base_close.c and called from shmem finalize. 

 
Buddy Component/Module
----------------------

Responsible for handling the entire activities of the symmetric heap.
The supported activities are: 
                            - buddy_init (Initialization) 
                            - buddy_alloc (Allocates a variable on the symmetric heap)
                            - buddy_free (frees a variable previously allocated on the symetric heap)
                            - buddy_finalize (Finalization).
 
Data members of buddy module: - priority. The module's priority.
                              - buddy allocator: bits, num_free, lock and the maximal order (log2 of the maximal size) 
                                of a variable on the symmetric heap. Buddy Allocator gives the offset in the symmetric heap
                                where a variable should be allocated. 
                              - symmetric_heap: a range of reserved addresses (equal in all executing PE's) dedicated to "shared memory" allocation.
                              - symmetric_heap_hashtable (holding the size of an allocated variable on the symmetric heap.
                                 used to free an allocated variable on the symmetric heap)