{"id":1077,"date":"2018-08-29T19:07:04","date_gmt":"2018-08-29T19:07:04","guid":{"rendered":"https:\/\/aciref.org\/?page_id=1077"},"modified":"2018-08-29T19:07:04","modified_gmt":"2018-08-29T19:07:04","slug":"oceanography-going-parallel-with-r","status":"publish","type":"page","link":"https:\/\/aciref.chpc.utah.edu\/?page_id=1077","title":{"rendered":"Oceanography – Going Parallel with R"},"content":{"rendered":"

\t\t\t\tSean Cleveland, University of Hawai’i, August 29, 2018<\/span><\/p>\n

A graduate student\u2019s project studying ocean larval dispersion and population modeling would not run on the lab computers due to memory issues. \u00a0University of Hawaii ACI-REFs assisted in fixing the researcher\u2019s code to utilize less memory, to run faster, and to increase the granularity of the time step to increase the level of accuracy in simulations results. The ACI-REFs further assisted the researcher by enabling parallel processing which reduced the time for computational runs from more than 870 days down to about 16 days – allowing the researcher to work at a scale and finer granularity that was previously untenable. \u00a0Prior to meeting with ACI-REFs the researchers had not thought of running their simulations on the UH High Performance Computing (HPC) cluster or realized the potential of parallelization in their implementation.<\/span><\/p><\/blockquote>\n

The Objective<\/h2>\n

In the summer of 2015 the Sean Cleveland and Ron Merrill (UH ACI-REFs) met with researcher Dr. Robert Toonen and his doctoral student, Johanna Wren, \u00a0from the Hawaiian Institute for Marine Biology (HIMB) to discuss how to assist with some code to run simulations for\u00a0<\/span>the first comprehensive estimate of connectivity of passive pelagic particles released from coral reef habitat throughout the Hawaiian Archipelago.<\/span>. The simulations were using all the memory in their current lab workstations, but were not running to completion. \u00a0Since they had reached the capacity of their lab workstations for running the simulations, they met with ACI-REFs to see if they could utilize the recently deployed University of Hawaii High Performance Computing (HPC) cluster resource to help solve these problems. Johanna\u2019s dissertation was dependent on completing the simulations so getting them to run and complete was the most important initial outcome for the researchers.<\/span><\/p>\n

Once this initial problem was solved, the researchers were then interested in getting the simulation to run in a more reasonable time span, as it was taking weeks or months to complete. \u00a0And finally, a third goal was to increase the timestamp granularity for the simulation to get down to hourly time steps allow better resolution of movement and increasing the accuracy of the model.<\/span><\/p>\n

The Solution<\/h2>\n

Sean Cleveland and Ron Merrill worked with Dr. Toonen and Johanna to gain access to the UH HPC cluster and for training on how to run their initial simulation code on the cluster. This allowed them to see how it worked on a compute node with resources larger than their entire existing lab compute infrastructure. This worked initially for the scope of simulations they were working on but as the scale for the length of the simulation increased they began to reach the capacity of the UH HPC compute node memory, which is 128GB. \u00a0David Schanzenbach, another UH ACI-REF, began working with Johanna to review the simulation code for ways to solve this memory issue. David discovered and fixed a memory leak which solved the issue, and also identified that the code could be parallelized to run faster.<\/span><\/p>\n

Johanna and Dr. Toonen decided that they wanted to pursue the parallelization so that the simulation time step could become more granular, down to hourly steps allowing more accurate calculations of particle movement. \u00a0David helped get the simulation code to run parallel threads for portions of the simulation and was able to significantly reduce the time needed to run the simulation. With a threaded parallel version that could run on a UH HPC compute node, work that would have taken 870 days to run could now be completed in about 16 days.<\/p>\n

The Result<\/h2>\n

As a result of efforts of the UH ACI-REF\u2019s collaboration the researchers were able to: complete simulation execution without running out of memory, run the simulations in a shorter amount of time than initially would have been possible (16 vs 870 days) and finally the simulations could execute with a finer level of time step granularity resolving to better accuracy in model outputs. \u00a0Further, the enhanced computational model enabled Johanna, by May of 2016, to complete her Ph.D. dissertation work and publish the results of her work in PLoS ONE in December 2016.<\/span><\/p>\n

The success of this collaboration paved the way for more researcher of HIMB to adopt using the UH HPC cluster and collaborate with the UH ACI-REFs to enhance their productivity.<\/span><\/p>\n

Supporting Media<\/h2>\n

Chang, C. (2016). T<\/span>he Influence of Biophysical Factors on the Connectivity of Holoplanktonic Copepods <\/span>(Mater dissertation). Retrieved from University of Hawaii – Manoa ScholarSpace. (doi: <\/span>doi: <\/span>http:\/\/hdl.handle.net\/10125\/51444<\/span><\/a>)<\/span><\/p>\n

\"\"<\/a><\/p>\n

Figure 1. Chantel Chang standing next to her poster related to the work done using the UH ITS HPC cluster.<\/span><\/a><\/h6>\n

 <\/p>\n

\"\"<\/a>Figure 2. Expected connectivity for <\/span>Pleuromamma xiphias<\/span><\/i>. Provinces outlined in red are where genetic data for <\/span>P. xiphias<\/span><\/i> was available. Blue arrows represent self recruitment, and yellow arrows represent exchange of migrants between regions. Here, we refer to Longhurst province (Longhurst 2007) \u201cNASTE\u201d as North Subtropical, \u201cNATR\u201d as North Tropical, \u201cSATL\u201d as South Gyre, and \u201cSSTC\u201d as South Convergence Zone. Longhurst\u2019s biogeochemical provinces across the Atlantic basin. Seven (#1-7) provinces are in the Northern Atlantic basin, four (#8-11) in the equatorial Atlantic, and four (#12-15) in the Southern Atlantic basin. 1) GFST = Gulf Stream; 2) NASTW = North Atlantic Subtropical Gyre (West), 3) NASTE = North Atlantic Subtropical Gyre (East), 4) MEDI = Mediterranean Sea, 5) CARB = Caribbean, 6) NATR = North Atlantic Tropical Gyre, 7) CNRY = Canary Current, 8) GUIA = Guianas, 9) WTRA = Western Tropical Atlantic, 10) ETRA = Eastern Tropical Atlantic, 11) GUIN = Guinea Current, 12) BRAZ = Brazil Current, 13) SATL = South Atlantic Gyre, 14) BENG = Benguela Current, 15) SSTC = South Subtropical Convergence. (Chang C 2016)<\/span><\/h6>\n
\"\"<\/a><\/h6>\n
Figure 3. \u00a0Experiment 1 significant differences in connectivity between passive particle simulation at depth 200 m and simulation including ontogenetic vertical migration (OVM) with depth range between 50 and 500 m. Color of fill designates significance level, and hatched pattern versus filled boxes represent a decrease or increase of connectivity, respectively, and where increased connectivity means more connections under OVM scenario. Longhurst regions on x and y-axes as defined in Figure 1. (Chang C 2016)<\/h6>\n

Notable Publications and Presentations Resulting from this Work<\/h2>\n

Wren JLK, Kobayashi DR, Jia Y, Toonen RJ (2016) Modeled Population Connectivity across the Hawaiian Archipelago. PLoS ONE 11(12): e0167626. https:\/\/doi.org\/10.1371\/journal.pone.0167626<\/span><\/p>\n

Collaborators and Resources<\/h2>\n
    \n
  • Robert Toonen, Professor, SOEST, Hawaiian Institute for Marine Biology<\/span><\/li>\n
  • Johanna Wren, Ph.D, SOES, Hawaiian Institute for Marine Biology<\/span><\/li>\n
  • David Schanzenbach, ACI-REF, Cyberinfrastructure, UH Information Technology Services<\/span><\/li>\n
  • Ron Merrill, \u00a0ACI-REF, Cyberinfrastructure, UH Information Technology Services<\/span><\/li>\n
  • Sean Cleveland, \u00a0ACI-REF, Cyberinfrastructure, UH Information Technology Services<\/span><\/li>\n<\/ul>\n

    Resources:<\/span><\/p>\n

      \n
    • University of Hawaii High Performance Compute cluster.<\/span><\/li>\n<\/ul>\n

      Funding Sources<\/h2>\n

      The work described in this case study was supported in part by a grant from the National Science Foundation, Award #1341935,\u00a0Advanced Cyberinfrastructure – Research and Educational Facilitation: Campus-Based Computational Research Support\u00a0<\/i>and\u00a0by NSF (OCE12-60169), and in part by a grant\/cooperative agreement from the National Oceanic and Atmospheric Administration, Project R\/SS-13, which is sponsored by the University of Hawaii Sea Grant College Program, SOEST, under Institutional Grant No. NA14OAR4170071 from NOAA Office of Sea Grant, Department of Commerce (for RJT and JLKW). Sea Grant contribution UNIHI-SEAGRANT-JC-13-16, SOEST contribution number 9638 and contribution number 1661 from the Hawai\u02bbi Institute of Marine Biology.\u00a0<\/span>\t\t<\/p>\n","protected":false},"excerpt":{"rendered":"

      Sean Cleveland, University of Hawai’i, August 29, 2018 A graduate student\u2019s project studying ocean larval dispersion and population modeling would not run on the lab computers due to memory issues. \u00a0University of Hawaii ACI-REFs assisted in fixing the researcher\u2019s code to utilize less memory, to run faster, and to increase the granularity of the time […]<\/p>\n","protected":false},"author":7,"featured_media":0,"parent":978,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1077","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=\/wp\/v2\/pages\/1077","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1077"}],"version-history":[{"count":0,"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=\/wp\/v2\/pages\/1077\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=\/wp\/v2\/pages\/978"}],"wp:attachment":[{"href":"https:\/\/aciref.chpc.utah.edu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1077"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}