Southwestern Oklahoma State University
SWOSU Digital Commons
Student Research
Business & Computer Science
3-3-2017
Porting a parallel program from the NASA Center
for Climate Simulation (NCCS) Discoverer
supercomputer to desktops for validation of the
Multi-sensor Aerosol Products Sampling System
(MAPSS)
Charles Sleeper
Southwestern Oklahoma State University
Jeremy Evert
Southwestern Oklahoma State University, [email protected]
Follow this and additional works at: http://dc.swosu.edu/cpgs_edsbt_bcs_student
Recommended Citation
Sleeper, Charles and Evert, Jeremy, "Porting a parallel program from the NASA Center for Climate Simulation (NCCS) Discoverer
supercomputer to desktops for validation of the Multi-sensor Aerosol Products Sampling System (MAPSS)" (2017). Student Research.
5.
http://dc.swosu.edu/cpgs_edsbt_bcs_student/5
This Poster is brought to you for free and open access by the Business & Computer Science at SWOSU Digital Commons. It has been accepted for
inclusion in Student Research by an authorized administrator of SWOSU Digital Commons. An ADA compliant document is available upon request.
For more information, please contact [email protected].
Porting a parallel program from the NASA Center for Climate Simulation (NCCS) Discoverer
supercom puter to desktops for validation of the Multi-sensor Aerosol Products Sampling System (MAPSS)
S o u t h w e s t e r n O k la h o m a S t a t e U n iv e r s it y
Charles Sleeper Jack Guillory Dr. Jeremy Evert Department of Computer Science
Abstract
Timeline
The National A eronautics and S p a c e Administration (NASA) produces nearly
two gigabytes of data per second. NASA re sea rc h ers leverage millions of
dollars of computing hardw are to analyze this data. NASA s h a re s this data
with the rest of the world. A dvances in com puter technology have provided
m odern desktop com puters more powerful than the fa stest supercom puters
in the world from two and three d e c a d e s ago. This provides many
possibilities for g reater use of NASA data. A lack of education m aterials for
u ndergraduate research in high perform ance computing limits th e se
possibilities. This research a d d re ss e s this need by presenting the
m ethodologies used to translate the NASA MAPSS softw are system from
supercom puters and softw are engineers to desk to p s and undergrads.
U ndergraduate student re sea rc h ers studied the MAPSS softw are system ,
created for the NASA G oddard S p a c e Flight C enter supercom puters, to
conduct a validation study of NASA Earth A tm osphere aerosol data.
U ndergrads rewrote parts of the softw are allowing it to run on an Intel
p ro cesso r running a Linux system . The stu d en ts com pleted translation of
four of the sev en satellite sen so rs, and developed autom ation softw are
allowing MAPSS to be portable betw een individual com puters. The stu d en ts
provided docum entation of this p ro cess allowing future stu d en ts to com plete
the translation of the remaining s e n so r sy stem s and the validation study.
This should provide g reater u se of the data that stream s from NASA every
day.
•
•
\ 1
Atmospheric Aerosol Data Collection
•
S p a c e - b a s e d s e n s o r to o k
m e a s u r e m e n t s loo k in g d o w n
to E a rth , w h ile g r o u n d - b a s e d
s e n s o r s to o k m e a s u r e m e n t s
lo o k in g u p. S ta tis tic s for
e a c h o f th e a e r o s o l p ro d u c ts
in v o lv e d e x tra c tin g
m e a s u r e m e n t s th a t fall w ithin
2 7 .5 km o f th e c h o s e n
lo c a tio n s , a n d w ithin 3 0
m in u te s o f e a c h s a te llite fly
o v er.
• J u n e 20 1 6 : S W O SU s tu d e n ts b e g a n w orking th ro u g h th e NASA
M A P SS so ftw are. T h e so ftw a re c o n tin u e s to b e in u s e a fte r two
d e c a d e s of d e v e lo p m e n t. T h e te a m of so ftw a re e n g in e e rs a t th e
NASA G o d d a rd S p a c e Flight C e n te r h a d tu n e d th e so ftw a re for
optim al p e rfo rm a n c e on se v e ra l s u p e rc o m p u te rs , including th e
D isco v e re r 12. J a c k Guillory w a s a b le to d eliv er functionality with
four of th e nine m o d u le s within th e so ftw are.
• A u g u st 20 1 6 : S W O S U s tu d e n ts p articip ated in a N SF CC* g ra n t
p ro p o sa l. T h e S W O SU te a m c o o rd in a te d a C y b er In frastru ctu re
plan for th re e u n iv ersities. D uring th e fall 2 0 1 7 O k lah o m a
S u p e rc o m p u tin g S y m p o siu m , this plan w a s p ra ise d by m e m b e rs of
th e O n e OCII te a m a s being o n e of th e b e tte r w ritten p la n s th e s ta te
h ad s e e n in re c e n t y e a rs.
•
S e p te m b e r 20 1 6 : S W O S U m e e ts with S o u th e a s te rn O k lah o m a
S ta te U niversity re s e a rc h faculty to b eg in co llab o ratio n on future
NASA OK E P S o R G ran ts.
•
D e c e m b e r 20 1 6 : O k lah o m a S ta te U niversity provided S W O S U with
eig h t s e r v e rs from a retired cluster. T his c lu ste r w a s d e p lo y e d using
c e n tO S with th e SLURM jo b s c h e d u le r. S tu d e n ts installed th e
o p e ra tin g sy ste m , s e t up th e ad m in istra to r a c c o u n ts , a n d w orked
with university IT staff to e n a b le a c c e s s to th e s e rv e r from v ario u s
c la s s ro o m s .
D o N A SA s a te llite s s e n s o r p la tfo rm s p r o d u c e sim ila r r e a d in g s to
g ro u n d -b a se d s e n s o rs ?
W h a t lev el o f C y b e r in fr a s tru c tu re r e s o u r c e s a r e n e c e s s a r y to
e x a m in e a d a ta s e t o f th is s iz e ?
M ay 20 1 6 : T h e S W O S U H PC te a m p articip ated in th e first
O k lah o m a H PC com petition. S tu d e n ts d e p lo y ed a R a s p b e rry Pi
clu ster. S tu d e n ts a lso d e v e lo p e d c o d e to find th e d e te rm in a n t of a
five th o u s a n d by five th o u s a n d matrix.
• J u n e 20 1 6 : S W O SU s tu d e n ts a tte n d e d th e E x trem e S c ie n c e an d
E n g in eerin g D iscovery E n v iro n m en t (X SE D E) High P e rfo rm a n c e
C om p u tin g (H PC ) W o rk sh o p : S u m m e r B oot C am p . T his w a s in
s u p p o rt of d ev elo p in g an d optim izing c o d e for H PC ap p licatio n s.
S tu d e n ts w e re in tro d u ced to parallel co m p u tin g c o n c e p ts , openM P,
th e M e s s a g e P a s s in g In terface (MPI), CUDA, a n d o p en A C C .
S tu d e n ts to u re d th e OU S u p e rc o m p u tin g C e n te r for E d u catio n &
R e s e a rc h (O S C E R ), including th eir $2M S u p e rc o m p u te r. D uring th e
b o o t c am p , s tu d e n ts ran c o d e on th e P ittsb u rg S u p e rc o m p u tin g
C e n te r B rid g es $10M su p e rc o m p u te r, ran by C a rn e g ie Mellon
University.
R esearch Questions
C a n N A SA r e s e a r c h b e v e rifie d b y u n d e r g r a d u a t e r e s e a r c h e r s ?
M ay 20 1 6 : S W O S U s tu d e n ts re c eiv e d a n O k la h o m a NASA
E P S C o R R e s e a rc h Initiation G rant. S tu d e n ts form ed a s u m m e r
re s e a rc h te a m . T h e s tu d e n ts s e le c te d LaTeX for d o c u m e n ta tio n of
all p u b licatio n s, G ithub a s th eir k n o w led g e m a n a g e m e n t tool. All
s tu d e n ts fo c u s e d on th eir a r e a s of e x p e rtise . S o m e b e g a n a
literature review of th e NASA M A PSS project. O th e r s tu d e n ts
d e v e lo p e d a P y th o n tra n slatio n of th e functionality of th e M A PSS
so ftw are. S W O S U s tu d e n t J a c k Guillory to o k th e lead on tran slatin g
th e M A P SS s o u rc e c o d e to run on a Linux distribution a n d s ta n d a rd
d e sk to p co m p u ter. C h a rle s S le e p e r b e g a n d ev elo p in g a R a sp b e rry
Pi C lu ster to su p p o rt future re s e a rc h p a rtn e rs h ip s with a re a High
S c h o o ls.
•
F e b ru a ry 20 1 7 : T h e S W O S U H PC te a m re a c h e d o u t to Dr.
T oshihisu M atsui for a c o p y of th e N U -W RF m odel. T h e S W O SU
C O M S C 3 1 3 3 S o ftw are E n g in eerin g s tu d e n ts will begin a n a ly s is of
th e so ftw are. T his so ftw a re w a s u s e d a s o n e of th e th re e
c o m p o n e n ts of th e S tu d e n t C lu ste r C om petition a t T h e 2 0 1 6
International C o n fe re n c e for High P e rfo rm a n c e C om puting,
N etw orking, S to ra g e a n d A n aly sis (S C 1 6 )
R esearch Challenges
• The MAPSS software contained hundreds of
source files written in several programming
languages over two decades by multiple
authors.
• Som e files for the software are automatically
generated by the NASA supercom puter are
not automatically generated within a standard
installation of Linux Mint. These files were
manually recreated from error m essages
Results
• Tool currently functions with:
C lo u d -A e ro s o l L i n d a r a n d In fra re d P a th f in d e r S a te llite
O b s e r v a tio n (C A L IP S O )
• A e ro s o l R o b o tic N e tw o rk (A e ro n e t)
M u lti-a n g le Im a g in g S p e c tr o R a d i o m e te r (M IS R )
O z o n e M on ito rin g I n s tru m e n t (O M I)
• In progress
P o la riz a tio n a n d D ire c tio n a lity o f th e E a r th ’s R e f le c ta n c e 's
(P o ld e r)
V isib le In fra re d Im a g in g R a d io m e te r S u ite (V IIR S)
M o d e r a te R e s o lu tio n Im a g in g S p e c tr o r a d io m e te r (M O D IS )
• Next step s
R u n a n a ly s is o n S W O S U Intel C lu s te r C o m p u te r s a n d
p u b lis h r e s u lts
R u n a n a ly s is o n S W O S U R a s p b e r r y Pi c lu s te r c o m p u te r s
a n d e x p a n d a n a ly s is : L a rg e r s e n s o r ra d iu s , d iffe re n t s e n s o r
fu s io n m o d e ls .
R eferences
•
Ichoku, C., D. A. Chu, S. Mattoo, Y. J. Kaufman, L. A. Remer, D. Tanre, I. Slutsker, and B.
N. Holben, 2002: A spatio-temporal approach for global validation and analysis of MODIS
aerosol products. Geophys. Res. Lett., 29 , doi: 10.1029/2001GL013206.
•
Chu, D. A., Y. J. Kaufman, C. Ichoku, L. A. Remer, D. Tanre, and B. N. Holben, 2002:
Validation of MODIS aerosol optical depth retrieval over land. Geophys. Res. Lett., 29 ,
doi: 10.1029/2001G L013205.
Remer, L. A., D. Tanre, Y. J. Kaufman, C. Ichoku, S. Mattoo, R. Levy, D. A. Chu, B. N.
Holben, O. Dubovik, A. Smirnov, J. V. Martins, R.-R. Li, and Z. Ahmad, 2002: Validation of
MODIS aerosol retrieval over ocean. Geophys Res. Lett., 29 , doi:
10.1029/2001GL013204.