| 1 |
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> |
| 2 |
|
| 3 |
<!--Converted with LaTeX2HTML 2019.2 (Released June 5, 2019) --> |
| 4 |
<HTML lang="EN"> |
| 5 |
<HEAD> |
| 6 |
<TITLE>2.9 Cray machines</TITLE> |
| 7 |
<META NAME="description" CONTENT="2.9 Cray machines"> |
| 8 |
<META NAME="keywords" CONTENT="user_guide"> |
| 9 |
<META NAME="resource-type" CONTENT="document"> |
| 10 |
<META NAME="distribution" CONTENT="global"> |
| 11 |
|
| 12 |
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=utf-8"> |
| 13 |
<META NAME="viewport" CONTENT="width=device-width, initial-scale=1.0"> |
| 14 |
<META NAME="Generator" CONTENT="LaTeX2HTML v2019.2"> |
| 15 |
|
| 16 |
<LINK REL="STYLESHEET" HREF="user_guide.css"> |
| 17 |
|
| 18 |
<LINK REL="previous" HREF="node15.html"> |
| 19 |
<LINK REL="next" HREF="node17.html"> |
| 20 |
</HEAD> |
| 21 |
|
| 22 |
<BODY > |
| 23 |
<!--Navigation Panel--> |
| 24 |
<A |
| 25 |
HREF="node17.html"> |
| 26 |
<IMG WIDTH="37" HEIGHT="24" ALT="next" SRC="next.png"></A> |
| 27 |
<A |
| 28 |
HREF="node7.html"> |
| 29 |
<IMG WIDTH="26" HEIGHT="24" ALT="up" SRC="up.png"></A> |
| 30 |
<A |
| 31 |
HREF="node15.html"> |
| 32 |
<IMG WIDTH="63" HEIGHT="24" ALT="previous" SRC="prev.png"></A> |
| 33 |
<A ID="tex2html203" |
| 34 |
HREF="node1.html"> |
| 35 |
<IMG WIDTH="65" HEIGHT="24" ALT="contents" SRC="contents.png"></A> |
| 36 |
<BR> |
| 37 |
<B> Next:</B> <A |
| 38 |
HREF="node17.html">3 Parallelism</A> |
| 39 |
<B> Up:</B> <A |
| 40 |
HREF="node7.html">2 Installation</A> |
| 41 |
<B> Previous:</B> <A |
| 42 |
HREF="node15.html">2.8 Installation tricks and</A> |
| 43 |
<B> <A ID="tex2html204" |
| 44 |
HREF="node1.html">Contents</A></B> |
| 45 |
<BR> |
| 46 |
<BR> |
| 47 |
<!--End of Navigation Panel--> |
| 48 |
<!--Table of Child-Links--> |
| 49 |
<A ID="CHILD_LINKS"><STRONG>Subsections</STRONG></A> |
| 50 |
|
| 51 |
<UL> |
| 52 |
<LI><A ID="tex2html205" |
| 53 |
HREF="node16.html#SECTION00039100000000000000">2.9.1 Obsolescent architectures</A> |
| 54 |
<UL> |
| 55 |
<LI><A ID="tex2html206" |
| 56 |
HREF="node16.html#SECTION00039110000000000000">2.9.1.1 Intel Xeon Phi</A> |
| 57 |
<LI><A ID="tex2html207" |
| 58 |
HREF="node16.html#SECTION00039120000000000000">2.9.1.2 IBM BlueGene</A> |
| 59 |
</UL></UL> |
| 60 |
<!--End of Table of Child-Links--> |
| 61 |
<HR> |
| 62 |
|
| 63 |
<H2><A ID="SECTION00039000000000000000"> |
| 64 |
2.9 Cray machines</A> |
| 65 |
</H2> |
| 66 |
|
| 67 |
<P> |
| 68 |
For Cray XE machines: |
| 69 |
<PRE> |
| 70 |
$ module swap PrgEnv-cray PrgEnv-pgi |
| 71 |
$ ./configure --enable-openmp --enable-parallel --with-scalapack |
| 72 |
$ vim make.inc |
| 73 |
</PRE> |
| 74 |
then manually add <TT>-D__IOTK_WORKAROUND1</TT> at the end of <TT>DFLAGS</TT> line. |
| 75 |
|
| 76 |
<P> |
| 77 |
''Now, despite what people can imagine, every CRAY machine deployed can |
| 78 |
have different environment. For example on the machine I usually use |
| 79 |
for tests [...] I do have to unload some modules to make QE running |
| 80 |
properly. On another CRAY [...] there is also Intel compiler as option |
| 81 |
and the system is slightly different compared to the other. |
| 82 |
So my recipe should work, 99% of the cases.'' (info by Filippo Spiga) |
| 83 |
|
| 84 |
<P> |
| 85 |
For Cray XT machines, use <TT>./configure ARCH=crayxt4</TT> or else |
| 86 |
<TT>configure</TT> will not recognize the Cray-specific software environment. |
| 87 |
|
| 88 |
<P> |
| 89 |
Older Cray machines: T3D, T3E, X1, are no longer supported. |
| 90 |
|
| 91 |
<P> |
| 92 |
|
| 93 |
<H3><A ID="SECTION00039100000000000000"> |
| 94 |
2.9.1 Obsolescent architectures</A> |
| 95 |
</H3> |
| 96 |
|
| 97 |
<P> |
| 98 |
|
| 99 |
<H4><A ID="SECTION00039110000000000000"> |
| 100 |
2.9.1.1 Intel Xeon Phi</A> |
| 101 |
</H4> |
| 102 |
|
| 103 |
<P> |
| 104 |
For Intel Xeon CPUs with Phi coprocessor, see this link: |
| 105 |
<BR><TT>https://software.intel.com/en-us/articles/explicit-offload-for-quantum-espresso</TT>. |
| 106 |
|
| 107 |
<P> |
| 108 |
There are three ways of compiling: |
| 109 |
|
| 110 |
<UL> |
| 111 |
<LI><EM>offload</EM> mode, executed on main CPU and offloaded onto coprocessor |
| 112 |
"automagically"; |
| 113 |
</LI> |
| 114 |
<LI><EM>native</EM> mode, executed completely on coprocessor; |
| 115 |
</LI> |
| 116 |
<LI><EM>symmetric</EM> mode, requiring creation of both binaries. |
| 117 |
</LI> |
| 118 |
</UL> |
| 119 |
"You can take advantage of the offload mode using the <TT>libxphi</TT> |
| 120 |
library. This library offloads the BLAS/MKL functions on the Xeon Phi |
| 121 |
platform hiding the latency times due to the communication. You just |
| 122 |
need to compile this library and then to link it dynamically. The |
| 123 |
library works with any version of QE. Libxphi is available from |
| 124 |
<TT>https://github.com/cdahnken/libxphi</TT>. Some documentation is |
| 125 |
available therein. |
| 126 |
|
| 127 |
<P> |
| 128 |
Instead, if you want to compile a native version of QE, you just need |
| 129 |
to add the <TT>-mmic</TT> flag and cross compile. If you want to use |
| 130 |
the symmetric mode, you need to compile twice: with and without the |
| 131 |
<TT>-mmic</TT> flag". "[...] everything, i.e. code+libraries, must be |
| 132 |
cross-compiled with the <TT>-mmic</TT> flag. In my opinion, it's pretty |
| 133 |
unlikely that native mode can outperform the execution on the standard |
| 134 |
Xeon cpu. I strongly suggest to use the Xeon Phi in offload mode, for now" |
| 135 |
(info by Fabio Affinito, March 2015). |
| 136 |
|
| 137 |
<P> |
| 138 |
|
| 139 |
<H4><A ID="SECTION00039120000000000000"> |
| 140 |
2.9.1.2 IBM BlueGene</A> |
| 141 |
</H4> |
| 142 |
|
| 143 |
<P> |
| 144 |
The current <TT>configure</TT> was working on the machines at CINECA and at Jülich. |
| 145 |
For other machines, you may need something like |
| 146 |
<PRE> |
| 147 |
./configure ARCH=ppc64-bg BLAS_LIBS=... LAPACK_LIBS=... \ |
| 148 |
SCALAPACK_DIR=... BLACS_DIR=..." |
| 149 |
</PRE> |
| 150 |
where the various *_LIBS and *_DIR "suggest" where the various libraries |
| 151 |
are located. |
| 152 |
|
| 153 |
<P> |
| 154 |
|
| 155 |
<P> |
| 156 |
<HR> |
| 157 |
<!--Navigation Panel--> |
| 158 |
<A |
| 159 |
HREF="node17.html"> |
| 160 |
<IMG WIDTH="37" HEIGHT="24" ALT="next" SRC="next.png"></A> |
| 161 |
<A |
| 162 |
HREF="node7.html"> |
| 163 |
<IMG WIDTH="26" HEIGHT="24" ALT="up" SRC="up.png"></A> |
| 164 |
<A |
| 165 |
HREF="node15.html"> |
| 166 |
<IMG WIDTH="63" HEIGHT="24" ALT="previous" SRC="prev.png"></A> |
| 167 |
<A ID="tex2html203" |
| 168 |
HREF="node1.html"> |
| 169 |
<IMG WIDTH="65" HEIGHT="24" ALT="contents" SRC="contents.png"></A> |
| 170 |
<BR> |
| 171 |
<B> Next:</B> <A |
| 172 |
HREF="node17.html">3 Parallelism</A> |
| 173 |
<B> Up:</B> <A |
| 174 |
HREF="node7.html">2 Installation</A> |
| 175 |
<B> Previous:</B> <A |
| 176 |
HREF="node15.html">2.8 Installation tricks and</A> |
| 177 |
<B> <A ID="tex2html204" |
| 178 |
HREF="node1.html">Contents</A></B> |
| 179 |
<!--End of Navigation Panel--> |
| 180 |
|
| 181 |
</BODY> |
| 182 |
</HTML> |