<ahref="igemm__epilogue_8h.html">Go to the documentation of this file.</a><divclass="fragment"><divclass="line"><aname="l00001"></a><spanclass="lineno"> 1</span> <spanclass="comment">/***************************************************************************************************</span></div><divclass="line"><aname="l00002"></a><spanclass="lineno"> 2</span> <spanclass="comment"> * Copyright (c) 2017-2018, NVIDIA CORPORATION. All rights reserved.</span></div><divclass="line"><aname="l00003"></a><spanclass="lineno"> 3</span> <spanclass="comment"> *</span></div><divclass="line"><aname="l00004"></a><spanclass="lineno"> 4</span> <spanclass="comment"> * Redistribution and use in source and binary forms, with or without modification, are permitted</span></div><divclass="line"><aname="l00005"></a><spanclass="lineno"> 5</span> <spanclass="comment"> * provided that the following conditions are met:</span></div><divclass="line"><aname="l00006"></a><spanclass="lineno"> 6</span> <spanclass="comment"> * * Redistributions of source code must retain the above copyright notice, this list of</span></div><divclass="line"><aname="l00007"></a><spanclass="lineno"> 7</span> <spanclass="comment"> * conditions and the following disclaimer.</span></div><divclass="line"><aname="l00008"></a><spanclass="lineno"> 8</span> <spanclass="comment"> * * Redistributions in binary form must reproduce the above copyright notice, this list of</span></div><divclass="line"><aname="l00009"></a><spanclass="lineno"> 9</span> <spanclass="comment"> * conditions and the following disclaimer in the documentation and/or other materials</span></div><divclass="line"><aname="l00010"></a><spanclass="lineno"> 10</span> <spanclass="comment"> * provided with the distribution.</span></div><divclass="line"><aname="l00011"></a><spanclass="lineno"> 11</span> <spanclass="comment"> * * Neither the name of the NVIDIA CORPORATION nor the names of its contributors may be used</span></div><divclass="line"><aname="l00012"></a><spanclass="lineno"> 12</span> <spanclass="comment"> * to endorse or promote products derived from this software without specific prior written</span></div><divclass="line"><aname="l00013"></a><spanclass="lineno"> 13</span> <spanclass="comment"> * permission.</span></div><divclass="line"><aname="l00014"></a><spanclass="lineno"> 14</span> <spanclass="comment"> *</span></div><divclass="line"><aname="l00015"></a><spanclass="lineno"> 15</span> <spanclass="comment"> * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR</span></div><divclass="line"><aname="l00016"></a><spanclass="lineno"> 16</span> <spanclass="comment"> * IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND</span></div><divclass="line"><aname="l00017"></a><spanclass="lineno"> 17</span> <spanclass="comment"> * FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL NVIDIA CORPORATION BE LIABLE</span></div><divclass="line"><aname="l00018"></a><spanclass="lineno"> 18</span> <spanclass="comment"> * FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING,</span></div><divclass="line"><aname="l00019"></a><spanclass="lineno"> 19</span> <spanclass="comment"> * BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS;</span></div><divclass="line"><aname="l00020"></a><spanclass="lineno"> 20</span> <spanclass="comment"> * OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,</span></div><divclass="line"><aname="l00021"></a><spanclass="lineno"> 21</span> <spanclass="comment"> * STRICT LIABILITY, OR TOR (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE</span></div><divclass="line"><aname="l000
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_ad7659dc0eaa491447ad127ef7098924f"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#ad7659dc0eaa491447ad127ef7098924f">cutlass::gemm::IgemmEpilogueTraitsHelper::SharedStoreTileTraits</a></div><divclass="ttdeci">Base::SharedStoreTileTraits SharedStoreTileTraits</div><divclass="ttdoc">The traits class for the shared iterator to store D to shared memory. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:221</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a880293ef6a48a0f4941c8f984c36f591"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a880293ef6a48a0f4941c8f984c36f591">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalTransformerD</a></div><divclass="ttdeci">IgemmGlobalStoreTransformer< Scalar, GlobalFragmentD >::Transformer GlobalTransformerD</div><divclass="ttdoc">The transformer from accumulators to shared memory fragments. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:218</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a851113bffb5b656c5c649845852b3b8d"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a851113bffb5b656c5c649845852b3b8d">cutlass::gemm::IgemmEpilogueTraitsHelper::SharedLoadTileTraits</a></div><divclass="ttdeci">Base::SharedLoadTileTraits SharedLoadTileTraits</div><divclass="ttdoc">The traits class for the shared iterator to load D from shared memory. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:235</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_ad33ee44527a7fcfd41b4e677927fd4fa"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#ad33ee44527a7fcfd41b4e677927fd4fa">cutlass::gemm::IgemmEpilogueTraitsHelper::SharedLoadIteratorD</a></div><divclass="ttdeci">TileLoadIterator< SharedLoadTileTraits, typename SharedLoadTileTraits::Scalar, IteratorAdvance::kH, MemorySpace::kShared > SharedLoadIteratorD</div><divclass="ttdoc">The shared iterator to load D from shared memory. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:241</div></div>
<divclass="ttc"id="tile__iterator_8h_html"><divclass="ttname"><ahref="tile__iterator_8h.html">tile_iterator.h</a></div><divclass="ttdoc">Defines the Tile Traits concept and iterators for loading and storing to tiles efficiently. </div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a5e64440830b36899f9c0ed8b369665c8"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a5e64440830b36899f9c0ed8b369665c8">cutlass::gemm::IgemmEpilogueTraitsHelper::SharedStoreFragmentD</a></div><divclass="ttdeci">SharedStoreIteratorD::Fragment SharedStoreFragmentD</div><divclass="ttdoc">The fragment that needs to be passed to that store iterator. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:229</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_ae4128bba3f1df6ef7824e2db79745b00"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#ae4128bba3f1df6ef7824e2db79745b00">cutlass::gemm::IgemmEpilogueTraitsHelper::Scalar</a></div><divclass="ttdeci">Base::Scalar Scalar</div><divclass="ttdoc">The scalar type of the epilogue. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:194</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_ad8e5337f3d19437e9c4cafcfcc3e3d3e"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#ad8e5337f3d19437e9c4cafcfcc3e3d3e">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalFragmentC</a></div><divclass="ttdeci">GlobalLoadIteratorC::Fragment GlobalFragmentC</div><divclass="ttdoc">The fragment that needs to be produced by the load iterator. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:205</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_ad3e937c15bfac443b0e3b94d702f46b2"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#ad3e937c15bfac443b0e3b94d702f46b2">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalStoreIteratorD</a></div><divclass="ttdeci">GemmGlobalIteratorCd< GlobalStoreTileTraits > GlobalStoreIteratorD</div><divclass="ttdoc">The iterator to store to shared memory. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:213</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a00000e0cd14b9e6e242eafb5133af8cf"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a00000e0cd14b9e6e242eafb5133af8cf">cutlass::gemm::IgemmEpilogueTraitsHelper::SharedStoreTransformerD</a></div><divclass="ttdeci">IgemmSharedStoreTransformer< typename IgemmConfig::Accumulators::Element, SharedStoreFragmentD >::Transformer SharedStoreTransformerD</div><divclass="ttdoc">The transformer from accumulators to shared memory fragments. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:233</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraits_html_a8609af98d1e43cd25688bae6f33feed4"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraits.html#a8609af98d1e43cd25688bae6f33feed4">cutlass::gemm::IgemmEpilogueTraits::kInt8Output</a></div><divclass="ttdeci">static bool const kInt8Output</div><divclass="ttdoc">Do we output in int8? </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:283</div></div>
<divclass="ttc"id="structcutlass_1_1TileLoadIterator_html"><divclass="ttname"><ahref="structcutlass_1_1TileLoadIterator.html">cutlass::TileLoadIterator</a></div><divclass="ttdoc">An iterator implementing Tile Load Iterator Concept for loading a tile from memory. </div><divclass="ttdef"><b>Definition:</b> tile_iterator.h:402</div></div>
<divclass="ttc"id="reshape__tile_8h_html"><divclass="ttname"><ahref="reshape__tile_8h.html">reshape_tile.h</a></div><divclass="ttdoc">Defines a type for restructuring a tile. </div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_aaa009025dcd6360ead1dc18005688821"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#aaa009025dcd6360ead1dc18005688821">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalLoadTileTraits</a></div><divclass="ttdeci">Base::GlobalLoadTileTraits GlobalLoadTileTraits</div><divclass="ttdoc">The traits class for the iterator. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:201</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a723cd69ee4d5c26579b36e02c531ea88"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a723cd69ee4d5c26579b36e02c531ea88">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalFragmentD</a></div><divclass="ttdeci">GlobalStoreIteratorD::Fragment GlobalFragmentD</div><divclass="ttdoc">The fragment that needs to be passed to that store iterator. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:215</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a24826f99d097eea0298e6be12a6327b9"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a24826f99d097eea0298e6be12a6327b9">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalLoadIteratorC</a></div><divclass="ttdeci">GemmGlobalIteratorCd< GlobalLoadTileTraits > GlobalLoadIteratorC</div><divclass="ttdoc">The iterator to store to shared memory. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:203</div></div>
<divclass="ttc"id="structcutlass_1_1Shape_html"><divclass="ttname"><ahref="structcutlass_1_1Shape.html">cutlass::Shape</a></div><divclass="ttdoc">A Shape implementing Layout Concept describing the dimensions of a cube. </div><divclass="ttdef"><b>Definition:</b> shape.h:64</div></div>
<divclass="ttc"id="gemm__global__stream_8h_html"><divclass="ttname"><ahref="gemm__global__stream_8h.html">gemm_global_stream.h</a></div><divclass="ttdoc">Implements efficient loading of the thread block-level tile from global memory and storing to shared ...</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_ad0116b2e7b2ca1526246e2ff7e73fd2f"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#ad0116b2e7b2ca1526246e2ff7e73fd2f">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalTransformerC</a></div><divclass="ttdeci">IgemmGlobalLoadTransformer< GlobalFragmentC, Scalar >::Transformer GlobalTransformerC</div><divclass="ttdoc">The transformer from loaded data to math fragment. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:208</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_a16b06a1611dbd22adaa0c9ee5e1b15bd"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a16b06a1611dbd22adaa0c9ee5e1b15bd">cutlass::gemm::IgemmEpilogueTraitsHelper::GlobalStoreTileTraits</a></div><divclass="ttdeci">Base::GlobalStoreTileTraits GlobalStoreTileTraits</div><divclass="ttdoc">The traits class for the iterator. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:211</div></div>
<divclass="ttc"id="fragment_8h_html"><divclass="ttname"><ahref="fragment_8h.html">fragment.h</a></div><divclass="ttdoc">Defines Fragment, a statically-sized array for storing parts of matrices within a thread&#39;s registers...</div></div>
<divclass="ttc"id="gemm__shared__stream_8h_html"><divclass="ttname"><ahref="gemm__shared__stream_8h.html">gemm_shared_stream.h</a></div><divclass="ttdoc">Defines abstractions for managing loading and storing fragments to shared memory in the efficient GEM...</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper_html_af7024128202d642d3535e1ae5cf5f43d"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#af7024128202d642d3535e1ae5cf5f43d">cutlass::gemm::IgemmEpilogueTraitsHelper::SharedStoreIteratorD</a></div><divclass="ttdeci">TileStoreIterator< SharedStoreTileTraits, typename SharedStoreTileTraits::Scalar, IteratorAdvance::kH, MemorySpace::kGlobal > SharedStoreIteratorD</div><divclass="ttdoc">The shared iterator to store D to shared memory. </div><divclass="ttdef"><b>Definition:</b> igemm_epilogue.h:227</div></div>
<divclass="ttc"id="convert_8h_html"><divclass="ttname"><ahref="convert_8h.html">convert.h</a></div><divclass="ttdoc">Defines conversion operations among Fragments of different base type. </div></div>
<divclass="ttc"id="igemm__global__tile_8h_html"><divclass="ttname"><ahref="igemm__global__tile_8h.html">igemm_global_tile.h</a></div><divclass="ttdoc">Implements tile iterators to partition the thread block tile into 2D subtiles and efficiently load ea...</div></div>
<divclass="ttc"id="structcutlass_1_1TileStoreIterator_html"><divclass="ttname"><ahref="structcutlass_1_1TileStoreIterator.html">cutlass::TileStoreIterator</a></div><divclass="ttdoc">An iterator implementing Tile Store Iterator Concept for storing a tile to memory. </div><divclass="ttdef"><b>Definition:</b> tile_iterator.h:841</div></div>