<ahref="hgemm__traits_8h.html">Go to the documentation of this file.</a><divclass="fragment"><divclass="line"><aname="l00001"></a><spanclass="lineno"> 1</span> <spanclass="comment">/***************************************************************************************************</span></div><divclass="line"><aname="l00002"></a><spanclass="lineno"> 2</span> <spanclass="comment"> * Copyright (c) 2017-2018, NVIDIA CORPORATION. All rights reserved.</span></div><divclass="line"><aname="l00003"></a><spanclass="lineno"> 3</span> <spanclass="comment"> *</span></div><divclass="line"><aname="l00004"></a><spanclass="lineno"> 4</span> <spanclass="comment"> * Redistribution and use in source and binary forms, with or without modification, are permitted</span></div><divclass="line"><aname="l00005"></a><spanclass="lineno"> 5</span> <spanclass="comment"> * provided that the following conditions are met:</span></div><divclass="line"><aname="l00006"></a><spanclass="lineno"> 6</span> <spanclass="comment"> * * Redistributions of source code must retain the above copyright notice, this list of</span></div><divclass="line"><aname="l00007"></a><spanclass="lineno"> 7</span> <spanclass="comment"> * conditions and the following disclaimer.</span></div><divclass="line"><aname="l00008"></a><spanclass="lineno"> 8</span> <spanclass="comment"> * * Redistributions in binary form must reproduce the above copyright notice, this list of</span></div><divclass="line"><aname="l00009"></a><spanclass="lineno"> 9</span> <spanclass="comment"> * conditions and the following disclaimer in the documentation and/or other materials</span></div><divclass="line"><aname="l00010"></a><spanclass="lineno"> 10</span> <spanclass="comment"> * provided with the distribution.</span></div><divclass="line"><aname="l00011"></a><spanclass="lineno"> 11</span> <spanclass="comment"> * * Neither the name of the NVIDIA CORPORATION nor the names of its contributors may be used</span></div><divclass="line"><aname="l00012"></a><spanclass="lineno"> 12</span> <spanclass="comment"> * to endorse or promote products derived from this software without specific prior written</span></div><divclass="line"><aname="l00013"></a><spanclass="lineno"> 13</span> <spanclass="comment"> * permission.</span></div><divclass="line"><aname="l00014"></a><spanclass="lineno"> 14</span> <spanclass="comment"> *</span></div><divclass="line"><aname="l00015"></a><spanclass="lineno"> 15</span> <spanclass="comment"> * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR</span></div><divclass="line"><aname="l00016"></a><spanclass="lineno"> 16</span> <spanclass="comment"> * IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND</span></div><divclass="line"><aname="l00017"></a><spanclass="lineno"> 17</span> <spanclass="comment"> * FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL NVIDIA CORPORATION BE LIABLE</span></div><divclass="line"><aname="l00018"></a><spanclass="lineno"> 18</span> <spanclass="comment"> * FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING,</span></div><divclass="line"><aname="l00019"></a><spanclass="lineno"> 19</span> <spanclass="comment"> * BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS;</span></div><divclass="line"><aname="l00020"></a><spanclass="lineno"> 20</span> <spanclass="comment"> * OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,</span></div><divclass="line"><aname="l00021"></a><spanclass="lineno"> 21</span> <spanclass="comment"> * STRICT LIABILITY, OR TOR (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE</span></div><divclass="line"><aname="l00022
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_aa190538ab678c82e379db4038af665ee"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#aa190538ab678c82e379db4038af665ee">cutlass::gemm::HgemmTraitsHelper::GlobalLoadIteratorB</a></div><divclass="ttdeci">GemmGlobalIteratorAb< typename GemmTileTraitsHelperB::GlobalTileTraits, Index_ > GlobalLoadIteratorB</div><divclass="ttdoc">The iterator to load B from global memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:310</div></div>
<divclass="ttc"id="gemm__global__tile_8h_html"><divclass="ttname"><ahref="gemm__global__tile_8h.html">gemm_global_tile.h</a></div><divclass="ttdoc">Defines iterators for efficiently loading and storing to global memory. </div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_aeb825b6575955a714ff24df2e142c047"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#aeb825b6575955a714ff24df2e142c047">cutlass::gemm::HgemmTraitsHelper::GemmEpilogueTraits</a></div><divclass="ttdeci">SimplifiedGemmEpilogueTraits< GemmConfig, EpilogueFunctor_, Index_ > GemmEpilogueTraits</div><divclass="ttdoc">The traits class for the epilogue. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:350</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTileTraitsHelperB_3_01MatrixLayout_1_1kColumnMajor_00_01GemmConfig___01_4_html_a1e6356bf5c87271ab9794fcc79edc145"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTileTraitsHelperB_3_01MatrixLayout_1_1kColumnMajor_00_01GemmConfig___01_4.html#a1e6356bf5c87271ab9794fcc79edc145">cutlass::gemm::HgemmTileTraitsHelperB< MatrixLayout::kColumnMajor, GemmConfig_ >::GlobalTileTraits</a></div><divclass="ttdeci">HgemmCrosswiseGlobalTileTraits< GemmOperand::kB, MatrixLayout::kColumnMajor, half const, Shape< 1, GemmConfig_::OutputTile::kH, GemmConfig_::OutputTile::kD >, Shape< 1, GemmConfig_::kThreads/GemmConfig_::OutputTile::kD, GemmConfig_::OutputTile::kD >, GemmConfig_::kScalarsPerLdgB > GlobalTileTraits</div><divclass="ttdoc">The traits class to build the iterator to load data from global memory for B^N. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:221</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_a80e36b583ccd9aa9b37d52faa090cbca"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#a80e36b583ccd9aa9b37d52faa090cbca">cutlass::gemm::HgemmTraitsHelper::GlobalLoadStreamA</a></div><divclass="ttdeci">GlobalLoadStream< GemmOperand::kA, GlobalLoadIteratorA, SharedStoreIteratorA, GlobalTransformerA > GlobalLoadStreamA</div><divclass="ttdoc">The stream to load A from global memory to shared memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:306</div></div>
<divclass="ttc"id="gemm__epilogue_8h_html"><divclass="ttname"><ahref="gemm__epilogue_8h.html">gemm_epilogue.h</a></div><divclass="ttdoc">Implements the epilogue phase of the GEMM kernel that efficiently updates global memory with the comp...</div></div>
<divclass="ttc"id="structcutlass_1_1TileLoadIterator_html"><divclass="ttname"><ahref="structcutlass_1_1TileLoadIterator.html">cutlass::TileLoadIterator</a></div><divclass="ttdoc">An iterator implementing Tile Load Iterator Concept for loading a tile from memory. </div><divclass="ttdef"><b>Definition:</b> tile_iterator.h:402</div></div>
<divclass="ttc"id="gemm__shared__tile_8h_html"><divclass="ttname"><ahref="gemm__shared__tile_8h.html">gemm_shared_tile.h</a></div><divclass="ttdoc">Defines iterators for efficiently loading and storing tiles to and from shared memory. </div></div>
<divclass="ttc"id="reshape__tile_8h_html"><divclass="ttname"><ahref="reshape__tile_8h.html">reshape_tile.h</a></div><divclass="ttdoc">Defines a type for restructuring a tile. </div></div>
<divclass="ttc"id="hgemm__multiply__add_8h_html"><divclass="ttname"><ahref="hgemm__multiply__add_8h.html">hgemm_multiply_add.h</a></div><divclass="ttdoc">Specialization implementing multiply-add operation on half-precision floating point fragments...</div></div>
<divclass="ttc"id="hgemm__swizzle_8h_html"><divclass="ttname"><ahref="hgemm__swizzle_8h.html">hgemm_swizzle.h</a></div><divclass="ttdoc">Transposes a tile of 16b elements. Used by HGEMM to construct a K-strided layout in shared memory for...</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_ae82826fde376748cf67ff2e1bcaa8cef"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#ae82826fde376748cf67ff2e1bcaa8cef">cutlass::gemm::HgemmTraitsHelper::MultiplyAdd</a></div><divclass="ttdeci">GemmConfig::MultiplyAdd MultiplyAdd</div><divclass="ttdoc">The functor to do the multiply-add in the main loop. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:345</div></div>
<divclass="ttc"id="structcutlass_1_1Shape_html"><divclass="ttname"><ahref="structcutlass_1_1Shape.html">cutlass::Shape</a></div><divclass="ttdoc">A Shape implementing Layout Concept describing the dimensions of a cube. </div><divclass="ttdef"><b>Definition:</b> shape.h:64</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1ThreadMultiplyAdd_html"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1ThreadMultiplyAdd.html">cutlass::gemm::ThreadMultiplyAdd</a></div><divclass="ttdoc">Template performing matrix multiply-add operation within a thread. </div><divclass="ttdef"><b>Definition:</b> thread_multiply_add.h:44</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_ac6eac542d9d994509f931804b8b85ff5"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#ac6eac542d9d994509f931804b8b85ff5">cutlass::gemm::HgemmTraitsHelper::GlobalLoadIteratorA</a></div><divclass="ttdeci">GemmGlobalIteratorAb< typename GemmTileTraitsHelperA::GlobalTileTraits, Index_ > GlobalLoadIteratorA</div><divclass="ttdoc">The iterator to load A from global memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:291</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTileTraitsHelperA_3_01MatrixLayout_1_1kRowMajor_00_01GemmConfig___01_4_html_a36e082b2da22d17eeb73af6bd0632314"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTileTraitsHelperA_3_01MatrixLayout_1_1kRowMajor_00_01GemmConfig___01_4.html#a36e082b2da22d17eeb73af6bd0632314">cutlass::gemm::HgemmTileTraitsHelperA< MatrixLayout::kRowMajor, GemmConfig_ >::GlobalTileTraits</a></div><divclass="ttdeci">HgemmCrosswiseGlobalTileTraits< GemmOperand::kA, MatrixLayout::kRowMajor, half const, Shape< 1, GemmConfig_::OutputTile::kW, GemmConfig_::OutputTile::kD >, Shape< 1, GemmConfig_::kThreads/GemmConfig_::OutputTile::kD, GemmConfig_::OutputTile::kD >, GemmConfig_::kScalarsPerLdgA > GlobalTileTraits</div><divclass="ttdoc">The traits class to build the iterator to load data from global memory for A^T. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:154</div></div>
<divclass="ttc"id="hgemm__global__tile_8h_html"><divclass="ttname"><ahref="hgemm__global__tile_8h.html">hgemm_global_tile.h</a></div><divclass="ttdoc">Tile traits used to construct global tile iterator for HGEMM. This is intended to partition the threa...</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1LinearScaling_html"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1LinearScaling.html">cutlass::gemm::LinearScaling</a></div><divclass="ttdoc">Functor to compute linear combination of fragments. </div><divclass="ttdef"><b>Definition:</b> linear_scaling.h:51</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_a2c46c11f5fddb865645f555547c823ba"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#a2c46c11f5fddb865645f555547c823ba">cutlass::gemm::HgemmTraitsHelper::GlobalLoadStreamB</a></div><divclass="ttdeci">GlobalLoadStream< GemmOperand::kB, GlobalLoadIteratorB, SharedStoreIteratorB, GlobalTransformerB > GlobalLoadStreamB</div><divclass="ttdoc">The stream to load B from global memory to shared memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:325</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_aaa35c4d2a90f137f50c9ccd24d5c4f5c"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#aaa35c4d2a90f137f50c9ccd24d5c4f5c">cutlass::gemm::HgemmTraitsHelper::SharedLoadStreamA</a></div><divclass="ttdeci">SharedLoadStream< SharedLoadIteratorA > SharedLoadStreamA</div><divclass="ttdoc">The stream to load A from shared memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:334</div></div>
<divclass="ttc"id="gemm__epilogue__traits_8h_html"><divclass="ttname"><ahref="gemm__epilogue__traits_8h.html">gemm_epilogue_traits.h</a></div><divclass="ttdoc">Defines structural properties of the GEMM epilogue. </div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_a463dddee069606fd4ecf7c386ff23fce"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#a463dddee069606fd4ecf7c386ff23fce">cutlass::gemm::HgemmTraitsHelper::SharedStoreIteratorB</a></div><divclass="ttdeci">TileStoreIterator< typename GemmTileTraitsHelperB::SharedStoreTileTraits, typename GemmTileTraitsHelperB::SharedStoreTileTraits::Scalar, IteratorAdvance::kH, MemorySpace::kShared > SharedStoreIteratorB</div><divclass="ttdoc">The iterator to store B to shared memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:319</div></div>
<divclass="ttc"id="structcutlass_1_1gemm_1_1HgemmTraitsHelper_html_a366c89f8ecfbf0aef894cfb6fae25be9"><divclass="ttname"><ahref="structcutlass_1_1gemm_1_1HgemmTraitsHelper.html#a366c89f8ecfbf0aef894cfb6fae25be9">cutlass::gemm::HgemmTraitsHelper::SharedStoreIteratorA</a></div><divclass="ttdeci">TileStoreIterator< typename GemmTileTraitsHelperA::SharedStoreTileTraits, typename GemmTileTraitsHelperA::SharedStoreTileTraits::Scalar, IteratorAdvance::kH, MemorySpace::kShared > SharedStoreIteratorA</div><divclass="ttdoc">The iterator to store A to shared memory. </div><divclass="ttdef"><b>Definition:</b> hgemm_traits.h:300</div></div>
<divclass="ttc"id="convert_8h_html"><divclass="ttname"><ahref="convert_8h.html">convert.h</a></div><divclass="ttdoc">Defines conversion operations among Fragments of different base type. </div></div>
<divclass="ttc"id="structcutlass_1_1TileStoreIterator_html"><divclass="ttname"><ahref="structcutlass_1_1TileStoreIterator.html">cutlass::TileStoreIterator</a></div><divclass="ttdoc">An iterator implementing Tile Store Iterator Concept for storing a tile to memory. </div><divclass="ttdef"><b>Definition:</b> tile_iterator.h:841</div></div>