CANN/PTO-ISA SET_QUANT_VECTOR指令

SET_QUANT_VECTOR

【免费下载链接】pto-isaParallel Tile Operation (PTO) is a virtual instruction set architecture designed by Ascend CANN, focusing on tile-level operations. This repository offers high-performance, cross-platform tile operations across Ascend platforms.项目地址: https://gitcode.com/cann/pto-isa

Introduction

Set the vector quantization parameter for subsequentTPUSHoperations by configuring the hardware FPC register from a Scaling-type tile's address. The tile address is converted to the quantization parameter address format and written to the hardware quantization configuration.

C++ Intrinsic

Declared ininclude/pto/common/pto_instr.hpp:

template <typename FpTileData, typename... WaitEvents> PTO_INST RecordEvent SET_QUANT_VECTOR(FpTileData &fpTile, WaitEvents &...events);

Constraints

• FpTileData::Locmust beTileType::Scaling. Only Scaling-type tiles are supported as input.
• This instruction must be called before theTPUSHinstruction that consumes this configuration.
• The tile address encoding into the hardware FPC register is implementation-defined.

Examples

#include <pto/pto-inst.hpp> using namespace pto; template <typename T> AICORE void example_set_quant_vector() { using ScalingTile = Tile<TileType::Scaling, T, 1, 128, BLayout::RowMajor, 1, 128>; ScalingTile fpTile; TASSIGN(fpTile, 0x0); SET_QUANT_VECTOR(fpTile); }

ASM Form Examples

The current public assembly reference does not define a stable PTO-AS spelling forSET_QUANT_VECTOR. Use the C++ intrinsic form for quantization configuration.

【免费下载链接】pto-isaParallel Tile Operation (PTO) is a virtual instruction set architecture designed by Ascend CANN, focusing on tile-level operations. This repository offers high-performance, cross-platform tile operations across Ascend platforms.项目地址: https://gitcode.com/cann/pto-isa