Skip to content

NormalizeBy

NormalizeBy module-attribute 

NormalizeBy: TypeAlias = Literal['sum_abs', 'abs_sum']

The strategy for normalizing token contributions, dividing each contribution \(\delta_\tau\) by a single constant:

  • "sum_abs" divides by the sum of absolute contributions, \(\sum_\tau |\delta_\tau|\).
  • "abs_sum" divides by the absolute sum of contributions, \(|\sum_\tau \delta_\tau|\).

Source